1.2  Upper Bounds, Maxima and Suprema

The previous section ended with a puzzle. The rationals and the reals obey the same rules of arithmetic and the same rules of order (Definition 1.1.1), yet x2−2 has a zero in one (as Theorem 1.6.1 will prove) and not in the other. The difference lies in how sets of numbers behave: in Q, a set can press against a point that is not there. This section builds the vocabulary to say that precisely. Everything happens in an arbitrary ordered field F, because we need to compare F=Q with F=R, and the definitions must not already take a side.

1.2.1. A largest element that is not there

Ask for the largest element of the open interval (0,1) in R. There is none. Whatever a∈(0,1) you propose, the midpoint a+12 lies strictly between a and 1 by Theorem 1.1.2 (h), so it belongs to (0,1) and beats a. The same happens, less visibly, for the set of positive rationals whose square is less than 2; Case 1 of the proof at the end of this section is the reason, and Exercise (C1: The two sides of the gap) writes it out.

And yet both sets are heading somewhere. The interval (0,1) is pressed against 1: nothing in it reaches 1, and nothing smaller than 1 stays above it. “Largest element” is the wrong notion, because it demands that the target belong to the set. What survives is the smallest number that sits above the whole set. To define it we first need words for “sits above”.

1.2.2. Upper and lower bounds

Definition 1.2.1 (Upper and Lower Bounds)

Let F be an ordered field and A⊆F. An element M∈F is an upper bound of A if a≤M for every a∈A. An element m∈F is a lower bound of A if m≤a for every a∈A.

In symbols, M is an upper bound of A when ∀a∈A: a≤M. The bound is an element of F, and nothing requires it to belong to A.

For the interval (0,1) in R, the numbers 1, 32, and 2026 are all upper bounds, and 0 and −17 are lower bounds. Upper bounds are never unique: if M is one, so is every M′≥M, by transitivity. A minimal change gives a nonexample: 12 is not an upper bound of (0,1), because 34∈(0,1) and 34>12. One element above M is enough to spoil it. Negating the definition quantifier by quantifier (the negation rules are the subject of Logic and Proof, Chapter 6), M is not an upper bound of A⟺∃a∈A: a>M, where we have used trichotomy to rewrite “not a≤M” as “a>M”.

The empty set is the degenerate case, and it will matter. Every M∈F is an upper bound of ∅: the condition “a≤M for every a∈∅” has no instances to check, so it holds vacuously. Instance by instance it is the implication “if a∈∅, then a≤M”, whose hypothesis is false, and Logic and Proof, Proposition 2.1.2 derives an implication from the negation of its hypothesis. Likewise every element of F is a lower bound of ∅.

Definition 1.2.2 (Bounded Sets)

Let F be an ordered field and A⊆F. The set A is bounded above if it has at least one upper bound, bounded below if it has at least one lower bound, and bounded if it is both bounded above and bounded below.

In symbols, A is bounded above when ∃M∈F  ∀a∈A: a≤M. The order of the quantifiers carries the meaning. One M is chosen first and must then work for every a. Swap them, to “∀a∈A ∃M∈F:a≤M”, and the statement becomes empty of content: every set satisfies it, since each a can take M=a.

Examples in R: the interval (0,1) is bounded; the empty set is bounded (by anything); the interval [0,∞) is bounded below by 0 but not bounded above. To see the last claim, negate the definition: we must show that for every M∈R there is a∈[0,∞) with a>M. Given M, the element a:=max{M,0}+1 works, where max{M,0} is the larger of M and 0 (maxima are defined in general just below): it is at least 1>0, so it lies in [0,∞), and it exceeds M by (O3). The witness a depends on M, as the order ∀M ∃a allows.

Whether N is bounded above in R looks like the same kind of question, but it is not. The answer, “no”, is the Archimedean property, and it is proved later in this chapter from the axiom of the next section. It cannot be proved from the ordered-field axioms alone.

1.2.3. Maximum and minimum

Definition 1.2.3 (Maximum and Minimum)

Let F be an ordered field and A⊆F. An element m is a maximum (or greatest element) of A if m∈A and m is an upper bound of A. It is a minimum (or least element) of A if m∈A and m is a lower bound of A.

A set has at most one maximum. If m and m′ are both maxima, then m∈A and m′ is an upper bound, so m≤m′; by the same argument with the roles swapped, m′≤m; and trichotomy forces m=m′. So when it exists we may write maxA, and likewise minA.

Examples: the set {−1,3,72} has maximum 72, since 72 is in the set and −1≤72, 3≤72, 72≤72. The interval (0,1] has maximum 1. The minimal change from (0,1] to (0,1) keeps every upper bound but removes the only candidate: (0,1) has no maximum, as the opening subsection showed. The empty set has no maximum, since it has no elements at all.

1.2.4. The supremum

Here is the notion that survives where “maximum” fails. Look again at (0,1). Its upper bounds form the set [1,∞), and that set has a least element, namely 1. The number we want is the least element of the set of upper bounds.

Diagram. Labels: 0, 1, A = (0,1), upper bounds of A: the set [1,infty ), sup A = 1, the least upper bound, not in A

The supremum is the upper bound that cannot be lowered.

Definition 1.2.4 (Supremum)

Let F be an ordered field and A⊆F. An element s∈F is a supremum (or least upper bound) of A in F if

  • (S1) s is an upper bound of A, and
  • (S2) s≤M for every upper bound M of A.

In symbols, s is a supremum of A in F when (∀a∈A: a≤s)  and  (∀M∈F: (∀a∈A:a≤M)⇒s≤M).

In words: (S1) says that s sits above the whole set. (S2) says that no upper bound sits below s; every upper bound is at least s. So s is an upper bound (S1), and it is the least one (S2). The words “in F” matter: s must be an element of F, and the upper bounds M in (S2) range over F. The same set of rationals can have a supremum when viewed in one field and none when viewed in another, and that is precisely the phenomenon this chapter is about.

Before we write “the supremum”, we must know there cannot be two.

Theorem 1.2.1 (Uniqueness of the Supremum)

Let F be an ordered field and A⊆F. If s and s′ are both suprema of A in F, then s=s′.

Proof. By (S1) for s′, the element s′ is an upper bound of A. So (S2) for s gives s≤s′. Swapping the roles of s and s′ gives s′≤s. By trichotomy, s=s′.

The proof is the standard uniqueness move: suppose there are two, use the first property of one against the second property of the other, and then swap. From now on, when A has a supremum in F, we call it the supremum and write supA. Existence is a different matter, and nothing so far guarantees it. It can fail in three ways: the set may have no upper bound at all, like [0,∞) above; it may have no elements; or it may press against a gap in the field. The rest of this section shows the last two.

The mirror-image notion comes with its own definition, since we use it as often.

Definition 1.2.5 (Infimum)

Let F be an ordered field and A⊆F. An element t∈F is an infimum (or greatest lower bound) of A in F if

  • (I1) t is a lower bound of A, and
  • (I2) M≤t for every lower bound M of A.

The proof of Theorem 1.2.1, with every inequality reversed, shows that a set has at most one infimum, written infA. The names are Latin: supremum is “the highest”, infimum “the lowest”.

Example (A finite set, and a half-open interval)

Find the supremum of A={−1,3,72} and of B=(0,1] in R.

Solution. For A: the element 72 is an upper bound, as checked above, so (S1) holds. For (S2), let M be any upper bound of A. Since 72∈A, the definition of upper bound gives 72≤M. So supA=72=maxA.

For B: the same two lines work with 1 in place of 72. It bounds (0,1] from above by the definition of that interval, and it is least because 1∈B, so every upper bound M satisfies 1≤M. So supB=1=maxB.

The argument used only that the candidate is a maximum. It shows that a maximum, when it exists, is the supremum (Exercise (B1: Maxima are suprema)). Every nonempty finite set has a maximum, by an induction on the number of elements of the kind practiced in Sets, Relations, and Cardinality, Chapter 2, so for finite sets the supremum is nothing new.

Example (The supremum need not belong to the set)

Show that sup(0,1)=1 in R, although 1∉(0,1).

Solution. (S1): every a∈(0,1) satisfies a<1, so 1 is an upper bound.

(S2): let M be an upper bound of (0,1); we show 1≤M. Suppose instead that M<1. Since 12∈(0,1), we have 12≤M, so M>0. By Theorem 1.1.2 (h), the midpoint a:=M+12 satisfies M<a<1. Then 0<M<a<1, so a∈(0,1), and a>M. This contradicts M being an upper bound. Hence 1≤M, by trichotomy.

So 1 is the supremum. It is not a maximum, since 1∉(0,1). Nothing in the argument used anything beyond the ordered-field axioms; the same proof shows that {x∈Q:0<x<1} has supremum 1 in Q.

Example (A supremum we cannot yet prove)

Let A={1−1n:n∈Z>0}={0,12,23,34,…} in R, where Z>0={1,2,3,…} is the set of positive integers (taken informally for now; later in this chapter, once the natural numbers are defined inside R, it becomes a defined subset of R). Show that 1 is an upper bound of A and that A has no maximum.

Solution. Each n∈Z>0 is positive, so 1n>0 by Theorem 1.1.2 (f), and hence 1−1n<1 by Theorem 1.1.2 (a). So 1 is an upper bound, and 1∉A. No element is a maximum either: 1−1n<1−1n+1, because 1n+1<1n by Theorem 1.1.2 (f), so every element is beaten by the next one.

It is true that supA=1, but (S2) is harder than it looks. It says that no M<1 is an upper bound, that is, for every M<1 some 1−1n exceeds M. That requires 1n<1−M for some n. The existence of such an n says, in effect, that the natural numbers are not bounded above, and that does not follow from the ordered-field axioms. We prove it later in this chapter, from the axiom of the next section, and prove supA=1 right after it.

The degenerate case is the empty set. By the vacuous-truth remark above, every element of F is an upper bound of ∅. If s were a supremum, then s−1 would be an upper bound too, and (S2) would give s≤s−1, that is, 1≤0, contradicting 1>0. So the empty set has no supremum, although it is bounded above. This is why the axiom of the next section has to say “nonempty”.

A nonexample by minimal change shows why both clauses are needed. Keep A=(0,1). The number 2 satisfies (S1) but fails (S2): the upper bound 1 lies below it. The number 12 satisfies (S2), since every upper bound is at least 1≥12, but it fails (S1). Drop (S1) from the definition and every number below 1, such as 12 or −5, would qualify. Drop (S2) and every upper bound would. Only the two clauses together pin down a single number.

Warning. The supremum is not the maximum. The supremum of a set need not belong to the set: sup(0,1)=1∉(0,1). The two notions agree exactly when the supremum lies in the set (Exercise (B1: Maxima are suprema)). A proof that writes “let a=supA∈A” has assumed something false in general; the section on working with the supremum contains a proof that fails for exactly this reason.

Warning. A bounded set need not have a maximum. The interval (0,1) is bounded, and it has no greatest element. “Bounded” promises upper bounds, which live outside the set; it promises nothing about the elements themselves.

Quick check. Let A={(−1)nn:n∈Z>0}={−1,12,−13,14,…}. Find maxA and supA in R, if they exist. Do the same for minA and infA.

Solution. For odd n the element is −1n<0. For even n≥2 it is 1n≤12, by Theorem 1.1.2 (f). So 12 is an upper bound, and it is attained at n=2. Hence maxA=12, and by the argument of Example (A finite set, and a half-open interval) (a maximum is the supremum), supA=12.

Similarly, every element is at least −1: even-indexed ones are positive, and odd-indexed ones are −1n≥−1 because 1n≤1. The value −1 is attained at n=1. So minA=infA=−1. Although A is infinite, both extremes are attained, at its first two elements.

1.2.5. A bounded set of rationals with no rational supremum

We now prove what the opening section promised: in Q, a nonempty set that is bounded above can fail to have a supremum. This is the gap in Q, expressed in the language of this section.

Theorem 1.2.2 (No Rational Supremum for the Rationals Below the Square Root of Two)

Let A={x∈Q:x>0 and x2<2}. Then A is nonempty and bounded above in Q, but A has no supremum in Q.

Idea. Suppose a rational s were the supremum. By Logic and Proof, Theorem 2.2.1, s2≠2, so s2<2 or s2>2, and each case is a disaster.

If s2<2, then s is too small: there is room to step right to a rational s+h whose square is still below 2, and then s+h∈A beats s. To find h, work backwards from the goal (s+h)2<2. Expanding, (s+h)2=s2+2sh+h2. The h2 is awkward, so bound it by something simpler: if 0<h≤1, then h2≤h, and (s+h)2≤s2+h(2s+1). The room available is 2−s2. Asking h(2s+1) to use only half of it, h(2s+1)=2−s22, gives h=2−s24s+2. We then owe a check of the condition h≤1 that we assumed along the way.

If s2>2, then s is too big: step left to s−h, still an upper bound, and then s was not the least one. Now (s−h)2=s2−2sh+h2>s2−2sh, and the right side equals 2 exactly when h=s2−22s.

In both cases h depends only on s, and it is rational because s is. Before reading on: where does the proof use that s is rational, and where does it use Logic and Proof, Theorem 2.2.1?

Proof. Since 1>0 and 12=1<2, we have 1∈A, so A is nonempty. The rational number 2 is an upper bound: if some x∈A had x>2, then x2>4 by Theorem 1.1.2 (g), contradicting x2<2, so x≤2 by trichotomy.

Suppose, for a contradiction, that s∈Q is a supremum of A in Q. Since 1∈A, (S1) gives s≥1; in particular s>0, and s2≥1 by Theorem 1.1.2 (g). By Logic and Proof, Theorem 2.2.1, s2≠2, so by trichotomy either s2<2 or s2>2.

Case 1: s2<2. Let h:=2−s24s+2. Then h∈Q, and h>0 because 2−s2>0 and 4s+2>0. Moreover h≤16, since 2−s2≤1 (as s2≥1) and 4s+2≥6 (as s≥1). Hence h≤1, and multiplying by h>0 gives h2≤h. Therefore (s+h)2=s2+2sh+h2≤s2+h(2s+1)=s2+2−s22=1+s22<2, where the last inequality holds because s2<2. So s+h is a positive rational with square less than 2, that is, s+h∈A. But s+h>s, so s is not an upper bound of A, contradicting (S1).

Case 2: s2>2. Let h:=s2−22s. Then h∈Q and h>0. Also s−h=s2+22s>0, and (s−h)2=s2−2sh+h2=s2−(s2−2)+h2=2+h2>2. We claim that s−h is an upper bound of A. Indeed, if some x∈A had x>s−h, then, as s−h>0, Theorem 1.1.2 (g) would give x2>(s−h)2>2, contradicting x2<2. So s−h is a rational upper bound of A with s−h<s, contradicting (S2).

Both cases are impossible. Hence A has no supremum in Q. This proves the theorem.

Rationality of s was used in exactly two places: to make h, and so s±h, rational, which is what membership in A and “upper bound in Q” require; and to rule out s2=2 by Logic and Proof, Theorem 2.2.1. The logical shape is the same as in the irrationality of 2: assume the object exists, reach a contradiction, conclude that it does not.

To see the constants at work, start from the rational upper bound s=32, whose square 94 exceeds 2. Case 2 gives h=112 and the smaller upper bound s−h=1712, with (1712)2=289144=2+1144. Starting instead from s=1∈A, Case 1 gives h=16, and 76∈A because 4936<2. Each step can be repeated forever from either side, and no rational number is ever reached at which both processes stop.

This is the gap in Q in its final form. The next section adds to the ordered-field axioms the single statement that such gaps do not occur in R. Later in the chapter, the same two-case argument, with s now a real number supplied by that axiom, proves that 2 exists.

1.2.6. Exercises

A. Check your understanding

Exercise (A1)

In (a)–(d), give the supremum, infimum, maximum, and minimum of the set in R, or say that it does not exist. Justify each answer in a line or two. Parts (e) and (f) are about the proof of Theorem 1.2.2.

  • (a) {−2,0,73}.
  • (b) [−1,4).
  • (c) {x∈R:x2≤4}.
  • (d) ∅.
  • (e) Run Case 2 of the proof on the rational upper bound s=1712: compute h and s−h, and check that (s−h)2>2.
  • (f) Replace Q by R throughout the statement and the proof. Which single step of the proof can no longer be justified, and what possibility does it leave open?

Solution.

  • (a) max=sup=73 and min=inf=−2: both are elements of the set, and comparing with the three elements shows they are an upper and a lower bound. A maximum is the supremum and a minimum is the infimum (Exercise (B1: Maxima are suprema)).

  • (b) min=inf=−1, since −1 belongs to the set and is a lower bound. sup=4 and there is no maximum: 4 is an upper bound not in the set, and the midpoint argument of Example (The supremum need not belong to the set) shows that no M<4 is an upper bound (if M<4 is an upper bound, then M≥−1 and M+42 is in the set and exceeds M).

  • (c) The set is [−2,2]: by Theorem 1.1.2 (g) applied to |x| and 2, and Proposition 1.1.3 (b), x2≤4 holds if and only if |x|≤2, which by Proposition 1.1.3 (d) means −2≤x≤2. So max=sup=2 and min=inf=−2.

  • (d) None of the four exists. Every real number is an upper and a lower bound of ∅, so there is no least upper bound and no greatest lower bound (as shown in the text), and ∅ has no elements to be a maximum or minimum.

  • (e) Here s2=289144=2+1144, so h=s2−22s=1/14417/6=1408,s−h=1712−1408=577408. Then (s−h)2=2+h2=2+1166464>2, as the proof’s display predicts; directly, 5772=332929=2⋅4082+1. So 577408 is a smaller rational upper bound, and the step can be repeated from it.

  • (f) The step “by Logic and Proof, Theorem 2.2.1, s2≠2”. Over R nothing rules out s2=2, so after Cases 1 and 2 the possibility s2=2 remains, and no contradiction is reached. Every other step is algebra valid in any ordered field, R included. This is exactly the opening that the existence proof for 2, later in this chapter, walks through.

B. Practice

Exercise (B1: Maxima are suprema)

Let F be an ordered field and A⊆F.

  • (a) Prove that if A has a maximum m, then m is the supremum of A.
  • (b) Prove that if A has a supremum s and s∈A, then s is the maximum of A.
  • (c) State and prove the corresponding facts for minimum and infimum.

Solution.

  • (a) By Definition 1.2.3, m is an upper bound of A, which is (S1). For (S2), let M be any upper bound of A. Since m∈A, the definition of upper bound gives m≤M. Hence m is a supremum of A, and by Theorem 1.2.1 it is the supremum.

  • (b) By (S1), s is an upper bound of A, and s∈A by hypothesis. That is exactly Definition 1.2.3.

  • (c) If A has a minimum m, then m=infA; and if infA exists and belongs to A, it is the minimum. The proofs are those of (a) and (b) with every inequality reversed: m is a lower bound (I1), and any lower bound M satisfies M≤m because m∈A (I2).

Exercise (B2: Negating the definitions)

Let F be an ordered field and A⊆F.

  • (a) Write in symbols the statement “s is not an upper bound of A”.
  • (b) Write in symbols the statement “s is not a supremum of A”, as a disjunction of two statements.
  • (c) Use (b) to show directly that 2 is not the supremum of (0,1) in R, by exhibiting a witness.

Solution.

  • (a) ∃a∈A:a>s.

  • (b) Negating the conjunction (S1) and (S2) gives: (S1) fails or (S2) fails. So “s is not a supremum of A” is (∃a∈A:a>s)  or  (∃M∈F:(∀a∈A:a≤M) and M<s). The second disjunct says: some upper bound lies strictly below s.

  • (c) The first disjunct fails for s=2, since every element of (0,1) is below 2. The second holds with the witness M=1: it is an upper bound of (0,1), and 1<2. Hence 2 is not the supremum.

Exercise (B3: A supremum that is approached but not attained)

Let A={xx+1:x∈R, x>0}. Prove that supA=1 and that A has no maximum.

Solution. For x>0, the denominator x+1 is positive, and x<x+1; multiplying by 1x+1>0 (Theorem 1.1.2 (c) and (f)) gives xx+1<1. So 1 is an upper bound (S1), and 1∉A.

For (S2), let M be an upper bound of A, and suppose M<1. Since 12=11+1∈A, we have M≥12>0. Let x:=M1−M+1, which is positive because M>0 and 1−M>0. Then x(1−M)=M+(1−M)=1>M, so x>Mx+M=M(x+1), and dividing by x+1>0 gives xx+1>M. This element of A exceeds the upper bound M, a contradiction. Hence M≥1 for every upper bound M, and supA=1. Finally, A has no maximum: by Exercise (B1: Maxima are suprema) (a), a maximum would be the supremum 1, but 1∉A.

(The choice of x comes from solving xx+1>M backwards: it is equivalent to x(1−M)>M, that is, x>M1−M, and adding 1 gives a strict margin.)

C. Going deeper

Exercise (C1: The two sides of the gap)
  • (a) Give a set A⊆Q that is bounded above and has a supremum in Q that does not belong to A.
  • (b) Let B={x∈Q:x>0, x2<2}, and let U be the set of rational upper bounds of B. Prove that U={u∈Q:u>0, u2>2}.
  • (c) Deduce that every positive rational number lies in exactly one of B and U, that B has no largest element, and that U has no smallest element.

Hint: the two cases in the proof of Theorem 1.2.2 each produce a new rational from an old one.

Solution.

  • (a) A={x∈Q:0<x<1}. The argument of Example (The supremum need not belong to the set) works in the ordered field Q, because the midpoint of two rationals is rational; it shows supA=1 in Q, and 1∉A.

  • (b) (⊆) Let u∈U. Since 1∈B, we get u≥1>0. By Logic and Proof, Theorem 2.2.1, u2≠2. If u2<2, then u∈B, and Case 1 of the proof of Theorem 1.2.2, applied to s=u (which used only s∈Q, s≥1, and s2<2), produces u+h∈B with u+h>u, contradicting u∈U. Hence u2>2. (⊇) Let u∈Q with u>0 and u2>2. If some x∈B had x>u, then x2>u2>2 by Theorem 1.1.2 (g), contradicting x2<2. So u is an upper bound of B, and u∈U.

  • (c) Let q∈Q with q>0. By Logic and Proof, Theorem 2.2.1, q2≠2, so by trichotomy exactly one of q2<2 and q2>2 holds, that is, q lies in exactly one of B and U, by (b). If B had a largest element b, Case 1 of the proof (with s=b, valid since b≥1 when b is largest, as 1∈B) would give a larger element b+h∈B. If U had a smallest element u, Case 2 of the proof (with s=u, which needs only s>0, s∈Q, and s2>2) would give u−h∈U, smaller. So the positive rationals split into a lower piece with no top and an upper piece with no bottom. Nothing rational sits between the two pieces; that missing point is the gap.

Exercise (C2: The least element of the upper bounds)

Let F be an ordered field, A⊆F, and let U(A) be the set of all upper bounds of A in F.

  • (a) Prove that s is a supremum of A if and only if s is the minimum of U(A). (This explains the name “least upper bound”.)
  • (b) Prove that if A⊆B⊆F, then U(B)⊆U(A).
  • (c) Describe U(∅) and U(F), and use (a) to decide whether ∅ and F have suprema.

Solution.

  • (a) (⇒) If s is a supremum, then s∈U(A) by (S1), and s≤M for every M∈U(A) by (S2). So s is an element of U(A) and a lower bound of U(A), which is Definition 1.2.3’s definition of minimum. (⇐) If s=minU(A), then s∈U(A), which is (S1), and s≤M for every M∈U(A), which is (S2).

  • (b) Let M∈U(B). For every a∈A we have a∈B, so a≤M. Hence M∈U(A).

  • (c) U(∅)=F, since every element is an upper bound of the empty set vacuously; and F has no minimum, because m−1<m for every m∈F. So ∅ has no supremum. U(F)=∅, since for any M the element M+1∈F exceeds M; and ∅ has no minimum. So F has no supremum either. The two degenerate cases fail for opposite reasons: too many upper bounds, and none.