1.4  Working with the Supremum

The least upper bound axiom (Axiom 1.3.1) tells us that suprema exist. To use a supremum, or to recognize one, we need a handle on its second property. As defined (Definition 1.2.4), (S2) quantifies over all upper bounds of the set, and in practice there is no way to list them. This section replaces (S2) by an equivalent statement quantified over small positive numbers ε, which can be checked by exhibiting elements. With it we prove the rules for computing suprema of scaled sets and of sums of sets, and meet the first ε/2 argument of the book.

1.4.1. The epsilon characterization

Look back at how (S2) was verified for (0,1) in Example (The supremum need not belong to the set). We supposed that some M<1 was an upper bound and then produced an element of the set above M. Writing M=1−ε, the argument really showed: for every ε>0, some element of the set exceeds 1−ε. That is a statement about elements of the set, not about upper bounds, and it is exactly equivalent to (S2).

A supremum is an upper bound that the set comes arbitrarily close to.

Theorem 1.4.1 (Epsilon Characterization of the Supremum)

Let A⊆R and let s∈R be an upper bound of A. Then s=supA if and only if for every ε>0 there exists a∈A with a>s−ε.

In symbols, for an upper bound s of A: s=supA⟺∀ε>0  ∃a∈A: s−ε<a (≤s). The part in parentheses is automatic, since s is an upper bound; it is written to show where a lies.

Diagram. Labels: A, s, s - varepsilon, band (s-varepsilon , s], a

Idea. Draw the band (s−ε,s] just below s. The theorem says: s is the supremum exactly when every such band, however thin, contains a point of A.

(⇒) The number s−ε is smaller than s, so it cannot be an upper bound, by (S2). Not being an upper bound means precisely that some element of A lies above it.

(⇐) We need (S2): every upper bound M satisfies s≤M. Suppose some upper bound M lies below s. Then the band between M and s contains no point of A, and the hypothesis says every band does. So the band of width s−M, that is, the hypothesis with ε=s−M, gives the contradiction.

Proof. (⇒) Suppose s=supA, and let ε>0. Then s−ε<s by Theorem 1.1.2 (a). If s−ε were an upper bound of A, then (S2) would give s≤s−ε, contradicting s−ε<s by trichotomy. So s−ε is not an upper bound of A, which means there is a∈A with a>s−ε.

(⇐) Suppose that for every ε>0 there is a∈A with a>s−ε. Since s is an upper bound of A by hypothesis, (S1) holds, and it remains to check (S2). Let M be an upper bound of A, and suppose, for a contradiction, that M<s. Put ε:=s−M, which is positive by Theorem 1.1.2 (a). By hypothesis there is a∈A with a>s−ε=M. This contradicts M being an upper bound of A. Hence s≤M by trichotomy, which is (S2). So s=supA.

The theorem does not use the axiom. It holds in any ordered field, and it recognizes a supremum; the axiom is what guarantees that there is one to recognize. The two halves are used differently. The forward direction is how a known supremum is used: it hands us elements of A as close to supA as we like. The backward direction is how a candidate is confirmed: it replaces “every upper bound is at least s” by “every band below s meets A”, which can be checked by writing down an element.

Remark. The hypothesis “s is an upper bound” cannot be dropped. For A=(0,1) and s=12, every band (12−ε,12] meets A, yet 12 is not the supremum. The band condition alone says only that s is not too big; being an upper bound says it is not too small.

The element a that the theorem produces depends on ε, as the order “∀ε ∃a” allows. For A=(0,1) and s=1, the choice a:=max{12,1−ε2} works: it lies in (0,1) and exceeds 1−ε. For ε=110 it gives a=1920; for ε=11000 it must be above 9991000, and 1920 no longer works. No single element of (0,1) works for every ε.

Warning. The witness depends on ε. The theorem gives, for each ε, some a; it never gives one a that serves every ε at once. A proof that fixes a first and then says “for every ε>0, a>s−ε” has swapped the quantifiers, and for (0,1) it asserts something false. When you take a witness from the theorem, write “choose a∈A (depending on ε) with …”.

Quick check. Let s be an upper bound of a set A⊆R. Compare (i)  ∀ε>0  ∃a∈A:a>s−εand(ii)  ∃a∈A  ∀ε>0:a>s−ε. Statement (i) says s=supA. What does (ii) say, and when is it true?

Solution. Fix a∈A. The condition “a>s−ε for every ε>0” forces a≥s: if a<s, then ε:=s−a>0 would give a>s−(s−a)=a, which is absurd. Since s is an upper bound, also a≤s, so a=s. Conversely, if s∈A, then a=s satisfies s>s−ε for every ε>0.

So (ii) says exactly that s∈A, that is, s is the maximum of A. Swapping the quantifiers turned “supremum” into “maximum”. For A=(0,1) and s=1, (i) is true and (ii) is false.

Here is the theorem at work on a set where the witness must be found by a short computation. The Idea finds it backwards; the solution writes it forwards.

Example (Confirming a supremum with epsilon)

Prove that sup{x2:x∈(0,1)}=1.

Solution. Idea. The upper bound part is easy. For the band condition, fix ε>0; we need x∈(0,1) with x2>1−ε. Try x=1−h with h>0 small. Then x2=1−2h+h2>1−2h, so it suffices that 1−2h≥1−ε, that is, h≤ε2. But we also need x∈(0,1), that is, 0<h<1, and ε2 can be large. Capping it fixes this: take h=min{12,ε2}.

Proof. Let A={x2:x∈(0,1)}. For x∈(0,1), Theorem 1.1.2 (g) gives x2<12=1, so 1 is an upper bound of A.

Let ε>0, and let h:=min{12,ε2}, which depends only on ε. Then 0<h≤12, so x:=1−h lies in [12,1)⊆(0,1), and x2∈A. Since h>0, h2>0, and so x2=1−2h+h2>1−2h≥1−ε, where the last step uses h≤ε2. By Theorem 1.4.1, supA=1.

The 12 in the minimum is arbitrary: any cap below 1 keeps x positive. What matters is that a constraint discovered late in the Idea (here h<1) is built into the constant from the start of the proof.

1.4.2. Sup approximation

The forward direction of Theorem 1.4.1 is used so often with ε=1n that it deserves its own statement.

Corollary 1.4.2 (Sup Approximation)

Let A⊆R be nonempty and bounded above. For every n∈Z>0 there is an∈A with supA−1n<an≤supA.

Proof. By Axiom 1.3.1, supA exists. Let n∈Z>0. Then n>0, and 1n>0 by Theorem 1.1.2 (f). By Theorem 1.4.1 (⇒) with ε=1n, there is an∈A with an>supA−1n, and an≤supA by (S1).

The corollary gives, for each n separately, an element an. Choosing one for every n at once, so as to form a sequence (an), is a use of the axiom of countable choice; we flag it and move on. Once limits are defined in Chapter 2, this says that supA is the limit of a sequence from A. We call the move sup approximation: “supA−1n is not an upper bound, so some an∈A exceeds it.”

1.4.3. Monotonicity and scaling

We now compute suprema of sets built from other sets. The first rule says that enlarging a set cannot lower its supremum.

Theorem 1.4.3 (Monotonicity of the Supremum)

Let A⊆B⊆R, where A is nonempty and B is bounded above. Then supA and supB exist, and supA≤supB.

Proof. Since A is nonempty and A⊆B, the set B is nonempty; as it is bounded above, supB exists by Axiom 1.3.1. Every a∈A lies in B, so a≤supB by (S1) for B. Hence supB is an upper bound of A. So A is nonempty and bounded above, supA exists by Axiom 1.3.1, and supA≤supB by (S2) for A.

Strict inclusion does not give strict inequality: (0,1)⊊(0,1], and both have supremum 1. The hypothesis that A is nonempty cannot be dropped, since ∅⊆B always and ∅ has no supremum.

For scaling we need the scaled set. For A⊆R and c∈R, let cA:={ca:a∈A}. For example 2(0,1]=(0,2] and (−1)A=−A.

Theorem 1.4.4 (Scaling the Supremum)

Let A⊆R be nonempty and bounded above, and let c∈R.

  • (a) If c>0, then cA is nonempty and bounded above, and sup(cA)=csupA.
  • (b) If c<0, then cA is nonempty and bounded below, and inf(cA)=csupA.

Idea. For (a), prove the equality as two inequalities. Multiplying the inequality a≤supA by c>0 shows that csupA is an upper bound of cA, which gives ≤. For ≥, undo the scaling: dividing by c turns an upper bound of cA into an upper bound of A. No ε is needed, because multiplication by c>0 is invertible and preserves order. For (b), a negative factor reverses order, so write c=−|c| and let Theorem 1.3.2 handle the sign.

Proof. Let s:=supA, which exists by Axiom 1.3.1. Since A is nonempty, so is cA.

  • (a) Let c>0. For every a∈A, a≤s by (S1), so ca≤cs by Theorem 1.1.2 (c) (or trivially if a=s). Hence cs is an upper bound of cA, so sup(cA) exists by Axiom 1.3.1, and t:=sup(cA)≤cs by (S2). For the reverse inequality, let a∈A. Then ca∈cA, so ca≤t. Multiplying by 1c>0 (Theorem 1.1.2 (f) and (c)) gives a≤tc. Hence tc is an upper bound of A, and (S2) gives s≤tc. Multiplying by c>0 gives cs≤t. By trichotomy, sup(cA)=cs.

  • (b) Let c<0, so −c>0. The set −(cA)={−ca:a∈A} equals (−c)A, which by (a) is nonempty and bounded above with sup((−c)A)=−cs. By Theorem 1.3.2 (a), cA=−((−c)A) is bounded below, and by Theorem 1.3.2, inf(cA)=−sup(−(cA))=−sup((−c)A)=−(−cs)=cs. This proves the theorem.

For c=0 the set cA is {0}, and sup(0A)=0=0⋅supA as well. Part (a) genuinely needs c>0: with c=−1 and A=(0,1], the set cA=[−1,0) has supremum 0, not csupA=−1. Part (b) says what happens instead: a negative factor exchanges supremum and infimum, and indeed inf[−1,0)=−1.

1.4.4. The supremum of a sum

For A,B⊆R, let A+B:={a+b:a∈A, b∈B}. For instance (0,1)+{5}=(5,6) and [0,1]+[0,2]=[0,3]. It is natural to expect sup(A+B)=supA+supB. This time the reverse inequality cannot be obtained by undoing an operation: a single element of A+B mixes one element of each set. We need the ε characterization.

Theorem 1.4.5 (Supremum of a Sum)

Let A,B⊆R be nonempty and bounded above. Then A+B is nonempty and bounded above, and sup(A+B)=supA+supB.

Try it first (ten minutes): the inequality ≤ takes one line. Try to prove ≥.

Idea. The attempt that comes first to mind takes a=supA and b=supB: then a+b∈A+B, and (S1) for sup(A+B) gives ≥ at once. It fails because a supremum need not belong to its set: for A=B=(0,1), the number 2 is not in A+B=(0,2). (The last exercise of this section takes that attempt apart.) The repair is to use elements that are only close to the suprema, which is what Theorem 1.4.1 (⇒) supplies.

So we prove the equality as two inequalities.

(≤) Every a+b is at most supA+supB, so the right side is an upper bound, and the supremum is at most any upper bound.

(≥) Work backwards. To show that sup(A+B) is at least supA+supB, it suffices to find, for each ε>0, an element of A+B above supA+supB−ε. The natural candidate is a+b with a close to supA and b close to supB. If a falls short of supA by less than ε/2, and b falls short of supB by less than ε/2, the total shortfall is less than ε. So we split the budget ε into two halves, one for each set, and ask Theorem 1.4.1 for an element within ε/2 of each supremum. This is the ε/2 argument. The number ε/2 depends only on ε; the elements a and b depend on ε. Before reading on: the proof asks for elements within ε/2 of each supremum. What would it give if it asked for ε instead, and would that still be enough?

Proof. By Axiom 1.3.1, supA and supB exist. Choosing a0∈A and b0∈B gives a0+b0∈A+B, so A+B is nonempty.

(≤) Let a∈A and b∈B. By (S1), a≤supA and b≤supB, so a+b≤supA+supB by Theorem 1.1.2 (b). Hence supA+supB is an upper bound of A+B. By Axiom 1.3.1, sup(A+B) exists, and by (S2), sup(A+B)≤supA+supB.

(≥) Let ε>0. Then ε2>0. By Theorem 1.4.1 (⇒), there are a∈A and b∈B (both depending on ε) with a>supA−ε2andb>supB−ε2. Adding, by Theorem 1.1.2 (b), gives a+b>supA+supB−ε. Since a+b∈A+B, (S1) gives sup(A+B)≥a+b>supA+supB−ε. This holds for every ε>0. If we had sup(A+B)<supA+supB, then the choice ε:=supA+supB−sup(A+B)>0 would give sup(A+B)>sup(A+B), which is absurd. Hence sup(A+B)≥supA+supB.

The two inequalities and trichotomy give sup(A+B)=supA+supB.

The answer to the prompt: with ε in place of ε/2 the proof gives sup(A+B)>supA+supB−2ε for every ε>0, and that is still enough, since 2ε runs through all positive numbers as ε does. Halving is a convenience: it makes the final inequality come out with exactly ε, which is the form Theorem 1.4.1 (⇐) asks for.

The halves of the proof use the two halves of the definition. The first inequality used only that each supremum is an upper bound (S1) and that sup(A+B) is least (S2). The second used that each of supA and supB is least, in its ε form, and that sup(A+B) is an upper bound. We call the pattern equality by two inequalities: prove ≤ by exhibiting an upper bound, and ≥ with an ε.

Every hypothesis is needed. If B=∅, then A+B=∅ has no supremum. If B is not bounded above, neither is A+B (Exercise (C2: Exit check: sums of sets)). And the analogous rule for differences is not sup(A−B)=supA−supB: the correct version subtracts an infimum (Exercise (B3: Supremum of a difference)).

Warning. Proving one inequality only. Here is a tempting “proof” of Theorem 1.4.5: “For a∈A and b∈B, a+b≤supA+supB. Therefore sup(A+B)=supA+supB.” The first sentence proves only that supA+supB is an upper bound of A+B, which gives ≤. It says nothing about being the least one: the same sentence with supA+supB+1 is equally true, and would “prove” sup(A+B)=supA+supB+1. Whenever a supremum is claimed to equal something, both (S1) and (S2), or both inequalities, must appear.

1.4.5. Exercises

A. Check your understanding

Exercise (A1)
  • (a) Use Theorem 1.4.1 to confirm that sup[0,5)=5. Give the witness a as a formula in ε.
  • (b) Use Theorem 1.4.1 to confirm that sup{3}=3. Does your witness depend on ε? Why not?
  • (c) Use Theorem 1.4.1 to confirm that sup((−1,1)∪(2,4))=4.
  • (d) Let s be an upper bound of A. Write in symbols, using the ε characterization, the statement “s is not the supremum of A”.
  • (e) Run the (≥) half of the proof of Theorem 1.4.5 on A=(0,1), B={5}, and ε=110: give an a and a b the proof could use, and check the inequality it derives.
  • (f) In the proof of Theorem 1.4.5, which line can no longer be justified if B is allowed to be empty?

Solution.

  • (a) 5 is an upper bound of [0,5). Given ε>0, let a:=max{0,5−ε2}. Then a≥0, and a<5 because both 0 and 5−ε2 are less than 5; so a∈[0,5). Also a≥5−ε2>5−ε. By Theorem 1.4.1, sup[0,5)=5.

  • (b) 3 is an upper bound of {3}, and for every ε>0 the element a=3 satisfies 3>3−ε. The witness does not depend on ε because 3 belongs to the set: by the Quick check above, a single witness for all ε exists exactly when the supremum is a maximum.

  • (c) Every element is less than 4, so 4 is an upper bound. Given ε>0, let a:=max{3,4−ε2}. Then 3≤a<4, so a∈(2,4), and a≥4−ε2>4−ε. By Theorem 1.4.1 the supremum is 4.

  • (d) ∃ε>0  ∀a∈A:a≤s−ε. In words: some band below s contains no point of A, so s−ε is a smaller upper bound.

  • (e) Here supA=1, supB=5, and ε2=120. The proof needs a∈(0,1) with a>1−120=1920, for instance a=2425, and b∈B with b>5−120, which forces b=5. Then a+b=14925=5.96>5.9=supA+supB−ε. Any a∈(1920,1) works; the one b works for every ε because 5 is the maximum of B.

  • (f) The first line, “By Axiom 1.3.1, supA and supB exist”. The axiom needs B nonempty, and ∅ has no supremum. The line that chooses b∈B in the (≥) half fails too, since there is nothing to choose.

B. Practice

Exercise (B1: A computed supremum)

Prove that sup{x2:x∈(−1,2)}=4. Hence show that the set has no maximum.

Solution. Let A={x2:x∈(−1,2)}. Upper bound. Let x∈(−1,2). If x≥0, then x<2 gives x2<4 by Theorem 1.1.2 (g). If −1<x<0, then |x|<1 by Proposition 1.1.3 (d), so x2=|x|2<1<4 by Theorem 1.1.2 (g). So 4 is an upper bound, and 4∉A.

Band condition. Working backwards as in Example (Confirming a supremum with epsilon): with x=2−h we have x2=4−4h+h2>4−4h, so h≤ε4 suffices, provided 0<h<3 to keep x∈(−1,2). So let ε>0 and h:=min{1,ε4}, which depends only on ε. Then 0<h≤1, so x:=2−h∈[1,2)⊆(−1,2), and since h2>0, x2=4−4h+h2>4−4h≥4−ε. By Theorem 1.4.1, supA=4. Since 4∉A, the set has no maximum, by Exercise (B1: Maxima are suprema) (a).

Exercise (B2: Supremum of a union)

Let A,B⊆R be nonempty and bounded above. Prove that A∪B is bounded above and sup(A∪B)=max{supA,supB}.

Solution. Let m:=max{supA,supB}; both suprema exist by Axiom 1.3.1. If x∈A∪B, then x≤supA≤m or x≤supB≤m, so m is an upper bound of A∪B, which is nonempty. By symmetry we may assume m=supA. Given ε>0, Theorem 1.4.1 (⇒) gives a∈A with a>supA−ε=m−ε, and a∈A∪B. By Theorem 1.4.1 (⇐), sup(A∪B)=m.

Exercise (B3: Supremum of a difference)

Let A⊆R be nonempty and bounded above, and B⊆R nonempty and bounded below. Prove that sup{a−b:a∈A, b∈B}=supA−infB. Give an example showing that the right side cannot be replaced by supA−supB.

Solution. The set in question is A+(−B). By Theorem 1.3.2 (a), −B is bounded above, and it is nonempty. By Theorem 1.3.3, infB=−sup(−B), that is, sup(−B)=−infB. So Theorem 1.4.5 applies to A and −B: sup(A+(−B))=supA+sup(−B)=supA−infB. For the example, take A={0} and B=[0,1]. The differences 0−b fill [−1,0], whose supremum is 0=supA−infB, whereas supA−supB=−1.

C. Going deeper

Exercise (C1: Products of sets)

For A,B⊆R let AB:={ab:a∈A, b∈B}.

  • (a) Show that sup(AB)=supA⋅supB can fail for nonempty bounded sets A,B.
  • (b) Prove that it holds when A and B are nonempty, bounded above, and contained in (0,∞).

Solution (Hint 1). For (a), try sets of negative numbers. For (b), the inequality ≤ is routine; for ≥, fix one element b∈B and compare the set bA with AB.

Solution (Hint 2). For ≥ in (b): fix b∈B. Which theorem computes sup(bA), and which compares the suprema of two sets, one inside the other? What does the inequality you get say about b, once b varies?

Solution.

  • (a) Take A=B=[−2,−1]. Then supA⋅supB=(−1)(−1)=1, but 4=(−2)(−2)∈AB, so sup(AB)≥4≠1 by (S1).

  • (b) Let s:=supA and t:=supB, which exist by Axiom 1.3.1. Since A contains a positive element and s is an upper bound, s>0; likewise t>0.

(≤) For a∈A and b∈B, we have 0<a≤s and 0<b≤t, so ab≤sb≤st by Theorem 1.1.2 (c) (with trivial equality cases). So st is an upper bound of the nonempty set AB, sup(AB) exists, and sup(AB)≤st by (S2).

(≥) Fix b∈B. Then bA⊆AB and b>0, so Theorem 1.4.4 and Theorem 1.4.3 give bs=sup(bA)≤sup(AB). Multiplying by 1s>0 gives b≤sup(AB)s. As b∈B was arbitrary, sup(AB)s is an upper bound of B, so t≤sup(AB)s by (S2), that is, st≤sup(AB).

By trichotomy, sup(AB)=st. Positivity was used in (≤), to multiply inequalities, and in (≥), to scale by b and divide by s; part (a) shows it cannot be dropped.

Exercise (C2: Exit check: sums of sets)

Let A,B⊆R be nonempty.

  • (a) Assume A and B are bounded above. Without looking back, prove sup(A+B)=supA+supB. This time, instead of proving ≥ separately, show that supA+supB satisfies both hypotheses of Theorem 1.4.1 for the set A+B.
  • (b) Assume A and B are bounded below. State and prove the corresponding formula for inf(A+B).
  • (c) Show that if B is not bounded above, then neither is A+B.

Solution.

  • (a) Let s:=supA+supB, where both suprema exist by Axiom 1.3.1. Upper bound: for a∈A, b∈B, (S1) and Theorem 1.1.2 (b) give a+b≤s. Band condition: let ε>0; then ε2>0, and Theorem 1.4.1 (⇒) gives a∈A and b∈B, depending on ε, with a>supA−ε2 and b>supB−ε2. Adding, a+b>s−ε, and a+b∈A+B. By Theorem 1.4.1 (⇐), s=sup(A+B).

  • (b) inf(A+B)=infA+infB. Indeed −(A+B)=(−A)+(−B), since −(a+b)=(−a)+(−b). By Theorem 1.3.2 (a), −A and −B are nonempty and bounded above, so (a) and Theorem 1.3.3 give inf(A+B)=−sup((−A)+(−B))=−sup(−A)−sup(−B)=infA+infB. Here A+B is bounded below because −(A+B) is bounded above, by (a) and Theorem 1.3.2 (a).

  • (c) Fix a0∈A and let M∈R. Since B is not bounded above, M−a0 is not an upper bound of B, so some b∈B has b>M−a0. Then a0+b∈A+B and a0+b>M. As M was arbitrary, A+B is not bounded above.

Marking scheme. (10 points) - 1: (a) says why supA, supB exist and why A+B is nonempty. - 2: (a) shows supA+supB is an upper bound of A+B, adding the two (S1) inequalities. - 3: (a) fixes an arbitrary ε>0, obtains a∈A and b∈B, depending on ε, within ε/2 of their suprema, and concludes with Theorem 1.4.1 (⇐). - 2: (b) reduces to (a) through −(A+B)=(−A)+(−B) and Theorem 1.3.3, including why A+B is bounded below. - 2: (c) produces, for an arbitrary M, an element of A+B above M. Fatal errors (0 for the step): taking a=supA∈A; choosing one a before ε is fixed; proving only ≤ in (a). A solution of (a) that proves ≤ and ≥ separately, as in Theorem 1.4.5, earns the 5 points of the second and third lines if the ≥ half is complete. A solution of (b) that repeats the argument of (a) with lower bounds earns the (b) points.

Exercise (C3: Find the wrong line)

Each “proof” below contains a line that is false in general. Find it, give a set for which it fails, and decide whether the claim itself is true.

  • (a) Claim. If A⊆R is nonempty and bounded above and a<1 for every a∈A, then supA<1. “Proof.” (1) Let s=supA. (2) Since s∈A, the hypothesis gives s<1. (3) Hence supA<1.
  • (b) Claim. If A,B⊆R are nonempty and bounded above, then sup(A+B)≥supA+supB. “Proof.” (1) Let a=supA and b=supB. (2) Then a∈A and b∈B, so a+b∈A+B. (3) By (S1), a+b≤sup(A+B), which is the claim.

Solution.

  • (a) Line (2) is wrong: it assumes supA∈A, which fails for A=(0,1), where supA=1∉A. For that set the claim is false: every element is less than 1, and supA=1≮1. The correct conclusion is supA≤1, which follows from (S2) because 1 is an upper bound.

  • (b) Line (2) is wrong for the same reason: for A=B=(0,1), neither supremum belongs to its set, so a+b=2 need not lie in A+B=(0,2), and here it does not. The claim is true, since it is half of Theorem 1.4.5, but this argument does not prove it; a correct argument for this inequality is the ε/2 argument in the proof of Theorem 1.4.5. The flawed line is valid exactly when A and B have maxima, which is the situation the author of the “proof” silently imagined.