Number Systems proved that is a complete ordered
field (Number Systems: From to , Theorem 5.5.2).
By the definition of completeness (Number Systems: From to , Definition 5.5.1),
every non-empty set of real numbers that is bounded
above has a supremum. A supremum is a least upper bound,
as in Sets and Functions (Sets and Functions, Definition 5.3.5).
A real function hands us such sets, one for each : the set
of its values
on . This section
asks when is
bounded, names its supremum and infimum, and fixes one
method for computing them: bound every value, then find
a witness. It then gives rules for comparing suprema
without computing them, measures the spread of values,
and shows that non-constant polynomials are unbounded on
.
A least
upper bound that is never reached
Let on . A few values: Every value is below , since and . The values
creep toward and
never reach it.
“Its maximum is ” is false: a maximum is
a value, and is
not a value of .
“Its least upper bound is ” is true, and proving
it takes two halves. First, bounds every value.
Second, no number below bounds every value. The
first half is one line. The second half is the real
work, and the epsilon test below turns it into a search
for a single point.
The infimum
and the epsilon test
Suprema come with a mirror image. Sets and
Functions defined the infimum of a set as its
greatest lower bound (Sets and Functions, Definition 5.3.5),
but completeness speaks only of suprema. Reflection in
turns one into
the other. For , write , the image of
under (Sets and Functions, Example (Reflections, scalings and sums as images)).
A small case first. Let , so .
The lower bound
of becomes the
upper bound of
. The supremum of
is , and .
Number Systems set part (b) of the next
proposition as an exercise (Number Systems: From to , Exercise (B1)).
We prove it here so that later sections can cite it.
Proposition
8.3.1 (Infimum by Reflection)
Let .
- (a) A real number
is a lower bound
of if and only if
is an upper
bound of .
- (b) If is
non-empty and bounded below, then has an infimum, and
.
Proof.
(a) For , holds if and only
if , by Number Systems: From to , Proposition 2.4.3
(a) together with the case of equality. The elements of
are exactly the
numbers with
, so for every if and only if
for every
.
(b) Let be a lower bound of
. By (a), is an upper bound of
, and is non-empty because
is. Since is complete (Number Systems: From to , Theorem 5.5.2),
exists. By (a), applied to , the number is a lower bound of
, since is an upper
bound of . Let
be any lower
bound of . Then
is an upper
bound of by (a).
A supremum is at most every upper bound, (S2), so , that is,
. So
is the greatest
lower bound of .
Every statement about suprema thus has a twin about
infima, obtained by reflection.
The second half of “least upper bound” says that
nothing smaller is an upper bound. In “smaller” can be
measured by a positive gap , and “not an
upper bound” means that some element sticks out above.
That gives a test with an explicit witness.
Here is the test on a small case. Take and the upper
bound . For
the gap , the element of lies above . For , the
element lies
above . Every
gap, however small, has such an element.
Proposition
8.3.2 (The Epsilon Test for a Supremum)
Let be non-empty and let be an upper bound of
. Then if and only
if, for every ,
there exists with .
In symbols: Likewise, if is a lower bound of
, then if and only if
for every there exists with .
Proof. Let and . Then
. If were an upper bound of , the least-upper-bound
property (S2) would give , which is false. So some
fails ; by
totality of the order (Number Systems: From to , Proposition 2.4.3
(i)), .
Assume the condition, and let be an upper bound of
. Suppose , and put . The condition gives with , against being an upper bound.
So by
totality. Hence
is an upper bound, (S1), and is at most every upper
bound, (S2): it is the supremum.
For the infimum, apply the supremum statement to
and the upper
bound (Proposition 8.3.1
(a)). By the proof of Proposition 8.3.1
(b), if
and only if ; and if and only if .
The element is
a witness for . It may
depend on , and it
usually does: a smaller asks for an
element closer to the top.
Quick check. Is the supremum of
? Use the
test.
Solution. No, and the test does not
even apply: it is stated for an upper bound , and is not one, since
and . The supremum is : it bounds , and for the
element of exceeds .
Bounded
functions and their suprema
A real function (Definition 8.1.1)
on has a set of
values on each , and the words of the previous subsection
apply to that set.
A small case first. Let and . For , , so ; and . One number,
, lies above every
value on , and
lies below every
value.
A function is bounded on when its values on
stay inside a
fixed window. That is, some fixed interval contains
every value on .
Definition
8.3.1 (Bounded Function)
Let and . The function is bounded
above on
if the set (Sets and Functions, Definition 2.5.1)
is bounded above: there exists with for
every . It is bounded below on if is bounded below,
and bounded on if there
exists
with for every . When , “on ”
may be dropped.
In words: one number , chosen before , works for all . By Number Systems: From to , Proposition 4.1.3
(d), says , so a bounded function is bounded above
and below. Conversely, if on , then gives and , so . The two meanings of “bounded” agree.
Examples. The function from the start
of the section is bounded on , with . A
constant function
is bounded on every , by . The function
on is bounded below
by but not above:
given , the point
lies in and . Change only the set to
and the same
formula is bounded, with (Number Systems: From to , Proposition 4.1.2
(c)). Boundedness belongs to the pair , not to the
formula.
Before the next definition, one more small case. On
the function
takes the values . The least upper bound of these values is
, and it is a
value, at .
The greatest lower bound is , at .
Definition
8.3.2 (Supremum and Infimum of a
Function)
Let and let be non-empty. If
is bounded above
on , the
supremum of on is also written . If
is bounded below
on , its
infimum on is . The supremum is attained
if , that is, for
some ; it
is then the maximum of on , written . Likewise an
attained infimum is the minimum .
Both exist under the stated hypotheses: is non-empty because
is, so
completeness gives , and Proposition 8.3.1
(b) gives . The set must be non-empty,
since every real number bounds the empty set and no
least one exists. An attained supremum is an upper bound
of that lies
in , so it is
the largest value. Conversely, a largest value is an upper bound,
and every upper bound is at least . So it is the
supremum.
Warning. The supremum need
not be a value. A proof that starts “let be the point where
reaches ” has assumed
that the supremum is attained. For on no such point
exists. The supremum also depends on : and
.
The two halves we used for at the start of
the section now become a general method.
Example
(Method: bound every value, then find a witness)
How it goes. To prove for a
non-empty and a
candidate :
- Bound
every value. Let be arbitrary and prove .
- Find
a witness. Let be
arbitrary and produce , depending on , with .
The first half shows that is bounded above on
and that is an upper bound of
; then by Proposition 8.3.2.
For an infimum, reverse the inequalities: for every
, and for
each some
with .
| on ; a
candidate |
;
|
When to use it. Whenever a supremum
or infimum is to be computed. An inequality needs only
the first half, since the supremum is the least upper
bound; an equality needs both.
Common mistakes. Proving only shows that is an upper bound, not
that it is the least one. A witness for one , such as
, is not
enough: the second half needs a witness for every . A witness
for must not be
paired with a different witness for , as if were a value
of . Exercise
B4 shows where that mistake leads.
Two worked
examples
The first example returns to . Its witness
has to move with .
Example
(A supremum that is not attained)
Let on . Prove that and that it
is not attained. Find .
Idea (Scratch work). The bounding
half: means , after multiplying by , and that
holds, even strictly.
The witness half is the gap. Given , we
want with
For the right side is at most and any works. For , work backwards: multiply by , collect : So is a clean choice, a little
larger than needed. Does it also cover ? At
the value is , and means , true for every . One
choice, no cases; the restriction was
needed only while solving backwards.
|
|
|
some
with |
| , value |
, i.e. :
the gap is closed |
The proof runs forwards: bound, then choose from , then
check.
Solution. Bound every
value. Let . Then and ; multiplying by (Number Systems: From to , Proposition 3.2.2
(a), Number Systems: From to , Proposition 2.4.3
(c)) gives .
Find a witness. Let and
put , which lies in . Then Since and , dividing by gives
.
By the method of Example (Method: bound every value, then find a witness),
. It is
not attained, because for every .
For the infimum, for , as a quotient of by , and . So , attained:
.
Quick check. For , which
does the proof
choose, and is its value above ?
Solution. , with , and . The proof needs no
separate case for large .
In the second example the candidate is a value, and
the witness half costs nothing.
Example
(A supremum that is attained)
Find and
of on .
Solution. Completing the square,
.
Bound every value. Since , for every .
Find a witness. , and for every . So
is a
witness for every at once.
Hence , attained at : it is . For the
infimum, on
both and
, so
, and
: .
An attained value is its own witness, which is why
the witness in the second solution does not depend on
.
Solution. For : the values on form , so , not attained
( needs
), and
, attained
at .
For :
, attained
at any rational point such as , and , attained at any
irrational point of . One is , with from Number Systems: From to , Proposition 6.1.4:
it lies in
since . First, is irrational. If , then
in . The copy of in respects products and
is injective (Number Systems: From to , Theorem 4.2.2),
so would
hold in . That
is impossible, since no rational number has square (Number Systems: From to , Theorem 3.3.1).
Then is
irrational too: would make
rational.
Rules for
suprema of functions
Suprema are compared more often than they are
computed. Each comparison below, except (e), which is
reflection, is one or both halves of the method.
A small case first. On let take the values , , and let take , . Then and . The sum takes the values
and , so .
The function
takes and , so .
Theorem
8.3.3 (Rules for Suprema of Functions)
Let , let be non-empty, let
and be bounded above on
, and let . All suprema
are on , and , , are as in Definition 8.1.2.
- (a) If for every
, then .
- (b) .
- (c) .
- (d) If , then .
- (e) If is bounded below on
, then is bounded above on
and .
- (f) If is
non-empty, then .
- (g) If and are bounded (above and
below) on , then
.
Idea. Parts (a), (b) and (f) are
inequalities between suprema, so only the bounding half
is needed: the right side bounds every value of the left
side, and the left supremum is the least such bound.
Parts (c) and (d) are equalities and take both halves;
(d) treats
apart, since a witness for comes from . Part (e)
is Proposition 8.3.1
applied to the set of values. Part (g) uses that lies between shifted down and shifted up by the
constant .
Proof. Write
and .
(a) For , . So
is an upper
bound of . A
supremum is at most every upper bound, (S2), so .
(b) Bound
every value. For , and . Adding the two inequalities, . So is bounded above on , and is an upper
bound of . Least upper bound. The supremum
is at most every upper bound, so .
(c) For , . For
,
Proposition 8.3.2
gives with
, so . By the method, .
(d) If , then is the constant on the non-empty set
, so . Let . Bound every value. For , , so (Number Systems: From to , Proposition 2.4.3
(c), with equality allowed). Find a witness.
Let . Then , and
Proposition 8.3.2
gives with
; multiplying by , . By the method, .
(e) Let be a lower bound of
. Then for , so is bounded above. The
set of values of
on is , so by Proposition 8.3.1
(b).
(f) , so
is an upper
bound of , and
is non-empty.
Hence is bounded
above on , and
,
since a supremum is at most every upper bound.
(g) If and
on
, then by the triangle inequality (Number Systems: From to , Proposition 4.1.3
(e)), so exists. For , since a number is at most its absolute value.
By (a) and then (c), . Swapping and , and using , gives . So , which is .
Rule (b) bounds the supremum of a sum, and rule (g)
says that two functions close at every point have close
suprema.
Warning. Rule (b) is an
inequality, and it can be strict. On let and . Then ,
while is the
constant , so
. The two suprema are reached at different
points, and .
Quick check. Which half of the
method does rule (f) use, and why is the other half not
needed?
Solution. Only , bounding every
value: every value of on is a value on , so bounds , and the least upper
bound of is at
most it. No witness is needed because the claim is an
inequality, not an equality.
How far
apart can two values be?
For a bounded function, the largest gap between two
of its values measures how much the function varies on
. The obvious
guess is “the top minus the bottom”, and the next result
confirms it, with the top and bottom read as supremum
and infimum.
A small case first. On let take the values . The gaps are
, and the
largest is , the largest value minus the smallest.
Proposition
8.3.4 (The Spread of Values)
Let be
non-empty and let be
bounded (above and below) on . Then
Try it first (ten minutes): which two points make
almost ?
Idea. The natural attempt takes
where is largest and where it is smallest.
That attempt fails at once: neither point need exist, as
on showed. What
does exist, for each , is a
point with within of the
supremum and a point with within of the
infimum (Proposition 8.3.2).
Their gap falls short of by
less than . The bounding half
needs two inequalities, one for each sign of .
Before reading on: why , and not
?
Proof. Let and
, which exist by Definition 8.3.2,
and let , a non-empty
set.
Bound every value. Let . Then and
,
so and . Thus , and by Number Systems: From to , Proposition 4.1.3
(d). So is an
upper bound of .
Find a witness. Let . Then
. By Proposition 8.3.2
there are
with and with . A number is at most its
absolute value, so By Proposition 8.3.2,
.
With
in place of each , the last
display would end in , and the test asks for ; any two
positive tolerances adding up to would do. The
proof never used a point where is largest. The result
holds for
on ,
where the spread is and is not attained.
Polynomials
are unbounded
On a set like many functions are bounded. On all of , no polynomial
function of degree at least is. Chapter 7 proved
how fast a complex polynomial grows (Lemma 7.6.1),
and a real polynomial is a complex one whose
coefficients happen to be real. Nothing new has to be
estimated.
A small case first. Let . Then
and
. Once
is large,
the top term
outweighs the rest, and the values grow without
limit.
Example
(Polynomials of positive degree are unbounded)
Let with , and put
Show:
- (a) for every real with ;
- (b) every real root
of lies in ;
- (c) the polynomial
function of on
(Definition 8.1.3)
is not bounded.
Solution. Regard as an element of , with coefficients
(Proposition 3.1.1).
The inclusion respects sums and products. So, for real
, the value of
at computed in is the real number
. The modulus
of a real number is its absolute value (Proposition 3.2.1).
So the numbers
and above are the
and of Lemma 7.6.1,
with .
(a) For real
with , the lemma
gives .
(b) If , then and , so (a) gives
, and is not a root. So every
real root has , that is, (Number Systems: From to , Proposition 4.1.3
(d)).
(c) Let and put . Then , so , and
(a) gives since . So no satisfies for
every .
The growth bound says where roots can be, not that
one exists:
has no real root. That a real polynomial of odd degree
has a real root came from factoring, in Chapter 7 (Corollary 7.6.11),
and (b) now adds that such a root lies in . For example
has
and , so its roots lie
in .
Quick check. Is bounded on
? On ?
Suprema
over a product
A function of two variables can be bounded in two
stages: first over one variable with the other frozen,
then over the other. The order of the stages does not
matter. Here and
are any sets, not
necessarily of numbers, and means
,
the supremum of the set of values, as in Definition 8.3.2;
likewise for the inner suprema.
A small case first. Let , and write the values of as a table with rows
and
columns :
the first row is and the second is . The row tops are
and , and the larger is
. The column tops
are and , and the larger is
again , the
largest entry.
Proposition
8.3.5 (Iterated Suprema)
Let and be non-empty sets and
let be bounded above. Then
In words: to find the top of a table of numbers, take
the top of each row and then the top of those, or the
same with columns.
↺Second readingSuprema
over a product
Proof. Let , which exists since is non-empty.
For fixed ,
every is a
value of , so
for
every .
Hence is bounded above on the non-empty . A supremum is at most
every upper bound, (S2), so . So is bounded above
on by , and for
the same reason.
Conversely, for , . So is an upper bound of the values of
, and .
Hence , the first equality. Exchanging the
roles of and
gives the
second.
If
is a singleton, the inner supremum is , and the
statement says only that : the same set of
values, written twice. The hypothesis that and are non-empty cannot be
dropped, since an empty factor makes empty and
leaves nothing to take the supremum of.
Exercises
A. Check your
understanding
Exercise
(A1)
Parts (a)–(c) are about the proof of Proposition 8.3.4.
Parts (d)–(f) are true or false: give a reason or a
counterexample (here is non-empty and bounded on ).
- (a) Run the
statement on on : find , and the supremum of . Is
that supremum attained?
- (b) Which line of
the proof uses that is bounded below on
?
- (c) State the idea
of the proof in two sentences.
- (d) .
- (e) .
- (f) .
Solution.
(a) The values of
on form , so and , and the
supremum of is . It is not attained: both values lie in , so ,
and equality would need , that is, , neither of which lies in .
(b) The opening
sentence, first: exists only because is bounded below on
(Proposition 8.3.1
(b)). It is then used in the choice of with . The infimum version of Proposition 8.3.2
then gives . (The
bounding half also uses .)
(c) A largest and
a smallest value need not exist, so take points whose
values are within of the
supremum and of the infimum. Their gap is within of ,
which also bounds every gap.
(d) False: Example (A supremum that is not attained).
(e) True: pick
any ,
possible since ; then .
(f) True. Write
, , . Bound every value: gives
and , so .
Find a witness, for . If
and , take
with ; then . If and , take with ; then . No other case occurs: forces , so ; and
forces
, so
.
B. Practice
Exercise
(B1)
Let be
non-empty and
bounded below on .
Here is a proof that , with its last
step left out.
For each , and , so .
Say which method this is, then complete
it.
Exercise
(B2: Prove or disprove)
Let be
non-empty and
bounded on . Prove
or disprove each statement; all suprema and infima are
on .
- (a) .
- (b) .
- (c) If and for every
, then .
- (d) .
Solution.
(a) False. On
, and give and
, as in the warning after Theorem 8.3.3.
(b) True. Let
. Bound every value: is or
. So . Other half: and
on
, so rule (a) of
Theorem 8.3.3 gives
and , hence .
(c) False. On
let and , both
positive. Then , but by Example (A supremum that is attained),
with attained at . So .
(d) True. is bounded (above and
below) on , and
rule (e) of Theorem 8.3.3
applied to gives
, that is, .
Exercise
(B3)
Find and
of on
, and say
whether each is attained. Hence
for every real .
Hint: compare with over a common
denominator.
Solution. For every real , , and So for every : every value is
bounded. Witnesses: and are values, each its own witness
for every . Hence and , both attained. The two-sided
bound is by Number Systems: From to , Proposition 4.1.3
(d).
Exercise
(B4: Find the error)
Here is an argument for “ for
bounded above on a non-empty .”
- (i) The inequality
is rule (b) of
Theorem 8.3.3.
- (ii) For , let .
Choose with
and with .
- (iii) Then .
- (iv) So passes
the epsilon test for the values of , and equality
holds.
Is the conclusion true? Which line fails, and
why?
Solution. The conclusion is false:
Exercise (B2: Prove or disprove)
(a) gives ,
on
, with .
Lines (i)–(iii) are correct. Line (iv) fails: the
epsilon test needs an element of the set of values , and with is not of that form. In the counterexample,
and (each a witness for
every )
give , while every value of is . This is the mistake of
pairing a witness for with a different
witness for ,
listed in Example (Method: bound every value, then find a witness).
C. Going deeper
Exercise
(C1: Chapter check: the supremum of a square)
Let be
non-empty and let be bounded on , with for every
. Prove that
.
Solution (Hint 2). For the witness,
aim at and expand ; then
choose from
and
.
Solution. Let .
Since and on ,
for any .
Bound every value. For , , so
by
Number Systems: From to , Proposition 4.1.2
(d), applied with both factors equal. So is bounded above on
by .
Find a witness. Let . If
, then on , so is the constant and any has . Let and put , chosen from and . By Proposition 8.3.2
there is
with .
Case . Then , so by Number Systems: From to , Proposition 2.4.3
(g), and So .
Case . Then , so ,
and .
In every case . By the method, .
The hypothesis is needed: on has , but .
What a complete answer needs. (10
points)
- 2: names and states both halves as the goal (every
; for
every some ).
- 3: proves the bounding half, naming the
nonnegativity of (and of ) as what allows
squaring the inequality.
- 3: chooses the witness tolerance from (and ) before taking the
witness, and verifies .
- 2: handles the cases the choice leaves open (, and or its
equivalent in another route).
A route that writes and bounds
earns the same points for the same steps. A route that
bounds by , using
the least-upper-bound property and squaring non-negative
numbers (Number Systems: From to , Proposition 2.4.3
(g)), earns the 3 + 2 points of the witness bullets for
those steps.
Slips that lose the step (0 points for it): squaring
an inequality between numbers that may be negative; a
witness that does not depend on ; dividing by
without treating
.
Exercise
(C2)
Let ,
, and let
satisfy for all . Here is the first half of a proof that
is bounded and
, all suprema on .
For , , so is bounded. By Proposition 8.3.4,
, so it
suffices to bound this supremum.
Say which method this is, then complete
it.
Solution. The method is the
bounding half of Example (Method: bound every value, then find a witness),
followed by “the supremum is the least upper bound”.
Bound every value. Let . Both lie
between and , so , that is, (Number Systems: From to , Proposition 4.1.3
(d)). Since , So is an upper bound of , and its supremum is at most , since a
supremum is at most every upper bound, (S2). Hence .
(The first half used the triangle inequality, Number Systems: From to , Proposition 4.1.3
(e), and .) The bound can be an equality: has .