Section 4.1 made formulas into objects: strings built
from atoms and
by the clauses of Definition 4.1.1,
and by nothing else. There are infinitely many of them,
and the theorems this chapter is heading for are about
all of them. This section supplies the tool for proving
anything about infinitely many objects at once. It is
induction on the natural numbers, where
it is familiar. Section 4.3 carries it over to formulas,
where the chapter needs it most.
One
argument for infinitely many cases
Here is a claim about every formula: every
formula has as many left parentheses as right ones.
It is believable. The clause (F3) of Definition 4.1.1
adds one of each, and the other clauses add none. But
the claim is about infinitely many strings, and checking
them one by one never ends.
The belief already contains the shape of a proof.
Every formula is reached by finitely many building steps
from atoms and
(clause (F4)). The starting pieces have no parentheses,
so they have equally many of each kind. Each building
step turns formulas that balance into a formula that
balances. So, step by step along any formation sequence,
balance is never lost, and every formula balances.
Exactly the same shape appears with numbers. To show
that some property holds for every natural number, show
that it holds for , and that it passes
from each number to the next. Every natural number is
reached from by
finitely many steps of “add one”, so the property is
never lost. This is induction. We state
it for numbers first, because it is simpler there, then
prove the version for formulas from it.
As in Chapters 1 and 2, “for every ” and “there is
a ” are used in
their everyday sense. As in the rest of the book,
starts at , and
the arithmetic and order of the natural numbers are
school facts.
The
principle of induction
A property of natural numbers is an
open sentence
about a natural number , such as “” or “”: for each
particular it
becomes a statement, true or false (compare the open
sentence
of Example (Statements and nonstatements),
which became a statement once was fixed).
If a property holds for , and passes from each
number to the next, then it holds for every
number.
Axiom
4.2.1 (Principle of Induction)
Let be a
property of natural numbers. Suppose that
- (i) holds, and
- (ii) for
every , if holds, then holds.
Then holds
for every .
In symbols (here abbreviates the
words “for every”):
In words: hypothesis (i) is the base
case. Hypothesis (ii) is the inductive
step, and inside it, the assumption “ holds” is the
induction hypothesis. The step is
one implication, proved
once, for a number about which we assume
nothing except that it is a natural number with . The conclusion is
about every natural number at once.
Its status. We take Axiom 4.2.1
as a basic property of , given and not
proved. It is, in a precise sense, what the three dots
in mean: the natural numbers are what we
reach from by
adding one, again and again, and nothing else. Every
later use cites this principle.
Dominoes. The usual picture is a row
of dominoes, one for each natural number. The base case
knocks over the first. The inductive step says that each
domino, if it falls, knocks over the next. Then every
domino falls. The picture carries the one point that
matters: the step must work for every
, the first
transition from
to included. A
single domino standing too far from the next stops the
whole row, however well the others are placed.
↺Second readingWhy
induction is not a rule of logic
Not an infinite derivation. From
and the
instances , , of the step we could derive by , then
, and so on;
each single
has a finite derivation, lines long or so. But
no finite derivation contains all of them, and “and so
on” is not a rule. The principle of induction is what
licenses the passage, in one step, from the two
hypotheses to “for every ”. It is a rule about
, not a rule of
logic.
The step as a box. In the language
of Chapter 1, the inductive step is proved by a box. We
fix a natural number , knowing nothing about
it except what the step allows, and open a box assuming
; inside the
box we reach ; closing the box gives the implication.
asm, for
–
For now, “let ” means what Chapter 1 made it mean (Section
1.1): one fixed number, not further specified.
Starting from another number. Often
a property is claimed only from some on, as in “for
every ”.
Then it suffices to prove , and, for every
with
, that implies . Indeed, apply
Axiom 4.2.1
to the property : “ holds”. Its base
case is , and its step from
to is the step from
to , where . So holds for every
, and
every natural number is
for the natural number . We call this induction started
at ; it
is Axiom 4.2.1
applied to .
Here is the first proof by induction, with every part
labeled.
Example
(A sum of products of neighbors)
Prove that for every natural number ,
Solution. Let be the displayed
equation. Its left side is the sum of the terms for , so the
left side for
is the left side for plus the one new term
.
Before proving anything, test small cases. For the left side
is , and , and the
right side is , and . The claim is plausible. It
starts at , so
we use induction started at (see above).
Base case. For the left side is the single term , and the
right side is . So holds.
Inductive step. Let with , and suppose
holds (the
induction hypothesis). Then where the first equality is the induction
hypothesis and the second takes out the common factor
,
leaving . The last expression is the
right side of . So implies .
Conclusion. By Axiom 4.2.1,
started at , holds for every
natural number .
Notice where the induction hypothesis entered:
exactly once, to replace the sum of the first terms by a closed
expression. A proof by induction that never uses its
induction hypothesis is either not an induction or is
hiding a gap.
The inductive step of an inequality usually has a
second ingredient besides the hypothesis: a crude
estimate that finishes the job.
Example
(An inequality by induction)
Prove that for every .
Solution. Let be “”.
Base case. , so holds.
Inductive step. Let and suppose
.
Then where the first inequality multiplies the
induction hypothesis by the positive number , and the second uses
, true
because . So
holds.
Conclusion. By Axiom 4.2.1,
for
every .
The estimate throws away a great deal. That is
typical: the step needs only to reach , not to reach it
tightly, and a generous estimate that is obviously true
is better than a sharp one that needs its own proof.
Quick check. For the claim “ is divisible by
for every ”, write down
the base case and the statement of the inductive step,
without proving the step.
Solution. Base case: .
Step: for every , if , then . (It holds, since .)
Warning. The inductive step must
hold for every , including the first
transition. Try to prove “ for every
”: the
base case
holds, and the step looks
fine, but its last inequality holds only for , so the steps
from to , from to and from to are not covered. The
claim survives the first two gaps (at , , and at both sides are
), but it is false
at , where
; it is true again from on.
Strong
induction
Sometimes the step from to is the wrong shape.
The immediate parts of a formula are
shorter than it, but not by exactly one symbol; a
natural number may be best understood through a smaller
one that is not its predecessor. In such cases we want
to assume the property not just for , but for
every smaller number.
If a property holds for whenever it holds for
all smaller numbers, then it holds for every
number.
Theorem
4.2.2 (Strong Induction)
Let be a
property of natural numbers. Suppose that for
every : if holds for
every with , then holds. Then holds for every
.
This form is also called course-of-values
induction: the hypothesis may use the whole
course of values , not just the last one. Its
induction hypothesis is stronger (we assume more), so
its step is easier to prove; the theorem says we lose
nothing by it.
There seems to be no base case. There is one, hidden.
For , the
hypothesis says: if holds for every
with
, then
holds. No
natural number is less than , so “ holds for every
with
” is
vacuously true: for each , the
implication “if , then ” has a false
hypothesis, and an implication with a false hypothesis
holds (Proposition 2.1.2:
from we get ). So at the hypothesis of
the theorem hands us outright. In
practice, the proof of the step usually treats small
separately, and
that is where the base cases live.
Idea. Strong induction is ordinary
induction applied to a stronger property. Let say “ holds for
every ”. Then is exactly the
hypothesis the theorem needs at , since the numbers
below are
those up to ; so
the theorem’s hypothesis moves us from to . Ordinary
induction on does
the rest, and
contains .
Proof. Suppose the hypothesis of
the theorem holds. For , let be the property
“ holds for
every
with ”. We
prove for
every by Axiom 4.2.1.
Base case. No natural number is less than
, so holds for every
with
,
vacuously. By the hypothesis of the theorem at , holds. The only
with
is , so holds.
Inductive step. Let and suppose
. The natural
numbers are exactly those with , since no natural
number lies strictly between and . So says that holds for every
with
, and
the hypothesis of the theorem at gives . A natural
number
satisfies
or , and
holds in both
cases. Hence .
By Axiom 4.2.1,
holds for
every .
Given ,
applied to
gives . This proves the
theorem.
Quick check. In the proof of Theorem 4.2.2,
to which property is Axiom 4.2.1
applied, and why is it not applied to itself?
Solution. To : “ holds for every
with
”. Applied
to itself,
ordinary induction would give us only as induction
hypothesis, while the hypothesis of the theorem at asks for at
every . The property carries exactly that
information from one step to the next.
The first use shows the typical shape: the step
splits into a few small cases, handled directly, and a
general case that reaches back further than one.
Example
(Threes and fives)
Prove that every natural number is a sum of
threes and fives: for some integers .
Solution. Ordinary induction is
awkward here. From we cannot easily reach : we would have to
trade some threes for fives or the other way round, and
there may be none of the kind we want to trade. Going
back three steps is easy instead: if
is a sum of
threes and fives, add one more three. So we use strong
induction.
For ,
let be “if
, then for some
integers ”. Let , and suppose holds for every
with
. We show
.
Case . Then the hypothesis “” of is false, and holds vacuously.
Cases . Directly: , , .
Case . Let . Then , so , and . By the induction hypothesis , there are integers
with
.
Then , with and .
In every case holds. By Theorem 4.2.2,
holds for
every :
every is a
sum of threes and fives.
The three direct cases are the base cases. They are
needed because the general case reaches back three
steps: for , the number is , which is below , and there the
induction hypothesis is vacuous and gives us nothing. The bound
cannot be
lowered: is not a
sum of threes and fives, since neither nor is a multiple
of .
Proving
more to prove less
Sometimes the step will not go through although the
claim is true. The cure is surprising: prove more.
Example
(Prove more to prove less)
For let
Show that for every .
Solution. First try. Let
be “”. The base
case holds: . In the step, , and the hypothesis tells us
nothing more about : a number may exceed ,
and then . From alone we
cannot reach . The hypothesis is too weak to give . The claim is
not to blame; the hypothesis is.
Guess more. , , . Let be “”.
Base case. .
Inductive step. Let and suppose . Then
which is .
Conclusion. By Axiom 4.2.1
started at
(“Starting from another number”), holds for every
, and
gives the claim.
A stronger claim gives the step a stronger hypothesis
to use, and asks the step to deliver more; here it can.
The same need returns with formulas in Section 4.3,
where facts about parentheses are proved together,
because one of them, alone, does not pass through the
step.
Solution. Objects: the natural
numbers. Property: “if , then for some integers ”, with the
restriction inside. Base cases: , the numbers
whose step would reach below (for the property
holds vacuously). Step: for , the hypothesis
for , an
earlier number, and one more . Principle: Theorem 4.2.2.
Exercises
A. Check your
understanding
Exercise
(A1)
- (a) For each
statement, say which kind of induction fits best
(ordinary or strong), and write down its base case(s)
and the statement of its inductive step, without proving
them: (i)
is divisible by
for every ; (ii) every natural number is for some integers
.
- (b) True or false,
with a reason: to apply Theorem 4.2.2,
one must first check separately.
- (c) A proof of
“ for every
” checks
and proves “if
, then ” for every . Which form of Axiom 4.2.1
is this, and why is never needed?
- (d) In Example (Prove more to prove less),
why can “” not serve as the induction hypothesis?
Solution. (a) (i) Ordinary
induction. Base case: is divisible by . Step: for every , if , then
. (It holds because .)
- (ii) Strong
induction, reaching back four: from we get
.
With “if , then for some
integers ”, the step is: for every , if holds for every
, then
. Inside it,
is
vacuous, and the base cases are : , , , . For , and
, and the
hypothesis
is used.
(b) False. At the hypothesis of Theorem 4.2.2
reads “if
holds for every with , then ”, and its “if” part
holds vacuously, since no natural number is less than
. So proving the
hypothesis for every includes proving ; in practice small
are treated as
separate cases inside the step, as in Example (Threes and fives).
(c) Induction started at (“Starting from another
number”): Axiom 4.2.1
applied to :
“ holds”.
The claim is only about , and no step reaches below , so nothing about is ever asked.
(d) It says nothing about how close is to : a number within of
has , so from alone the step cannot reach . The step
would need a bound on how close is to ; the stronger gives
one (and so would ).
Exercise
(A2: Drill)
The parts run from locating the hypothesis, through
writing one base case or one step, to judging claims and
running the checklist.
- (a) In the inductive
step of Example (An inequality by induction),
where is the induction hypothesis used?
- (b) Write down the
base case and the step for “ is even for every
”.
- (c) Ordinary or
strong induction for “every is a product of
one or more primes”?
- (d) Write down for the property
: “” ().
- (e) Write down the
base case for “ for every ” (here ).
- (f) Does checking
, and prove the step “if
, then ”?
- (g) “ is prime”
holds for . Is it true for every ?
- (h) A proof shows
and “if , then ” for every . For which
is proved?
- (i) In Theorem 4.2.2,
what may the step assume when ?
- (j) Run items 1–3 of
the checklist on Example (A sum of products of neighbors).
- (k) In the step for
“
for every ”, . Is the
hypothesis enough to finish the step?
- (l) For “” in Example (Prove more to prove less),
which item of the checklist failed on the first
try?
Solution.
(a) In .
(b) Base: is even.
Step: if is
even, then so is .
(c) Strong: a
composite
with reaches back to and , not to .
(d) .
(e) .
(f) No. The step
is one implication for every ; three checked cases
prove those three cases only.
(g) No: at the value is ,
not a prime. Checked cases are not a proof.
(h) For the even
only.
(i) , and .
(j) Objects: the
natural numbers . Property: the displayed equation for . Base case: , where .
(k) Yes: is a multiple of
by hypothesis,
and so is .
(l) Item 2: the
property was too weak for the step (item 4) to go
through.
B. Practice
Exercise
(B1)
Prove that for every .
Solution. Let be “”.
Base case. , so holds.
Inductive step. Let and suppose
. Then
where the first inequality multiplies the
induction hypothesis by , and the second uses . So holds.
By Axiom 4.2.1,
for
every .
Exercise
(B2: Divisible by six)
Prove by induction that is divisible by
for every . You may use
that is
even for every .
Solution. Let be “”.
Base case. , so holds.
Inductive step. Let and suppose
.
Expanding, By the induction hypothesis, . Since
is even,
for
some integer , and
. A
sum of two multiples of is a multiple of , so holds.
Conclusion. By Axiom 4.2.1,
for
every .
Marking scheme. (6 points)
- 1: states the property .
- 1: base case.
- 3: inductive step: the identity (1), the use of the
induction hypothesis (1), the evenness of (1).
- 1: names the principle.
Exercise
(B3: Two base cases)
A sequence is given by , , and
for .
Prove that for every . Which form of induction do you use, and
why does it need two base cases?
Solution. We use Theorem 4.2.2
with : “”. Let , and suppose
for every
.
Cases . and .
Case . Then and are natural numbers less than , so and hold, and (Check: .)
By Theorem 4.2.2,
for
every .
The step reaches back two places, so it cannot be used
at or , where is not a natural
number: those two are the base cases.
Marking scheme. (6 points)
- 1: names strong induction (or ordinary induction on
“ and ”).
- 2: both base cases.
- 2: the step, with the hypothesis used at and at .
- 1: says why there are two base cases.
C. Going deeper
Exercise
(C1: Find the error)
Claim: for every , “Proof”: suppose it holds for . Then so it holds for ; by induction it holds for every .
- (a) Is the claim
true for any ?
- (b) Which item of
the checklist fails, and which part of the “proof” is
correct?
- (c) Show that the
same step “proves” for every number
. What singles out
?
Solution. (a) No. The true
sum is : that is the case of (c), whose step
is correct, with the base case . The
claimed value is larger by for every .
(b) Item 3: no base case is checked, and at
it fails,
since the left side is and the right side
. The step itself is correct algebra.
(c) For every , so a correct step passes any constant along.
Only the base case decides : at , forces .
Marking scheme. (10 points)
- 3: (a), with the true sum.
- 4: (b), naming the missing base case and endorsing
the step.
- 3: (c).
Fatal error (0 for (b)): calling the step wrong, or
claiming the formula holds at .
Exercise
(C2: Prove more)
Prove that for every , Write
for this product. First show that the hypothesis alone,
with , does not give ;
then prove more.
Solution (Hint 1). Compute the
product for as fractions.
Solution (Hint 2). Write with
denominators and guess a formula for the product; then
prove that formula by induction.
Solution. The plain claim.
The step multiplies by , and the hypothesis
tells us nothing more about : for a number just above , such as , the number is below , so the
hypothesis alone does not give the claim for .
Prove more. , , suggest .
Base case :
. Step: let and suppose .
Then By Axiom 4.2.1
started at , for
every , and
so .
Marking scheme. (10 points)
- 2: argues that the plain claim does not pass through
the step.
- 2: states the stronger claim.
- 2: base case.
- 3: the algebra of the step.
- 1: the conclusion, naming the principle.
Fatal error (0 for the step): “proving” the step from
alone.