1.3  Inequalities for Sums and Products

Bernoulli’s inequality (Sets and Functions, Theorem 3.3.7) compares a power with a linear function: (1+x)n≥1+nx whenever x≥−1. Estimates in analysis keep needing comparisons of this kind, and they usually need a little more than the plain statement gives. This section first sharpens Bernoulli’s inequality to a strict one. It then extends the inequality from a power of one factor to a product of different factors. Finally it uses Bernoulli’s inequality to prove the inequality between the arithmetic and the geometric mean. That last inequality is the tool for bounding a product by a power. The inequality of Cauchy and Schwarz, which bounds a sum of products, waits for vectors in Chapter 9.

1.3.1. Bernoulli’s inequality, sharpened and extended

The proof of Sets and Functions, Theorem 3.3.7 multiplied out (1+nx)(1+x)=1+(n+1)x+nx2 and threw away the term nx2 because it is non-negative. When x≠0 and n≥1, that term is positive, and something is lost by throwing it away. For example, at x=12 and n=2, the power is (32)2=94, while 1+2⋅12=2. Keeping the term gives a strict inequality.

Lemma 1.3.1 (Strict Bernoulli Inequality)

Let x∈R with x≥−1 and x≠0. Then (1+x)n>1+nx for every integer n≥2.

Idea. The induction of Sets and Functions, Theorem 3.3.7 runs again from the base n=2. The term it discarded, nx2, is now strictly positive, and that is where the strictness comes from.

Proof. We use Sets and Functions, Theorem 3.2.1 with base 2. For n=2, (1+x)2=1+2x+x2>1+2x, because x2>0 for x≠0: the square of a nonzero number is positive.

Let n≥2 and suppose (1+x)n>1+nx. Since x≥−1, we have 1+x≥0. Multiplying an inequality by a non-negative number keeps its direction, though perhaps not its strictness. If 1+x>0, multiplying by it keeps the inequality strict. If 1+x=0, both sides become 0. So (1+x)n+1=(1+x)n(1+x)≥(1+nx)(1+x)=1+(n+1)x+nx2>1+(n+1)x, where the last step holds because n>0 and x2>0, so nx2>0. The strictness of the conclusion comes from this last step, not from the hypothesis. This proves the lemma for every n≥2.

Uses: Number Systems: From N to R, Proposition 2.4.3 (c), (e), (h): signs of products and squares. Number Systems: From N to R, Proposition 2.3.2 (b): times zero is zero.

At x=−1 the lemma says 0>1−n, which is true for n≥2: the endpoint is allowed, and the proof used it only through 1+x≥0.

Quick check. Why does the lemma exclude x=0 and n=1?

Solution. Both give equality, so a strict inequality would be false. For x=0: (1+0)n=1=1+n⋅0. For n=1: (1+x)1=1+x=1+1⋅x. (For n=0 both sides are 1 as well.)

Put x=−a with 0≤a≤1. Bernoulli’s inequality becomes (1−a)n≥1−na: a product of n equal factors just below 1 is at least 1 minus the total of what each factor misses. The same holds when the factors differ. For example, (1−0.1)(1−0.2)=0.72, which is at least 1−(0.1+0.2)=0.7.

Proposition 1.3.2 (Products of Factors Below One)

Let n∈N and a1,…,an∈R with 0≤ak≤1 for every k. Then ∏k=1n(1−ak)≥1−∑k=1nak.

Idea. Induct on n, as for Bernoulli: multiply the hypothesis by the next factor 1−an+1, which is non-negative, and throw away the cross term san+1, which is non-negative too.

Proof. We induct on n∈N (Logic and Proof, Axiom 4.2.1). For n=0 the product is empty and the sum is empty, so the claim reads 1≥1−0.

Suppose the claim holds for n, and let a1,…,an+1∈[0,1]. Write s:=∑k=1nak. Every ak≥0, so s is at least the sum of n zeros, that is, s≥0. Since an+1≤1, the factor 1−an+1 is non-negative. Multiplying the hypothesis ∏k=1n(1−ak)≥1−s by it keeps the direction: by Number Systems: From N to R, Proposition 2.4.3 (c) if the factor is positive, and both sides become 0 if it is 0. Splitting off the last factor of the product, we get ∏k=1n+1(1−ak)≥(1−s)(1−an+1)=1−s−an+1+san+1≥1−(s+an+1)=1−∑k=1n+1ak, where the second inequality drops san+1≥0, a product of two non-negative numbers. This is the claim for n+1.

Uses: Proposition 1.1.5 (a): sums respect order. Number Systems: From N to R, Proposition 2.4.3 (c): multiplying by a positive. Number Systems: From N to R, Proposition 2.3.2 (b): times zero is zero. Sets and Functions, Definition 3.3.1: empty and last factor.

With all ak equal to a, the proposition is Bernoulli’s inequality at x=−a. It is useful when the ak are small and their sum is under control, for then the product stays close to 1. The analysis volumes use it to study infinite products, products of infinitely many factors 1−ak.

Quick check. Bound 0.99⋅0.98⋅0.97⋅0.96 from below by the proposition.

Solution. Take a1=0.01, a2=0.02, a3=0.03, a4=0.04, all in [0,1]. Their sum is 0.10, so the product is at least 1−0.10=0.90. Multiplying out gives about 0.9035, so the bound loses very little.

1.3.2. The arithmetic and geometric means

A rectangle with perimeter 4 has sides a and b with a+b=2. Its area ab is at most 1, the area of the square with the same perimeter. In general, for real a,b, (a+b2)2−ab=a2+2ab+b2−4ab4=(a−b2)2≥0, so ab≤(a+b2)2, with equality exactly when a=b. A product of two numbers is at most the square of their average.

For three numbers we would like abc≤(a+b+c3)3, and for n numbers the analogous statement. A single square no longer does the job: the difference of the two sides is not a square of anything simple. Still, it holds in examples: the numbers 1,2,6 have average 3, and 1⋅2⋅6=12≤27=33. We need a proof that handles every n at once.

A product is at most the matching power of the average. In plain words: if n numbers are non-negative, their product is at most their average raised to the power n.

Theorem 1.3.3 (Arithmetic and Geometric Means)

Let n≥1 be an integer, let a1,…,an∈R with ak≥0 for every k, and let A:=1n∑k=1nak.

  • (a) a1a2⋯an≤An.
  • (b) Equality holds in (a) if and only if a1=a2=⋯=an.

The number A is the arithmetic mean of a1,…,an. The geometric mean is the non-negative number whose n-th power is the product a1⋯an. Once n-th roots are available (Section 1.5), (a) says that the geometric mean is at most the arithmetic mean.

Try it first (ten minutes): prove (a) for n=3, or explain what goes wrong when you add a third number to the case n=2.

Idea (Scratch work). The natural attempt is induction on n. Write Am:=1m∑k=1mak for the mean of the first m numbers, and suppose a1⋯an≤Ann. Multiplying by an+1≥0 gives a1⋯an+1≤Annan+1. To finish we would need Annan+1≤An+1n+1, a comparison between means of different lengths. This is where the attempt stalls: nothing in the hypothesis speaks about An+1.

Suppose for now that every ak>0, so that An>0, and divide the missing inequality by Ann+1. It becomes (An+1An)n+1≥an+1An, a power on the left and something linear on the right: the shape of Bernoulli’s inequality. So set x:=An+1An−1, which makes the left side (1+x)n+1. Since (n+1)An+1=nAn+an+1, (n+1)x=(n+1)An+1−(n+1)AnAn=an+1−AnAn, so 1+(n+1)x=an+1An, exactly the right side. Bernoulli closes the gap.

We know We want
every ak>0; a1⋯an≤Ann a1⋯an+1≤An+1n+1
multiply by an+1>0: a1⋯an+1≤Annan+1 enough: Annan+1≤An+1n+1
x:=An+1/An−1>−1; Bernoulli with exponent n+1 (1+x)n+1≥1+(n+1)x=an+1/An: the gap closes

Zeros are handled first and separately: a zero factor makes the product 0.

Before reading on: where will x>−1 be needed, and why is it true?

Proof.

  • (a) If aj=0 for some j, the product a1⋯an is 0. Also A≥0, since the sum of the ak is non-negative and 1n>0. So An≥0. If A>0, this holds because every power of a positive number is positive. If A=0, it holds because 0n=0 for n≥1. Hence a1⋯an=0≤An.

    It remains to treat lists of positive numbers. For m≥1 let Am:=1m∑k=1mak. We prove by induction from base 1 (Sets and Functions, Theorem 3.2.1) that a1⋯an≤Ann for every integer n≥1 and all positive a1,…,an. For n=1, a1=A1.

    Let n≥1, suppose the claim for n, and let a1,…,an+1>0. Then An>0 and An+1>0, as means of positive numbers. Put x:=An+1/An−1. Then 1+x=An+1/An>0, so x>−1, and from (n+1)An+1=nAn+an+1 we get 1+(n+1)x=an+1/An. By Sets and Functions, Theorem 3.3.7 with exponent n+1, (An+1An)n+1≥an+1An. Multiply both sides by Ann+1, which is positive because An>0. Multiplying by a positive number keeps the inequality: a strict inequality stays strict, and an equality stays an equality. The power laws give (An+1/An)n+1Ann+1=An+1n+1 and Ann+1⋅an+1/An=Annan+1. So the inequality becomes An+1n+1≥Annan+1. Multiplying the induction hypothesis by an+1>0 gives the other half, and together a1⋯anan+1≤Annan+1≤An+1n+1. This is the claim for n+1, and (a) is proved.

  • (b) (⇐) If every ak equals a, then A=1n(na)=a, and both sides of (a) are an.

(⇒) We prove the contrapositive: if the ak are not all equal, then a1⋯an<An. With a zero among them this is immediate. For positive numbers, the induction of (a) runs again, with the strict Bernoulli inequality (Lemma 1.3.1) in place of Bernoulli’s inequality. In the step there are two cases. If the first n numbers are not all equal, the induction hypothesis is strict. If they are all equal to An, the new number differs from An, and the strict Bernoulli inequality applies.

Uses: Proposition 1.1.5 (a): sums respect order. Sets and Functions, Proposition 3.3.4 (e): powers of positives. Number Systems: From N to R, Proposition 2.4.3 (c), (h): multiplying by a positive; m>0. Number Systems: From N to R, Proposition 3.2.2 (a): 1m>0. Proposition 1.1.1 (a), (c): power laws.

Second readingThe equality case of the means

Suppose a1,…,an≥0 are not all equal; we show a1⋯an<An.

If some aj=0, then some ai≠0, since the numbers are not all equal; so ai>0. The sum of the ak is then positive, because one term is positive and none is negative. So A>0, and An>0=a1⋯an.

If every ak>0, we use induction from base 2 (Sets and Functions, Theorem 3.2.1). The claim for n≥2 is: for all positive a1,…,an that are not all equal, a1⋯an<Ann. (For n=1 there is nothing to prove: one number is always “all equal”.) For n=2, a1≠a2, and the computation before the theorem gives A22−a1a2=(a1−a22)2>0, since the square of a nonzero number is positive.

Let n≥2, suppose the claim for n, and let a1,…,an+1>0 be not all equal. The proof of (a) gave the chain a1⋯anan+1≤Annan+1≤An+1n+1, and it is enough to make one of its two inequalities strict.

Case 1: a1,…,an are not all equal. By the induction hypothesis a1⋯an<Ann, and multiplying by an+1>0 keeps it strict. The left inequality is strict.

Case 2: a1=⋯=an. Then each of them equals An, so an+1≠An, since otherwise all n+1 numbers would be equal. Hence (n+1)x=(an+1−An)/An≠0, so x≠0; also x>−1 and n+1≥2. So Lemma 1.3.1 gives (1+x)n+1>1+(n+1)x, and multiplying by Ann+1>0 as in (a) makes the right inequality strict.

In both cases a1⋯an+1<An+1n+1, which is the claim for n+1.

Uses: Proposition 1.1.5 (a): sums respect order. Sets and Functions, Proposition 3.3.4 (e): powers of positives. Number Systems: From N to R, Proposition 2.4.3 (c), (e): signs of products and squares.

The one real step of the proof is the right inequality of the displayed chain, and that step is Bernoulli’s inequality after the substitution found in the scratch work. The left inequality is only the induction hypothesis multiplied by an+1.

Example (Method: bound a product by a power)

How it goes. To bound a product of non-negative factors from above, arrange the factors so that their sum is known, or at least bounded. Then apply Theorem 1.3.3: the product is at most the n-th power of their mean. For a strict inequality, check that the factors are not all equal.

When to use it. Products such as n!, x(1−x) or (1+1n)n; and any problem that asks for the largest product under a condition on the sum.

Common mistakes. One mistake is to apply the theorem to factors that may be negative, where it is false. Another is to choose factors whose sum is not under control. That gives a bound that grows faster than the product.

The first example bounds a factorial. Its factors 1,2,…,n have a sum we know.

Example (A bound for n factorial)

Show that n!≤(n+12)n for every integer n≥1, with equality only for n=1.

Solution. Apply Theorem 1.3.3 to the n numbers 1,2,…,n, all non-negative. Their sum is n(n+1)2 (Sets and Functions, Proposition 3.3.5), so their mean is n+12, and part (a) gives n!=1⋅2⋯n≤(n+12)n.

By part (b), equality holds exactly when the factors 1,…,n are all equal. For n=1 there is one factor, and indeed 1!=1=11. For n≥2 the factors 1 and 2 differ, so the inequality is strict; at n=2 it reads 2<94.

The bound is crude, but it beats the obvious one, n!≤nn, by a lot: for n≥2, n+12n≤34, so (n+12)n≤(34)nnn.

The second example chooses the factors with more care. The sequence (1+1n)n begins 2,94,6427,…, and it seems to increase. Its terms are powers, and a power is a product of equal factors; the trick is to add one more factor that brings the length up to n+1.

Example (The compound-interest sequence increases)

Show that (1+1n)n<(1+1n+1)n+1 for every integer n≥1.

Solution. Apply Theorem 1.3.3 to the n+1 positive numbers 1+1n,…,1+1n⏟n times,1. Their product is (1+1n)n⋅1. Their sum is n(1+1n)+1=n+2, so their mean is n+2n+1=1+1n+1. They are not all equal, since 1+1n≠1. So part (b) makes part (a) strict: (1+1n)n<(1+1n+1)n+1.

The extra factor 1 changes the product not at all and raises the length by one. That is what makes the mean of length n+1 come out as the next term. The sequence is increasing; the exercises of Section 1.5 show that it is bounded above by 3, and Analysis on the Real Line, Chapter 4 proves that it converges.

Warning. The theorem needs every ak≥0. For the three numbers −1,−1,1, the product is 1, the mean is −13, and A3=−127<1. An even number of negative factors can make the product large while the mean stays small.

Quick check. Which numbers does the method use to show that x(2−x)≤1 for 0≤x≤2? When is the inequality an equality?

Solution. The two numbers x and 2−x, both non-negative on [0,2]. Their sum is 2 and their mean 1, so x(2−x)≤12=1. Equality holds exactly when x=2−x, that is, at x=1.

Remark (Looking ahead). Chapter 9 proves the Cauchy–Schwarz inequality, which bounds a sum of products ∑akbk by the sums of squares.

1.3.3. Exercises

A. Check your understanding

Exercise (A1)

These parts are about the proof of Theorem 1.3.3.

  • (a) In the induction step, what is x, and which fact gives x>−1?
  • (b) Which step uses that every ak>0, and not just ak≥0?
  • (c) Run the step from n=1 to n=2 with a1=1 and a2=4: compute A1, A2 and x, and the three members of the chain a1a2≤A1a2≤A22.
  • (d) True or false: abc≤(a+b+c3)3 for all real a,b,c.

Solution.

  • (a) x=An+1/An−1. Then 1+x=An+1/An, a quotient of two positive numbers, since An+1 and An are means of positive numbers. So 1+x>0, that is, x>−1, which is the hypothesis of Bernoulli’s inequality.

  • (b) The definition of x divides by An, which needs An≠0. With zeros allowed, An could be 0 (take a1=⋯=an=0). That is why lists with a zero were handled first, by a separate argument.

  • (c) A1=1, A2=52, x=52−1=32. The chain reads a1a2=4≤A1a2=4≤A22=254. The left inequality is an equality here, since the hypothesis a1≤A1 is one; Bernoulli gives (52)2≥1+2⋅32=4=a2/A1.

  • (d) False. For a=b=−1, c=1: abc=1, while (−13)3=−127. The theorem needs non-negative numbers.

B. Practice

Exercise (B1: Apply the means)

Let a,b,c>0. Prove that (a+b)(b+c)(c+a)≥8abc.

Solution. By Theorem 1.3.3 with n=2, ab≤(a+b2)2, that is, 4ab≤(a+b)2. In the same way 4bc≤(b+c)2 and 4ca≤(c+a)2. All six sides are non-negative, so multiplying the three inequalities (Number Systems: From N to R, Proposition 4.1.2 (d), twice) gives 64a2b2c2≤(a+b)2(b+c)2(c+a)2, that is, (8abc)2≤P2 with P:=(a+b)(b+c)(c+a). Both 8abc and P are positive. If P<8abc, then P2<(8abc)2 by Number Systems: From N to R, Proposition 2.4.3 (g), a contradiction. Hence P≥8abc.

Exercise (B2: Prove or disprove)

Prove or disprove each statement.

  • (a) xy+yx≥2 for all real x,y>0.
  • (b) ∏k=1n(1−ak)≤1−∑k=1nak for every n∈N and all a1,…,an∈[0,1].
  • (c) (1+x)3≥1+3x+3x2 for every real x≥−1.
  • (d) abcd≤(a+b+c+d4)4 for all real a,b,c,d≥0.

Solution.

  • (a) True. Both x/y and y/x are positive and their product is 1, so Theorem 1.3.3 with n=2 gives 1≤u2 for u:=x/y+y/x2>0. If u<1, then u2<1 by Number Systems: From N to R, Proposition 2.4.3 (g), a contradiction; so u≥1, that is, x/y+y/x≥2. Directly: xy+yx−2=x2+y2−2xyxy=(x−y)2xy≥0, a square divided by a positive number.

  • (b) False. Take n=2 and a1=a2=12: the product is 14, the right side is 1−1=0, and 14>0. (Proposition 1.3.2 gives the opposite inequality.)

  • (c) False. Take x=−1: the left side is 0, the right side is 1−3+3=1. In general (1+x)3=1+3x+3x2+x3, so the claim holds exactly when x3≥0, that is, for x≥0.

  • (d) True: this is Theorem 1.3.3 (a) with n=4.

Exercise (B3: A product near one)

Show that ∏k=110(1−k100)≥0.45.

Solution. Put ak:=k100 for 1≤k≤10; each lies in [0,1]. By Sets and Functions, Proposition 3.3.5, ∑k=110k=55, so ∑k=110ak=55100. By Proposition 1.3.2 the product is at least 1−0.55=0.45.

C. Going deeper

Exercise (C1: Find the error)

Here is an argument for part (a) of Theorem 1.3.3 when all ak>0. Write Am for the mean of a1,…,am.

We induct on n. For n=1, a1=A1. Suppose a1⋯an≤Ann for all positive a1,…,an, and let a1,…,an+1>0. Multiplying the hypothesis by an+1>0 gives a1⋯an+1≤Annan+1. Adding a number to a list never lowers its mean, so An≤An+1; and the new number is at most the new mean, so an+1≤An+1. Hence Annan+1≤An+1nAn+1=An+1n+1, and a1⋯an+1≤An+1n+1.

Is the conclusion true? Does the argument prove it? If not, name the line that fails and give a counterexample to that line.

Solution. The conclusion is true: it is Theorem 1.3.3 (a). The argument does not prove it.

The base case and the multiplication by an+1 are correct. The line that fails is the claim that An≤An+1 and an+1≤An+1. Each half is false in general:

  • for a=(2,1): A1=2>A2=32, so adding a number can lower the mean;
  • for a=(1,2): a2=2>A2=32, so the new number can exceed the new mean.

In fact the two halves can hold together only in the dull case. Since (n+1)An+1=nAn+an+1, the new mean lies between An and an+1, so if both are at most An+1, then An=an+1=An+1. These are counterexamples to the step, not to the claim, which has none. The proof of Theorem 1.3.3 closes the same gap with Bernoulli’s inequality.

What a complete answer needs. (10 points)

  • 3: says that the conclusion is true (citing Theorem 1.3.3 or equivalent) and that the argument nevertheless fails.
  • 3: names either half of the line “An≤An+1 and an+1≤An+1” (or the whole line) as the failing step, without blaming the base case or the multiplication by an+1.
  • 4: gives a concrete list on which that line fails (one list for either half earns the points).

Slips that lose the step (0 for the step): calling the conclusion false; offering a “counterexample” to the conclusion; blaming the multiplication by an+1.