1.7  Sums and Direct Sums

We can now measure a single subspace: take a basis and count. This section asks how two or more subspaces combine. The intersection of two subspaces is again a subspace, but the union usually is not, so we need a better way to join them. The answer is the sum U+W. We then prove the dimension formula for sums and single out the best case, the direct sum, in which every vector splits into pieces in exactly one way.

1.7.1. The sum of subspaces

Recall from Theorem 1.2.2 that U∩W is a subspace whenever U and W are. It is the largest subspace inside both. The natural companion would be the smallest subspace containing both, and the first guess is the union U∪W.

That guess fails. In R2, let U be the x-axis and W the y-axis. Then (1,0)∈U and (0,1)∈W, but their sum (1,1) lies on neither axis, so U∪W is not closed under addition (Example (The Union of the Two Axes)). In fact Proposition 1.2.3 shows that U∪W is a subspace only in the dull case U⊆W or W⊆U.

The failure tells us what is missing. Any subspace containing U and W must contain u+w for every u∈U and w∈W, because subspaces are closed under addition. So we put all these sums in from the start.

The sum of two subspaces is everything you can reach by adding one vector from each.

Definition 1.7.1 (Sum of Subspaces)

Let V be a vector space over F, and let U and W be subspaces of V. The sum of U and W is the subset U+W:={u+w:u∈U and w∈W}. More generally, for subspaces U1,…,Uk of V (with k≥1), their sum is U1+⋯+Uk:={u1+⋯+uk:ui∈Ui for each i=1,…,k}.

In words: a vector v lies in U+W when there exist some u∈U and some w∈W with v=u+w. The definition asks for one such pair. It does not say the pair is unique, and in general it is not. For k subspaces we pick one vector from each Ui and add them. We also write ∑i=1kUi, and for k=1 the sum is just U1.

Here are some first examples.

  • The two axes. In R2, with U the x-axis and W the y-axis, every (a,b) equals (a,0)+(0,b), so U+W=R2. The union is two lines; the sum is the whole plane.
  • Two planes in R3. Let Pxy={(x,y,0)} and Pyz={(0,y,z)}. Every (a,b,c)=(a,b,0)+(0,0,c) is a sum of a vector in Pxy and one in Pyz, so Pxy+Pyz=R3.
  • Polynomials. In F[x]≤2, let U be the constant polynomials and W={bx+cx2:b,c∈F}. Then a+bx+cx2=a+(bx+cx2), so U+W=F[x]≤2.
  • Matrices. In M2(F), the upper triangular matrices plus the lower triangular matrices give everything: (abcd)=(ab0d)+(00c0).
  • Degenerate cases. For any subspace U, we have U+{0}=U and U+U=U. In both, “⊇” holds because u=u+0, and “⊆” holds because U is closed under addition. So adding a subspace to itself produces nothing new: a sum is not a count.

Nonexample by minimal change. The definition makes sense for any two subsets S,T⊆V, but the result need not be a subspace. Take S={(1,0)} and T={(0,1)} in R2. Then S+T={(1,1)}, which does not contain 0. What changed is that S and T are not subspaces: the hypothesis “subspace” is exactly what makes the next theorem work.

Warning. The sum U+W is not the union U∪W. A vector of U+W need not lie in U or in W: (1,1) lies in the sum of the two axes but on neither axis. Conversely, U+W is usually far bigger than U∪W.

The sum does what we built it to do.

Theorem 1.7.1 (Sum of Subspaces Theorem)

Let U1,…,Uk be subspaces of a vector space V. Then U1+⋯+Uk is a subspace of V that contains each Ui. Moreover, if X is any subspace of V containing every Ui, then U1+⋯+Uk⊆X. In other words, U1+⋯+Uk is the smallest subspace of V containing U1,…,Uk.

Proof. Write S=U1+⋯+Uk. We apply the Subspace Test (Theorem 1.2.1).

  1. Each Ui contains 0, so 0=0+⋯+0∈S.

  2. Let u1+⋯+uk and u1′+⋯+uk′ be in S, with ui,ui′∈Ui. Regrouping with (VS1) and (VS2), (u1+⋯+uk)+(u1′+⋯+uk′)=(u1+u1′)+⋯+(uk+uk′), and ui+ui′∈Ui because Ui is closed under addition. Hence S is closed under addition.

  3. Let c∈F. By the distributive axiom, c(u1+⋯+uk)=cu1+⋯+cuk, and cui∈Ui because Ui is closed under scaling. Hence S is closed under scalar multiplication.

Therefore S is a subspace. It contains Uj: for u∈Uj, take uj=u and ui=0∈Ui for i≠j. Finally, let X be a subspace containing every Ui. An element u1+⋯+uk of S is a sum of vectors ui∈Ui⊆X, so it lies in X since X is closed under addition. This shows S⊆X.

So the sum plays the role that the union could not. It is the subspace analogue of span, and the two notions fit together exactly. Recall from Theorem 1.3.1 that span(S) is the smallest subspace containing S.

Proposition 1.7.2 (Sum of Spans)

Let L1,…,Lk be finite lists of vectors in V, and let L be the list obtained by writing L1,…,Lk one after another. Then span(L1)+⋯+span(Lk)=span(L).

Proof. (⊆) The subspace span(L) contains every vector of each Li, so by Theorem 1.3.1 it contains each span(Li). By Theorem 1.7.1 it therefore contains span(L1)+⋯+span(Lk).

(⊇) The sum span(L1)+⋯+span(Lk) is a subspace by Theorem 1.7.1, and it contains each span(Li), hence every vector of L. By Theorem 1.3.1 it contains span(L).

In practice this means: to find a spanning list of a sum, concatenate spanning lists of the summands. That list may be dependent, and the dimension formula below tells us by how much.

Quick check. In R3, what is span((1,0,0))+span((0,1,0))? Is it equal to span((1,0,0))∪span((0,1,0))?

Solution. By Proposition 1.7.2 the sum is span((1,0,0),(0,1,0))={(a,b,0):a,b∈R}, the xy-plane. It is not the union: (1,1,0) lies in the plane but on neither axis.

1.7.2. The dimension formula

If U and W are finite-dimensional, how big is U+W? Concatenating a basis of U and a basis of W gives a spanning list of U+W of length dim⁡U+dim⁡W (Proposition 1.7.2). That count is too large when U and W overlap. For the two planes Pxy and Pyz in R3, it would give 2+2=4, but Pxy+Pyz=R3 has dimension 3. The overlap is the y-axis, of dimension 1, and it has been counted twice. The theorem says this is the whole story.

Theorem 1.7.3 (Dimension Formula for Sums)

Let U and W be finite-dimensional subspaces of a vector space V. Then U+W is finite-dimensional, and dim⁡(U+W)=dim⁡U+dim⁡W−dim⁡(U∩W).

The picture behind the proof is the inclusion diagram. The smallest space, U∩W, sits inside both U and W, and both sit inside U+W. We build bases from the bottom up.

Diagram. Labels: basis\\elem v_1, dots , elem v_r, basis elem v_1, dots , elem v_r, elem u_1, dots , elem u_s, basis elem v_1, dots , elem v_r, elem w_1, dots , elem w_t, Big Claim: basis\\elem v's, elem u's and elem w's, U cap W, U, W, U + W, each arrow is an inclusion subseteq

Idea. This is a dimension formula, so we start from the smallest space and extend outward.

① Take a basis (v1,…,vr) of U∩W. ② Extend it to a basis of U by adding u1,…,us, and separately to a basis of W by adding w1,…,wt. ③ Big Claim: the combined list of all r+s+t vectors is a basis of U+W. Spanning is easy. For independence, move the w-part to the other side: the common vector lies in U and in W, hence in U∩W, where the v’s are a basis. ④ Count: r+s+t=(r+s)+(r+t)−r.

Proof. Step 1: bases. By Theorem 1.2.2, U∩W is a subspace of V; it lies inside U and uses the same operations, so it is also a subspace of U. Since U is finite-dimensional, so is U∩W (Theorem 1.6.7), and it has a basis (v1,…,vr), where r=dim⁡(U∩W) (Corollary 1.5.5). This list is independent and lies in U, so by the Basis Extension Theorem (Theorem 1.6.5) there are vectors u1,…,us∈U such that (v1,…,vr,u1,…,us) is a basis of U. In the same way, since the list also lies in W, there are w1,…,wt∈W such that (v1,…,vr,w1,…,wt) is a basis of W. Thus dim⁡U=r+s and dim⁡W=r+t.

Step 2: the Big Claim.

Claim. The list B=(v1,…,vr,u1,…,us,w1,…,wt) is a basis of U+W.

Proof. Spanning. By Proposition 1.7.2, U+W=span(v1,…,vr,u1,…,us)+span(v1,…,vr,w1,…,wt) is the span of the concatenated list. That list contains each vi twice; removing the second copies does not change the span, since every removed vector already lies in the span of what remains (Theorem 1.3.5). Hence B spans U+W.

Independence. Let ai,bj,ck∈F satisfy a1v1+⋯+arvr+b1u1+⋯+bsus+c1w1+⋯+ctwt=0. Move the w-part across and name the common vector: x:=a1v1+⋯+arvr+b1u1+⋯+bsus=−c1w1−⋯−ctwt. The middle expression lies in U, because all the vi and uj do. The right-hand expression lies in W, because all the wk do. Hence x∈U∩W. Since (v1,…,vr) spans U∩W, there are d1,…,dr∈F with x=d1v1+⋯+drvr. Comparing with the right-hand expression for x, d1v1+⋯+drvr+c1w1+⋯+ctwt=0. This is a combination of the basis (v1,…,vr,w1,…,wt) of W, which is independent, so all di=0 and all ck=0. Putting c1=⋯=ct=0 into the original equation leaves a1v1+⋯+arvr+b1u1+⋯+bsus=0, a combination of the basis (v1,…,vr,u1,…,us) of U. By its independence, all ai=0 and all bj=0. Hence B is linearly independent (Definition 1.4.1).

Step 3: count. By the claim, U+W has a finite basis of length r+s+t, so it is finite-dimensional with dim⁡(U+W)=r+s+t (Definition 1.6.1). Therefore dim⁡(U+W)=r+s+t=(r+s)+(r+t)−r=dim⁡U+dim⁡W−dim⁡(U∩W), as claimed.

The proof also works when some of r,s,t are 0: an empty list is independent and spans {0}, and every step reads correctly with empty sums. The move “basis of the smallest space, extend, Big Claim, count” is worth learning as a unit. It proves Rank–Nullity in Chapter 2 with the same four blocks.

The formula is often used to find one of the four numbers from the other three. Here are two uses, one by counting and one by computing.

Example (Two planes in R3)

Let U={(x,y,z)∈R3:x+y+z=0} and W={(x,y,z)∈R3:x=z}. Show that U+W=R3, and find a basis of R3 of the shape used in the proof.

Solution. Solving x+y+z=0 for y, every vector of U is (x,−x−z,z)=x(1,−1,0)+z(0,−1,1). The two vectors are independent (look at the first and third entries), so dim⁡U=2. Similarly every vector of W is (x,y,x)=x(1,0,1)+y(0,1,0), and dim⁡W=2.

A vector lies in U∩W when x=z and x+y+z=0, that is, y=−2x. So U∩W={(x,−2x,x)}=span((1,−2,1)), which has dimension 1. By the dimension formula, dim⁡(U+W)=2+2−1=3=dim⁡R3. Since U+W⊆R3 and the dimensions agree, U+W=R3 by Theorem 1.6.8.

Following the proof: (1,−2,1) extends to a basis of U by (1,−1,0)∈U. Indeed (1,−1,0) is not a multiple (c,−2c,c) of (1,−2,1), since its first and third entries differ, so the list ((1,−2,1),(1,−1,0)) is independent by Lemma 1.5.3; it has length 2=dim⁡U, so it is a basis of U (Theorem 1.6.4). It extends to a basis of W by (0,1,0)∈W, for the same reason: a multiple of (1,−2,1) with first entry 0 is 0. The Big Claim says ((1,−2,1),(1,−1,0),(0,1,0)) is a basis of U+W=R3.

Example (Two planes in R4 from spanning lists)

Let U=span((1,1,0,0),(0,0,1,1)) and W=span((1,0,1,0),(0,1,0,1)) in R4. Find dim⁡(U∩W) and dim⁡(U+W), and hence a basis of U+W.

Solution. Each spanning list is independent: in a(1,1,0,0)+b(0,0,1,1)=(a,a,b,b)=0, both a and b are 0, and similarly c(1,0,1,0)+d(0,1,0,1)=(c,d,c,d). So dim⁡U=dim⁡W=2.

A vector lies in U∩W exactly when it can be written in both forms, (a,a,b,b)=(c,d,c,d). Comparing entries gives a=c, a=d, b=c, b=d, so a=b=c=d. Hence U∩W=span((1,1,1,1)) and dim⁡(U∩W)=1. By the dimension formula, dim⁡(U+W)=2+2−1=3.

For a basis, follow the proof. The vector (1,1,1,1) together with (1,1,0,0) is a list in U, and it is independent by Lemma 1.5.3, because a multiple (c,c,c,c) of (1,1,1,1) never equals (1,1,0,0). It has length 2=dim⁡U, hence it is a basis of U (Theorem 1.6.4). Likewise ((1,1,1,1),(1,0,1,0)) is a basis of W. By the Big Claim, ((1,1,1,1),(1,1,0,0),(1,0,1,0)) is a basis of U+W. In particular U+W≠R4.

1.7.3. Direct sums

In a basis, every vector has exactly one expression as a combination (Theorem 1.5.1). Read that for Fn with the standard basis: Fn=span(e1)+⋯+span(en), and each vector splits into pieces from these lines in exactly one way. We want the same property for subspaces that are not lines.

Sums do not always have it. In R3=Pxy+Pyz, (1,1,1)=(1,1,0)+(0,0,1)=(1,0,0)+(0,1,1), two different splittings, because the planes share the y-axis and the y-component can be handed to either side. If we replace Pyz by the z-axis Z, then (a,b,c)=(a,b,0)+(0,0,c) is the only splitting, since the Z-piece must have first two entries 0. We give this situation a name.

A sum is direct when every vector in it breaks into one piece from each subspace in exactly one way.

Definition 1.7.2 (Direct Sum)

Let U1,…,Uk be subspaces of a vector space V over F. The sum U1+⋯+Uk is direct if every vector v∈U1+⋯+Uk can be written in exactly one way as v=u1+⋯+ukwith ui∈Ui for each i. In that case we write the sum as U1⊕⋯⊕Uk. We write V=U1⊕⋯⊕Uk to mean that V=U1+⋯+Uk and the sum is direct.

In words: existence of a splitting is automatic, since that is what membership in the sum means. The content of “direct” is uniqueness: if u1+⋯+uk=u1′+⋯+uk′ with ui,ui′∈Ui, then ui=ui′ for every i. The symbol ⊕ does not build a new space. It is the same subspace U1+⋯+Uk, with a property recorded in the notation. (Chapter 4 builds an “external” direct sum out of spaces that do not sit inside a common V.)

Examples.

  • Standard basis. Fn=span(e1)⊕⋯⊕span(en). More generally, if (v1,…,vn) is a basis of V, then V=span(v1)⊕⋯⊕span(vn). A splitting v=a1v1+⋯+anvn is a choice of coefficients, and Theorem 1.5.1 says there is exactly one.
  • Two splittings of the plane. Let X be the x-axis, Y the y-axis, and D={(t,t):t∈R} the line y=x. Then R2=X⊕Y, with (a,b)=(a,0)+(0,b) the only splitting. Also R2=X⊕D: if (a,b)=(s,0)+(t,t), the second entry forces t=b, and then the first forces s=a−b. So (a,b)=(a−b,0)+(b,b), and there is no other choice.
  • Polynomials. F[x]≤2=span(1)⊕span(x,x2). If a+bx+cx2=a′+(b′x+c′x2), comparing coefficients gives a=a′, b=b′, c=c′.
  • Degenerate. U⊕{0}=U for every subspace U: the only possible {0}-piece is 0, so the U-piece of v must be v.

Nonexample by minimal change. Replace the z-axis in R3=Pxy⊕Z by the plane Pyz. The sum is still all of R3, so existence still holds. What fails is uniqueness, as the two splittings of (1,1,1) above show. So R3=Pxy+Pyz, but the sum is not direct. Likewise upper plus lower triangular 2×2 matrices give M2(F), but a diagonal matrix can be put in either summand, so that sum is not direct.

Checking uniqueness for every vector looks like a lot of work. For two subspaces it reduces to one condition you can check in a line.

Theorem 1.7.4 (Direct Sum Criteria for Two Subspaces)

Let U and W be subspaces of a vector space V. The following are equivalent:

  • (a) the sum U+W is direct;
  • (b) U∩W={0}.

If moreover U and W are finite-dimensional, they are also equivalent to

  • (c) dim⁡(U+W)=dim⁡U+dim⁡W.

Idea. Uniqueness questions go through differences. If u+w=u′+w′, then u−u′=w′−w is a single vector lying in both U and W. So “no overlap” is exactly “no freedom in splitting”. For (c), the dimension formula says the overcount dim⁡U+dim⁡W−dim⁡(U+W) is dim⁡(U∩W), which is 0 exactly when U∩W={0}.

Proof.

  • (a) ⇒ (b). Suppose the sum is direct and let v∈U∩W. Then v=v+0 with v∈U, 0∈W, and v=0+v with 0∈U, v∈W. These are two splittings of v∈U+W, so by uniqueness their U-pieces agree: v=0. Hence U∩W={0}.

  • (b) ⇒ (a). Suppose U∩W={0}, and let u+w=u′+w′ with u,u′∈U and w,w′∈W. Then u−u′=w′−w. The left side lies in U and the right side in W, since both are subspaces. So this common vector lies in U∩W={0}, which gives u=u′ and w=w′. Hence every vector of U+W has only one splitting.

  • (c) ⇔ (c). Now let U and W be finite-dimensional. By the dimension formula (Theorem 1.7.3), (c) holds if and only if dim⁡(U∩W)=0. A space has dimension 0 exactly when the empty list is a basis of it, that is, when it equals the span of the empty list, which is {0}. So (c) holds if and only if U∩W={0}.

This is the everyday test: to show V=U⊕W, show V=U+W and U∩W={0}. In finite dimension there is a shortcut that avoids checking V=U+W at all: if U∩W={0} and dim⁡U+dim⁡W=dim⁡V, then dim⁡(U+W)=dim⁡V by (c), so U+W=V by Theorem 1.6.8. Count instead of check.

Example (A plane and a line in R3)

Let U={(x,y,z)∈R3:x+y+z=0} and L=span((1,1,1)). Show that R3=U⊕L, and split (a,b,c) into its two pieces.

Solution. From Example (Two planes in R3), dim⁡U=2, and dim⁡L=1 since (1,1,1)≠0. If t(1,1,1)∈U, then t+t+t=3t=0, so t=0. Hence U∩L={0}. By Theorem 1.7.4, dim⁡(U+L)=2+1=3, so U+L=R3 by Theorem 1.6.8. Therefore R3=U⊕L.

To split (a,b,c), look for t with (a,b,c)−t(1,1,1)∈U, that is, (a−t)+(b−t)+(c−t)=0. This gives t=a+b+c3, and (a,b,c)=(a−a+b+c3, b−a+b+c3, c−a+b+c3)+a+b+c3(1,1,1). The L-piece is the average of the entries times (1,1,1); the U-piece is what is left over.

The same splitting trick, “average with a reflected copy”, works for functions and matrices.

Example (Even and odd functions)

Let V=RR be the space of all functions R→R, with E={f:f(−x)=f(x) for all x} and O={f:f(−x)=−f(x) for all x}. Then V=E⊕O.

Solution. Both are subspaces by the Subspace Test (Theorem 1.2.1): the zero function is even and odd, and the defining equations are preserved by sums and scalar multiples. For instance, if f,g∈O, then (f+g)(−x)=−f(x)−g(x)=−(f+g)(x).

Sum. For any f∈V, put fE(x)=f(x)+f(−x)2 and fO(x)=f(x)−f(−x)2. Then f=fE+fO, and fE(−x)=f(−x)+f(x)2=fE(x), fO(−x)=f(−x)−f(x)2=−fO(x). So V=E+O.

Intersection. If f∈E∩O, then f(x)=f(−x)=−f(x) for every x, so 2f(x)=0 and f(x)=0. Hence E∩O={0}, and V=E⊕O by Theorem 1.7.4.

For example, ex=cosh⁡x+sinh⁡x is the splitting of the exponential function.

Example (Symmetric and skew-symmetric matrices)

Let F be a field of characteristic not 2 (for instance R or C), and let n≥1. In Mn(F), let U+={A:A⊤=A} be the symmetric matrices and U−={A:A⊤=−A} the skew-symmetric ones (Definition 0.9.11). Then Mn(F)=U+⊕U−.

Solution. Both are subspaces: O⊤=O=−O, and by Theorem 0.9.5, (A+B)⊤=A⊤+B⊤ and (cA)⊤=cA⊤, so the equations A⊤=±A survive sums and scalar multiples.

Since the characteristic is not 2, we have 2=1+1≠0 in F, so 12 exists (Definition 0.7.2). For A∈Mn(F), A=12(A+A⊤)+12(A−A⊤). By Theorem 0.9.5, (12(A+A⊤))⊤=12(A⊤+A) and (12(A−A⊤))⊤=12(A⊤−A)=−12(A−A⊤). So the first piece is in U+, the second in U−, and Mn(F)=U++U−.

If A∈U+∩U−, then A=A⊤=−A, so 2A=O. Multiplying by 12 gives A=O. Hence U+∩U−={O}, and Mn(F)=U+⊕U− by Theorem 1.7.4. The pattern is the same as even plus odd: transpose plays the role of x↦−x.

The hypothesis on the characteristic is used twice, both times to divide by 2. Exercise (C1: Symmetric Plus Skew over F2) shows what goes wrong over F2.

Quick check. Can two 2-dimensional subspaces of R3 form a direct sum?

Solution. No. If the sum U+W were direct, Theorem 1.7.4 (c) would give dim⁡(U+W)=2+2=4. But U+W⊆R3, so dim⁡(U+W)≤3 by Theorem 1.6.7. So two planes through 0 in R3 always share a nonzero vector.

1.7.4. Direct sums of several subspaces

For k≥3 subspaces, the tidy condition U∩W={0} has no direct replacement by pairwise intersections; we will see why in a moment. What does carry over is the zero vector test, which looks just like linear independence, and a condition that compares each subspace with the sum of all the others.

Theorem 1.7.5 (Direct Sum Criteria for Several Subspaces)

Let U1,…,Uk be subspaces of a vector space V, and write S=U1+⋯+Uk. The following are equivalent:

  • (a) the sum S is direct;
  • (b) the only way to write 0=u1+⋯+uk with ui∈Ui is u1=⋯=uk=0;
  • (c) for every j=1,…,k, Uj∩∑i≠jUi={0}.

If moreover each Ui is finite-dimensional with a basis Bi, and B is the list obtained by writing B1,…,Bk one after another, then (a)–(c) are also equivalent to

  • (d) B is a basis of S;
  • (e) dim⁡S=dim⁡U1+⋯+dim⁡Uk.

Here ∑i≠jUi is the sum of the k−1 subspaces other than Uj (and {0} if k=1).

Idea. Condition (b) is uniqueness for the single vector 0, and just as for independence, uniqueness for 0 gives uniqueness everywhere by taking differences. For (b) ⇔ (c), a nontrivial way of writing 0 is the same thing as a nonzero vector uj that equals minus the sum of the other pieces. For (d), a combination of B groups into one piece per Ui; independence of each Bi turns “piece is 0” into “coefficients are 0”. Finally (d) ⇔ (e) is count instead of check: B always spans S, so it is a basis exactly when its length is right.

Proof.

  • (a) ⇒ (b). The vector 0∈S has the splitting 0=0+⋯+0. If the sum is direct, it has no other, which is (b).

  • (b) ⇒ (a). Assume (b), and let u1+⋯+uk=u1′+⋯+uk′ with ui,ui′∈Ui. Subtracting and regrouping, (u1−u1′)+⋯+(uk−uk′)=0, where ui−ui′∈Ui because Ui is a subspace. By (b), ui−ui′=0, that is, ui=ui′, for every i. Hence every vector of S has only one splitting.

  • (c) ⇒ (c). Assume (b), fix j, and let v∈Uj∩∑i≠jUi. Then v=∑i≠jui for some ui∈Ui, and so u1+⋯+uj−1+(−v)+uj+1+⋯+uk=0, with −v∈Uj in the j-th slot. By (b), every piece is 0; in particular −v=0, so v=0.

  • (d) ⇒ (b). Assume (c), and let u1+⋯+uk=0 with ui∈Ui. Fix j. Then uj=−∑i≠jui=∑i≠j(−ui). The left side lies in Uj, and the right side lies in ∑i≠jUi since each −ui∈Ui. By (c), uj=0. As j was arbitrary, all pieces are 0.

For the rest, assume each Ui is finite-dimensional with basis Bi=(bi1,…,bimi), where mi=dim⁡Ui. By Proposition 1.7.2, B spans S=span(B1)+⋯+span(Bk). In particular S is finite-dimensional.

  • (b) ⇒ (d). Since B spans S, it remains to prove independence. Let ∑i=1k∑r=1miairbir=0, and group the terms by subspace: put ui=∑r=1miairbir∈Ui. Then u1+⋯+uk=0, so each ui=0 by (b). Since Bi is independent, ai1=⋯=aimi=0 for each i. Hence B is independent, and so a basis of S.

  • (c) ⇒ (b). Assume (d), and let u1+⋯+uk=0 with ui∈Ui. Since Bi spans Ui, write ui=∑r=1miairbir. Then ∑i=1k∑r=1miairbir=0 is a combination of the independent list B, so every air=0, and therefore every ui=0.

  • (d) ⇒ (e). The list B has length m1+⋯+mk, so if it is a basis of S, then dim⁡S=dim⁡U1+⋯+dim⁡Uk by Definition 1.6.1.

  • (e) ⇒ (d). The list B spans S and has length m1+⋯+mk, which equals dim⁡S by (e). A spanning list whose length is the dimension is a basis (Theorem 1.6.4). This proves the theorem.

For k=2, condition (c) reads U1∩U2={0} and U2∩U1={0}, so we recover Theorem 1.7.4. The criteria (d) and (e) say that bases of the pieces assemble into a basis of a direct sum, and dimensions add.

For k≥3, the tempting shortcut is to check only the intersections of the subspaces two at a time. It does not work.

Warning. Pairwise intersections {0} do not make a sum direct. In R2, take the three lines X (the x-axis), Y (the y-axis), and D (the line y=x). Any two of them meet only in 0. But (1,0)+(0,1)+(−1,−1)=(0,0) writes 0 with nonzero pieces from X, Y, D, so (b) fails and X+Y+D is not direct. Condition (c) sees the problem: D∩(X+Y)=D∩R2=D≠{0}.

The same example breaks another tempting generalization. For finite sets, |A∪B∪C| is given by inclusion–exclusion, and the dimension formula looks like its two-set case. For three subspaces the analogous formula would be dim⁡(U1+U2+U3)=?∑idim⁡Ui−∑i<jdim⁡(Ui∩Uj)+dim⁡(U1∩U2∩U3). For X,Y,D the left side is dim⁡R2=2, and the right side is 1+1+1−0−0−0+0=3. So the formula is false. The reason is that U+W is not a union: the dimension of (U1+U2)∩U3 is not determined by the pairwise intersections. Exercise (C3: Three Subspaces) gives the correct replacement and a second failure.

1.7.5. Complements

Given a subspace U of V, can we always find a subspace W with V=U⊕W? Such a W is called a complement of U in V. In R3, the plane U of Example (A plane and a line in R3) has the complement span((1,1,1)). In finite dimension, complements always exist, and the proof is again “basis of the smaller space, then extend”.

Theorem 1.7.6 (Existence of Complements)

Let V be a finite-dimensional vector space and U a subspace of V. Then there is a subspace W of V with V=U⊕W. Every such W satisfies dim⁡W=dim⁡V−dim⁡U.

Proof. By Theorem 1.6.7, U is finite-dimensional; let (u1,…,um) be a basis of U (Corollary 1.5.5). This list is independent in V, so by the Basis Extension Theorem (Theorem 1.6.5) there are w1,…,wr∈V such that (u1,…,um,w1,…,wr) is a basis of V. Put W=span(w1,…,wr), a subspace by Theorem 1.3.1.

By Proposition 1.7.2, U+W=span(u1,…,um,w1,…,wr)=V. The list (w1,…,wr) is independent, since a relation c1w1+⋯+crwr=0 is also a relation 0u1+⋯+0um+c1w1+⋯+crwr=0 among the basis vectors of V, forcing all ck=0. So (w1,…,wr) is a basis of W. The concatenation of the bases of U and W is a basis of U+W=V, so the sum is direct by Theorem 1.7.5 ((d) ⇒ (a)). Hence V=U⊕W.

Finally, if W is any subspace with V=U⊕W, then W is finite-dimensional (Theorem 1.6.7), and Theorem 1.7.4 (c) gives dim⁡V=dim⁡U+dim⁡W, as claimed.

The proof made a choice: the vectors w1,…,wr that extend the basis. Different choices give different complements.

Diagram. Labels: x, y, (1,1), U, W, W'

Warning. A complement is not unique. In R2, the x-axis U (solid) has the complement W, the y-axis (dashed), and also the complement W′, the line y=x (dotted), as shown in the examples after Definition 1.7.2. So “the complement of U” is meaningless, and U⊕W=U⊕W′ does not allow us to cancel U and conclude W=W′. What all complements share is their dimension. Also, a complement is not the set complement V∖U, which does not even contain 0.

Complements matter because a splitting V=U⊕W lets us study V one piece at a time. In Chapter 4 each such splitting gives a projection of V onto U along W, and the warning above becomes visible there: different complements give different projections. In Chapter 9 the eigenspaces of a diagonalizable operator split V as a direct sum, and that is what makes such operators easy to understand.

1.7.6. Exercises

A. Check your understanding

Exercise (A1)
  • (a) Define the sum U1+⋯+Uk of subspaces of V, and what it means for the sum to be direct.
  • (b) State the dimension formula for dim⁡(U+W), with its hypotheses.
  • (c) True or false: if V=U+W and U∩W={0}, then V=U⊕W. Justify your answer.
  • (d) True or false: if U1,U2,U3 are subspaces with Ui∩Uj={0} for all i≠j, then the sum U1+U2+U3 is direct. Justify your answer.
  • (e) True or false: if U is a subspace of V with U≠V, then V∖U is a complement of U. Justify your answer.
  • (f) Name the method used to prove the dimension formula, in four steps.

Solution.

  • (a) See Definition 1.7.1: U1+⋯+Uk={u1+⋯+uk:ui∈Ui}. By Definition 1.7.2, the sum is direct if every vector in it can be written as u1+⋯+uk with ui∈Ui in exactly one way.

  • (b) If U and W are finite-dimensional subspaces of a vector space V, then dim⁡(U+W)=dim⁡U+dim⁡W−dim⁡(U∩W) (Theorem 1.7.3).

  • (c) True. By Theorem 1.7.4, U∩W={0} means the sum U+W is direct, and it equals V.

  • (d) False. The three lines X, Y, D in R2 (the axes and the line y=x) meet pairwise only in 0, but (1,0)+(0,1)+(−1,−1)=0 is a nontrivial way to write 0, so the sum is not direct by Theorem 1.7.5.

  • (e) False. V∖U does not contain 0, because 0∈U. So it is not a subspace, and cannot be a complement.

  • (f) Take a basis of the smallest space U∩W; extend it to bases of U and of W (Basis Extension); prove the Big Claim that all the vectors together form a basis of U+W (spanning, then independence by moving one block across and noting the common vector lies in U∩W); count.

B. Practice

Exercise (B1: Two Planes in R4)

Let U=span((1,2,0,1),(0,1,1,0)) and W=span((1,3,1,1),(0,0,1,1)) in R4.

  • (a) Show that dim⁡U=dim⁡W=2.
  • (b) Find U∩W and its dimension.
  • (c) Hence find dim⁡(U+W) and a basis of U+W.

Solution.

  • (a) If a(1,2,0,1)+b(0,1,1,0)=(a,2a+b,b,a)=0, then a=0 and b=0 from the first and third entries. So the spanning list of U is independent, hence a basis, and dim⁡U=2. Similarly c(1,3,1,1)+d(0,0,1,1)=(c,3c,c+d,c+d)=0 forces c=0, then d=0, so dim⁡W=2.

  • (b) A vector lies in U∩W exactly when (a,2a+b,b,a)=(c,3c,c+d,c+d) for some a,b,c,d∈R. The first entries give a=c. The second gives 2a+b=3a, so b=a. The third gives a=a+d, so d=0; the fourth, a=a+0, then holds. So the common vectors are (a,3a,a,a)=a(1,3,1,1), and U∩W=span((1,3,1,1)), of dimension 1.

  • (c) By the dimension formula (Theorem 1.7.3), dim⁡(U+W)=2+2−1=3. Following its proof: ((1,3,1,1),(0,1,1,0)) is a list in U (by (b), (1,3,1,1)∈U∩W). It is independent by Lemma 1.5.3, since a multiple c(1,3,1,1) with first entry 0 is 0≠(0,1,1,0). It has length 2=dim⁡U, hence it is a basis of U by Theorem 1.6.4. Likewise ((1,3,1,1),(0,0,1,1)) is a basis of W. By the Big Claim in the proof, ((1,3,1,1),(0,1,1,0),(0,0,1,1)) is a basis of U+W.

Exercise (B2: A Plane and a Line)

Let U={(x,y,z)∈R3:x−2y+z=0} and L=span((1,0,1)).

  • (a) Prove that R3=U⊕L.
  • (b) Write (2,0,4) as u+w with u∈U and w∈L.

Solution.

  • (a) Solving for x, every vector of U is (2y−z,y,z)=y(2,1,0)+z(−1,0,1). These two vectors are independent (look at the second and third entries), so dim⁡U=2. Since (1,0,1)≠0, dim⁡L=1. If t(1,0,1)∈U, then t−0+t=2t=0, so t=0; hence U∩L={0}. By Theorem 1.7.4, dim⁡(U+L)=2+1=3, so U+L=R3 by Theorem 1.6.8. Therefore R3=U⊕L.

  • (b) We need t with (2,0,4)−t(1,0,1)=(2−t,0,4−t)∈U, that is, (2−t)−0+(4−t)=0. This gives t=3. So (2,0,4)=(−1,0,1)+3(1,0,1), and indeed −1−0+1=0, so (−1,0,1)∈U. By (a) this is the only such splitting.

Exercise (B3: Direct or Not?)

Determine which of the following sums are direct. Justify your answer.

  • (a) span(1,x2)+span(x,x3) in R[x]≤3.
  • (b) Tup+Tlow in M2(R), where Tup and Tlow are the upper and lower triangular matrices.
  • (c) span((1,0,0))+span((0,1,0))+span((1,1,1)) in R3.
  • (d) span((1,1,0))+span((0,1,1))+span((1,0,−1)) in R3.

Solution.

  • (a) Direct. If p∈span(1,x2)∩span(x,x3), then p=a+bx2=cx+dx3. Comparing coefficients of 1,x,x2,x3 gives a=c=b=d=0, so p=0. By Theorem 1.7.4 the sum is direct.

  • (b) Not direct. The identity matrix I2 is both upper and lower triangular, so I2∈Tup∩Tlow≠{O}, and Theorem 1.7.4 applies.

  • (c) Direct. Each line has the basis given by its spanning vector, and we check that the concatenated list ((1,0,0),(0,1,0),(1,1,1)) is independent. If a(1,0,0)+b(0,1,0)+c(1,1,1)=(a+c,b+c,c)=0, then c=0, hence a=0 and b=0. The list spans the sum by Proposition 1.7.2, so it is a basis of the sum, and the sum is direct by Theorem 1.7.5 ((d) ⇒ (a)).

  • (d) Not direct, although any two of the three lines meet only in 0 (no spanning vector is a multiple of another). Indeed (1,1,0)+(−1)(0,1,1)+(−1)(1,0,−1)=(0,0,0) writes 0 as a sum of nonzero pieces from the three lines, so condition (b) of Theorem 1.7.5 fails.

C. Going deeper

Exercise (C1: Symmetric Plus Skew over F2)

Let U+ and U− be the symmetric and skew-symmetric matrices in M2(F2).

Solution.

  • (a) In F2 we have 1+1=0, so −a=a for every a∈F2, and hence −A=A for every A∈M2(F2). Therefore A⊤=−A holds if and only if A⊤=A, which says U−=U+.

  • (b) By (a), U+∩U−=U+, which contains I2≠O. So the sum is not direct (Theorem 1.7.4). It is not even all of M2(F2): U++U−=U++U+=U+, and (0100) is not symmetric. In Example (Symmetric and skew-symmetric matrices) both halves of the proof divide by 2: the splitting A=12(A+A⊤)+12(A−A⊤) and the step from 2A=O to A=O. In F2, 2=1+1=0 has no inverse, so neither step is available. This is exactly the case of characteristic 2 excluded by the hypothesis.

Exercise (C2: Subspaces That Must Meet)
  • (a) Let V be a vector space of dimension n, and let U, W be subspaces with dim⁡U+dim⁡W>n. Prove that U∩W≠{0}.
  • (b) Deduce that any two 3-dimensional subspaces of R[x]≤4 contain a common nonzero polynomial.
  • (c) Give an example showing that (a) fails if “>” is replaced by “=”.

Solution.

  • (a) By Theorem 1.6.7, U, W, and U+W are finite-dimensional, and dim⁡(U+W)≤dim⁡V=n. By the dimension formula (Theorem 1.7.3), dim⁡(U∩W)=dim⁡U+dim⁡W−dim⁡(U+W)≥dim⁡U+dim⁡W−n>0. A subspace of positive dimension has a basis with at least one vector, which is nonzero because a list containing 0 is dependent. Hence U∩W≠{0}.

  • (b) dim⁡R[x]≤4=5 and 3+3=6>5. By (a), the two subspaces meet in a nonzero polynomial.

  • (c) In R2 (with n=2), the x-axis and the y-axis have 1+1=2=n, but their intersection is {0}.

Exercise (C3: Three Subspaces)
  • (a) Let U1,U2,U3 be subspaces of a vector space V. Show that (U1+U2)+U3=U1+U2+U3.
  • (b) Now let U1,U2,U3 be finite-dimensional. Prove that dim⁡(U1+U2+U3)=dim⁡U1+dim⁡U2+dim⁡U3−dim⁡(U1∩U2)−dim⁡((U1+U2)∩U3).
  • (c) In R3, let U1={z=0}, U2={y=0}, and U3={y=z}. Compute dim⁡(U1+U2+U3), every dim⁡(Ui∩Uj), and dim⁡(U1∩U2∩U3). Show that the inclusion–exclusion formula fails, and compare with (b).

Hint: for (b), apply the dimension formula twice.

Solution.

  • (a) Both sides are subspaces by Theorem 1.7.1. The right side contains U1 and U2, hence U1+U2 (Theorem 1.7.1), and it contains U3; so it contains (U1+U2)+U3 by Theorem 1.7.1. Conversely, an element u1+u2+u3 of the right side is the sum of u1+u2∈U1+U2 and u3∈U3, so it lies in the left side.

  • (b) By Theorem 1.7.3, U1+U2 is finite-dimensional with dim⁡(U1+U2)=dim⁡U1+dim⁡U2−dim⁡(U1∩U2). Applying the formula again to U1+U2 and U3, and using (a), dim⁡(U1+U2+U3)=dim⁡(U1+U2)+dim⁡U3−dim⁡((U1+U2)∩U3). Substituting the first equation into the second gives the formula.

  • (c) Each Ui is a plane, so dim⁡Ui=2: U1=span(e1,e2), U2=span(e1,e3), U3=span(e1,e2+e3), each with an evidently independent spanning list. All three contain the x-axis span(e1).

  • U1∩U2={y=z=0}=span(e1).
  • U1∩U3={z=0,y=z}={y=z=0}=span(e1).
  • U2∩U3={y=0,y=z}=span(e1).
  • U1∩U2∩U3=span(e1).

So each of these has dimension 1. Since U1+U2 contains e1,e2,e3, it is R3, and so U1+U2+U3=R3 has dimension 3. The inclusion–exclusion formula would give 2+2+2−1−1−1+1=4≠3, so it fails. In (b), the last term is (U1+U2)∩U3=R3∩U3=U3, of dimension 2, and indeed 2+2+2−1−2=3. The inclusion–exclusion guess replaces this 2 by dim⁡(U1∩U3)+dim⁡(U2∩U3)−dim⁡(U1∩U2∩U3)=1+1−1=1, which is wrong because (U1+U2)∩U3 is much bigger than (U1∩U3)+(U2∩U3)=span(e1).

Found a typo or a mistake? Report it, or read this page’s source

The text of this book is licensed under CC BY-NC-SA 4.0.