Chapter 9 left one gap wide open. When an operator
has too few eigenvectors, its eigenspaces are too small
to fill the space, and diagonalization fails. The remedy
of this chapter is to enlarge each eigenspace until the
enlarged pieces do fill the space. This section builds
the enlargement, shows that the enlarging process stops
after finitely many steps, and proves that the pieces
split whenever
the characteristic polynomial splits.
Enlarging
an eigenspace
Take the standing counterexample of Chapter 9, and let . The only eigenvalue is , and is a line: one eigenvector
direction where we need two, so is not diagonalizable
over any field (Theorem 9.4.1
(e)).
Now look at what does to the missing
direction . One
application does not kill , but two do:
So is killed by
, and is
everything. The eigenspace was too small, but the kernel
of the square is as big as we could
wish.
This is the whole idea. Instead of asking for vectors
killed by , ask for vectors killed by
some power of . The
eigenvectors are still there (they are killed at the
first step), and there may be more.
A generalized eigenvector is a vector that some
power of kills, not necessarily the first
power.
Generalized eigenvectors and generalized
eigenspaces
Definition
10.1.1 (Generalized Eigenvector)
Let be a
vector space over , let and . A
generalized eigenvector of for is a vector with
such that
In words: the vector must be
nonzero, exactly as for an eigenvector;
the scalar
must lie in ; and the power
is not fixed in
advance — it may depend on . Taking recovers the
eigenvector condition, so every eigenvector for
is a
generalized eigenvector for .
Collecting all of them, together with , gives the space
we are after.
Definition
10.1.2 (Generalized Eigenspace)
Let be a
vector space over , let and . The
generalized eigenspace of for is For we write .
So
consists of together with
all generalized eigenvectors for . Writing
for the rest of this subsection, the definition says
.
Well-definedness: it really is a
subspace. A union of subspaces is almost never
a subspace (Proposition 1.2.3),
so this needs a check. What saves us is that the union
is increasing: if ,
then , so Now use the subspace test (Theorem 1.2.1). We
have , so the set is nonempty.
If , say
and , put ; then by the inclusions above, and is a subspace,
so and lie in for every . Hence is a
subspace of .
Examples.
- The standing counterexample. For
, we computed and .
So ,
while is
only a line. The generalized eigenspace is strictly
bigger than the eigenspace, and it is all of .
- A diagonalizable operator gains
nothing. Let over . Then , whose kernel is for
every . So
, and likewise . Enlarging an eigenspace of a
diagonalizable operator does nothing, a fact we prove in
general below.
- Differentiation. Let
be differentiation. Then (Example (Differentiation Is Nilpotent)),
so every polynomial is killed by a
power of , that
is, of ,
and . By contrast is the
line of constants when . Here the generalized eigenspace for the
single eigenvalue
is the whole space, of dimension .
- A scalar not among the eigenvalues.
For the same and , the matrix is invertible,
so its kernel is for every
. Hence .
The definition makes sense for every , and gives
the zero space unless is an
eigenvalue.
- A degenerate case. On a space of
dimension , every
operator is for one
scalar , and
,
for . Small as
it is, this is the model for a Jordan
block.
- No eigenvalues at all. The rotation
of by a right angle
has no real eigenvalue (Example (A Rotation Has No Invariant Lines)),
and indeed for every : if with ,
then
would not be injective, so would be an
eigenvalue. Over , where splits, and are the two
eigenlines.
Nonexample by minimal change. Keep
over and take
.
This vector is killed by a polynomial
in whose roots
are eigenvalues: as one checks entry by entry. But it is a
generalized eigenvector for neither
eigenvalue: and
for every . The failing
clause is that the definition demands a power of a
single factor , not a
product of different factors. (Of course is a sum of two generalized
eigenvectors; that is the decomposition theorem below,
not the definition.)
Why this definition. Three clauses
are doing work. The vector must be nonzero, or every
would
contain a “generalized eigenvector” and the word would
carry no information. The exponent must be allowed to
grow, because nothing tells us in advance how many steps
a vector needs: for on the
polynomial
needs steps.
And the power is a power of one factor, which is what
makes one
piece attached to one eigenvalue. The name is the honest
one: these are the vectors that behave like eigenvectors
after enough applications of .
Warning. is usually
bigger than , and
“generalized eigenvector” includes the ordinary
ones. The inclusion always holds, and it is strict
exactly when has
too few eigenvectors for : for , and . So a
generalized eigenvector need not satisfy : the vector satisfies
. Conversely, do not read
“generalized” as “not an eigenvector”: every eigenvector
is a generalized eigenvector.
The kernel
chain stabilizes
The definition of is an
infinite union, which is awkward: to decide membership
we would have to try every . In finite dimension
this is an illusion. The chain is a chain of subspaces of
, and their
dimensions cannot keep growing. Once the chain stops
growing, it stops forever.
Theorem
10.1.1 (The Kernel Chain Stabilizes)
Let be a
finite-dimensional vector space over with , let , and write
for
, so that
.
Then:
- (a) , and every is -invariant;
- (b) if for some
, then for
every ;
- (c) there is a
least index with ; it
satisfies ,
the inclusions are strict, and for every ;
- (d) in particular
for every .
Idea. The only real point is (b):
equality at one step propagates. Read it backwards. To
put into , look at .
It lies in ,
which by hypothesis is , and that is exactly
the statement . Then (c) and (d) are bookkeeping:
while the inclusions are strict the dimensions go up by
at least , so
strictness cannot survive past step .
Proof.
(a) If ,
then , so .
Each
is the kernel of a polynomial in , hence -invariant by Theorem 6.7.4
(b).
(b) Suppose . We prove
by
induction on . For there is nothing to prove. Assume , and let
. Then so , which says . Hence . Together with
from (a), this gives .
(c) First, some
with satisfies
.
Otherwise for every , so for those , and hence ,
contradicting (Theorem 1.6.7). By
the well-ordering principle (Theorem 0.2.11) there
is a least such index; call it , and . For minimality gives
, so
the inclusion of (a) is strict. For , (b) gives .
(d) Since , (c) gives for
every .
Quick check. Can happen? Can happen?
Solution. The first can: for on we have and , since . Here .
The second cannot, by Theorem 10.1.1 (b)
with :
equality at one step forces equality at every later
step. This is why the theorem says the strict inclusions
come first and the equalities
after; the chain never resumes
growing.
The index will
come up often enough to name. We call the least with
the stabilization index of . Part (d) is the useful
form: the chain has certainly stopped by step , whatever
is. Applying this
to turns the infinite union in Definition 10.1.2
into a single kernel.
Corollary
10.1.2 (The Generalized Eigenspace Is One
Kernel)
Let be a
finite-dimensional vector space over with , let and , and put
with stabilization index . Then:
- (a) ;
- (b) is -invariant, and ;
- (c) if and only if is an eigenvalue
of ;
- (d) if
is nonzero and is least with ,
then is an
eigenvector of
for .
Proof.
(a) Every with is contained in
by Theorem 10.1.1 (a)
and (d), so the union equals ; and by
(c) of the same theorem, since .
(b) By (a),
is the kernel of a polynomial in , so maps it into itself (Theorem 6.7.4 (b)).
And .
(c) If is an eigenvalue,
then (Theorem 9.2.1), and
by (b). If
is nonzero, take least with ,
which exists by the definition of and Theorem 0.2.11. Then
by minimality of (for this reads ), while . So is
nonzero and
is an eigenvalue.
(d) This is the
computation just made: is nonzero and lies in .
Part (d) is a move worth remembering: to get
a genuine eigenvector out of a generalized one, apply
as many times as possible without reaching . It is
the reason the enlargement never produces eigenvalues
out of thin air, and it will start every Jordan chain in
Section 2.
The
generalized eigenspace decomposition
We can now state the payoff. Chapter 9’s primary
decomposition (Theorem 9.8.1) already
splits into
invariant pieces, one for each irreducible factor of
. When splits, all those
factors are linear, the pieces are kernels of powers of
— and those are exactly the
generalized eigenspaces. The extra information here is
that the piece attached to has dimension
, so
the sizes are read off the characteristic
polynomial.
When the characteristic polynomial splits, the
generalized eigenspaces fill the space, and the one for
has
dimension the algebraic multiplicity of .
Theorem
10.1.3 (Generalized Eigenspace
Decomposition)
Let be a
finite-dimensional vector space over with , let
, and
suppose
splits over , with distinct
eigenvalues and where and . Write
and . Then:
- (a) , and
- (b) each is -invariant and nonzero,
with , and if
and only if ;
- (c) and ;
- (d) ; that is,
with nilpotent, of
stabilization index ;
- (e) if is a basis of obtained by writing
bases of one after another, then is block diagonal, with the -th block of size .
Idea. Almost everything is already
proved; the one new step is (a), the identification
. One inclusion is free,
since sits inside the union defining
. For the other,
count. Chapter 9 says the primary piece
has dimension ,
so it is enough to show . Now is invariant, and the
only eigenvalue of on is : an eigenvector
in for is killed by ,
which forces . So the characteristic polynomial of
the restriction is a power of dividing
, and its degree
is at most
.
Proof. Since splits and , Corollary 9.6.2 (b)
gives the displayed factorization of with . Put
. The polynomials are
distinct monic irreducibles, so Theorem 9.8.1 applies
to and gives with each invariant and
nonzero. By Corollary 9.8.4, , , and with equality if and only if .
Claim: . Fix and write , ,
, .
.
It
suffices to prove : then and
force , and Theorem 1.6.8,
applied to the subspace of , gives .
First, the only eigenvalue of is . Indeed,
is -invariant (Corollary 10.1.2
(b)), so the restriction makes sense (Definition 9.1.2). Let
be an
eigenvalue of ,
with eigenvector , . From
we get , hence by induction. But by Corollary 10.1.2
(a), so with ,
which forces the scalar to be (Theorem 1.1.9), and
so ,
since a field has no zero divisors (Theorem 0.7.1).
Now compare characteristic polynomials. , since
is an
eigenvalue of (Corollary 10.1.2
(c)). If ,
then every root of is an eigenvalue of
(Theorem 9.2.1), so
is the only
root; as splits
and is monic of degree (Theorem 7.10.2),
and . If , then Theorem 9.1.3 (b)
applies to the invariant subspace and gives so is a monic
divisor of . By Lemma 9.5.2, with . Its
roots are the eigenvalues of (Theorem 9.2.1, applied
to ), which we
just showed to be alone, so for . Hence , and comparing degrees (Theorem 7.10.2) gives
.
This proves the claim, and with it (a), (b), and (c),
since .
(d) By Theorem 9.8.1 (c) and
the claim, . For an integer , the operator
is
evaluated at , so if and only
if divides (Theorem 9.5.1), that
is, if and only if . Since , this gives , and it
identifies as
the least exponent killing . Hence
while , so the stabilization index of
is .
(e) Each is invariant and
nonzero, and , so Theorem 9.1.5 gives
the block diagonal shape, the -th block being ,
of size .
Read (d) again, since it is the plan for the rest of
the chapter. On its generalized eigenspace,
is a scalar plus
a nilpotent operator. The scalar part is as
simple as an operator can be. So the only question left
is what a nilpotent operator looks like in a well-chosen
basis, and that is the subject of the next section. Once
it is answered, (e) assembles the answers for the
different eigenvalues into one matrix for .
Two consistency checks. Summing dimensions in (a) and
using (c) gives , which is the degree count for a split . And if is diagonalizable, then
every (Theorem 9.8.2), so (b)
says and (a) becomes the eigenspace
decomposition of Theorem 9.4.1 (c).
Nothing is lost, and nothing new is gained, in the
diagonalizable case.
Example
(Generalized Eigenspaces of a Matrix)
Let Find , , , the
stabilization index of , and the minimal polynomial. Verify Theorem 10.1.3 on
this matrix.
Solution. The eigenspace.
Write , so Rows
and are equal and
row is their
negative, so the row space is spanned by rows and , which are not
proportional; hence and (Theorem 3.5.7). The
kernel is cut out by Subtracting the first equation from the second
gives , so , and then . With and free, Since , the matrix is not diagonalizable (Theorem 9.4.1
(e)).
The generalized eigenspace. Squaring, which has rank , so has dimension
and is the
hyperplane The chain of kernels has dimensions so far. Since
and by
part (c) of the theorem, we get , and
the stabilization index is . One can see the stabilization by hand as
well: multiplying out gives , so
directly.
The second generalized eigenspace. Here
, so
and by part (b) — its must be . Solving gives . As a check, .
The decomposition. , of dimensions , and the sum is
direct because : its first and last coordinates
are .
The minimal polynomial. The stabilization
indices are
at and
at , and part (d)
of the theorem identifies these indices as the exponents
in , so . Consistently, : the two factors are coprime, so the kernel
of the product is (Theorem 6.7.5 (a)), of
dimension .
A basis adapted to the splitting. Take , a basis of followed by one of
. By part (e),
is
block diagonal with a block and the block .
Warning. The dimension of
is the
algebraic multiplicity, not the number of steps the
chain takes. In the example, while the
chain
stabilizes after steps. The two numbers measure different
things: is the total size of the piece, and
is the exponent
of in
the minimal polynomial. All that holds in general is
and
(Theorem 9.3.1).
Finally, a word on what we may not yet assume. The
decomposition needs to split, which is
automatic over
(Corollary 6.5.5) but
fails, for instance, for a rotation of , whose generalized
eigenspaces over are all and
certainly do not fill . Operators over an
arbitrary field need the coarser primary decomposition
of Chapter 9, whose pieces we return to in Section
6.
Exercises
A. Check your
understanding
Exercise
(A1)
- (a) Define a
generalized eigenvector and the generalized eigenspace
.
- (b) State what Theorem 10.1.1
says about the chain , including
the bound on where it stabilizes.
- (c) True or false:
every generalized eigenvector of for satisfies . Justify your answer.
- (d) True or false:
if is not
an eigenvalue of ,
then . Justify your answer.
- (e) Let and let
split over . What
are and
?
- (f) In the situation
of (e), what can you say about ?
Solution.
(a) A generalized
eigenvector of
for
is a nonzero with for some (Definition 10.1.1);
is the
set of all of them together with , that is, (Definition 10.1.2).
(b) The kernels
increase; once two consecutive ones are equal, all later
ones equal them; the strict inclusions come first, and
the chain has stabilized by step , so .
(c) False. For
, the vector lies in but . Only the vectors
of satisfy the eigenvector
equation.
(d) True, by Corollary 10.1.2
(c).
(e)
and (Theorem 10.1.3
(c)).
(f) Only ,
since and (Theorem 9.3.1). All
four values occur, as the Jordan forms of Section 3 will
show.
B. Practice
Exercise
(B1: Computing generalized eigenspaces)
For each operator, find all generalized eigenspaces,
and compare each with the corresponding eigenspace.
- (a) .
- (b) , which has (Exercise (B2: Decomposing )).
- (c) , differentiation.
- (d) The rotation
, first over and then over .
Solution.
(a) , so
is the only
eigenvalue, and for (Corollary 10.1.2
(c)). Since , , while is a line.
(b) From and Theorem 10.1.3
(a), and . Chapter 9 computed these:
, the plane , and . The eigenspace is a line strictly inside , while because
. All other
are .
(c) (Example (Differentiation Is Nilpotent)),
so , of dimension , while is
the line of constants. Since has as its only root, every
other generalized eigenspace is .
(d) Over , has no
root, so has no
eigenvalue and for every . The
generalized eigenspaces do not fill
; the
hypothesis that splits fails. Over
,
splits with , so and , and . (Check: .)
Exercise
(B2: The image chain stabilizes too)
Let be
finite-dimensional with , and let .
- (a) Prove that , and that each is -invariant.
- (b) Prove that
if and only if .
- (c) Deduce that
for every , and that the image chain stabilizes at
exactly the same index as the kernel
chain.
Solution.
(a) . Each is the image of a
polynomial in ,
hence -invariant
(Theorem 6.7.4
(b)).
(b) By Theorem 2.3.1, for every . The inclusions and are equalities exactly
when the dimensions agree (Theorem 1.6.8), and
if and only if by the displayed identity.
(c) By Theorem 10.1.1
(d), ; iterating (b) at each step from to gives .
And by (b), the least index at which two consecutive
images agree is the least index at which two consecutive
kernels agree, namely .
Exercise
(B3: Reading the dimensions off a triangular
matrix)
Let
- (a) Write down and the algebraic
multiplicities.
- (b) Compute , , , and , and check .
- (c) Verify that
, and find .
Solution.
(a) is upper triangular,
so (Theorem 7.4.6), and
.
(b) has rank (rows are independent
and row is the
sum of rows and
), so . Squaring, of rank , with kernel ; so , of dimension .
(Membership can be seen directly: and .)
Similarly has rank , so is a line;
solving gives . And has rank ; its kernel is cut out
by and , so , of
dimension . (Check: , the eigenvector.)
- (c) The four vectors
form a basis of : the matrix with
these columns is upper triangular with diagonal , hence
invertible. So the sum is direct and equals , as Theorem 10.1.3 (a)
predicts. Both stabilization indices are (the eigenspaces are
lines, the generalized eigenspaces planes), so .
C. Going deeper
Exercise
(C1: The Fitting decomposition)
Let be
finite-dimensional with , and let be any operator.
Put
and .
- (a) Prove that ,
and deduce .
- (b) Prove that and are -invariant, that is nilpotent, and
that is
invertible.
- (c) Identify as a generalized
eigenspace of .
- (d) Compute and for .
Hint: for (a), if
and , look at which kernel lies
in.
Solution.
(a) Let ,
say with .
Then , so by Theorem 10.1.1
(d), and therefore . By Theorem 2.3.1, , so
(Theorem 1.7.3),
whence
(Theorem 1.6.8) and
the sum is direct (Theorem 1.7.4).
(b) Both are
invariant by Theorem 6.7.4 (b). On
we have by
definition of , so
is nilpotent.
On , the map is
surjective: by Exercise (B2: The image chain stabilizes too)
(c). A surjective operator on a finite-dimensional space
is invertible (Corollary 2.3.2
(e)).
(c) , by
Corollary 10.1.2
(a) with . So the Fitting decomposition splits into the generalized
eigenspace for
and a part on which is invertible.
(d) Here and , so and . Indeed , is zero on , and , so
is the
identity.
Exercise
(C2: Commuting operators preserve generalized
eigenspaces)
Let be
finite-dimensional, and let with
.
- (a) Prove that for every .
- (b) Deduce that if
splits, then
every generalized eigenspace of is invariant under
every polynomial in and under , and that has a basis in which
both and have block diagonal
matrices with blocks of sizes .
- (c) Show by example
that part (a) can be vacuous: find commuting on and a with a line,
, and not a scalar multiple
of the identity.
Solution.
(a) Since , commutes with every
polynomial in (Theorem 6.7.1 (d)), in
particular with , where .
Let , say .
Then so . (This is Theorem 6.7.4 (a) with
.)
(b) Invariance
under polynomials in is Theorem 6.7.4 (b), and
invariance under
is (a). If
splits, then with (Theorem 10.1.3),
and a basis assembled from bases of the summands makes
both matrices block diagonal, by Theorem 9.1.5 applied
to and to .
(c) Take and . They commute,
is a line, , and is not a scalar matrix.
Consistently with Theorem 9.9.1, maps the line into
itself, and by (a) it maps into
itself, which says nothing. The lesson is that (a) is
informative only when .