Section 4 decided diagonalizability by counting
eigenvectors, one eigenspace at a time. There is a
second source of information about an operator, which
Chapter 6 set up: the polynomials that kill it. On a
finite-dimensional space they form an ideal of , and that ideal has
a single monic generator. This section gives the
generator its name, the minimal polynomial, and shows
that its roots are exactly the eigenvalues. We learn two
ways to compute it and check that similar matrices share
it. The next section compares it with the characteristic
polynomial, and Section 8 reads diagonalizability off
its factorization.
The
polynomial that divides all the others
Chapter 6 turned every polynomial identity satisfied
by an operator into a statement about one ideal. For
, the
set is an ideal of (Theorem 6.7.3 (a)). If
is
finite-dimensional, it contains a nonzero polynomial (Theorem 6.7.3 (c)).
Then it consists of the multiples of a unique monic
polynomial (Theorem 6.7.3
(b)).
Look at what this says for one operator. A projection
with satisfies
, so kills it. So do
, , and
, and a
short calculation shows each one is a multiple of . This is no
accident. Every annihilating polynomial of is a multiple of , which Chapter 6
found to be the monic generator of . One polynomial
controls the whole list, and whenever something in
mathematics is unique we give it a name.
The minimal polynomial of is the one monic
polynomial that kills and divides every other
polynomial that kills .
Definition
9.5.1 (Minimal Polynomial)
Let be a
finite-dimensional vector space over
and . The
minimal polynomial of is the
unique monic polynomial with Equivalently, is the monic
polynomial of least degree with .
For , the minimal polynomial is : the monic polynomial of least
degree with .
In words: we look at all polynomials
with , where replaces by and the constant term
by (Definition 2.4.2).
They are exactly the multiples of one polynomial . Among the generators
of this ideal, which differ by nonzero constant factors,
we pick the monic one. The second
sentence of the definition gives the same polynomial
described by size: it is the monic polynomial of
least degree that kills .
Well-definedness. Three things need
checking, and Chapter 6 did all three.
Existence: because is finite-dimensional
(Theorem 6.7.3 (c)).
Uniqueness: a nonzero ideal of has exactly one
monic generator (Theorem 6.2.2).
The two descriptions agree: the same theorem
says that the monic generator is the unique monic
polynomial of least degree in the ideal. For a matrix,
if
and only if , because in the standard basis (Corollary 4.1.3).
So , and the matrix version is the operator
version for .
The name records the second description: is the annihilating
polynomial of minimal degree. The first description is
the one we use in proofs, because it hands us a
divisibility for free.
Theorem
9.5.1 (Annihilating Polynomials Are Multiples
of the Minimal Polynomial)
Let be
finite-dimensional and . For every , In particular, a nonzero polynomial that
annihilates has
degree at least . If , then .
Proof. By Definition 9.5.1,
means
, that is, for some , that is, . If and , then by Proposition 6.1.2 (c).
Finally, the only monic polynomial of degree is the constant , and when
;
so and
.
This is the move we will use again and again:
a polynomial relation becomes a
divisibility. If we learn that , we do not need
to know anything else about to conclude that . That leaves only finitely many candidates
for . To list
candidates like these we need to know the monic divisors
of a factored polynomial, and unique factorization
describes them exactly.
Lemma
9.5.2 (Monic Divisors of a Factored
Polynomial)
Let , where , are
distinct monic irreducible polynomials,
and . Then
the monic divisors of are exactly the
polynomials
Idea. One direction is a product:
the missing factors form the cofactor. For the other,
factor a monic divisor into irreducibles,
multiply that factorization by one of the cofactor, and
compare the result with the factorization of . Uniqueness says the
two lists of irreducibles agree, so the irreducibles in
are among the
, and none can
occur more often in than in .
Proof. Each such product divides
, with cofactor
. Conversely, let be monic with . If , take every . Otherwise is nonconstant, and by
Theorem 6.3.5 (a) it
is a product of monic irreducibles; the constant in
front is the leading coefficient of , which is . The cofactor is nonzero (as ), so it is either
a nonzero constant or, by the same
theorem, with monic irreducible.
Multiplying, (with no ’s in the first case) is
a factorization of into a constant and
monic irreducibles. By Theorem 6.3.5 (b),
after renumbering it is the factorization , in which occurs exactly times. So each is one of the , and occurs at most times among . Hence
with .
Examples. Each computation follows
the same plan: find one annihilating polynomial, list
its monic divisors with Lemma 9.5.2, and
discard those that do not annihilate.
- A diagonal matrix with a repeated
entry. Let . Diagonal matrices multiply
entry by entry, so By Theorem 9.5.1, is a monic divisor
of :
one of , , , . None of
the first three annihilates , since , ,
and are nonzero. So .
The repeated diagonal entry appears only
once in , while the
characteristic polynomial is .
- A matrix with too few eigenvectors.
Let over any
field. Then , and . So is a monic divisor
of ,
namely , , or , and the first
two do not annihilate . Hence , which
equals .
- Projections. Chapter 6 found, by
this plan, that a projection with and has (the
examples after Theorem 6.7.3).
- Differentiation. Let be differentiation on
.
Then
and (Example (Differentiation Is Nilpotent)).
By Lemma 9.5.2, the monic
divisors of
are the powers
with . For , , since would otherwise be . Hence , of degree
.
- Degenerate cases. On , the
identity has and the zero operator has : each is killed by
a polynomial of degree , which is the least
possible degree. More generally , and
every
matrix has
. On , even
the constant
annihilates, so . This last case is the reason for the
hypothesis in Theorem 9.5.1.
Nonexample by minimal change. For
above, take
instead
of . It is
still monic, it has the least degree a minimal
polynomial can have on a nonzero space, and its only
root is the eigenvalue of . What fails is the
clause :
. In the other direction, is monic and
does annihilate ,
but it fails the clause : the annihilating polynomial is not a
multiple of .
Quick check. Find the minimal
polynomial of
and of .
Solution. , so
divides
; it is not
, since . Hence . For
: , , , so and kills . Thus .
By Lemma 9.5.2, , and only annihilates (the others give ).
So .
Why this definition. Each clause has
a job.
- Monic. The polynomials and generate the same
ideal, so “a generator” is determined only up to a
nonzero constant. Insisting on leading coefficient picks one, and makes
statements like “” meaningful.
- Generator, not only least degree. The two
descriptions give the same polynomial. Stating the
definition through the ideal puts Theorem 9.5.1 in front
of us, and divisibility is the property we use.
- Finite dimension. Without it, can be , and then there is
nothing to name. For multiplication by on , , so for every
(the remark
after Theorem 6.7.2). The
same happens for the right shift on .
Warning. The minimal
polynomial is not the characteristic
polynomial. For , while ; for above,
while . The two can differ in their exponents, and
can have smaller
degree than the size of the matrix. How they are related
is the subject of the next section. Its main theorem is
one that Chapter 7 warned against “proving” by
substituting
into ; that shortcut is not a proof and must not
be used here either.
The roots
are the eigenvalues
The minimal polynomial is defined by an ideal, and
eigenvalues by vectors. They are closely linked.
Theorem
9.5.3 (Roots of the Minimal Polynomial)
Let be
finite-dimensional, , and . Then if and
only if is
an eigenvalue of .
Consequently, if , then and have the same roots
in .
Idea. is a
one-liner: apply to an eigenvector . Since scales by , every polynomial
in scales by the value of
the polynomial at . For , a root
gives a factor: . The cofactor has smaller degree, so
by minimality it does not kill , and some vector survives it.
Then
is nonzero and is killed by . The
eigenvector is manufactured by the part of we removed.
Proof. Let
with . Then for every , by induction: it
holds for ,
and , the
first equality by Definition 2.4.2.
Writing , Definition 2.4.2 gives
for every
. With
, Since , Theorem 1.1.9 gives
.
Suppose . By Theorem 6.1.3 (b),
for some , and is monic with by
Theorem 0.8.3. By Theorem 9.5.1, a
nonzero polynomial of degree less than does not
annihilate ; so
, and
there is with . By Theorem 6.7.1 (b),
So with ,
and is an
eigenvalue of .
If ,
the eigenvalues of are exactly the roots
of in (Theorem 9.2.1, (a)
(e)), so and
have the same
roots in . This
proves the theorem.
So the minimal polynomial knows the spectrum, just as
the characteristic polynomial does, although the
multiplicities of the roots may differ. The examples
bear this out. has spectrum , the roots of
.
has spectrum
, the root of
. The
rotation of by a right angle
has
(the check after Theorem 6.7.3), with
no real root, and indeed over
. Its minimal
polynomial has no linear factor at all.
Two consequences are worth stating.
- Invertibility. Taking : for , is invertible if and
only if . Indeed if and only if , if and only if is not
invertible (Theorem 9.2.1, (a)
(c)
with ;
for matrices this is Theorem 9.2.6).
Chapter 6 proved the same statement without eigenvalues
(Exercise (C1: Inverses are polynomials)
(c)).
- Over . If and , then
splits (Corollary 6.5.5), and
its roots are the distinct eigenvalues . So Only the exponents remain to be found.
Computing
the minimal polynomial
There are two practical methods. The first needs
nothing but elimination. The second uses the
eigenvalues, when we know them, to cut the search down
to a few candidates.
Method 1: the first dependence among
powers. The proof of Theorem 6.7.2 searched
for a dependence among . The
first dependence that appears gives
exactly.
Proposition
9.5.4 (The First Dependence Among the
Powers)
Let be
finite-dimensional and . Let be the least integer such
that the list in is linearly
dependent. Then there are unique
with and . In
particular . The same holds for , with
powers of in
.
Proof. Such a exists: with , the space
has
dimension (Theorem 4.1.4),
so the list , of length , is linearly
dependent (Theorem 1.6.3 (a)).
By minimality of ,
the list is independent (for it is empty). By Lemma 1.5.3, since
appending makes
it dependent, . The coefficients
are unique by Theorem 1.4.3.
Let . It is monic, and
by the
displayed relation. Let with . Then with the not all zero, and
this is not
because is independent. So no nonzero
polynomial of degree less than annihilates , and is the monic
annihilating polynomial of least degree. By Definition 9.5.1,
.
Solution. Degree . is not a scalar
multiple of ,
since its -entry is nonzero. So is
independent.
Degree . Multiplying out,
We look for with . The -entries give , so . The -entries give , so . Now check every entry of : So is dependent, and . By Proposition 9.5.4,
This fits Theorem 9.5.3: Example (Diagonalizing a Matrix
with a Repeated Eigenvalue) found the eigenvalues
and , and . Once again the repeated eigenvalue appears only once in
. Section 8
explains that this is exactly why was
diagonalizable.
Method 2: eigenvalues and trial
exponents. Suppose splits, with distinct . By Theorem 9.5.3, every
divides . If we
find any annihilating polynomial of the
form ,
then . By
Lemma 9.5.2, with , so
only finitely many candidates remain, and we test them
from the smallest degree up. The next section proves
that always
annihilates , so
the search always succeeds with . Here we
verify that directly.
Solution. By Theorem 9.5.3, both
and divide , so the candidate
of least degree is . With the product is So . Raise one exponent and try (had
this failed, the other candidate of degree , namely , would
come next). Polynomials in commute (Theorem 6.7.1 (c)), so
we can multiply the matrix just found by on the right:
So , and by Lemma 9.5.2, with and . The case was excluded, so In Section 3 we found
for this matrix. The exponent of in is the polynomial
trace of the same shortage of eigenvectors.
The product in Method 2 need not be multiplied out
completely: to rule out a candidate it is enough to find
one nonzero entry, and to confirm one,
the factored form usually makes the zero visible.
Similar
matrices and block diagonal matrices
The minimal polynomial belongs to the operator, not
to a basis. That is what makes it an invariant of
similarity.
Theorem
9.5.5 (Similar Matrices Have the Same Minimal
Polynomial)
Let be
finite-dimensional with a basis , and let . Then . If are
similar, then .
Proof. By Corollary 4.1.3,
for every . An operator
is zero exactly when its matrix is zero (Theorem 4.1.4),
so if and
only if . Thus and have
the same ideal of annihilating polynomials, and hence
the same monic generator. If , then
by Proposition 4.2.6
(c), so again if and only if , and .
The theorem gives a quick nonsimilarity test. For
instance and
have the same
characteristic polynomial, but , so they are not similar.
Chapter 8 showed that a block diagonal matrix
computes polynomials blockwise: (Theorem 8.1.4 (b)).
So a polynomial kills exactly when it kills both blocks. In
the language of ideals, the answer is the least common
multiple.
Proposition
9.5.6 (Minimal Polynomial of a Block Diagonal
Matrix)
Let and with . Then .
Proof. Let . By Theorem 8.1.4 (b),
, which is zero if and only if
and
. By Theorem 9.5.1, this
holds if and only if . So . This ideal contains ,
and by Definition 6.2.4 its
monic generator is . By Definition 9.5.1 its
monic generator is also , and the
monic generator is unique (Theorem 6.2.2).
For example, has , as computed above. And
has
: a block can contribute a factor that the
other block already contains, and then the factor is not
repeated. This is the difference from the characteristic
polynomial, which multiplies: .
Warning. Equal minimal
polynomials do not make matrices similar. and both have
minimal polynomial , by Proposition 9.5.6. But
their characteristic polynomials and
differ, so they are not similar (Theorem 7.10.3).
Exercises
A. Check your
understanding
Exercise
(A1)
- (a) Define the
minimal polynomial of an operator on a finite-dimensional
space, and give its two equivalent descriptions.
- (b) True or false:
for
every . Justify your answer.
- (c) State the
relation between the roots of and the eigenvalues
of .
- (d) Let satisfy . Which
polynomials can be?
- (e) True or false:
if ,
then .
Justify your answer.
- (f) Explain why
multiplication by
on has no
minimal polynomial.
Solution.
(a) is the unique monic
polynomial with ; equivalently, the
monic polynomial of least degree with (Definition 9.5.1).
(b) False. For
, and .
(c) They
coincide: if and only if is an eigenvalue
of (Theorem 9.5.3).
(d) By Theorem 9.5.1, , so by Lemma 9.5.2. It is not
(as ) and not (as ). So or , and both
occur: and the
matrix of the
Quick check.
(e) False. and have the
same minimal polynomial but different characteristic
polynomials.
(f) For , we have , so for all . The ideal is and has no monic
generator. The space is
infinite-dimensional, so the definition does not
apply.
B. Practice
Exercise
(B1: Computing minimal polynomials)
Find the minimal polynomial of each real matrix.
- (a) .
- (b) .
- (c) , given that .
- (d) , given that .
Hence decide whether and are similar.
Solution.
(a) is not scalar, so
. Here and , and , as one checks entry by entry. By
Proposition 9.5.4,
.
(b) is not scalar. Every
entry of is
, so
. By
Proposition 9.5.4,
.
(c) By Theorem 9.5.3, . First candidate: Next candidate: multiplying this on the left
by , the
rows of the result are , , and , where is the matrix just
found. Since the rows of sum to zero and its
third row is zero, all three products are . So , and by Lemma 9.5.2, .
(d) Again , and since each column of the second matrix has
entries summing to and each row of the
first is a multiple of . So .
Hence , and by Theorem 9.5.5 and are
not similar, although their
characteristic polynomials agree. (This matches Exercise (B1: Computing multiplicities),
where the same two matrices appear as and , with for the first
and for
the second.)
Exercise
(B2: Operators with )
Let be finite-dimensional and with .
- (a) Show that .
- (b) Show that exactly when
, and exactly when
.
- (c) What is on ?
Solution.
(a)
annihilates , so
by Theorem 9.5.1. By Lemma 9.5.2, the monic
divisors are . Since , , so .
(b) If , then .
Conversely, if , then
annihilates , so
, and
by (a).
Likewise if and only if . In all other cases .
(c) On , , so
.
Exercise
(B3: Companion matrices)
Let ,
, and let be its
companion matrix (Exercise (C1: Companion matrices)).
- (a) Show that for , so
for .
- (b) Deduce that no
nonzero polynomial of degree less than annihilates .
- (c) Show that , and hence for all .
- (d) Deduce that
.
Solution.
(a) Column of , for , has a single
in row , so . By induction on , .
(b) Let with . By (a), ,
which is not because some
. So .
(c) By (a), , the last column . Hence
For , polynomials in commute (Theorem 6.7.1 (c)), so
.
(d) By (c), kills the standard
basis, so and . By (b), . Two monic polynomials,
one dividing the other, with ,
are equal (Proposition 6.1.2 (c),
(d)). So , and by Exercise (C1: Companion matrices)
(b). Every monic polynomial of degree is therefore the
minimal polynomial of some matrix.
C. Going deeper
Exercise
(C1: Cyclic vectors)
Let and . A vector is a
cyclic vector for if is a basis of .
- (a) Prove that if
has a cyclic
vector, then .
- (b) Suppose is cyclic and
. Show that the matrix
of in the basis
is the companion matrix of
(for ), and deduce .
- (c) Find a cyclic
vector for , and show that has none.
(The converse of (a), that forces a
cyclic vector, is proved in Chapter 10.)
Solution.
(a) Let with . Then , because the
vectors , , are
independent and some . So , and by Theorem 9.5.1, .
(b) Let . For , , the -th basis vector,
so column of
is .
The last column is . This is . By Theorem 9.5.5 and Exercise (B3: Companion matrices)
(d), . By Definition 7.10.2 and
Exercise (C1: Companion matrices)
(b), . (For , and , so
directly.)
(c) ,
and is independent, so is cyclic. For
, every has ,
so is dependent. This matches (a):
.
Exercise
(C2: Minimal polynomials of the pieces)
Let be
finite-dimensional, , and a -invariant subspace,
with restriction and induced operator
on (Definition 9.1.2).
- (a) Prove that and
for every .
- (b) Deduce that
and .
- (c) Prove that .
- (d) For and ,
compute all three minimal polynomials, and show that
need not equal
.
Hint: for (c), apply to and ask where
the result lies.
Solution.
(a) First, by
induction on : for
,
. Taking linear combinations,
. For the quotient, by the same induction, using Definition 9.1.2 (b)
at each step, and by the coset operations (Theorem 4.4.4).
(b) By (a),
and for all . By Theorem 9.5.1, applied
to
and to , both finite-dimensional, and
.
(c) Let . By (a),
, so . By (a)
again, . Hence
(Theorem 6.7.1 (b)). As
was
arbitrary, annihilates , and by Theorem 9.5.1.
(d) , so and . The
quotient has
basis , and , so and . But , computed earlier. So , while . Compare Proposition 9.5.6:
when has an
invariant complement the lcm is right, but in general it
is not.