The rational canonical form of the previous section
is a complete answer to the similarity problem, but the
proof did not tell us how to find the invariant
factors of a given matrix. This section supplies the
missing algorithm, and it comes from an unexpected
place: instead of working with , we work with the
single polynomial matrix , and we reduce it by row and column
operations whose scalars are allowed to be polynomials.
The reduced form is diagonal, its nonconstant diagonal
entries are the invariant factors, and two matrices are
similar exactly when their reduced forms agree. On the
way we finally pay off a promise from Chapter 4: every
square matrix is similar to its transpose, over every
field.
The space
as a module over the polynomials
Everything in this chapter is built by applying
polynomials in to vectors: the -annihilator of a
vector, the cyclic subspace , the
kernels .
Name that structure once. For a vector space over
and , the product
satisfies, by Theorem 6.7.1, exactly
the vector space axioms with replaced by : it is additive in
each factor, , and . A set with an addition and a product
by the elements of a commutative ring obeying these rules is
an -module, so the
pair is the
same thing as an -module that is
finite-dimensional over the constants . We develop no general
theory of modules; the point is the dictionary:
| submodule of |
-invariant
subspace (Definition 9.1.1) |
| submodule generated by , that is |
cyclic subspace (Definition 10.5.1) |
| the annihilator of in |
the -annihilator of |
| is generated
by one element |
has a cyclic
vector |
A subspace closed under multiplication by is closed under
multiplication by every polynomial, which is why the
first two lines match.
Where does come from here? Fix with . As an -module, is generated by , subject to the relations , whose coefficient vectors are
the columns of . So is the matrix of relations,
and changing generators or replacing one relation by a
combination of relations should not change . That is the intuition
behind the operations we now allow; the proofs below are
matrix proofs and do not rely on it.
Row and
column operations with polynomial multipliers
A matrix in will be called
a polynomial matrix. Over a field we
reduced a matrix by three kinds of row operation (Definition 3.2.1).
Over we must
be careful with one of them: multiplying a row by cannot be undone,
because has no
inverse in . So
the scaling operation keeps its scalar in , while the operation
that adds a multiple of one row to another may use any
polynomial multiplier.
Definition
10.7.1 (Elementary Operations over )
Let . An elementary row operation
over
on is one
of:
- (E1) interchanging
two rows;
- (E2) multiplying one
row by a nonzero scalar ;
- (E3) adding times one row to a
different row, where is
any polynomial.
Elementary column operations over are defined
the same way with “column” in place of “row”.
In words: (E1) and (E3) are as over a field, except
that (E3) now permits a polynomial multiplier; (E2) is
restricted, because only the nonzero constants have
inverses in .
Each of the three is reversible by an operation of the
same kind: swap back, scale by , add times the row
back.
Two polynomial matrices reachable from one another by
such operations should count as the same. As over a
field (Definition 4.3.1),
the clean way to say this is with invertible matrices on
both sides — but “invertible” must now mean invertible
inside .
Proposition
10.7.1 (Invertible Polynomial Matrices)
Let . Then has an inverse in
if and
only if is
a nonzero constant.
Proof. Suppose
with
.
Taking determinants and using multiplicativity over the
commutative ring (Theorem 7.5.4 and the
remark on commutative rings after it), . By Theorem 0.8.3, , and degrees of nonzero polynomials
are , so ; that
is, .
Suppose . The adjugate identity holds over any commutative ring (Theorem 7.6.2 and the
remark on commutative rings following it), and ,
since its entries are minors of . So satisfies .
Definition
10.7.2 (Equivalence over )
Let . We say and are
equivalent over , written
,
if there are , each invertible in , with
Proposition
10.7.2 (Operations and Equivalence)
Let .
- (a) is an equivalence
relation on .
- (b) If is obtained from
by a finite
sequence of elementary row and column operations over
, then .
Proof.
(a) Take for
reflexivity. If , then , and are
invertible in ; this gives
symmetry. If and , then , and a product of invertible matrices
is invertible, which gives transitivity.
(b) Each
elementary row operation over is left
multiplication by the matrix obtained by performing that
operation on ,
exactly as over a field (Theorem 3.4.1,
whose proof uses only the ring operations). Those three
matrices are , , and with , of determinants
, , and respectively (Theorem 7.4.6 and Theorem 7.5.1, valid
over a commutative ring), hence invertible in by Proposition 10.7.1.
Column operations are right multiplication by the same
matrices. Now use (a).
Warning. Multiplying a row
by a nonconstant polynomial is not an allowed
operation. It changes the answer. The matrix
becomes after “multiplying row 1
by ”, and the two
are not equivalent: their determinants are and , and by Proposition 10.7.1
the first is invertible over while the second is
not. The rule to remember is that only the
units of — the nonzero
constants — may be used as scaling factors.
Every polynomial matrix can be brought to a
diagonal form whose diagonal entries divide one another
in turn, and that form is unique.
The existence proof is Euclidean division, run on
whichever nonzero entry has the smallest degree: if that
entry fails to divide one of its neighbors in the same
row or column, the remainder gives a nonzero entry of
strictly smaller degree, and degrees cannot decrease
forever.
Since
holds only for , the divisibility chain forces the zero
entries, if any, to be the last ones.
Idea. Step roadmap for
existence. ① Among all matrices reachable from
by operations,
pick one whose smallest nonzero entry degree is least,
and move that entry to the corner. ② That corner entry
must divide every
other entry of its row and column: otherwise divide with
remainder and produce an entry of smaller degree,
contradicting the choice in ①. ③ Clear the first row and
column with ; the
same remainder trick, after adding a row to the first
one, shows
divides every entry of what is left. ④ Induct on the
size. The divisibility survives the induction because
operations replace entries by -combinations of
entries.
For uniqueness, find a quantity that can be read off
both and . The greatest common
divisor of all minors is such a quantity: minors of a
product are -combinations of
minors of the factors (Cauchy–Binet), so the gcd cannot
change under equivalence, and for a diagonal matrix with
a divisibility chain it is simply .
Proof.
- (a) If , it is already of
the stated form. So assume .
For a nonzero put the least degree of a nonzero entry. Let be the set of all
nonzero matrices obtainable from by finite sequences of
elementary row and column operations over ; it contains . The set is a nonempty subset of , so it has a least
element; fix with
least.
Step 1. Put a least-degree entry in the
corner, monic. Choose with and .
Swapping row with
row and column
with column (operations (E1)), and
then scaling the new first row by the inverse of the
leading coefficient of the corner entry (operation
(E2)), we obtain a matrix in whose -entry is
monic of degree . These
operations permute the entries and rescale some of them,
so the new matrix still has least nonzero entry degree
. Rename
it .
Step 2. divides every entry of
the first row and the first column. Suppose
for
some . By Theorem 6.1.1, with
and .
Adding times
column to column
(operation (E3))
produces a matrix whose -entry is with . Then , contradicting the minimality of
. Hence
for
every , and the
same argument with rows in place of columns gives for every
.
Step 3. Clear the first row and
column. For add times column
to column ; the multipliers are
polynomials by Step 2, and after these operations the
first row is while the first column is unchanged. Then
for add
times
row to row ; since the first row is
now , this clears the first column and changes
nothing else. The result is and its least nonzero entry degree is still
: it is
by
minimality, and
is an entry of degree .
Step 4. divides every entry of
.
Suppose for some . Add row to row . The new first row is
, so the -entry of the
resulting matrix is
,
which is not divisible by , while the -entry is still
, monic of degree
. By
minimality , so Step 2 applies to and says
that divides
every entry of the first row of — a
contradiction.
Step 5. Induct on . We prove (a)
by induction on .
For , scale
the single entry to be monic (or leave it ). For , Steps 1–4 give a
sequence of operations taking to with
monic and dividing every entry of
. By the
induction hypothesis there are operations taking to with every monic or zero and
; performing the corresponding operations on
rows and columns of takes it to .
It remains to see that . By Proposition 10.7.2,
for some , so every entry of is a sum of
products
(Definition 0.9.9) and
is therefore divisible by , since every is. In
particular . Setting finishes the induction.
- (b) Call a set with
a -set.
For and define the -th
determinantal divisor and if all the minors of
vanish. This is
well defined by Proposition 6.2.1 and
Theorem 6.2.2: the
ideal generated by the finitely many minors is
for exactly one monic unless the
ideal is .
Equivalently, is the monic
greatest common divisor of the minors: it
divides each of them, and every common divisor of them
divides it (Theorem 6.2.3,
extended from two polynomials to finitely many by the
same ideal argument).
Claim 1. implies for every .
Proof. Let with
invertible
over , and let
be -sets. The submatrix of
a product on rows
and columns is
the product of the submatrix of the left factor on rows
and all columns
with the submatrix of the right factor on all rows and
columns (Definition 0.9.9, read
off entry by entry). Applying this twice and then Theorem 7.7.2 over
the commutative ring — legitimate by the
remark after that theorem — to the times products
involved, with
and running over
the -sets. So
every
minor of is
an -combination
of
minors of , hence
lies in . Therefore divides
every
minor of ,
and so . Exchanging the roles of
and using gives . Two monic polynomials dividing
each other are equal (Proposition 6.1.2),
and if one is so
is the other.
Claim 2. If with , then .
Proof. Let be -sets. If , pick ; row
of has its only possibly
nonzero entry in column , so the submatrix has a zero row
and . If , then and (Theorem 7.4.6, valid
over the commutative ring by the remark after
it). Since , the chain gives for each
, hence So divides every minor of , and it is itself the
minor for . Hence the ideal generated by the
minors
is . If it is
monic, being a product of monic polynomials, and equals
. If
,
say with
, then for
every -set we have , so forces
and the
minor vanishes; thus .
Now let with the as in (a). By Claims
1 and 2, a quantity depending only on . Reading this
backwards recovers the : first ; and
for , if
then , while if then
, so some with , and the chain forces . Hence any second
list as in (a) satisfies the same recipe and
equals . This proves the theorem.
The proof is an algorithm, and it is the one to use
by hand: hunt for the entry of least degree, divide, and
repeat.
Algorithm. Smith normal
form of .
- If ,
stop. Otherwise find a nonzero entry of least degree and
move it to position by a row and a
column swap; scale row so that the entry is
monic. Call it .
- For each other entry in row or column with , replace by its remainder on
division by
(subtract a multiple of column , resp. row ), move the remainder to
the corner, and go back to step 1.
- When divides
all of row and
column , clear
them. If some entry of the remaining block
is not divisible by , add its row to row
and go back to
step 2.
- Repeat on the remaining
block.
- Check the answer: must equal . In
particular is rescaled by a nonzero constant to be monic,
and is the
monic gcd of the entries.
Quick check. Two polynomial
matrices in have
determinants
and , and in
both the greatest common divisor of the four entries is
. Are they
equivalent over ?
Solution. Yes. Here (the gcd of
the
minors, that is, of the entries) and is the
determinant rescaled to be monic, so for both.
By Theorem 10.7.3
both have Smith normal form , and since
is an
equivalence relation (Proposition 10.7.2
(a)) they are equivalent to each other. For matrices the
pair is therefore a complete
invariant.
Solution. We have
Find the corner. The entries of least degree
are the three entries equal to . Swap columns and , then multiply the
first row by :
The corner is now , which divides
everything, so no division step is needed.
Clear the first column. Add times row to row , and add row to row . In row this gives entries
and ; in row it gives and
:
Clear the first row. Add times column to column , and times column to column . Since the first column
below the corner is zero, nothing else changes: Every entry of the block is
divisible by , so
we move on to the block.
The block. Its entries of least degree are
the three of degree . Swap rows and and scale the new row
by , putting the monic
in the corner
of the block: Now
divides every entry of its row and column. Add column
to column , which clears the
block’s first row and turns the -entry into : Add times row to row to clear the block’s
first column: and , so by the uniqueness in Theorem 10.7.3
this is the Smith normal form.
The check. The matrix has an entry
, so . Its
determinant is — expanding along the first row, which is — so . For
, the minor
on rows and
columns is
, so ; and every minor is
divisible by ,
as Claim 2 predicts from . Hence , and in agreement. As a sanity check on itself: has rank , so and the
Jordan form of
is (Corollary 10.3.2).
Similarity
read off from a polynomial matrix
We can now state the theorem that makes all of this
useful. It converts a question about and — is there an
invertible with ? — into a question about the two
polynomial matrices and , which the Smith algorithm answers by
computation.
One direction is immediate. The other needs a tool:
polynomial matrices can be divided by , with a
constant remainder.
Lemma
10.7.4 (Division of a Polynomial Matrix by
)
Let and . Then there are and
with
Idea. Write as a polynomial with
constant matrix coefficients. The
scalar identity has a matrix
version , in which the second factor is a
polynomial in and
and so commutes
with .
Replacing each by
puts a factor in front of everything except a constant
matrix.
Proof. Collecting the coefficients
of each power of
in the entries of , write with ; note that is a scalar
polynomial, so . For put Expanding the product and telescoping, for every . Therefore with and , as claimed.
Theorem
10.7.5 (Similarity as Equivalence of and )
Let be a
field, , and
.
Then
Idea. is a
one-line computation: a constant invertible is also an invertible
polynomial matrix.
is
the substance, and the whole difficulty is that the
matrices
witnessing the equivalence have polynomial entries,
while we must produce a constant . The trick is to
divide by and keep only
the constant remainder . Comparing degrees in
the resulting identity shows that alone already
conjugates: , that is, . Running
the same argument on the inverted relation produces a
second constant with ,
and multiplying the two expressions for and shows , so is invertible.
Proof. Suppose
with
invertible. Then, inside , and have nonzero
constant determinants, hence are invertible over (Proposition 10.7.1).
So .
Suppose with invertible over .
Step 1. Divide by . By Lemma 10.7.4 there
are and with . Substituting into , so .
Multiplying on the right by and putting we get
Step 2. is a constant matrix,
and . Suppose and write with and . The
coefficient of in is , while the
left-hand side of (1) is , whose coefficients vanish beyond . Hence , that is
. So in every
case .
Comparing the coefficients of in (1) gives , and comparing
the constant terms gives . Therefore the second form because . Moreover turns the
definition of
into
Step 3. The same argument, inverted.
From , , which is with interchanged and
replaced by
the invertible polynomial matrices . So
Steps 1 and 2 apply and give and
with
Step 4. is
invertible. Multiplying (3) by (4), By the first identity in (4), , so the third summand is and
If , write with ; the
coefficient of on the right is
, while
the left-hand side is constant. Hence and . By Theorem 3.4.5,
is invertible
with .
Step 5. Conclude. By (2), , so and
. This
proves the theorem.
Two by-products are worth recording. Whenever
with
invertible over , taking determinants
gives with nonzero
constants (Proposition 10.7.1);
both and
are monic of
degree , so which recovers the invariance of the
characteristic polynomial. And, by Theorem 10.7.3,
the test is now decidable by a finite computation in
: reduce and to Smith normal
form and compare.
Corollary
10.7.6 (The Smith Form of Carries the
Invariant Factors)
Let with invariant factors as in Theorem 10.6.5.
Then the Smith normal form of is In particular the invariant factors of are exactly the
nonconstant diagonal entries of the Smith normal form of
, read from
the top down, and two matrices in are similar if and
only if
and have
the same Smith normal form.
Proof. By Theorem 10.6.5,
with monic, , and
. By
the
direction of Theorem 10.7.5 it
is enough to find the Smith normal form of the equality by Theorem 8.1.4
(a).
One block. Let be monic of degree
. By Definition 10.5.3,
the only nonzero entries of are on the diagonal (with
in the
corner), in each
position ,
and the entries of the last column. Delete row and column . In the remaining
matrix, the entry in position is the -entry of : it is
when , it is when , and it is when . So that matrix
is upper triangular with every diagonal entry , and its determinant
is
by Theorem 7.4.6, again
over . Hence
. By Claim 2 in the proof of Theorem 10.7.3,
the determinantal divisors of any matrix are the partial
products of its Smith diagonal, so and therefore for every
. Also
by Theorem 10.5.3. By
the uniqueness part of Theorem 10.7.3,
the Smith normal form of is .
(For read
this as .)
Assembling. If
with witnesses , then with witnesses and
,
which are invertible with inverses ,
(Theorem 8.1.4 (a),
(c)). So
is equivalent to the direct sum of the matrices ,
a diagonal matrix whose diagonal entries are ones and the
polynomials . Simultaneous row and column swaps — each a
pair of elementary operations — reorder these entries at
will, so
is equivalent to and this is already in the shape required by
Theorem 10.7.3
(a), because and all the entries are
monic. By uniqueness it is the Smith normal
form of .
The final claim combines this with Theorem 10.7.5 and
the uniqueness in Theorem 10.7.3.
So the determinantal divisors of compute the
invariant factors of without any
factorization of polynomials: is a gcd,
obtained from the Euclidean algorithm alone. Moreover
and .
Every
matrix is similar to its transpose
Chapter 4 asked whether and are always similar
and postponed the answer; Exercise (C1: A matrix is similar to its transpose)
settled it whenever splits. The Smith
form removes that hypothesis, because transposing a
matrix does not change its minors.
Corollary
10.7.7 (A Matrix Is Similar to Its
Transpose)
Let be any
field and . Then .
Proof. Let , so that
. For -sets we have by Definition 0.9.10, so
by Theorem 7.4.5, valid
over the commutative ring . Hence the minors of
are exactly
the
minors of ,
listed in a different order, and By Theorem 10.7.3,
each of
and is
equivalent over to the diagonal
matrix built from its own determinantal divisors, and
these two diagonal matrices coincide. Since is an equivalence
relation (Proposition 10.7.2
(a)), . By Theorem 10.7.5,
.
Two sentences of consequence. An operator and its
dual have the same invariants: by Theorem 5.4.2 the matrix
of in the
dual basis is ,
so and share their
characteristic polynomial, their minimal polynomial, and
their invariant factors. And a matrix and its transpose
always have the same Jordan form when one exists, which
says that the rows of are
exactly as informative as its columns.
Warning. Similar is not the
same as “equivalent over ” for the matrices
themselves. The theorem compares with , not with . As polynomial
matrices, any two invertible are
equivalent over — take , — whether or not
they are similar. The whole content of Theorem 10.7.5 is
that inserting the variable on the diagonal
remembers the conjugation.
Exercises
A. Check your
understanding
Solution.
(a) Swap two
rows; multiply a row by a nonzero
scalar of ; add a
polynomial multiple of one row to a
different row (Definition 10.7.1).
The scaling operation is restricted, because only the
nonzero constants are invertible in ; multiplying a row
by is not
reversible.
(b) is invertible over
if and only if
is a
nonzero constant (Proposition 10.7.1).
(c) Every is
equivalent over , by elementary
operations, to a diagonal
with each monic
or zero and ; this diagonal is unique (Theorem 10.7.3).
(d) is the monic
generator of the ideal generated by all minors of
, equivalently
their monic gcd. It is unchanged by equivalence because
every
minor of
is an -combination of minors of
, by the
Cauchy–Binet formula (Theorem 7.7.2; Claim
1 in the proof of Theorem 10.7.3).
(e) False.
Equality of determinants says only ; the lower determinantal
divisors can differ. For and in , both determinants
are , but the
Smith normal forms are and
.
(Equivalently, the matrices are not similar, by Corollary 10.3.3.)
(f) is the
last diagonal entry of the Smith normal
form of ,
that is (Corollary 10.7.6,
since the last diagonal entry is in the
notation there).
B. Practice
Solution.
(a) , so
is invertible over (Proposition 10.7.1)
and . The Smith normal form is .
(Concretely: subtract column from column to get , then subtract row from row , swap columns, and
clear.)
(b) Here and
. Reading the determinantal
divisors backwards as in the proof of Theorem 10.7.3,
the Smith normal form is and indeed divides . By
operations: add column to column , giving first column
;
subtract row from
row to get in column
; the entry has least degree,
so swap it into the corner, scale by , and
continue.
(c) The minor on rows
and columns
is , so , and then
as
well (it divides ). Expanding
along the
first row, , so and
the Smith normal form is . Note
with , and Corollary 10.7.6
predicts exactly this, since a companion matrix has the
single invariant factor .
Solution. One remark makes the
minors easy. If with square blocks, and are -sets, split and
according to the blocks. If , then
has a zero
row or a zero column and ; if
, then
and the determinant is
the product of the two, by Theorem 7.8.4, whose
proof uses only sums and products of entries and so
applies over
(the remark after that theorem). So the minors
of a block diagonal matrix are the products of
matching-size minors of the blocks. Here is the direct
sum of the blocks , each upper triangular with on the diagonal and
on the
superdiagonal.
(a)
with , whose
minors are the entries for and
for . By the
remark, the minors of are for ; the products of two minors
together with
for ; times a minor for
; and for . Hence so by Theorem 10.7.3 the
Smith normal form is ,
the invariant factors are , is the last
of them, and the Jordan form is .
(b) Now with . The minors
of are for ; for
, the value
coming from rows
and columns
; and for . By the remark, the
minors
of are
those of
together with
times its minors, so The Smith normal form is : the
invariant factors are , is the last of them, and the Jordan form is
. Compared with (a) the determinants
agree but
does not, which is exactly why the two matrices are not
similar.
(c) . Then
and
,
so the Smith normal form is , the
only invariant factor is , and the Jordan form is . Consistently,
is a companion
matrix up to similarity, since (Theorem 10.5.6).
Solution.
(a) Similar. Here
, so Corollary 10.7.7
applies. (Explicitly, and for
both, so both Smith normal forms are .)
(b) Similar. By
Example (A Smith Normal Form Computed by Hand)
the Smith normal form of is . For , . Its entry gives . By the
block-minor rule in the solution to Exercise (B2: Invariant factors from determinantal divisors),
the
minors are ,
from the
block, together with the products of a minor of each
block, that is , and ; so . Finally
. The Smith normal forms agree, so
and .
(c) Similar. Here
and each has an entry that is a nonzero
constant, so in both cases; and . So both Smith normal forms
are , hence and by Theorem 10.7.5.
Note that
is irreducible over , so no Jordan form
exists over and
Exercise (C1: A matrix is similar to its transpose)
would not have decided this pair. (Here , so Corollary 10.7.7
does not apply directly; the Smith forms settle it
anyway.)
C. Going deeper
Solution.
(a) Every can be
brought by integer elementary operations — swap two rows
or columns, multiply a row or column by (the units of ), add an
integer multiple of one row or column
to another — to a diagonal matrix
with every and , and this diagonal is unique. “Monic”
is replaced by “nonnegative”, which is the normalization
available because the units of are . Uniqueness again
follows from the determinantal divisors , now nonnegative
integer gcds of the minors, using the Cauchy–Binet formula (Theorem 7.7.2, valid
over any commutative ring by the remark after it) over
the commutative ring .
(b) The least
absolute value among the entries is , already in the corner.
It divides and
. Subtract times column from column , and times row from row : the last step multiplying row by . Since , the Smith
normal form is . Check: and .
(c) By (b) and
the hint, the group is ,
of order . This is the structure theorem for finite
abelian groups in miniature: the invariant divisors
of the relation matrix are the orders of
the cyclic factors.
Solution.
(a) Write , the
monic gcd of the entries, that is, the monic generator
of the ideal (Theorem 6.2.2). A swap
permutes the entries, so the ideal is unchanged. Scaling
a row by replaces two generators by , and since is a unit, so the ideal
is unchanged. Adding times row to row replaces by , which
lies in the old ideal; so the new ideal is contained in
the old one, and the operation is reversed by adding
times row to row , which gives the
reverse containment. The same three arguments apply to
columns. Hence is
unchanged.
(b) By
multiplicativity of the determinant over the commutative
ring (Theorem 7.5.4 and the
remark on commutative rings), , and are
nonzero constants by Proposition 10.7.1.
Take .
(c) By Proposition 10.7.2
and (a),
is an invariant of equivalence as far as elementary
operations go; and for a general equivalence the
argument of (a) applies verbatim with the generators of
the ideal replaced using ,
and symmetrically. For the two diagonal matrices, since and is monic (or ); likewise
. Hence . By (b), for some nonzero constant ; if then
, and
two monic polynomials (or two zeros) differing by a
constant factor are equal, so . If , then by the
divisibility chain.