10.3 The Jordan Canonical Form
Chapter 4 asked how simple the matrix of an operator can be made by choosing the basis well, and Chapter 9 answered it only for operators with enough eigenvectors. The two previous sections have quietly finished the job: the space splits into generalized eigenspaces, and on each of them the operator is a scalar plus a nilpotent operator, which is a disjoint union of chains. Assembling these pieces gives the best matrix there is, and it is unique. This section states that theorem, proves it, reads the familiar invariants off it, and turns it into a similarity test.
10.3.1. The shape we are aiming for
Here is the goal, stated before its parts are named.
If
The building block is the matrix of
Let
Reading its columns: if
A Jordan matrix is a diagonal matrix with some chains glued in: blocks along the diagonal, each block one eigenvalue with ones above it.
A Jordan matrix is a matrix of the
form
In words: the matrix is block diagonal (Definition 8.1.2),
and each diagonal block is a single Jordan block.
Different blocks may carry the same eigenvalue or
different ones, and the sizes may repeat. A Jordan basis
is a basis that is a concatenation of Jordan chains, one
chain per block. The two descriptions match for
The order of the blocks never
matters. Reordering the blocks of
Examples.
- Diagonal matrices.
is a Jordan matrix with all blocks of size . So every diagonalizable operator has a Jordan form, namely a diagonal one. - The standing counterexample.
is its own Jordan form, and is a Jordan basis: is an eigenvector and . - Nilpotent operators. By Theorem 10.2.3, a
nilpotent operator has the Jordan form
, all eigenvalues . Section 2 is exactly the case of this section. - Mixed blocks.
has , , and . It is the answer to the worked example at the end of this section. - The degenerate case. On a space of
dimension
, every operator is . One block, size one, no superdiagonal to speak of.
Nonexample by minimal change. The
matrix
Why this definition. Two conventions
are being fixed. First, the ones sit
above the diagonal, which matches the
chain order “eigenvector first” of Definition 10.2.2;
putting them below the diagonal gives the transposed
matrix, which is just as good and appears in some books.
Second, the off-diagonal entries are
Warning. A Jordan form
exists only when
10.3.2. The theorem
Every operator whose characteristic polynomial splits is a direct sum of Jordan blocks, in exactly one way.
Let
- (a)
(Existence)
has a Jordan form if and only if splits over . - (b)
(Uniqueness) Suppose
is a Jordan form of . Then for every and every integer , the number of blocks in with equals a number depending only on , , and . Consequently any two Jordan forms of have the same blocks, up to the order in which they are listed.
Equivalently, for
Idea. Existence is an assembly of
the two previous sections, in three steps. ① Split
Proof.
- (a)
Suppose splits, with distinct eigenvalues .Step 1. Split the space. By Theorem 10.1.3,
with nonzero and -invariant, , andStep 2. One eigenvalue at a time. Fix
. By Theorem 10.2.3 applied to , there is a basis of , a concatenation of Jordan chains of , with Since is linear (Theorem 4.1.4) and , where the middle equality is the blockwise addition of Theorem 8.1.4 (a) and the last is Definition 10.3.1.Step 3. Assemble. Let
be the basis of obtained by writing one after another. By Theorem 9.1.5, which by Step 2 is a direct sum of Jordan blocks, that is, a Jordan matrix. So has a Jordan form, and is a Jordan basis. Suppose is a Jordan matrix. Each Jordan block is upper triangular, so is upper triangular, and is triangularizable (Definition 9.7.1). By Theorem 9.7.2, splits over . - (b) Let
, with not necessarily distinct; fix and let . Then , which is block diagonal with blocks , so by Theorem 8.1.4 (b), and the rank of a block diagonal matrix is the sum of the ranks of its blocks (Theorem 8.2.1 (b), applied times). Also equals the rank of this matrix (Theorem 4.1.5 (a)). Now compute block by block.
Blocks with
Blocks with
Adding up, with
For a matrix
Step 1 → Step 2 → Step 3, and the dream comes true:
for every complex square matrix there is a basis
in which the matrix is diagonal apart from some ones on
the superdiagonal, since
Quick check. How many Jordan forms,
up to the order of the blocks, are possible for an
operator with
Solution. The
10.3.3. Reading the invariants off the blocks
The Jordan form makes every invariant of Chapter 9 visible at a glance.
Let
- (a)
is the sum of the sizes of the -blocks of ; in particular if and only if has a -block; - (b)
is the number of -blocks of ; - (c) the exponent of
in is the largest size of a -block of (and when has no -block); - (d)
, summed over the sizes of the -blocks, for every ; - (e)
is diagonalizable if and only if every block of has size , that is, if and only if is diagonal.
Proof. Write
(a)
is upper triangular with diagonal entries repeated times, so (Theorem 7.4.6, Definition 7.10.2). Grouping equal and using that the multiplicity of as a root of a product of powers of distinct linear factors is the exponent it carries (Lemma 6.4.1), . The last claim follows since is the set of roots of (Theorem 9.2.1).(b) Take
in Theorem 10.3.1 (b): the number of -blocks of size , which is all of them, equals by Theorem 2.3.1 and Definition 9.3.2.(c) First,
for every : the polynomial annihilates because and , while , so no smaller power of annihilates it; and divides (Corollary 9.6.2), hence is a power of (Lemma 9.5.2). Applying Proposition 9.5.6 times, the last equality because the least common multiple of powers of linear factors takes, for each factor, the largest exponent occurring (Definition 6.2.4, Theorem 6.3.5).(d) The proof of Theorem 10.3.1 (b) computed
Since , we have , so by Theorem 2.3.1(e) If every block has size
, then is diagonal and is diagonalizable (Definition 9.4.1). Conversely, if is diagonalizable, then is a product of distinct linear factors (Theorem 9.8.2), so every exponent in (c) is , which says that every block has size .
Parts (a) and (b) give the practical reading:
the total size of the
Warning. The multiplicities
10.3.4. Deciding similarity
We can now settle the question Chapter 4 raised and Chapter 7 sharpened: which data decide whether two matrices are similar?
Let
- (a)
; - (b)
splits over , and and have the same Jordan form, up to the order of the blocks; - (c)
and for every and every .
Proof.
(a)
(c). Similar matrices have the same characteristic polynomial (Theorem 7.10.3). If , then for every and (Proposition 4.2.6 (c) applied to the polynomial ), so the ranks agree (Proposition 4.2.6 (a)).(b)
(b). From we get that splits and that (Theorem 9.2.1). By Theorem 10.3.1 (a) both matrices have Jordan forms, and by (b) of that theorem the number of -blocks of each size in each of them is determined by the ranks , with sufficing because and all higher powers have the same rank (Theorem 10.1.1 (d), Theorem 2.3.1). These numbers agree by hypothesis for , and for neither form has a -block (Corollary 10.3.2 (a)). So the two Jordan forms have the same blocks.(c)
(a). Let be a Jordan form of and one of , with the same blocks in possibly different orders. Then , because reordering blocks is a change of basis, as noted after Definition 10.3.2. Hence , and similarity is an equivalence relation (Example (Similarity)).
This is the promise of Chapter 4 kept, and of Chapter
7: when
Remark. The matrices
When
Warning. The Jordan form is
not stable under small changes of the matrix.
For
10.3.5. Computing a Jordan form
The proof is an algorithm: it says to work one eigenvalue at a time and to find chains inside each generalized eigenspace. The rank data tell us the shape before we look for a single vector.
Algorithm. Jordan form and
a Jordan basis of
- Factor
. If it does not split over , stop: there is no Jordan form. - For each eigenvalue
, compute for until the rank stops changing, and get the -block sizes from Theorem 10.3.1 (b), subtracting twice for the exact counts. - For each
, find a Jordan basis of the nilpotent restricted to , as in Section 2: tops of long chains first, then vectors of to complete. - Let
be the matrix whose columns are all the chains, in order; then . Check the answer as , column by column.
Let
Solution. The eigenvalue
The chain for
The eigenvalue
The answer. Writing the three chains one
after another,
The check, column by column. The claim
Cross-checks. The diagonal of
10.3.6. Exercises
A. Check your understanding
- (a) Define a Jordan
block and a Jordan matrix, and state what a Jordan form
of
is. - (b) State the Jordan Canonical Form Theorem, including the uniqueness clause.
- (c) How do you read
, , and the exponent of in off a Jordan form? - (d) True or false:
every matrix in
has a Jordan form over . Justify your answer. - (e) True or false:
if
and have the same characteristic and the same minimal polynomial, they are similar. Justify your answer. - (f) Is
a Jordan matrix? What is its Jordan form?
Solution.
(a)
has on the diagonal and on the superdiagonal (Definition 10.3.1); a Jordan matrix is a direct sum of Jordan blocks; a Jordan form of is a Jordan matrix equal to for some basis (Definition 10.3.2).(b)
has a Jordan form if and only if splits, and then the number of -blocks of size at least is , so the blocks are unique up to their order (Theorem 10.3.1).(c)
is the total size of the -blocks, their number, and the exponent in the largest of their sizes (Corollary 10.3.2).(d) False. A Jordan matrix is triangular, so its existence forces
to split; the rotation by a right angle has , which does not split over .(e) False.
and share and but have different Jordan forms, hence are not similar (Corollary 10.3.3).(f) No: a superdiagonal
may only stand between two equal diagonal entries. The eigenvalues and are distinct, so the matrix is diagonalizable (Corollary 9.4.2) and its Jordan form is .
B. Practice
In each case
- (a)
, . - (b)
, . - (c)
, .
Solution. By Corollary 10.3.2,
the
(a) Partitions of
with largest part : and . So or . The value of — that is, against — decides.(b) For
: partitions of with largest part , only . For : partitions of with largest part , only . So the Jordan form is , and no extra data is needed.(c) Partitions of
with largest part : and . So or , told apart by against , or by against .
For each matrix, find the Jordan form
- (a)
, with . - (b)
, with . - (c)
, with .
Solution.
(a)
has rank , so and there is one block, of size : . A top must satisfy , and has nonzero first column, so works. The chain is so , with . The check reads , , , which are the three chain relations.(b)
has rank , so and the single -block has size ; the eigenvalue gives one block of size . So . For the chain, the third column of is and , so is a top with . Solving gives . Hence and reads , , .(c)
has rank (rows are equal), so : with the -blocks have sizes and . The eigenvalue has , so . Now , and the second column of is , which is nonzero and lies in that kernel, so is the top of the -chain. Completing to a basis of with , and solving to get , we obtain and reads , , , . For instance the second of these is , read off the second column of .
Determine whether each pair of matrices is similar. Justify your answer.
- (a)
and . - (b)
and . - (c)
and . - (d)
and the matrix of Exercise (B2: Jordan forms and Jordan bases) (b).
Solution.
(a) Similar: the blocks are the same and only their order differs, which is a change of basis, as noted after Definition 10.3.2.
(b) Not similar. Both are nilpotent of rank
, but while (Theorem 8.1.4 (b)). By Corollary 10.3.3 (or Corollary 10.2.5) they are not similar; their partitions are and .(c) Not similar, although
and agree, as in the remark after Corollary 10.3.3: for the first and for the second, so is against .(d) Not similar.
is diagonal, so , while has by Exercise (B2: Jordan forms and Jordan bases) (b); its Jordan form is , which is not diagonal. The characteristic polynomials agree, so this pair is another witness that alone decides nothing.
C. Going deeper
Let
- (a) Let
be the reversal permutation matrix, with in each position and elsewhere. Prove that and . - (b) Deduce that
every Jordan matrix
satisfies . - (c) Deduce that
.
Hint: for (c), transpose a similarity
Solution.
(a)
, so for every and , that is, . Since and , it suffices to prove . Both sides are computed on basis vectors: and for , so which is exactly the action of , whose columns satisfy for and . Hence .(b) Let
and let , the direct sum of the reversal matrices of the block sizes. Then is invertible with (Theorem 8.1.4 (c)), and multiplying blockwise (Theorem 8.1.4 (a)), the last equality because transposing a block diagonal matrix transposes each block (Proposition 8.1.2).(c) By Theorem 10.3.1 there are a Jordan matrix
and an invertible with . Transposing and using and (Theorem 0.9.5, Theorem 0.9.7), so . By (b), , and similarity is an equivalence relation (Example (Similarity)), so .
Work over
- (a) Find all Jordan
forms with
and . - (b) Find all Jordan
forms with
and . - (c) In (b), what is the least amount of extra information that determines the Jordan form?
- (d) Prove that
and determine the Jordan form whenever for every eigenvalue .
Solution.
(a) For
: partitions of with largest part , so only. For : partitions of with largest part , so only. There is exactly one Jordan form,(b) For
: partitions of with largest part , namely and . For : as before. So there are two Jordan forms,(c) The single number
, which is for the first and for the second; equivalently or (Corollary 10.3.2 (b)).(d) Fix
with and let be the exponent of in , which is the largest block size (Corollary 10.3.2 (c)). The -blocks form a partition of with largest part . For the only partition is . For : gives , and gives . For : gives , gives , and gives . In every case the pair determines the partition, so the blocks for each eigenvalue, and hence the whole Jordan form, are determined by and . The first ambiguity appears at , , which is part (a) of Exercise (B1: Jordan forms from polynomial data).