Every theorem so far in this chapter has been a
yes-or-no statement. An operator either commutes with
its adjoint or it does not; there either is an
orthonormal basis of eigenvectors or there is not. That
is unsatisfying, because the two matrices and are both nonnormal, and
no one would want to treat them alike. This section
replaces the yes-or-no answer with a number. The number
comes out of Schur’s theorem almost for free, once we
know that the Frobenius norm cannot tell one orthonormal
basis from another, and it turns out to measure exactly
the mass that a Schur factorization is forced to leave
above the diagonal.
Throughout, and carries the
standard inner product. Eigenvalues are always counted
in and
with algebraic multiplicity, so that an
matrix
always has a list of exactly of them (Corollary 6.5.5).
The
yardstick
Sizes here are measured in the Frobenius
norm, which Chapter 11 §07 defined as the norm
induced by the Frobenius inner product: where . It is the right instrument here
for one reason, proved there: unitary factors are
invisible to it, so for unitary and , and in particular a
unitary similarity leaves it alone (Lemma 11.7.5).
Everything below follows from that one sentence and from
Schur’s theorem.
Schur’s
inequality
Here is the observation the section is built on.
Write a matrix in a Schur form . The
diagonal of
holds the eigenvalues, so is the Frobenius mass
sitting on the diagonal of . The rest of sits strictly above
it. And by Lemma 11.7.5 the
total mass of is
the total mass of . Rearranged, that is a
theorem.
Theorem
12.11.1 (Schur’s Inequality)
Let have eigenvalues , listed with algebraic multiplicity.
Then with equality if and only if is
normal.
Idea. Schur-triangularize, then
count. ① with upper triangular and
the on
its diagonal (Corollary 12.1.3).
② The Frobenius norm does not notice the ’s, so . ③ Splitting into its
diagonal part and its strictly upper part gives the
inequality on the nose, with the strictly upper part as
the exact surplus. ④ For the equality case, that surplus
vanishes exactly when is diagonal, and
“triangular and normal” and “diagonal” were shown to be
the same thing in Lemma 12.4.1.
Proof. By Corollary 12.1.3
there are a unitary and an upper
triangular with and for
every . Since
whenever
, the
entries of fall
into the diagonal ones and the strictly upper ones, so
by Lemma 11.7.5
(12.11.1)
The second sum is a sum of nonnegative reals, so it
is , and the
inequality follows. Moreover equality holds if and only
if that sum is ,
which happens if and only if for all , that is, if and
only if this is diagonal.
Suppose is
normal. Then so is : using in the
middle of each product, A normal upper triangular matrix is diagonal
(Lemma 12.4.1), so
is diagonal and
Eq. 12.11.1 gives
equality.
Suppose equality holds. Then, as noted, is diagonal, so exhibits
as unitarily
diagonalizable, and Corollary 12.4.3
makes
normal.
This proves the inequality and both halves of the
equality case.
Notice that the proof never had to worry about
which Schur factorization was used. The two
sides of the inequality — the eigenvalue list and — are
determined by
alone, so the surplus in Eq. 12.11.1 comes
out the same for every triangularization of , even though the
individual entries certainly do not.
That is worth a second look, and we will look at it in a
moment.
Example
(Both sides of Schur’s inequality)
Verify Theorem 12.11.1
for and locate the surplus inside an explicit
Schur factorization (Corollary 12.1.3).
Solution. Here and , so and the
eigenvalues are . Thus and indeed . The inequality is strict, so Theorem 12.11.1
already says that is not normal — no
product of matrices needed.
For the factorization, solve : the first row reads ,
giving the eigenvector of norm . Take a pair of orthonormal vectors, and let have them as columns.
Then Its Frobenius mass is , as Lemma 11.7.5
promises, and the split of Eq. 12.11.1 reads
: the
whole surplus is the single entry above the
diagonal.
Quick check. The real matrix has and no
real eigenvalue at all. Does Theorem 12.11.1
fail for it?
Solution. No, because the
eigenvalues are counted in . They are and , so : equality, which is
exactly right, since makes normal. Restricting
the eigenvalue list to would leave the
left-hand side empty and the statement meaningless; this
is one more place where the Fundamental Theorem of
Algebra (Theorem 6.5.1) is
doing silent work.
The
departure from normality
Schur’s inequality has a slack term, and the slack
term is the interesting object. It is nonnegative for
every matrix; it vanishes exactly on the normal ones;
and, both of its ingredients being unitary-similarity
invariants, it survives a change of orthonormal basis.
Those are precisely the properties one wants of a
measurement, so we name it.
The departure from normality is the Frobenius
mass that no Schur factorization can push onto the
diagonal.
Definition
12.11.1 (Departure from Normality)
Let have eigenvalues , listed with algebraic multiplicity.
The departure from normality of is the nonnegative
real number defined by
Clause by clause: the quantity on the right is a real
number because and each
are real; it is nonnegative by Theorem 12.11.1,
which is what allows us to take its nonnegative square
root and call the result ; and the
eigenvalue list, though it comes with no preferred
order, contributes a sum that does not care about the
order. So is well
defined, with no choices made anywhere.
Two facts come straight from Theorem 12.11.1
and its proof.
-
if and only if is normal.
This is the equality case, restated.
- for
every Schur factorization , by Eq. 12.11.1. So
is the
length of the strictly upper triangular part of , and the remark after
Theorem 12.11.1
says that this length is the same for all of them, even
though the entries are not.
And one more, which is the reason the number deserves
to be called a measurement rather than a coincidence:
for every unitary . Both ingredients are
unitary-similarity invariants — the Frobenius norm by Lemma 11.7.5, the
eigenvalue list because similar matrices have the same
characteristic polynomial (Theorem 7.10.3). Exercise (C1: Unitary similarity preserves the defect, ordinary similarity does
not) asks for the details, and for an example
showing that ordinary similarity wrecks the number
completely.
Example
(The defect of a Jordan block)
Compute for
the
Jordan block with eigenvalue .
Solution. The matrix has in each of its
diagonal
positions and in
each of the
superdiagonal positions, and zeros elsewhere, so It is upper triangular, so its eigenvalue list
is repeated
times (Theorem 9.7.4), giving
. Subtracting, Three things are worth reading off. The answer
does not depend on : sliding a Jordan
block up and down the complex plane does not make it
more or less normal. It is exactly when , agreeing with the
fact that a matrix is normal. And it grows with the
block, which matches what Theorem 12.3.5
gave us in Section 3: a normal operator has no Jordan
block of size larger than (Theorem 10.3.1).
Here the defect is counting exactly the superdiagonal
ones that normality forbids.
A minimal-change nonexample makes the same point on a
smaller scale. The matrix is normal, so
its defect is .
Change the single entry in position from to : so . The eigenvalues did not move — a triangular
matrix wears them on its diagonal — and the entire
change went into the defect. That is the general picture
for triangular matrices: for them, is just the length
of everything above the diagonal.
The defect also bounds something one might actually
want to know. Fix a Schur factorization (Corollary 12.1.3),
write for the
diagonal part of , and put , which is
normal by Corollary 12.4.3.
Then the first step by Lemma 11.7.5. So
is an
upper bound for the Frobenius distance from to the set of normal
matrices. It is not that distance.
Warning. is a defect, not a
distance. It is tempting to read as “how far
is from the
nearest normal matrix”, and the displayed bound above
makes the temptation worse. But the bound can be strict.
Take , so that by Example (The defect of a Jordan block).
The symmetric — hence normal — matrix satisfies
So some normal matrix is strictly nearer to
than . What measures is
the mass that survives triangularization, which
is a genuine and useful quantity, but it is an upper
bound for the distance and not the distance itself.
Eigenvalues that will not sit still
Here is why anyone outside this chapter cares.
Eigenvalues are computed, in practice, from data that is
only approximately right, so the question “if I move the
matrix a little, how far do the eigenvalues move?” is
not academic. For a normal matrix the answer is “just as
little”. For a matrix with a large defect it can be
“enormously further”. The following pair of matrices shows
the whole phenomenon with nothing but the quadratic
formula.
Example
(A perturbation that moves the eigenvalues a thousand
times as far)
Fix a real number and a real with . Compare the effect of adding to the
lower-left entry of each of Compute the defects of and , the eigenvalues of
both perturbed matrices exactly, and the distance each
eigenvalue travels.
Solution. The two defects.
The matrix is
upper triangular with both diagonal entries , so its eigenvalue list
is and The matrix is normal: , a direct multiplication. So . Its
eigenvalues are , since . The two matrices have the same
diagonal and the same entry in the corner we are
leaving alone; where they differ is that one has defect
and the other
defect .
The nonnormal one. Perturbing the corner
gives , with The perturbation has size , and each eigenvalue has moved a
distance ,
which is
times the size of the perturbation. With and ,
the perturbation is one ten-thousandth and the
eigenvalues move by : a thousandfold amplification.
The normal one. Perturbing the same corner
gives , with the square root being a real number because
.
The eigenvalue has moved to , a distance of where the middle equality multiplies top and
bottom by and the last step uses . So here the eigenvalues move by at
most the size of the perturbation. The same
denominator is at most , so the movement is
also at least : with and it
is a shade over .
The contrast is not an accident of these two
matrices, and it is not a theorem we can prove here
either. The general statement — that for a
diagonalizable
every eigenvalue of a perturbed lies within of some
eigenvalue of ,
where
measures how far from unitary the diagonalizing matrix
is, and that exactly in the normal case — is the
Bauer–Fike theorem. It needs matrix norms and a little
analysis, and Chapter 20 develops both and proves it.
What the example above establishes on its own is modest
and exact: of two matrices with the same diagonal and the same
large off-diagonal entry, the one with defect amplifies a corner
perturbation by a factor of at most , and the one with
defect amplifies
it by . The
defect is not bookkeeping.
The
characterizations collected
Schur’s inequality gives a normality test of a new
kind. Every earlier test compared two matrix products or
ranged over all vectors; this one compares two numbers,
and one of them is a trace.
Theorem
12.11.2 (Normality as a Trace Identity)
Let have eigenvalues , listed with algebraic multiplicity.
Then is normal
if and only if
Proof. We showed above that . So the displayed equation is the
equality case of Theorem 12.11.1,
which holds exactly when is normal.
Small as it is, this is the first criterion in the
chapter that never asks for . If the spectrum
is already known — from the characteristic polynomial,
or because the matrix arrived in triangular form —
normality costs one sum of squared moduli and
one sum of
more.
We can now put every description of normality in one
place. Sections 3 and 4 proved most of them; this
section adds the last one; and one equivalence, the
converse of Corollary 12.4.5,
has not been proved anywhere and is proved here.
Theorem
12.11.3 (Normality: The Complete List)
Let have eigenvalues , listed with algebraic multiplicity,
and put both of which are Hermitian, with . The
following are equivalent.
- (a) , that
is, is
normal.
- (b) for every .
- (c) for all
.
- (d) .
- (e) has an orthonormal
basis of eigenvectors of .
- (f) for some
unitary and some
diagonal .
- (g) for some
polynomial .
- (h) .
Proof. Let on with its standard
inner product, for which the standard basis is
orthonormal; then by Theorem 11.6.3, and
is normal exactly
when is.
(a), (b), (c), and (d) are equivalent by Theorem 12.3.1
applied to , whose
four conditions are these four read for instead of . (a) (e) is Theorem 12.4.2,
again for . (a)
(f)
is Corollary 12.4.3.
(a)
(h) is Theorem 12.11.2,
since . (a) (g) is Corollary 12.4.5,
applied to and
read back as matrices.
It remains to prove (g) (a). Suppose
with
. Every power of commutes with , hence so does any
linear combination of powers: Substituting for on both sides gives
, which is (a). This closes the loop
and proves the theorem.
This list is the summary result of the chapter, and
it is worth reading as a whole rather than as eight
separate facts. Conditions (a) and (d) are algebraic:
one equation between products. Conditions (b) and (c)
are metric: and
distort
lengths and angles identically. Conditions (e) and (f)
are geometric: the eigenvectors can be chosen
perpendicular. Condition (g) is a surprise, and says
that for a normal matrix the adjoint carries no
information beyond itself. And condition
(h) is quantitative: it is the only one on the list that
comes with a number attached, so that when it
fails one can ask by how much. That number is , and it is the
reason this section exists.
The operator versions of (a)–(g) hold verbatim on any
finite-dimensional complex inner product space, by
passing to the matrix in an orthonormal basis. So does
(h), once is read as
the Frobenius norm of that matrix, which Lemma 11.7.5 showed
does not depend on which orthonormal basis is used.
Exercises
A. Check your
understanding
Exercise
(A1)
- (a) Define the
Frobenius norm of a matrix, and give the expression for
as a
trace.
- (b) State Theorem 12.11.1,
including the equality case and how the eigenvalues are
counted.
- (c) Define , and say why
the definition needs Theorem 12.11.1
before it can be made.
- (d) True or false:
equals
the Frobenius distance from to the nearest normal
matrix. Justify your answer.
- (e) True or false:
if and are similar then .
Justify your answer.
- (f) Name the two
facts about the Frobenius norm and about triangular
matrices that the proof of Theorem 12.11.1
rests on.
Solution.
(a) , the norm induced by
the Frobenius inner product of Chapter 11. As a trace, .
(b) For with
eigenvalues listed in and with algebraic
multiplicity, , with equality if and only if
is
normal.
(c) , and is its
nonnegative square root. Without Theorem 12.11.1
the right-hand side might be negative, and there would
be no real square root to take.
(d) False. It is
an upper bound for that distance, as the paragraph
before the warning shows, but the warning gives with and a
normal matrix at distance .
(e) False. The
matrices and are similar,
since the first is diagonalizable with eigenvalues and , yet their defects are
and . What is true is that
is unchanged
by unitary similarity; see Exercise (C1: Unitary similarity preserves the defect, ordinary similarity does
not).
(f) That the
Frobenius norm is unchanged by unitary factors (Lemma 11.7.5), so
that ; and that a normal upper triangular
matrix is diagonal (Lemma 12.4.1),
which is what makes the equality case work in the
direction .
B. Practice
Exercise
(B1: Computing the defect)
For each matrix below, compute , the
eigenvalue list, and . State in each
case whether the matrix is normal, and say how you know
without multiplying by .
- (a)
- (b)
- (c)
- (d)
Solution.
(a) . The matrix is upper triangular, so its
eigenvalues are
and (Theorem 9.7.4) and
. Hence and
.
Since , the matrix is not normal (Theorem 12.11.1).
(b) . Here and , so and the eigenvalues are , each of modulus
. Then , so and the
matrix is normal.
(c) , the eigenvalue is three times, and . So and , which is with , as Example (The defect of a Jordan block)
says. Not normal.
(d) . The
matrix is the cyclic shift, with (expand
along the first row, or note and with having no repeated
eigenvalue). Its eigenvalues are the three cube roots of
unity, each of modulus , so and : normal.
Exercise
(B2: Verifying Schur’s inequality)
Let
- (a) Compute both
sides of Theorem 12.11.1
for and verify
the inequality.
- (b) Hence determine
whether is
normal, without computing or .
- (c) Write down a
normal matrix
with , and verify the equality.
Solution.
(a) . The matrix is upper triangular, so
its eigenvalues are (Theorem 9.7.4) and
. Indeed .
(b) The
inequality is strict, so by the equality case of Theorem 12.11.1
the matrix is not normal. Equivalently .
(c) Since is already upper
triangular, is a Schur factorization (Corollary 12.1.3)
with and
. The
construction before the warning takes to be the diagonal
part, , which is normal. Then has the three
entries above the
diagonal and zeros elsewhere, so .
Exercise
(B3: The nearest symmetric matrix)
Let and write
and , so that with and .
- (a) Prove that in the
Frobenius inner product whenever is
symmetric and is skew-symmetric.
- (b) Deduce that
for every symmetric , with
equality only for . Hence is the nearest
symmetric matrix to .
- (c) Carry this out
for , and
compare the resulting distance with .
Solution.
(a) For real
matrices . Since , this is
. On the
other hand by Theorem 0.9.6 (2), and
, so , the last step by Theorem 0.9.6 (3). A
number equal to its own negative is , so and .
(b) Let be symmetric. Then
, where is symmetric and is skew-symmetric, so
the two are orthogonal by (a) and Pythagoras (Theorem 11.1.3)
gives Equality forces ,
that is (Theorem 11.1.2
(a)). So is the
unique nearest symmetric matrix, at distance .
(c) Here and , so the distance from
to the symmetric
matrices is . For the defect, , and
is triangular with eigenvalues and , so and . A symmetric matrix is normal, so this again
exhibits a normal matrix strictly closer than : .
C. Going deeper
Exercise
(C1: Unitary similarity preserves the defect, ordinary
similarity does not)
- (a) Prove that for every and every
unitary .
- (b) Give that
are similar with , exhibiting an explicit with .
- (c) Deduce that two
similar matrices with different defects cannot be
unitarily similar, and use this to show that and are not
unitarily similar.
Solution.
(a) Put . By Lemma 11.7.5, . Also is similar to , so (Theorem 7.10.3) and
the two matrices have the same eigenvalue list with
multiplicities. Both terms in Definition 12.11.1
therefore agree, so , and the defects are equal since
both are nonnegative.
(b) Take and . Then
with eigenvalues , so
and ,
while because is diagonal, hence
normal. They are similar: eigenvectors of are for and for , so with
, whose inverse is
, we get by
direct multiplication.
(c) By (a),
unitarily similar matrices have equal defects. So if
then no unitary can satisfy . The pair
in (b) has defects and , so it is similar but
not unitarily similar. (This is the failure of
“diagonalizable” to imply “unitarily diagonalizable”,
seen through a number instead of through Example (Diagonalizable, and no orthonormal eigenbasis).)
Exercise
(C2: Equality plus a single eigenvalue forces a
scalar)
Let satisfy , and
suppose has
only one distinct eigenvalue , so that .
- (a) Prove that .
- (b) Deduce that a
normal matrix whose characteristic polynomial is is the zero
matrix.
- (c) Show that the
hypothesis of equality cannot be dropped, by computing
for a matrix
with that is not .
Solution.
(a) By the
equality case of Theorem 12.11.1,
is normal. So by
Corollary 12.4.3
there are a unitary and a diagonal with , the
diagonal of
being the eigenvalue list of . That list is repeated times, so and
(b) A normal
matrix satisfies the equality hypothesis (Theorem 12.11.1
again), and says its only eigenvalue is . By (a), . In
words: a normal nilpotent matrix is zero, which is Theorem 12.3.5
seen from the quantitative side.
(c) Take with
. Its
characteristic polynomial is and it is
not , and
by Example (The defect of a Jordan block).
So equality in Theorem 12.11.1
fails, exactly as it must.
Exercise
(C3: The commutator is at least as big as the defect
squared)
For write .
- (a) Prove that is
unchanged when
is replaced by with unitary.
- (b) Let .
Compute and show that
- (c) Deduce that
every satisfies , and determine exactly
when equality holds.
Hint for (c): Schur-triangularize, and use (a) to
move the computation to the triangular factor.
Solution.
(a) Put , so .
Inserting between the factors, and Lemma 11.7.5 gives
.
(b) Multiplying
out, Subtracting, Its four squared moduli are , , , and . Adding
them gives the stated formula.
(c) Let and write
as
in Corollary 12.1.3,
with upper
triangular of the shape in (b) and the
eigenvalues of .
By Eq. 12.11.1, . By (a) and (b), and taking nonnegative square roots gives
.
Equality holds exactly when , that is, when or .
The first case says , that is,
is normal, and
then both sides are . So equality holds if
and only if is
normal or its two eigenvalues coincide.