The previous section produced a diagonal matrix and
then took it away again: the diagonal entries are not
invariants, because rescaling the -th basis vector by
multiplies the
-th entry by . Over the squares are
exactly the positive numbers, so rescaling can change
the size of an entry but never its sign. This section
proves that the signs are all that survives, and that
they survive completely: the number of positive,
negative, and zero entries is the same for every
diagonalization. That is the classification of real
symmetric matrices up to congruence, and it is also the
missing link between congruence and the spectral
theorem.
Throughout this section the field is . Every form
is a symmetric bilinear form on a finite-dimensional
real vector space , and every matrix is a
real symmetric matrix. The words “positive” and
“negative” have no meaning over a general field, and
almost nothing in this section survives the move to one;
Corollary 14.4.4 already
showed that over the answer is
different, since rank alone classifies there.
Normalizing the diagonal
Start from Theorem 14.4.2, which
applies because . It gives an orthogonal basis for , with . Over
we may go one
step further and scale.
By Proposition 14.4.3,
replacing by replaces
by . Choosing when , and when , turns every diagonal entry into , , or . A permutation of the
basis then sorts them, so after a further congruence by
a permutation matrix the matrix of is
where counts
the positive ,
the negative
ones and the
zeros, and . Nothing yet says that these three counts do
not depend on the orthogonal basis we started from. That
is the theorem.
Quick check. One of the three
counts is already known to be an invariant, by a result
of Section 2. Which one, and why?
Solution. The count . A diagonal matrix
has rank equal to its number of nonzero entries, so
, and congruence
preserves rank (Theorem 14.2.3). Hence is the same for
every orthogonal basis, and so is .
What is not yet known is how that total
splits into positives and negatives — which is exactly
the work left for the theorem below.
The law of
inertia
Theorem
14.5.1 (Sylvester’s Law of Inertia)
Let be a
symmetric bilinear form on a real vector space with , and let and be two
orthogonal bases for . Let be the
numbers of positive, negative, and zero diagonal entries
of ,
and the corresponding numbers for .
Then
Idea. Rank has already delivered
, so it is enough to prove , and for
that we may suppose and look for a disaster. The two bases
carve out two subspaces with incompatible behavior: on
the form is strictly
positive away from , because Eq. 14.4.1 has only positive
coefficients there; on it is everywhere, because
there the coefficients are all . A nonzero vector
in both would have and
at once, so the two subspaces meet only in . But their
dimensions add up to more than , and two such subspaces
of an -dimensional
space cannot meet only in . Contradiction
plus a dimension count.
Proof. Write and , and order each so that
the positive entries come first, then the negative ones,
then the zeros; reordering a basis does not change the
three counts. Put and , so that
As in the Quick check, by Theorem 14.2.3, and . So
it suffices to prove ; the other two equalities then
follow.
Suppose not. Swapping the names of the two bases if
necessary, we may assume . Put so that and .
Claim: . Let with .
Writing and using Eq. 14.4.1 for the basis
, whose later
coordinates of are zero, because every with is positive,
every ,
and at least one since . Writing instead and using Eq. 14.4.1 for , because every with is and every . A real
number cannot be both and , so no such exists, which
proves the claim.
On the other hand, is a subspace of , so ,
and the dimension formula (Theorem 1.7.3) gives
So contains a nonzero vector, contradicting
the claim. Therefore , and with it and . This
proves the theorem.
The name comes from mechanics, where the form is an
inertia tensor and the theorem says that a change of
coordinates cannot turn a direction of positive inertia
into one of negative inertia. The invariant has a name
of its own.
Definition
14.5.1 (Inertia and Signature)
Let be a
symmetric bilinear form on a real vector space of dimension , diagonalized in some
orthogonal basis. The triple of numbers of positive, negative, and zero
diagonal entries is the inertia of
, and it is
well defined by Theorem 14.5.1. The pair
is the
signature of , and
while . The same words are used for a real
symmetric matrix , through the form
, and we write , , .
Two conventions are in circulation and both are
called the signature: the pair , used here,
and the single integer . They carry the same information once the
rank is known, and the difference is only ever
notational; where a source writes “signature ” it means . The triple
is
the safest thing to quote, since it also records the
degeneracy.
The
classification over the reals
Corollary
14.5.2 (Classification of Real Symmetric
Matrices by Signature)
Let be symmetric. Then:
- (a) is congruent to , where is the
inertia of , and
to no other matrix of this shape;
- (b) if and only
if and have the same
inertia;
- (c) the number of
congruence classes of symmetric matrices in is .
Proof.
(a) The
congruence to is Eq. 14.5.1, obtained from Theorem 14.4.2 followed by
the scaling and sorting described above. That matrix is
itself diagonal with inertia , so by Theorem 14.5.1 no matrix of
the same shape with a different triple can be congruent
to .
(b) A
congruence with invertible is a change
of basis for the form (Theorem 14.2.1), so an
orthogonal basis diagonalizing yields one
diagonalizing
with the same diagonal, and Theorem 14.5.1 makes the
inertia equal.
If
and have the same inertia,
each is congruent to the same matrix by (a), hence to each other, since
congruence is an equivalence relation (Proposition 14.2.2).
- (c) By (b) the
classes correspond to the triples of
nonnegative integers summing to , equivalently to the
pairs
with . For each value there are
choices of
, so the total
is . This proves the
corollary.
So congruence over has a complete and
finite list of invariants, in sharp contrast to
similarity, where even real symmetric matrices fall into
infinitely many classes (one for each unordered pair of
eigenvalues). Congruence forgets a great deal; the point
of the law of inertia is that what it forgets is
precisely everything except the signs.
Reconciling congruence with the spectral theorem
Chapter 12 diagonalized a real symmetric matrix a
different way, by an orthogonal , and got the
eigenvalues on the diagonal. Chapter 12 also pointed out
why that theorem is special: because , the one
equation can be read twice, and “an orthogonal change
of variables is a similarity and a congruence,
so it keeps the eigenvalues and the geometry at once”.
Reading the same equation twice is all that is needed to
identify the inertia.
Theorem
14.5.3 (Inertia Is the Sign Pattern of the
Spectrum)
Let be symmetric. Then is the number of
positive eigenvalues of , counted with
multiplicity, the number of
negative ones, and the multiplicity
of .
Proof. By Corollary 12.5.2
there is an orthogonal and a real diagonal with , where is the eigenvalue list of with multiplicity.
Equivalently .
Read as a similarity: , so and the
diagonal entries of are the eigenvalues of
.
Read as a congruence: is invertible, so
exhibits as
congruent to (Definition 14.2.1). Being
diagonal, is the
matrix of the form of in an orthogonal
basis, namely the columns of . By Theorem 14.5.1 its numbers
of positive, negative, and zero entries are the inertia
of .
The same list of numbers is being counted both times,
so the counts agree. This proves the theorem.
This is what Chapter 13 promised when, having
diagonalized a pencil and found
while the eigenvalues of were , it
observed that the signs “match the signs of the eigenvalues of itself” and said that
Chapter 14 would show this is no coincidence. It is not:
the congruence has the inertia
of by Theorem 14.5.1, and that
inertia is the sign pattern of the spectrum by Theorem 14.5.3. Here and
— since — so the inertia of is , and any
congruent diagonal matrix must show exactly one positive
and one negative entry, as does.
The same reading settles the definiteness tests of
Chapter 13 in one line: means for all , which by Theorem 13.1.5 is the
statement that every eigenvalue is positive, which by Theorem 14.5.3 is the
statement that the inertia is . Section 6
takes that dictionary further.
Warning. Congruent matrices
have the same inertia and unrelated
eigenvalues. Take and
.
Then so , yet the eigenvalues have moved
from to . Nothing about
their sizes, their ratios, their sum, or their product
is preserved —
goes from to
, from to — and only the
pattern
survives. For a second witness with no scaling in sight,
is congruent
to with ; the
eigenvalues change from to , and the inertia stays .
Computing
a signature
Theorem 14.5.3 gives a
method — find the eigenvalues and count signs — but it
is the expensive one, since it needs the roots of a
degree-
polynomial. The cheap method is the algorithm of the
previous section, which needs only arithmetic:
diagonalize by paired row and column operations and read
off the signs. The eigenvalues are never computed and
never needed.
Example
(A signature by symmetric elimination)
Find the inertia of and say whether the form is positive definite.
Solution. The corner entry is , so no repair move is
needed.
Clear the first row and column. Subtract row
from row and row from row , then do the same two
operations on columns:
Clear the second row and column. The pivot
is and , so subtract
row from row
and then column
from column :
So the inertia is and the signature is . The form is
not positive definite: it is negative
at the third basis vector of the new basis, namely the
third column of which is .
Checking directly,
and .
The eigenvalue route would have to factor , whose roots are irrational; the elimination
never met them. As a partial check on the arithmetic,
and
, consistent with .
Over , then,
a symmetric matrix carries exactly two pieces of
congruence data, and both are cheap: its rank and how
that rank splits into positive and negative directions.
The next section reads the same two numbers as a
statement about definiteness, and uses them to decide
maxima and minima.
Exercises
A. Check your
understanding
Exercise
(A1)
- (a) Define the
inertia and the
signature of a real symmetric
matrix.
- (b) State Theorem 14.5.1, with all
hypotheses.
- (c) Which part of
the inertia is already an invariant before the law of
inertia is proved, and by which earlier result?
- (d) Determine
whether the following statement is correct, and justify
your answer: congruent real symmetric matrices have the
same trace.
- (e) Explain in one
sentence why an orthogonal change of basis lets the
spectral theorem compute an inertia.
Solution.
(a) Diagonalize
the associated form in an orthogonal basis. The inertia
is the triple of numbers of positive, negative, and zero
diagonal entries, and the signature is the pair .
(b) If is a symmetric
bilinear form on a finite-dimensional real vector space
and
are two orthogonal bases for , then the two
matrices and
have the same numbers of positive, negative, and zero
diagonal entries.
(c) The count
, equivalently
the sum ,
because that sum is the rank and congruence preserves
rank (Theorem 14.2.3).
(d) Incorrect.
and
are
congruent, by the congruence with , and
their traces are
and . Trace is a
similarity invariant (Theorem 4.2.5),
not a congruence invariant.
(e) For an
orthogonal we
have , so the single equation is
simultaneously a similarity, which puts the eigenvalues
on the diagonal, and a congruence, which makes that
diagonal compute the inertia.
B. Practice
Exercise
(B1: Signatures by elimination)
Find the inertia of each of the following real
symmetric matrices by paired row and column operations.
Do not compute any eigenvalues.
- (a) .
- (b) .
- (c) .
Solution.
(a) By Exercise (B1: Symmetric elimination),
is congruent to
.
Inertia .
(b) By Example (Diagonalizing a symmetric matrix with zero diagonal),
is congruent to
.
Inertia .
(c) Subtract
row from row , then column from column : Inertia : the form is degenerate, vanishing on the line
.
Exercise
(B2: Which of these are congruent?)
Sort the following real symmetric matrices into
congruence classes, justifying each answer.
Solution. Compute each inertia and
apply Corollary 14.5.2 (b).
: . : . : . : .
For , the
top-left
block is the form , which Exercise (B2: No pivot on the diagonal)
diagonalizes to ; so is congruent to
, with
inertia .
Therefore the classes are ,
, and . Note that and have the same rank
and are still not congruent, so rank alone does not
classify over —
unlike over (Corollary 14.4.4).
Exercise
(B3: Inertia from a characteristic polynomial)
Let be symmetric with .
- (a) Find the inertia
of .
- (b) Is congruent to ? Is it
similar to it?
Solution.
(a) The
polynomial factors as , since
is a root and
dividing gives . The eigenvalues are , so by Theorem 14.5.3 the inertia
is .
(b) Congruent:
yes, since also has
inertia and
Corollary 14.5.2 (b)
applies. Similar: no, because similar matrices have
equal characteristic polynomials, and has .
C. Going deeper
Exercise
(C1: An intrinsic description of )
Let be a
symmetric bilinear form on a real vector space of dimension , with quadratic form
. Call a subspace
positive if for
every with .
- (a) Prove that is the largest
dimension of a positive subspace of .
- (b) Deduce Theorem 14.5.1 again from
(a), in two lines.
- (c) State and prove
the corresponding description of .
Hint: for (a), use an orthogonal basis to produce
one positive subspace of dimension , and the dimension
formula to rule out a larger one.
Solution.
- (a) Fix an
orthogonal basis ordered so that and for .
A positive subspace of dimension . Put . For nonzero, Eq. 14.4.1 gives , since all and some . So is positive and .
No larger one. Let be positive with , and put , of dimension . Every has . If then by Theorem 1.7.3, so there is a nonzero
with and , which is impossible. Hence , and the
maximum is .
(b) The
right-hand side of (a) — the largest dimension of a
positive subspace — is defined from alone and mentions
no basis. So the number computed from any
orthogonal basis equals that basis-free quantity, hence
is the same for all of them. Then is
basis-free too (Theorem 14.2.3), so and are determined as
well.
(c) is the largest
dimension of a negative subspace, one
on which for every .
Apply (a) to the form , whose diagonal
entries in any orthogonal basis are the negatives of
those of , so
that , and whose positive subspaces are
exactly the negative subspaces of .
Exercise
(C2: Congruence cannot be read off the eigenvalues, and
inertia can)
- (a) Give two real
symmetric
matrices that are congruent but have no eigenvalue in
common.
- (b) Prove that if
and are real symmetric and
similar, then they are congruent.
- (c) Give two real
symmetric
matrices that are congruent but not similar, so that the
converse of (b) fails.
Solution.
(a) and , congruent by
.
Their spectra are and , which are
disjoint.
(b) Similar
matrices have the same characteristic polynomial (Theorem 7.10.3),
hence the same eigenvalues with multiplicity. By Theorem 14.5.3 they then
have the same inertia, and by Corollary 14.5.2 (b) they
are congruent. (Alternatively and more directly: by Corollary 12.5.2
each is orthogonally congruent to the diagonal matrix of
its eigenvalues, and those diagonal matrices agree up to
a permutation.)
(c) The pair in
(a) again: and are
congruent, but their characteristic polynomials are
and , so they
are not similar (Theorem 7.10.3).
Congruence is strictly coarser than similarity on real
symmetric matrices.
Exercise
(C3: Inertia of a block matrix)
Let and be symmetric. Let also be
symmetric and invertible, let , let
, and put
- (a) Prove that the
inertia of is the entrywise sum of the inertias of
and .
- (b) Prove that is congruent to .
- (c) Hence find the
inertia of when
,
,
and .
Hint: for (b), the congruence is the block
elimination of Chapter 8, and the leftover scalar is a
Schur complement.
Solution.
(a) Let and be the
canonical forms of Corollary 14.5.2 (a). Then
is
invertible and a diagonal matrix whose positive, negative,
and zero entries are those of the two blocks together.
By Theorem 14.5.1 those counts
are the inertia of .
(b) Put which is invertible, being unit upper
triangular. Multiplying, the first block row of is , and then using . This is , the
Schur complement sitting in the
corner.
(c) Here , so
and the leftover scalar is . By (b) and
(a), the inertia of is the inertia of
plus
that of the zero matrix,
namely . In particular is singular.