For any function, Chapter 0 asked two questions: is
it injective, and is it surjective? For a function
between sets, answering them means comparing outputs
pair by pair and hunting for preimages point by point.
For a linear map both questions reduce to a single
subspace each. This section defines the two subspaces,
the kernel and the image, shows how to compute them, and
proves the test that makes injectivity cheap: a linear
map is injective exactly when its kernel is zero.
Two
questions, two subspaces
Let be linear. Start with injectivity. Suppose
two inputs collide, . By Theorem 2.1.2 this is
the same as So a collision between and is the same
thing as their difference being sent to . To detect every
collision at once, it is enough to know which
vectors are sent to . For a
general function this trick is unavailable, because
there is no subtraction; linearity turns a question
about all pairs into a question about one set.
Surjectivity asks whether every is an
output, so the set to know is the set of all
outputs. For the matrix map both sets are concrete: the outputs
are the vectors for which can
be solved, and the inputs sent to are the
solutions of . Chapter 3 computes both. The
definitions below give the two sets a name for every
linear map. They are defined for what they measure.
The kernel is everything sends to zero; the
image is everything reaches.
Definition
2.2.1 (Kernel)
Let be a linear map over . The
kernel of is the subset of the
domain
Definition
2.2.2 (Image)
Let be a linear map over . The
image of is the subset of the
codomain
In words: a vector is in when lives in and
sends it to the
zero vector of . A
vector is
in when lives in and
there exists at least one input with
output ;
the input need not be unique. In the language of Definition 0.4.2,
is the preimage of the
zero vector, and is the image of the function . The kernel is also
called the null space of , and the image its
range. For group homomorphisms, the
kernel was defined the same way (Definition 0.10.3),
with
playing the role of the identity element.
There is nothing to check for well-definedness: both
sets are described by conditions that either hold or
fail. What does need checking is that they are
subspaces, not just subsets.
Theorem
2.2.1 (The Kernel Is a Subspace)
Let be linear. Then is a subspace of
.
Proof. We use the Subspace Test (Theorem 1.2.1).
By Theorem 2.1.1, , so .
Let , so . By (LT1), . Therefore .
Let and . By (LT2), , using Theorem 1.1.6.
Therefore .
Theorem
2.2.2 (The Image Is a Subspace)
Let be linear. Then:
- (a) is a subspace of
;
- (b) is surjective if and
only if .
Proof.
(a) We use the
Subspace Test (Theorem 1.2.1). (1)
by Theorem 2.1.1, so
. (2) Let , say and with . By (LT1), , and , so . (3) Let and . By (LT2),
with , so .
(b) The inclusion
always holds. By Definition 0.4.3,
is surjective
exactly when every equals for some
, that is,
when . So is
surjective if and only if .
This pays off a pattern from Chapter 1, §2. The null
space of a matrix (Example (Solutions of a Homogeneous System)),
the symmetric matrices (Example (Symmetric Matrices))
and the trace-free matrices (Example (Trace-Free Matrices))
were each shown to be subspaces by a separate check, and
that section promised a single theorem. Each is the
kernel of a linear map (, ,
and the trace), so Theorem 2.2.1 covers
them all at once.
First examples. Start with the maps
that have the most extreme kernels and images.
Example
(The Zero Map and the Identity)
Find the kernel and image of the zero map and of
the identity .
Solution. The zero map sends every
vector to , so and .
The identity sends to , which is only when , so
. Every is its own
image, so .
These two are the ends of the scale. The kernel is
always between and , and the image between
and
. The zero map
kills everything and reaches nothing but ; the identity
kills nothing and reaches everything.
Solution.
exactly when . So , the -axis. Every output has
second entry , and
every is
an output, namely . So is the -axis. The kernel is the
direction the light shines along; the image is the
screen the shadow falls on.
A nonexample by minimal change.
Replace by
another vector: for the projection, . This is the
vertical line through . It does not contain , and it is not
closed under addition, since
lies off the line. So it is not a
subspace. It is the kernel shifted by . The same thing
happens for systems in Chapter 3: the solution set of
is one particular solution plus the
set of solutions of ,
which is .
Why the preimage of ?
Because is
the one output that every linear map is guaranteed to
hit, so its preimage is never empty, and because all
other preimages are translates of it. If ,
then exactly when , that is, when . The kernel describes the shape of every
nonempty preimage at once.
Warning. Keep track of
where each subspace lives. The kernel sits
inside the domain ; the image sits inside
the codomain . For ,
the kernel consists of columns with entries and the image
of columns with
entries, so “” does not even make sense unless . And the image is
not the codomain in general: the
differentiation map has codomain
, but
is not the
derivative of any cubic, so .
Injectivity
via the kernel
The computation that opened the section now becomes a
theorem. It is the reason to prefer the kernel over the
definition of injectivity whenever a map is linear.
Theorem
2.2.3 (Kernel Test for Injectivity)
Let be linear. Then is injective if
and only if .
Proof. Suppose
is injective, and
let . Then by Theorem 2.1.1.
Injectivity gives . Hence , and the reverse inclusion holds
because is a
subspace (Theorem 2.2.1).
Suppose , and let . By Theorem 2.1.2, , so . Hence , and
is injective.
Compare the work. The definition asks: for
all pairs , does
force ? The
theorem asks only: for each , does
force ? The second question is usually a
homogeneous linear system or a coefficient comparison.
For , the
theorem says that is injective exactly when
has only the trivial solution; Chapter
3 turns that into a test that elimination can run.
Computing
the image
The image is defined by an existence condition, which
is hard to check directly. When has a spanning list,
applying to it
gives a spanning list of .
Theorem
2.2.4 (The Image Is Spanned by the Images of a
Spanning List)
Let be linear, and suppose spans . Then In particular, if is finite-dimensional,
then so is ,
even when is
not.
Proof. Each lies in
, which is a
subspace by Theorem 2.2.2. By Theorem 1.3.1 (3),
the span of these vectors is contained in .
Let
,
say with . Since
spans , for some . By Theorem 2.1.4, .
If is
finite-dimensional, some finite list spans (Definition 1.3.4),
and its images form a finite list spanning .
So the recipe for the image is: apply to a basis (or any
spanning list) of , then sift the results
to a basis if one is wanted (Theorem 1.5.4). The
images of a basis need not be independent; the
projection sends the basis
to .
Examples
We now compute kernels and images across the
families: polynomials, matrices, and sequences. In each
case we then read off injectivity from the kernel and
surjectivity from the image.
Example
(Differentiation)
Find the kernel and image of , .
Solution. Kernel. Let
. Then , which is the zero
polynomial exactly when . Since and in , this means . So
, the constants.
Image. By Theorem 2.2.4 applied
to the basis , So is
surjective but not injective: and have the same
derivative. Note .
Example
(Trace)
Find the kernel and image of .
Solution. Kernel. A matrix
has trace exactly when , that is, when it
equals So span . They are
independent: the combination above is the zero matrix
only if . Hence they form a basis, and .
Image. is a subspace of , and it contains
.
The lazy preimage of any shows . So the
trace is surjective but not injective. Again .
The next two examples live in infinite-dimensional
spaces, and the pattern “one property but not the other”
goes the opposite way.
Example
(Integration)
Find the kernel and image of , , of Example (Integration).
Solution. Kernel. For
, . This is the zero polynomial only if
every , that is, every . So , and is injective by Theorem 2.2.3.
Image. Let , the polynomials
with constant coefficient . Every has constant
coefficient , so
.
Conversely, if , then satisfies . Hence . Since , is not
surjective.
Solution. Right shift.
is the zero sequence only if
every . So
, and is injective. Every
output has first entry ; conversely, . So , and is not surjective:
is never an output.
Left shift. is zero exactly when ,
with arbitrary.
So , and is not injective. Every
sequence is an output, since . So , and is surjective.
This pays off the pointer from Chapter 1, §8: matches one-to-one with
its proper subspace . For a map on a finite set, injective
and surjective are equivalent (Theorem 0.4.9). The
shifts, and the pair and on (where makes surjective, while makes it not
injective), show that for linear maps on an
infinite-dimensional space this equivalence fails. The
next section proves that it holds again when is
finite-dimensional.
Solution. If , then
and , so . Hence ,
and is injective.
By Theorem 2.2.4, , a plane in . A span of two
vectors has dimension at most , so and
is not
surjective.
What
injective and surjective maps do to lists
Injectivity and surjectivity are statements about
vectors. They translate into statements about lists:
injective maps keep independent lists independent, and
surjective maps keep spanning lists spanning. On a
basis, the translation goes both ways.
Theorem
2.2.5 (Injective Maps Preserve Independence,
Surjective Maps Preserve Spanning)
Let be linear.
- (a) If is injective and is linearly independent in , then is linearly independent in .
- (b) If is surjective and spans , then spans .
- (c) If is a basis of , then is injective if and
only if is linearly independent,
and is surjective
if and only if spans .
Proof.
(a) Let . By Theorem 2.1.4, , so . Since is injective, (Theorem 2.2.3), so
. The independence of
gives .
(b) By Theorem 2.2.4, , and because is surjective (Theorem 2.2.2).
(c)
Injectivity. is (a).
Suppose the images are independent, and let .
Write . By Theorem 2.1.4, , so
all and
. Hence ,
and is injective
by Theorem 2.2.3.
Surjectivity. By Theorem 2.2.4, . By Theorem 2.2.2, is surjective exactly
when this span is .
Warning. Without
injectivity, independence can be lost. The
projection sends the independent list to , which
is dependent. The kernel is to blame:
lies in .
Likewise, a map that is not surjective sends
no list to a spanning list of , since all the images
lie in : the inclusion sends the basis to a list
that misses .
Part (c) turns a question about a map into a question
about vectors in
, which for
vectors in is a
question Chapter 3 settles by elimination. In the next
section, counting dimensions will let us check only
one of injectivity and surjectivity
when .
Exercises
A. Check your
understanding
Exercise
(A1)
- (a) Define the
kernel and the image of a linear map . Of
which spaces are they subspaces?
- (b) State the kernel
test for injectivity.
- (c) True or false:
if , then . Justify your answer.
- (d) True or false:
for , , we have
. Justify your answer.
- (e) True or false:
for a linear and any , the set
is a subspace of
. Justify your
answer.
Solution.
(a) See Definition 2.2.1 and
Definition 2.2.2:
, a subspace of (Theorem 2.2.1); , a subspace of (Theorem 2.2.2).
(b) See Theorem 2.2.3: a
linear map is injective if and only if its kernel is
.
(c) True. By Theorem 2.1.2, .
(d) False. Every
derivative of a polynomial of degree at most has degree at most
, so .
(e) False. If
, the set does not contain , since . For example, for the projection of Example (Projection onto an Axis)
and , the set is the line . It is a
subspace exactly when , in
which case it is .
B. Practice
Exercise
(B1: Kernel and Image from the Definitions)
For each map, find the kernel and the image, give a
basis of each, and decide whether the map is injective
and whether it is surjective.
- (a) , where is
differentiation.
- (b) , .
Solution.
(a) Write . Then . Kernel: forces , so , with basis . Image: the formula shows every
lies in , and
conversely , so ,
again with basis . Since , is not injective (Theorem 2.2.3); since
(it omits ), it is not
surjective.
(b) is linear because the
transpose is: and (Theorem 0.9.5).
Kernel: says , so is the space of symmetric matrices, with
basis . Image: each is
skew-symmetric, since ; and
every skew-symmetric is a multiple of , with
.
So , with basis .
is neither
injective (the kernel is nonzero) nor surjective (the
image is not all of ).
Exercise
(B2: Kernels and Images Beyond )
For each map, find a basis of the kernel and a basis
of the image, and decide whether the map is injective
and whether it is surjective.
- (a) , .
- (b) , .
Solution. Both maps are linear. For
, by
linearity of differentiation (Example (Differentiation)),
. By linearity
of the transpose (Example (Trace and Transpose)),
. Both are
linear by Theorem 2.1.3.
- (a) Kernel.
Let . Then . This is zero exactly when , , and , that is, . So , with the
empty list as basis, and is injective.
Image. We show is surjective. Given
, let . Then , and
since , So , with basis , and is surjective.
- (b) Kernel.
exactly
when . A
matrix is symmetric
exactly when ,
that is, when it equals . These three matrices are independent
(compare entries), so is a basis of . is not injective.
Image. By Theorem 2.2.4 with the
basis , is spanned by , , , and . So , with basis , the
skew-symmetric matrices. Since , is not surjective.
C. Going deeper
In these exercises, for linear maps and
we
write for the
composite , which applies first. It is linear:
, by Theorem 2.1.3 for
and then for
.
Exercise
(C1: Kernels and Images of a Composite)
Let and be linear.
- (a) Prove that
and .
- (b) Give an example,
with , where .
- (c) Deduce that if
is injective,
then is
injective, and if is surjective, then
is
surjective.
Solution.
(a) Let . Then
by Theorem 2.1.1, so
. Let , say
. Then
with , so .
(b) Let and let
be the projection
. Then , while is the
-axis (Example (Projection onto an Axis)).
(c) If is injective, then
(Theorem 2.2.3), so
by (a), and is injective. If is surjective, then
by (a), so and is surjective (Theorem 2.2.2).
Exercise
(C2: When Is a Composite Injective?)
Let and be linear, and suppose is injective. Prove
that is
injective if and only if , that is, if and only if is injective on . Give an example
where is not
injective but
is.
Solution. Suppose
is injective,
and let . Then
for some , and . So (Theorem 2.2.3), and
.
Suppose , and let .
Then and , so . Since is injective, .
Hence , and is injective.
Example: let , , which is injective with the -axis, and let ,
.
Then is the
-axis, so is not injective, but
, and indeed is
injective.
Solution. For , . In , and , so .
Kernel. exactly when , so , with basis . The polynomials
and are independent by Theorem 1.4.4.
Image. By Theorem 2.2.4, , with basis .
The failing step is “ forces ”, which divides by ; over , , and although
is not
constant. So over the kernel of
differentiation is bigger than the constants, and here
.