Linear Algebra

Lesson 5 of 11

Rank, Nullity, and the Four Subspaces

Column space, null space, the rank-nullity theorem, and the fundamental picture of a matrix.

Column space and null space

The column space C(A)C(A) is where AA can send vectors: all outputs AxA\mathbf{x}. Its dimension is the rank. The null space N(A)N(A) is what AA destroys: all x\mathbf{x} with Ax=0A\mathbf{x} = \mathbf{0}. Its dimension is the nullity.

If 1000 data points in 50 dimensions actually lie in a 3-dimensional subspace, the data matrix has rank 3: only 3 independent directions of variation exist. Rank measures the "information content" of a matrix.