The fundamental subspaces of a matrix 𝐴 (𝑝×𝑚, column partition 𝐴=[𝐚1,…,𝐚𝑚], see Matrix Algebra).

Range and Rank

  • Range of 𝐴 (𝑝×𝑚):
    • ℛ︀(𝐴)=span{𝐚𝑗}𝑚𝑗=1⊂ℝ𝑝
    • i.e. every possible 𝐴𝐱 (a linear combination of the columns)
  • Rank:
    • 𝜌(𝐴)=dimℛ︀(𝐴)=dimspan{𝐚𝑗}𝑚𝑗=1
    • = # of linearly independent columns of 𝐴

Nullspace and Nullity

  • Nullspace:
    • 𝒩︀(𝐴)={𝐱∈ℝ𝑚,𝐴𝐱=𝟎}(𝐱≠𝟎)
    • 𝒩︀(𝐴)⊂ℝ𝑚
  • Nullity:
    • 𝜈(𝐴)=dim𝒩︀(𝐴)
    • = max # of linearly independent vectors in the nullspace

Rank-Nullity Theorem

  • 𝜌(𝐴)+𝜈(𝐴)=𝑚(# cols of𝐴)

Singular Matrices

  • Fact: for 𝐴 𝑛×𝑛, det(𝐴)=0 ⇔
    • 𝐴−1 DNE (singular)
    • cols of 𝐴 not linearly independent
    • 𝜌(𝐴)<𝑛
    • dimℛ︀(𝐴)<𝑛
    • 𝜈(𝐴)>0
    • 𝒩︀(𝐴) nontrivial

Nonsingular Matrices as a Basis

  • Square, nonsingular matrices: given 𝐴 𝑛×𝑛, det(𝐴)≠0. Then
    • span{𝐚𝑘}𝑛𝑘=1=ℝ𝑛,{𝐚𝑘}linearly indep.
    • ⇒ the columns of 𝐴 provide a basis for ℝ𝑛
    • ⇒ℛ︀(𝐴)=ℝ𝑛
  • ⇒ any 𝐲∈ℝ𝑛 admits the expansion
    • 𝐲=∑𝑛𝑘=1𝑥𝑘𝐚𝑘
    • 𝑥𝑘 are the “coordinates” of 𝐲 in the basis {𝐚𝑘}
  • But then
    • 𝐲=𝐴𝐱⇒𝐱=𝐴−1𝐲
  • ⇒ Any nonsingular matrix defines a basis for ℝ𝑛