The “closest to diagonal” LTI coordinate transformation when 𝐴 has repeated eigenvalues.

Motivation

  • Recall: when all 𝜆𝑘 are distinct we can use 𝑃=[𝐯1,…,𝐯𝑛] to produce a purely diagonal 𝐴𝑝 (modal form)
  • Another reason to find an alternate 𝑃 for LTI: repeated (real) eigenvalues

Jordan Normal Form

  • Suppose
    • det(𝑠𝐼−𝐴)=(𝑠−𝜆1)𝑟(𝑠−𝜆𝑟+1)…(𝑠−𝜆𝑛)
    • i.e. 𝜆1 repeated 𝑟 times; 𝜆𝑟+1,…,𝜆𝑛 distinct
  • Then ∃𝑃 such that 𝐴𝑝=𝑃−1𝐴𝑃 has the form

Jordan Normal Form

  • 𝐴𝑝=[𝐽1(𝜆1)𝐽2(𝜆1)⋱𝐽𝑙(𝜆1)𝜆𝑟+1⋱𝜆𝑛]
    • the first 𝑟 rows/columns hold the Jordan blocks of 𝜆1; zeros elsewhere
  • i.e.
    • 𝐴𝑝=blkdiag{𝐽1,…,𝐽𝑙,𝜆𝑟+1,…,𝜆𝑛}
  • the “Jordan normal form”
  • where each 𝐽𝑖 is an 𝑛𝑖×𝑛𝑖 “Jordan block”:
    • 𝐽𝑖(𝜆)=[𝜆0⋮001𝜆…01⋱……⋱𝜆000⋮1𝜆](𝑛𝑖×𝑛𝑖)
  • Constraint:
    • ∑𝑙𝑖=1𝑛𝑖=𝑟

Multiplicities

  • Terminology:
    • 𝑟: “algebraic multiplicity” of 𝜆1
    • 𝑙: “geometric multiplicity”
  • Fact:
    • 𝑙=𝜈(𝜆1𝐼−𝐴)(nullity)
    • = # of linearly independent eigenvectors associated with 𝜆1
    • =𝑛−𝜌(𝜆1𝐼−𝐴) (by rank-nullity)

Special Cases

  1. 𝑙=𝜈(𝜆1𝐼−𝐴)=𝑟:
    • ⇒𝑟 linearly independent eigenvectors for 𝜆1
    • Let 𝐰1,…,𝐰𝑟 be these eigenvectors, and
    • 𝑃=[𝐰1,𝐰2,…,𝐰𝑟,𝐯𝑟+1,…,𝐯𝑛]
    • Then 𝐴𝑝 is purely diagonal:
    • 𝐴𝑝=diag{𝜆1,…,𝜆1⏟𝑟times,𝜆𝑟+1,…,𝜆𝑛}
    • here 𝑙=𝑟 and ∑𝑟𝑖=1𝑛𝑖=𝑟⇔𝑛𝑖=1
  2. 𝑙=𝜈(𝜆1𝐼−𝐴)=1:
    • ⇒ only 1 Jordan block, which must be 𝑟×𝑟
    • 𝐴𝑝=blkdiag{𝐽1(𝜆1),𝜆𝑟+1,…,𝜆𝑛}
    • 𝑒𝐴𝑝𝑡=blkdiag{𝑒𝐽1(𝜆1)𝑡,𝑒𝜆𝑟+1𝑡,…,𝑒𝜆𝑛𝑡}
    • where (see Jordan block exponential)
    • 𝑒𝐽1(𝜆1)𝑡=𝑒𝜆1𝑡[10⋮00𝑡1……12𝑡2𝑡⋱……⋱101(𝑟−1)!𝑡𝑟−11(𝑟−2)!𝑡𝑟−2⋮𝑡1]
  3. For 1<𝑙<𝑟: we know how many Jordan blocks, but not necessarily their sizes

Generalized Eigenvectors

  • Note for 𝑙=1:
    • 𝑃=[𝐯1,?,…,?,𝐯𝑟+1,…,𝐯𝑛]
  • The remaining columns come from a “chain of generalized eigenvectors”, satisfying
    • (𝜆1𝐼−𝐴)𝑘𝐰=𝟎𝑘>1,𝑘integer
  • These “chains” generate, in a complicated fashion, the exact sizes of each block
  • We do at least have the constraint
    • ∑𝑙𝑖=1𝑛𝑖=𝑟
    • which can sometimes uniquely determine the structure of 𝐴𝑝, i.e.
      • 𝑟=4,𝑙=3⇒𝑛1+𝑛2+𝑛3=4⇒𝑛1=2,𝑛2=𝑛3=1
    • But if 𝑟=4,𝑙=2, we could have
      • 𝑛1=3,𝑛2=1 or 𝑛1=𝑛2=2
  • Which case we’re in depends on the exact details of 𝐴, and is very sensitive to small changes in the entries of 𝐴

Sensitivity

Sensitivity of the Jordan Form

  • 𝐴=[1𝜀11]
  • If 𝜀=0:
    • 𝐴=[1011]=𝐴𝑝
    • repeated eigenvalue, 𝑟=2, 𝑙=1
  • If 𝜀≠0:
    • 𝐴𝑝=[𝜆100𝜆2],𝜆1≠𝜆2
    • (non-repeated eigenvalues)
  • The calculation is very sensitive to even the smallest perturbation in 𝐴

NOTE

  • Matlab’s jordan function is useful, but doesn’t always work