Scalar expressions 𝐱𝖳𝑀𝐱: they appear as soon as we differentiate ‖𝐱‖22 along solutions (see Lyapunov Functions).

Definition

  • Motivation: for ̇𝐱=𝐴(𝑡)𝐱,
    • dd𝑡‖𝐱(𝑡)‖22=𝐱𝖳(𝑡)[𝐴𝖳(𝑡)+𝐴(𝑡)]𝐱(𝑡)=𝐱𝖳(𝑡)𝑀(𝑡)𝐱(𝑡)
    • which is a quadratic form. What can we say generally about such forms, and in particular, when can they be guaranteed to be negative?
  • Quadratic form: any expression like
    • 𝐱𝖳𝑀𝐱
    • where 𝑀 is square, and the same size as 𝐱
  • This defines a scalar, equivalent to
    • 𝐱⋅(𝑀𝐱)
    • i.e. the dot product of 𝐱 with 𝑀𝐱

Symmetric and Skew-Symmetric Parts

  • Note any square matrix 𝑀 can be written as
    • 𝑀=𝑀sym+𝑀skew
    • 𝑀𝖳sym=𝑀sym (symmetric)
    • 𝑀𝖳skew=−𝑀skew
  • In fact
    • 𝑀sym=12(𝑀+𝑀𝖳)𝑀skew=12(𝑀−𝑀𝖳)
  • Then
    • 𝐱𝖳𝑀𝐱=𝐱𝖳(𝑀sym+𝑀skew)𝐱=𝐱𝖳𝑀sym𝐱+𝐱𝖳𝑀skew𝐱
  • Note (a scalar equals its own transpose)
    • 𝐱𝖳𝑀skew𝐱=(𝐱𝖳𝑀skew𝐱)𝖳=𝐱𝖳𝑀𝖳skew𝐱
    • so 𝐱𝖳𝑀skew𝐱=−(𝐱𝖳𝑀skew𝐱)
    • ⇒𝐱𝖳𝑀skew𝐱=0
  • Hence only the symmetric part of 𝑀 contributes to the quadratic form
    • ⇒ generally assume the matrix in a quadratic form is symmetric

Rayleigh-Ritz Inequality

  • Symmetric matrices have real eigenvalues, which leads to

Rayleigh-Ritz Inequality

  • 𝜆min(𝑀)‖𝐱‖22≤𝐱𝖳𝑀𝐱≤𝜆max(𝑀)‖𝐱‖22

Definiteness

  • A matrix 𝑀(𝑡) is said to be positive (semi-)definite if
    • 𝐱𝖳𝑀(𝑡)𝐱>0(≥0)∀𝑡
    • ⇒ (by Rayleigh-Ritz)
    • min𝑡𝜆min(𝑀(𝑡))>0(≥0)
  • 𝑀(𝑡) is uniformly PD if
    • min𝑡𝜆min(𝑀(𝑡))≥𝜂>0∀𝑡
  • These are the conditions used in the Lyapunov Equation stability theorems