Raising the bar

Applications of the diagonal representation I

When $latex A$ is symmetric, we can use the representation

(1) $latex A=UA_UU^T$ where $latex A_U=diag[\lambda_1,...,\lambda_n].$

1. Matrix positivity in terms of eigenvalues

Exercise 1. Let $latex A$ be a symmetric matrix. It is positive (non-negative) if and only if its eigenvalues are positive (non-negative).

Proof. By definition, we have to consider the quadratic form $latex x^TAx=x^TUA_UU^Tx=(U^Tx)^TA_UU^Tx.$ Denoting $latex y=U^Tx,$ we know that an orthogonal matrix preserves the norm: $latex \|y\|=\|x\|.$ This allows us to obtain a lower bound for the quadratic form

$latex x^TAx=y^TA_Uy=\sum\lambda_iy_i^2\geq\min_i\lambda_i\sum y_i^2=\min_i\lambda_i\|x\|^2.$

This implies the statement.

2. Analytical functions of a matrix

Definition 1. For a square matrix $latex A$ all non-negative integer powers $latex A^m$ are defined. This allows us to define an analytical function of a matrix $latex f(A)=\sum_{m=0}^\infty\frac{f^{(m)}(0)}{m!}A^m$ whenever a function $latex f$ has the Taylor decomposition $latex f(t)=\sum_{m=0}^\infty\frac{f^{(m)}(0)}{m!}t^m,$ $latex t\in R.$

Example 1. The exponential function $latex f(t)=e^t$ has the decomposition $latex e^t=\sum_{m=0}^\infty\frac{1}{m!}t^m.$ Hence, $latex e^{At}=\sum_{m=0}^\infty\frac{1}{m!}A^mt^m.$ Differentiating this gives

$latex \frac{de^{At}}{dt}=\sum_{m=1}^\infty\frac{1}{m!}A^mmt^{m-1}$ ( the constant term disappears)

$latex =A\sum_{m=1}^\infty\frac{1}{(m-1)!}A^{m-1}t^{m-1}=Ae^{At}.$

This means that $latex e^{At}$ solves the differential equation $latex x^\prime(t)=Ax(t).$ To satisfy the initial condition $latex x(t_0)=x_0,$ instead of $latex e^{At}$ we can consider $latex x(t)=e^{A(t-t_0)}x_0.$ This matrix function solves the initial value problem

(2) $latex x^\prime(t)=Ax(t),$ $latex x(t_{0})=x_0.$

Calculating all powers of a matrix can be a time-consuming business. The process is facilitated by the knowledge of the diagonal representation.

Exercise 2. If $latex A$ is symmetric, then $latex A^m=UA_U^mU^{-1}$ for all non-negative integer $latex m.$ Hence, $latex f(A)=U\left(\sum_{m=0}^\infty\frac{f^{(m)}(0)}{m!}A_U^m\right)U^{-1}=Uf(A_U)U^{-1}.$

Proof. The equation

(3) $latex A^2=UA_UU^{-1}UA_UU^{-1}=UA_UA_UU^{-1}=UA_U^2U^{-1}=Udiag[\lambda_1^2,...,\lambda_n^2]U^{-1}$

shows that to square $latex A$ it is enough to square $latex A_{U}.$ In a similar fashion we can find all non-negative integer powers of $latex A.$

Example 2. $latex e^{At}=U\left(\sum_{m=0}^\infty\frac{1}{m!}diag[\lambda_{1}^m,...,\lambda_n^m]t^m\right)U^{-1}.$

3. Linear differential equation

Example 1 about the exponential matrix function involves a bit of guessing. With the diagonal representation at hand, we can obtain the same result in a more logical way.

One-dimensional case. $latex \frac{dx}{dt}=ax$ is equivalent to $latex \frac{dx}{x}=adt.$ Upon integration this gives

$latex \log x(t)-\log x(t_0)=\int_{t_0}^td(\log x)=\int_{t_0}^tadt=a(t-t_0)$

or

(4) $latex x(t)=e^{a(t-t_0)}x_0.$

General case. In case of a $latex 2\times 2$ matrix the first equation of (2) is $latex \frac{dx_1}{dt}=a_{11}x_1+a_{12}x_2.$ The fact that the x's on the right are mixed up makes the direct solution difficult. The idea is to split the system and separate the x's.

Premultiplying (2) by $latex U^{-1}$ we have $latex \frac{d(U^{-1}x)}{dt}=U^{-1}Ax=U^{-1}AUU^{-1}x$ or, denoting $latex U^{-1}x=y$ and using (1), $latex \frac{dy}{dt}=A_Uy.$ The last system is a collection of one-dimensional equations $latex \frac{dy_i}{dt}=\lambda_iy_i,$ $latex i=1,...,n.$ Let $latex y_0=U^{-1}x_0$ be the initial vector. From (4) $latex y_i=e^{\lambda_i(t-t_0)}y_{0i}.$ In matrix form this amounts to $latex y=e^{A_U(t-t_0)}y_0.$ Hence, as in Exercise 2, $latex x=Uy=Ue^{A_U(t-t_0)}U^{-1}Uy_0=e^{A(t-t_0)}x_0.$

This is the same solution obtained above. The difference is that here we assume symmetry and, as a consequence, can use Example 2.

← Previous: Questions for repetition | Next: Applications of the diagonal representation II →

Get the PDF book “Matrix Algebra” on Lulu