11.3: Normal operators and the spectral decomposition
- Page ID
- 307
\( \newcommand{\vecs}[1]{\overset { \scriptstyle \rightharpoonup} {\mathbf{#1}} } \)
\( \newcommand{\vecd}[1]{\overset{-\!-\!\rightharpoonup}{\vphantom{a}\smash {#1}}} \)
\( \newcommand{\id}{\mathrm{id}}\) \( \newcommand{\Span}{\mathrm{span}}\)
( \newcommand{\kernel}{\mathrm{null}\,}\) \( \newcommand{\range}{\mathrm{range}\,}\)
\( \newcommand{\RealPart}{\mathrm{Re}}\) \( \newcommand{\ImaginaryPart}{\mathrm{Im}}\)
\( \newcommand{\Argument}{\mathrm{Arg}}\) \( \newcommand{\norm}[1]{\| #1 \|}\)
\( \newcommand{\inner}[2]{\langle #1, #2 \rangle}\)
\( \newcommand{\Span}{\mathrm{span}}\)
\( \newcommand{\id}{\mathrm{id}}\)
\( \newcommand{\Span}{\mathrm{span}}\)
\( \newcommand{\kernel}{\mathrm{null}\,}\)
\( \newcommand{\range}{\mathrm{range}\,}\)
\( \newcommand{\RealPart}{\mathrm{Re}}\)
\( \newcommand{\ImaginaryPart}{\mathrm{Im}}\)
\( \newcommand{\Argument}{\mathrm{Arg}}\)
\( \newcommand{\norm}[1]{\| #1 \|}\)
\( \newcommand{\inner}[2]{\langle #1, #2 \rangle}\)
\( \newcommand{\Span}{\mathrm{span}}\) \( \newcommand{\AA}{\unicode[.8,0]{x212B}}\)
\( \newcommand{\vectorA}[1]{\vec{#1}} % arrow\)
\( \newcommand{\vectorAt}[1]{\vec{\text{#1}}} % arrow\)
\( \newcommand{\vectorB}[1]{\overset { \scriptstyle \rightharpoonup} {\mathbf{#1}} } \)
\( \newcommand{\vectorC}[1]{\textbf{#1}} \)
\( \newcommand{\vectorD}[1]{\overrightarrow{#1}} \)
\( \newcommand{\vectorDt}[1]{\overrightarrow{\text{#1}}} \)
\( \newcommand{\vectE}[1]{\overset{-\!-\!\rightharpoonup}{\vphantom{a}\smash{\mathbf {#1}}}} \)
\( \newcommand{\vecs}[1]{\overset { \scriptstyle \rightharpoonup} {\mathbf{#1}} } \)
\( \newcommand{\vecd}[1]{\overset{-\!-\!\rightharpoonup}{\vphantom{a}\smash {#1}}} \)
\(\newcommand{\avec}{\mathbf a}\) \(\newcommand{\bvec}{\mathbf b}\) \(\newcommand{\cvec}{\mathbf c}\) \(\newcommand{\dvec}{\mathbf d}\) \(\newcommand{\dtil}{\widetilde{\mathbf d}}\) \(\newcommand{\evec}{\mathbf e}\) \(\newcommand{\fvec}{\mathbf f}\) \(\newcommand{\nvec}{\mathbf n}\) \(\newcommand{\pvec}{\mathbf p}\) \(\newcommand{\qvec}{\mathbf q}\) \(\newcommand{\svec}{\mathbf s}\) \(\newcommand{\tvec}{\mathbf t}\) \(\newcommand{\uvec}{\mathbf u}\) \(\newcommand{\vvec}{\mathbf v}\) \(\newcommand{\wvec}{\mathbf w}\) \(\newcommand{\xvec}{\mathbf x}\) \(\newcommand{\yvec}{\mathbf y}\) \(\newcommand{\zvec}{\mathbf z}\) \(\newcommand{\rvec}{\mathbf r}\) \(\newcommand{\mvec}{\mathbf m}\) \(\newcommand{\zerovec}{\mathbf 0}\) \(\newcommand{\onevec}{\mathbf 1}\) \(\newcommand{\real}{\mathbb R}\) \(\newcommand{\twovec}[2]{\left[\begin{array}{r}#1 \\ #2 \end{array}\right]}\) \(\newcommand{\ctwovec}[2]{\left[\begin{array}{c}#1 \\ #2 \end{array}\right]}\) \(\newcommand{\threevec}[3]{\left[\begin{array}{r}#1 \\ #2 \\ #3 \end{array}\right]}\) \(\newcommand{\cthreevec}[3]{\left[\begin{array}{c}#1 \\ #2 \\ #3 \end{array}\right]}\) \(\newcommand{\fourvec}[4]{\left[\begin{array}{r}#1 \\ #2 \\ #3 \\ #4 \end{array}\right]}\) \(\newcommand{\cfourvec}[4]{\left[\begin{array}{c}#1 \\ #2 \\ #3 \\ #4 \end{array}\right]}\) \(\newcommand{\fivevec}[5]{\left[\begin{array}{r}#1 \\ #2 \\ #3 \\ #4 \\ #5 \\ \end{array}\right]}\) \(\newcommand{\cfivevec}[5]{\left[\begin{array}{c}#1 \\ #2 \\ #3 \\ #4 \\ #5 \\ \end{array}\right]}\) \(\newcommand{\mattwo}[4]{\left[\begin{array}{rr}#1 \amp #2 \\ #3 \amp #4 \\ \end{array}\right]}\) \(\newcommand{\laspan}[1]{\text{Span}\{#1\}}\) \(\newcommand{\bcal}{\cal B}\) \(\newcommand{\ccal}{\cal C}\) \(\newcommand{\scal}{\cal S}\) \(\newcommand{\wcal}{\cal W}\) \(\newcommand{\ecal}{\cal E}\) \(\newcommand{\coords}[2]{\left\{#1\right\}_{#2}}\) \(\newcommand{\gray}[1]{\color{gray}{#1}}\) \(\newcommand{\lgray}[1]{\color{lightgray}{#1}}\) \(\newcommand{\rank}{\operatorname{rank}}\) \(\newcommand{\row}{\text{Row}}\) \(\newcommand{\col}{\text{Col}}\) \(\renewcommand{\row}{\text{Row}}\) \(\newcommand{\nul}{\text{Nul}}\) \(\newcommand{\var}{\text{Var}}\) \(\newcommand{\corr}{\text{corr}}\) \(\newcommand{\len}[1]{\left|#1\right|}\) \(\newcommand{\bbar}{\overline{\bvec}}\) \(\newcommand{\bhat}{\widehat{\bvec}}\) \(\newcommand{\bperp}{\bvec^\perp}\) \(\newcommand{\xhat}{\widehat{\xvec}}\) \(\newcommand{\vhat}{\widehat{\vvec}}\) \(\newcommand{\uhat}{\widehat{\uvec}}\) \(\newcommand{\what}{\widehat{\wvec}}\) \(\newcommand{\Sighat}{\widehat{\Sigma}}\) \(\newcommand{\lt}{<}\) \(\newcommand{\gt}{>}\) \(\newcommand{\amp}{&}\) \(\definecolor{fillinmathshade}{gray}{0.9}\)Recall that an operator \(T \in \mathcal{L}(V)\) is diagonalizable if there exists a basis \(B\) for \(V\) such that \(B\) consists entirely of eigenvectors for \(T\). The nicest operators on \(V\) are those that are diagonalizable with respect to some orthonormal basis for \(V\). In other words, these are the operators for which we can find an orthonormal basis for \(V\) that consists of eigenvectors for \(T\). The Spectral Theorem for finite-dimensional complex inner product spaces states that this can be done precisely for normal operators.
Theorem 11.3.1. Let \(V\) be a finite-dimensional inner product space over \(\mathbb{C}\) and \(T\in\mathcal{L}(V)\). Then \(T\) is normal if and only if there exists an orthonormal basis for \(V\) consisting of eigenvectors for \(T\).
Proof. \(( "\Longrightarrow" )\) Suppose that \(T\) is normal.
Combining Theorem7.5.3~\ref{thm:ComplexLinearMapsUpperTriangularWrtSomeBasis} and Corollary9.5.5~\ref{thm:ComplexLinearMapsUpperTriangularWrtSomeOrthonormalBasis}, there exists an orthonormal basis \(e=(e_1,\ldots,e_n)\) for which the matrix \(M(T)\) is upper triangular, i.e.,
\begin{equation*}
M(T) = \begin{bmatrix} a_{11} & \cdots & a_{1n}\\ &\ddots& \vdots \\ 0&& a_{nn} \end{bmatrix}.
\end{equation*}
We will show that \(M(T)\) is, in fact, diagonal, which implies that the basis elements \(e_1,\ldots,e_n\) are eigenvectors of \(T\).
Since \(M(T)=(a_{ij})_{i,j=1}^n\) with \(a_{ij}=0\) for \(i>j\), we have \(Te_1=a_{11}e_1\) and \(T^*e_1=\sum_{k=1}^n \overline{a}_{1k} e_k\). Thus, by the Pythagorean Theorem and Proposition11.2.3~\ref{prop:adjoint norm},
\begin{equation*}
|a_{11}|^2 = \norm{a_{11}e_1}^2 = \norm{Te_1}^2 = \norm{T^*e_1}^2
=\norm{\sum_{k=1}^n \overline{a}_{1k} e_k}^2 = \sum_{k=1}^n |a_{1k}|^2,
\end{equation*}
from which it follows that \(|a_{12}| = \cdots = |a_{1n}| = 0\). Repeating this argument, \(\norm{Te_j}^2=|a_{jj}|^2\) and \(\norm{T^*e_j}^2 = \sum_{k=j}^n |a_{jk}|^2\) so that \(a_{ij}=0\) for all \(2\le i<j\le n\). Hence, \(T\) is diagonal with respect to the basis
\(e\), and \(e_1,\ldots,e_n\) are eigenvectors of \(T\).
\(( "\Longleftarrow" )\) Suppose there exists an orthonormal basis \((e_1,\ldots,e_n)\) for \(V\) that consists of eigenvectors for \(T\). Then the matrix \(M(T)\) with respect to this basis is diagonal. Moreover, \(M(T^*)=M(T)^*\) with respect to this basis must also be a diagonal matrix.
It follows that \(TT^*=T^*T\) since their corresponding matrices commute:
\begin{equation*}
M(TT^*) = M(T)M(T^*) = M(T^*)M(T) = M(T^*T).
\end{equation*}
The following corollary is the best possible decomposition of a complex vector space \(V\) into subspaces that are invariant under a normal operator \(T\). On each subspace \(\kernel(T-\lambda_i I)\), the operator \(T\) acts just like multiplication by scalar \(\lambda_i\). In other words,
\[ T|_{\kernel(T-\lambda_i I)} = \lambda_{i}I_{\kernel(T-\lambda_i I)}. \]
Corollary 11.3.2. Let \(T\in\mathcal{L}(V)\) be a normal operator, and denote by \(\lambda_1,\ldots,\lambda_m\) the distinct eigenvalues of \(T\).
- \(V = \kernel(T-\lambda_1 I) \oplus \cdots \oplus \kernel(T-\lambda_m I)\).
- If \(i\neq j\), then \(\kernel(T-\lambda_i I)\bot \kernel(T-\lambda_j I)\).
As we will see in the next section, we can use Corollary 11.3.2 to decompose the canonical matrix for a normal operator into a so-called “unitary diagonalization”.
Contributors
- Isaiah Lankham, Mathematics Department at UC Davis
- Bruno Nachtergaele, Mathematics Department at UC Davis
- Anne Schilling, Mathematics Department at UC Davis
Both hardbound and softbound versions of this textbook are available online at WorldScientific.com.