11.1: A- Jacobians, Inverses of Matrices, and Eigenvalues
- Page ID
- 24207
\( \newcommand{\vecs}[1]{\overset { \scriptstyle \rightharpoonup} {\mathbf{#1}} } \)
\( \newcommand{\vecd}[1]{\overset{-\!-\!\rightharpoonup}{\vphantom{a}\smash {#1}}} \)
\( \newcommand{\id}{\mathrm{id}}\) \( \newcommand{\Span}{\mathrm{span}}\)
( \newcommand{\kernel}{\mathrm{null}\,}\) \( \newcommand{\range}{\mathrm{range}\,}\)
\( \newcommand{\RealPart}{\mathrm{Re}}\) \( \newcommand{\ImaginaryPart}{\mathrm{Im}}\)
\( \newcommand{\Argument}{\mathrm{Arg}}\) \( \newcommand{\norm}[1]{\| #1 \|}\)
\( \newcommand{\inner}[2]{\langle #1, #2 \rangle}\)
\( \newcommand{\Span}{\mathrm{span}}\)
\( \newcommand{\id}{\mathrm{id}}\)
\( \newcommand{\Span}{\mathrm{span}}\)
\( \newcommand{\kernel}{\mathrm{null}\,}\)
\( \newcommand{\range}{\mathrm{range}\,}\)
\( \newcommand{\RealPart}{\mathrm{Re}}\)
\( \newcommand{\ImaginaryPart}{\mathrm{Im}}\)
\( \newcommand{\Argument}{\mathrm{Arg}}\)
\( \newcommand{\norm}[1]{\| #1 \|}\)
\( \newcommand{\inner}[2]{\langle #1, #2 \rangle}\)
\( \newcommand{\Span}{\mathrm{span}}\) \( \newcommand{\AA}{\unicode[.8,0]{x212B}}\)
\( \newcommand{\vectorA}[1]{\vec{#1}} % arrow\)
\( \newcommand{\vectorAt}[1]{\vec{\text{#1}}} % arrow\)
\( \newcommand{\vectorB}[1]{\overset { \scriptstyle \rightharpoonup} {\mathbf{#1}} } \)
\( \newcommand{\vectorC}[1]{\textbf{#1}} \)
\( \newcommand{\vectorD}[1]{\overrightarrow{#1}} \)
\( \newcommand{\vectorDt}[1]{\overrightarrow{\text{#1}}} \)
\( \newcommand{\vectE}[1]{\overset{-\!-\!\rightharpoonup}{\vphantom{a}\smash{\mathbf {#1}}}} \)
\( \newcommand{\vecs}[1]{\overset { \scriptstyle \rightharpoonup} {\mathbf{#1}} } \)
\( \newcommand{\vecd}[1]{\overset{-\!-\!\rightharpoonup}{\vphantom{a}\smash {#1}}} \)
\(\newcommand{\avec}{\mathbf a}\) \(\newcommand{\bvec}{\mathbf b}\) \(\newcommand{\cvec}{\mathbf c}\) \(\newcommand{\dvec}{\mathbf d}\) \(\newcommand{\dtil}{\widetilde{\mathbf d}}\) \(\newcommand{\evec}{\mathbf e}\) \(\newcommand{\fvec}{\mathbf f}\) \(\newcommand{\nvec}{\mathbf n}\) \(\newcommand{\pvec}{\mathbf p}\) \(\newcommand{\qvec}{\mathbf q}\) \(\newcommand{\svec}{\mathbf s}\) \(\newcommand{\tvec}{\mathbf t}\) \(\newcommand{\uvec}{\mathbf u}\) \(\newcommand{\vvec}{\mathbf v}\) \(\newcommand{\wvec}{\mathbf w}\) \(\newcommand{\xvec}{\mathbf x}\) \(\newcommand{\yvec}{\mathbf y}\) \(\newcommand{\zvec}{\mathbf z}\) \(\newcommand{\rvec}{\mathbf r}\) \(\newcommand{\mvec}{\mathbf m}\) \(\newcommand{\zerovec}{\mathbf 0}\) \(\newcommand{\onevec}{\mathbf 1}\) \(\newcommand{\real}{\mathbb R}\) \(\newcommand{\twovec}[2]{\left[\begin{array}{r}#1 \\ #2 \end{array}\right]}\) \(\newcommand{\ctwovec}[2]{\left[\begin{array}{c}#1 \\ #2 \end{array}\right]}\) \(\newcommand{\threevec}[3]{\left[\begin{array}{r}#1 \\ #2 \\ #3 \end{array}\right]}\) \(\newcommand{\cthreevec}[3]{\left[\begin{array}{c}#1 \\ #2 \\ #3 \end{array}\right]}\) \(\newcommand{\fourvec}[4]{\left[\begin{array}{r}#1 \\ #2 \\ #3 \\ #4 \end{array}\right]}\) \(\newcommand{\cfourvec}[4]{\left[\begin{array}{c}#1 \\ #2 \\ #3 \\ #4 \end{array}\right]}\) \(\newcommand{\fivevec}[5]{\left[\begin{array}{r}#1 \\ #2 \\ #3 \\ #4 \\ #5 \\ \end{array}\right]}\) \(\newcommand{\cfivevec}[5]{\left[\begin{array}{c}#1 \\ #2 \\ #3 \\ #4 \\ #5 \\ \end{array}\right]}\) \(\newcommand{\mattwo}[4]{\left[\begin{array}{rr}#1 \amp #2 \\ #3 \amp #4 \\ \end{array}\right]}\) \(\newcommand{\laspan}[1]{\text{Span}\{#1\}}\) \(\newcommand{\bcal}{\cal B}\) \(\newcommand{\ccal}{\cal C}\) \(\newcommand{\scal}{\cal S}\) \(\newcommand{\wcal}{\cal W}\) \(\newcommand{\ecal}{\cal E}\) \(\newcommand{\coords}[2]{\left\{#1\right\}_{#2}}\) \(\newcommand{\gray}[1]{\color{gray}{#1}}\) \(\newcommand{\lgray}[1]{\color{lightgray}{#1}}\) \(\newcommand{\rank}{\operatorname{rank}}\) \(\newcommand{\row}{\text{Row}}\) \(\newcommand{\col}{\text{Col}}\) \(\renewcommand{\row}{\text{Row}}\) \(\newcommand{\nul}{\text{Nul}}\) \(\newcommand{\var}{\text{Var}}\) \(\newcommand{\corr}{\text{corr}}\) \(\newcommand{\len}[1]{\left|#1\right|}\) \(\newcommand{\bbar}{\overline{\bvec}}\) \(\newcommand{\bhat}{\widehat{\bvec}}\) \(\newcommand{\bperp}{\bvec^\perp}\) \(\newcommand{\xhat}{\widehat{\xvec}}\) \(\newcommand{\vhat}{\widehat{\vvec}}\) \(\newcommand{\uhat}{\widehat{\uvec}}\) \(\newcommand{\what}{\widehat{\wvec}}\) \(\newcommand{\Sighat}{\widehat{\Sigma}}\) \(\newcommand{\lt}{<}\) \(\newcommand{\gt}{>}\) \(\newcommand{\amp}{&}\) \(\definecolor{fillinmathshade}{gray}{0.9}\)In this appendix we collect together some results on Jacobians and inverses and eigenvalues of \(2 \times 2\) matrices that are used repeatedly in the material.
First, we consider the Taylor expansion of a vector valued function of two variables, denoted as follows:
\[H(x,y) = \begin{pmatrix} {f(x, y)}\\ {g(x, y)} \end{pmatrix}, (x, y) \in \mathbb{R}^2 , \label{A.1}\]
More precisely, we will need to Taylor expand such functions through second order:
\[H(x_{0} +h, y_{0} +k) = H(x_{0}, y_{0})+DH(x_{0}, y_{0}) \begin{pmatrix} {h}\\ {k} \end{pmatrix}+\mathcal{O}(2). \label{A.2}\]
The Taylor expansion of a scalar valued function of one variable should be familiar to most students at this level. Possibly there is less familiarity with the Taylor expansion of a vector valued function of a vector variable. However, to compute this we just Taylor expand each component of the function (which is a scalar valued function of a vector variable) in each variable, holding the other variable fixed for the expansion in that particular variable, and then we gather the results for each component into matrix form.
Carrying this procedure out for the \(f (x, y)\) component of Equation \ref{A.1} gives:
\[ \begin{align} f(x_{0}+h, y_{0}+k) &= f(x_{0}, y_{0}+k)+ \frac{\partial f }{\partial x} (x_{0}, y_{0}+k)h+\mathcal{O}(h^2) \\[4pt] &= f(x_{0}, y_{0})+\frac{\partial f}{\partial y}(x_{0}, y_{0})k+\mathcal{O}(k^2)+\frac{\partial f}{\partial x}(x_{0}, y_{0})h + \mathcal{O}(hk) + \mathcal{O}(h^2). \label{A.3} \end{align}\]
The same procedure can be applied to \(g(x, y)\). Recombining the terms back into the vector expression for Equation \ref{A.1} gives:
\[H(x_{0}+h, y_{0}+k) = \begin{pmatrix} {f(x_{0}, y_{0})}\\ {g(x_{0}, y_{0})} \end{pmatrix} +\begin{pmatrix} {\frac{\partial f}{\partial x} (x_{0}, y_{0})}&{\frac{\partial f}{\partial y} (x_{0}, y_{0})}\\ {\frac{\partial g}{\partial x} (x_{0}, y_{0})}&{\frac{\partial g}{\partial y} (x_{0}, y_{0})} \end{pmatrix} \begin{pmatrix} {h}\\ {k} \end{pmatrix} + \mathcal{O}(2), \label{A.4}\]
Hence, the Jacobian of Equation \ref{A.1} at \((x_{0}, y_{0})\) is:
\[\begin{pmatrix} {\frac{\partial f}{\partial x} (x_{0}, y_{0})}&{\frac{\partial f}{\partial y} (x_{0}, y_{0})}\\ {\frac{\partial g}{\partial x} (x_{0}, y_{0})}&{\frac{\partial g}{\partial y} (x_{0}, y_{0})} \end{pmatrix}, \label{A.5}\]
which is a \(2 \times 2\) matrix of real numbers.
We will need to compute the inverse of such matrices, as well as its eigenvalues.
We denote a general \(2 \times 2\) matrix of real numbers:
\[A= \begin{pmatrix} {a}&{b}\\ {c}&{d} \end{pmatrix}, a, b, c, d \in \mathbb{R}. \label{A.6}\]
It is easy to verify that the inverse of A is given by:
\[A^{-1} = \frac{1}{ad-bc} \begin{pmatrix} {d}&{-b}\\ {-c}&{a} \end{pmatrix}. \label{A.7}\]
Let \(\mathbb{I}\) denote the \(2 \times 2\) identity matrix. Then the eigenvalues of A are the solutions of the characteristic equation:
\[det (A - \lambda \mathbb{I}) = 0. \label{A.8}\]
where "det" is notation for the determinant of the matrix. This is a quadratic equation in \(\lambda\) which has two solutions:
\[\lambda_{1,2} = \frac{tr A}{2} \pm \frac{1}{2} \sqrt{(tr A)^2-4det A}, \label{A.9}\]
where we have used the notation:
\(tr A \equiv trace A = a + d\), \(det A \equiv determinant A = ad-bc\).