9.1: Inner Products
- Page ID
- 263
\( \newcommand{\vecs}[1]{\overset { \scriptstyle \rightharpoonup} {\mathbf{#1}} } \)
\( \newcommand{\vecd}[1]{\overset{-\!-\!\rightharpoonup}{\vphantom{a}\smash {#1}}} \)
\( \newcommand{\id}{\mathrm{id}}\) \( \newcommand{\Span}{\mathrm{span}}\)
( \newcommand{\kernel}{\mathrm{null}\,}\) \( \newcommand{\range}{\mathrm{range}\,}\)
\( \newcommand{\RealPart}{\mathrm{Re}}\) \( \newcommand{\ImaginaryPart}{\mathrm{Im}}\)
\( \newcommand{\Argument}{\mathrm{Arg}}\) \( \newcommand{\norm}[1]{\| #1 \|}\)
\( \newcommand{\inner}[2]{\langle #1, #2 \rangle}\)
\( \newcommand{\Span}{\mathrm{span}}\)
\( \newcommand{\id}{\mathrm{id}}\)
\( \newcommand{\Span}{\mathrm{span}}\)
\( \newcommand{\kernel}{\mathrm{null}\,}\)
\( \newcommand{\range}{\mathrm{range}\,}\)
\( \newcommand{\RealPart}{\mathrm{Re}}\)
\( \newcommand{\ImaginaryPart}{\mathrm{Im}}\)
\( \newcommand{\Argument}{\mathrm{Arg}}\)
\( \newcommand{\norm}[1]{\| #1 \|}\)
\( \newcommand{\inner}[2]{\langle #1, #2 \rangle}\)
\( \newcommand{\Span}{\mathrm{span}}\) \( \newcommand{\AA}{\unicode[.8,0]{x212B}}\)
\( \newcommand{\vectorA}[1]{\vec{#1}} % arrow\)
\( \newcommand{\vectorAt}[1]{\vec{\text{#1}}} % arrow\)
\( \newcommand{\vectorB}[1]{\overset { \scriptstyle \rightharpoonup} {\mathbf{#1}} } \)
\( \newcommand{\vectorC}[1]{\textbf{#1}} \)
\( \newcommand{\vectorD}[1]{\overrightarrow{#1}} \)
\( \newcommand{\vectorDt}[1]{\overrightarrow{\text{#1}}} \)
\( \newcommand{\vectE}[1]{\overset{-\!-\!\rightharpoonup}{\vphantom{a}\smash{\mathbf {#1}}}} \)
\( \newcommand{\vecs}[1]{\overset { \scriptstyle \rightharpoonup} {\mathbf{#1}} } \)
\( \newcommand{\vecd}[1]{\overset{-\!-\!\rightharpoonup}{\vphantom{a}\smash {#1}}} \)
\(\newcommand{\avec}{\mathbf a}\) \(\newcommand{\bvec}{\mathbf b}\) \(\newcommand{\cvec}{\mathbf c}\) \(\newcommand{\dvec}{\mathbf d}\) \(\newcommand{\dtil}{\widetilde{\mathbf d}}\) \(\newcommand{\evec}{\mathbf e}\) \(\newcommand{\fvec}{\mathbf f}\) \(\newcommand{\nvec}{\mathbf n}\) \(\newcommand{\pvec}{\mathbf p}\) \(\newcommand{\qvec}{\mathbf q}\) \(\newcommand{\svec}{\mathbf s}\) \(\newcommand{\tvec}{\mathbf t}\) \(\newcommand{\uvec}{\mathbf u}\) \(\newcommand{\vvec}{\mathbf v}\) \(\newcommand{\wvec}{\mathbf w}\) \(\newcommand{\xvec}{\mathbf x}\) \(\newcommand{\yvec}{\mathbf y}\) \(\newcommand{\zvec}{\mathbf z}\) \(\newcommand{\rvec}{\mathbf r}\) \(\newcommand{\mvec}{\mathbf m}\) \(\newcommand{\zerovec}{\mathbf 0}\) \(\newcommand{\onevec}{\mathbf 1}\) \(\newcommand{\real}{\mathbb R}\) \(\newcommand{\twovec}[2]{\left[\begin{array}{r}#1 \\ #2 \end{array}\right]}\) \(\newcommand{\ctwovec}[2]{\left[\begin{array}{c}#1 \\ #2 \end{array}\right]}\) \(\newcommand{\threevec}[3]{\left[\begin{array}{r}#1 \\ #2 \\ #3 \end{array}\right]}\) \(\newcommand{\cthreevec}[3]{\left[\begin{array}{c}#1 \\ #2 \\ #3 \end{array}\right]}\) \(\newcommand{\fourvec}[4]{\left[\begin{array}{r}#1 \\ #2 \\ #3 \\ #4 \end{array}\right]}\) \(\newcommand{\cfourvec}[4]{\left[\begin{array}{c}#1 \\ #2 \\ #3 \\ #4 \end{array}\right]}\) \(\newcommand{\fivevec}[5]{\left[\begin{array}{r}#1 \\ #2 \\ #3 \\ #4 \\ #5 \\ \end{array}\right]}\) \(\newcommand{\cfivevec}[5]{\left[\begin{array}{c}#1 \\ #2 \\ #3 \\ #4 \\ #5 \\ \end{array}\right]}\) \(\newcommand{\mattwo}[4]{\left[\begin{array}{rr}#1 \amp #2 \\ #3 \amp #4 \\ \end{array}\right]}\) \(\newcommand{\laspan}[1]{\text{Span}\{#1\}}\) \(\newcommand{\bcal}{\cal B}\) \(\newcommand{\ccal}{\cal C}\) \(\newcommand{\scal}{\cal S}\) \(\newcommand{\wcal}{\cal W}\) \(\newcommand{\ecal}{\cal E}\) \(\newcommand{\coords}[2]{\left\{#1\right\}_{#2}}\) \(\newcommand{\gray}[1]{\color{gray}{#1}}\) \(\newcommand{\lgray}[1]{\color{lightgray}{#1}}\) \(\newcommand{\rank}{\operatorname{rank}}\) \(\newcommand{\row}{\text{Row}}\) \(\newcommand{\col}{\text{Col}}\) \(\renewcommand{\row}{\text{Row}}\) \(\newcommand{\nul}{\text{Nul}}\) \(\newcommand{\var}{\text{Var}}\) \(\newcommand{\corr}{\text{corr}}\) \(\newcommand{\len}[1]{\left|#1\right|}\) \(\newcommand{\bbar}{\overline{\bvec}}\) \(\newcommand{\bhat}{\widehat{\bvec}}\) \(\newcommand{\bperp}{\bvec^\perp}\) \(\newcommand{\xhat}{\widehat{\xvec}}\) \(\newcommand{\vhat}{\widehat{\vvec}}\) \(\newcommand{\uhat}{\widehat{\uvec}}\) \(\newcommand{\what}{\widehat{\wvec}}\) \(\newcommand{\Sighat}{\widehat{\Sigma}}\) \(\newcommand{\lt}{<}\) \(\newcommand{\gt}{>}\) \(\newcommand{\amp}{&}\) \(\definecolor{fillinmathshade}{gray}{0.9}\)In this section, \(V \) is a finite-dimensional, nonzero vector space over \(\mathbb{F}\).
Definition 9.1.1. An inner product on \(V \) is a map
\begin{equation*}
\begin{split}
\inner{\cdot}{\cdot}:\;&V\times V \to \mathbb{F}\\
&(u,v) \mapsto \inner{u}{v}
\end{split}
\end{equation*}
with the following four properties.
- Linearity in first slot: \(\inner{u+v}{w}=\inner{u}{w}+\inner{v}{w} \) and \(\inner{au}{v}=a\inner{u}{v} \) for all \(u,v,w\in V \) and \(a\in \mathbb{F}\);
- Positivity: \(\inner{v}{v} \ge 0 \) for all \(v\in V\);
- Positive definiteness: \(\inner{v}{v}=0 \) if and only if \(v=0\);
- Conjugate symmetry: \(\inner{u}{v}=\overline{\inner{v}{u}} \) for all \(u,v\in V\).
Remark 9.1.2. Recall that every real number \(x\in\mathbb{R} \) equals its complex conjugate. Hence, for real vector spaces, conjugate symmetry of an inner product becomes actual symmetry.
Definition 9.1.3. An inner product space is a vector space over \(\mathbb{F} \) together with an inner product \(\inner{\cdot}{\cdot}\).
Example 9.1.4. Let \(V=\mathbb{F}^n \) and \(u=(u_1,\ldots,u_n), v=(v_1,\ldots,v_n)\in \mathbb{F}^n\). Then we can define an inner product on \(V \) by setting
\begin{equation*}
\inner{u}{v} = \sum_{i=1}^n u_i \overline{v}_i.
\end{equation*}
For \(\mathbb{F}=\mathbb{R}\), this reduces to the usual dot product, i.e.,
\begin{equation*}
u\cdot v = u_1v_1+\cdots+u_n v_n.
\end{equation*}
Example 9.1.5. Let \(V=\mathbb{F}[z] \) be the space of polynomials with coefficients in \(\mathbb{F}\).
Given \(f,g\in \mathbb{F}[z]\), we can define their inner product to be
\begin{equation*}
\inner{f}{g} = \int_0^1 f(z)\overline{g(z)}dz,
\end{equation*}
where \(\overline{g(z)} \) is the complex conjugate of the polynomial \(g(z)\).
For a fixed vector \(w\in V\), one can define a map \(T:V\to \mathbb{F} \) by setting \(Tv=\inner{v}{w}\). Note that \(T \) is linear by Condition~1 of Definition~9.1.1. This implies, in particular, that \(\inner{0}{w}=0 \) for every \(w\in V\). By conjugate symmetry, we also have \(\inner{w}{0}=0\).
Lemma 9.1.6. The inner product is anti-linear in the second slot, that is, \( \inner{u}{v+w}=\inner{u}{v}+\inner{u}{w} \) and \(\inner{u}{av}
=\overline{a}\inner{u}{v} \) for all \(u,v,w\in V \) and \(a\in \mathbb{F}\).
Proof. For additivity, note that
\begin{equation*}
\begin{split}
\inner{u}{v+w} & = \overline{\inner{v+w}{u}} = \overline{\inner{v}{u}+\inner{w}{u}}\\
& = \overline{\inner{v}{u}} + \overline{\inner{w}{u}} = \inner{u}{v} + \inner{u}{w}.
\end{split}
\end{equation*}
Similarly, for anti-homogeneity, note that
\begin{equation*}
\inner{u}{av} = \overline{\inner{av}{u}} = \overline{a\inner{v}{u}}
= \overline{a} \overline{\inner{v}{u}} = \overline{a} \inner{u}{v}.
\end{equation*}
We close this section by noting that the convention in physics is often the exact opposite of what we have defined above. In other words, an inner product in physics is traditionally linear in the second slot and anti-linear in the first slot.