$$\newcommand{\id}{\mathrm{id}}$$ $$\newcommand{\Span}{\mathrm{span}}$$ $$\newcommand{\kernel}{\mathrm{null}\,}$$ $$\newcommand{\range}{\mathrm{range}\,}$$ $$\newcommand{\RealPart}{\mathrm{Re}}$$ $$\newcommand{\ImaginaryPart}{\mathrm{Im}}$$ $$\newcommand{\Argument}{\mathrm{Arg}}$$ $$\newcommand{\norm}[1]{\| #1 \|}$$ $$\newcommand{\inner}[2]{\langle #1, #2 \rangle}$$ $$\newcommand{\Span}{\mathrm{span}}$$

# 5.6: Optimal Spanning Trees

$$\newcommand{\vecs}[1]{\overset { \scriptstyle \rightharpoonup} {\mathbf{#1}} }$$ $$\newcommand{\vecd}[1]{\overset{-\!-\!\rightharpoonup}{\vphantom{a}\smash {#1}}}$$$$\newcommand{\id}{\mathrm{id}}$$ $$\newcommand{\Span}{\mathrm{span}}$$ $$\newcommand{\kernel}{\mathrm{null}\,}$$ $$\newcommand{\range}{\mathrm{range}\,}$$ $$\newcommand{\RealPart}{\mathrm{Re}}$$ $$\newcommand{\ImaginaryPart}{\mathrm{Im}}$$ $$\newcommand{\Argument}{\mathrm{Arg}}$$ $$\newcommand{\norm}[1]{\| #1 \|}$$ $$\newcommand{\inner}[2]{\langle #1, #2 \rangle}$$ $$\newcommand{\Span}{\mathrm{span}}$$ $$\newcommand{\id}{\mathrm{id}}$$ $$\newcommand{\Span}{\mathrm{span}}$$ $$\newcommand{\kernel}{\mathrm{null}\,}$$ $$\newcommand{\range}{\mathrm{range}\,}$$ $$\newcommand{\RealPart}{\mathrm{Re}}$$ $$\newcommand{\ImaginaryPart}{\mathrm{Im}}$$ $$\newcommand{\Argument}{\mathrm{Arg}}$$ $$\newcommand{\norm}[1]{\| #1 \|}$$ $$\newcommand{\inner}[2]{\langle #1, #2 \rangle}$$ $$\newcommand{\Span}{\mathrm{span}}$$

In some applications, a graph $$G$$ is augmented by associating a weight or cost with each edge; such a graph is called a weighted graph. For example, if a graph represents a network of roads, the weight of an edge might be the length of the road between its two endpoints, or the amount of time required to travel from one endpoint to the other, or the cost to bury cable along the road from one end to the other. In such cases, instead of being interested in just any spanning tree, we may be interested in a least cost spanning tree, that is, a spanning tree such that the sum of the costs of the edges of the tree is as small as possible. For example, this would be the least expensive way to connect a set of towns by a communication network, burying the cable in such a way as to minimize the total cost of laying the cable.

This problem is one that can be solved by a greedy algorithm. Roughly speaking, a greedy algorithm is one that makes choices that are optimal in the short run. Typically this strategy does not result in an optimal solution in the long run, but in this case this approach works.

Definition: weighted graph

A weighted graph is a graph $$G$$ together with a cost function $$c\colon E(G)\to \R^{>0}$$. If $$H$$ is a subgraph of $$G$$, the cost of $$H$$ is $$c(H)=\sum_{e\in E(H)} c(e)$$.

The Jarník Algorithm

Given a weighted connected graph $$G$$, we construct a minimum cost spanning tree $$T$$ as follows. Choose any vertex $$v_0$$ in $$G$$ and include it in $$T$$. If vertices $$S=\{v_0, v_1,\ldots,v_k\}$$ have been chosen, choose an edge with one endpoint in $$S$$ and one endpoint not in $$S$$ and with smallest weight among all such edges. Let $$v_{k+1}$$ be the endpoint of this edge not in $$S$$, and add it and the associated edge to $$T$$. Continue until all vertices of $$G$$ are in $$T$$.

This algorithm was discovered by Vojtěch Jarník in 1930, and rediscovered independently by Robert C. Prim in 1957 and Edsger Dijkstra in 1959. It is often called Prim's Algorithm. The algorithm proceeds by constructing a sequence of trees $$T_1, T_2,\ldots,T_{n-1}$$, with $$T_{n-1}$$ a spanning tree for $$G$$. At each step, the algorithm adds an edge that will make $$c(T_{i+1})$$ as small as possible among all trees that consist of $$T_i$$ plus one edge. This is the best choice in the short run, but it is not obvious that in the long run, that is, by the time $$T_{n-1}$$ is constructed, that this will turn out to have been the best choice.

Theorem 5.6.2

The Jarník Algorithm produces a minimum cost spanning tree.

Proof

Suppose $$G$$ is connected on $$n$$ vertices. Let $$T$$ be the spanning tree produced by the algorithm, and $$T_m$$ a minimum cost spanning tree. We prove that $$c(T)=c(T_m)$$.

Let $$e_1, e_2,\ldots,e_{n-1}$$ be the edges of $$T$$ in the order in which they were added to $$T$$; one endpoint of $$e_i$$ is $$v_i$$, the other is in $$\{v_0,\ldots,v_{i-1}\}$$. We form a sequence of trees $$T_m=T_0, T_1,\ldots, T_{n-1}=T$$ such that for each $$i$$, $$c(T_i)=c(T_{i+1})$$, and we conclude that $$c(T_m)=c(T)$$.

If $$e_1$$ is in $$T_0$$, let $$T_1=T_0$$. Otherwise, add edge $$e_1$$ to $$T_0$$. This creates a cycle containing $$e_1$$ and another edge incident at $$v_0$$, say $$f_1$$. Remove $$f_1$$ to form $$T_1$$. Since the algorithm added edge $$e_1$$, $$c(e_1)\le c(f_1)$$. If $$c(e_1)< c(f_1)$$, then $$c(T_1)< c(T_0)=c(T_m)$$, a contradiction, so $$c(e_1)=c(f_1)$$ and $$c(T_1)=c(T_0)$$.

Suppose we have constructed tree $$T_i$$. If $$e_{i+1}$$ is in $$T_i$$, let $$T_{i+1}=T_i$$. Otherwise, add edge $$e_{i+1}$$ to $$T_i$$. This creates a cycle, one of whose edges, call it $$f_{i+1}$$, is not in $$e_1, e_2,\ldots,e_i$$ and has exactly one endpoint in $$\{v_0,\ldots,v_i\}$$. Remove $$f_{i+1}$$ to create $$T_{i+1}$$. Since the algorithm added $$e_{i+1}$$, $$c(e_{i+1})\le c(f_{i+1})$$. If $$c(e_{i+1})< c(f_{i+1})$$, then $$c(T_{i+1})< c(T_i)=c(T_m)$$, a contradiction, so $$c(e_{i+1})=c(f_{i+1})$$ and $$c(T_{i+1})=c(T_i)$$.

$$\square$$