2: Vectors

Learning Objectives

After reading this chapter, you should be able to:

1. define a vector
2. add and subtract vectors,
3. find linear combinations of vectors and their relationship to a set of equations,
4. explain what it means to have a linearly independent set of vectors, and
5. find the rank of a set of vectors.

What is a vector?

A vector is a collection of numbers in a definite order. If it is a collection of $n$ numbers, it is called a $n$-dimensional vector. So, the vector $\overrightarrow{A}$ given by

$$\overrightarrow{A} = \begin{bmatrix} \begin{matrix} a_{1} \\ a_{2} \\ \end{matrix} \\ \begin{matrix} \vdots \\ a_{n} \\ \end{matrix} \\ \end{bmatrix} \notag$$

is a $n$-dimensional column vector with $n$ components, $a_{1},a_{2},......,a_{n}$. The above is a column vector. A row vector $\lbrack B\rbrack$ is of the form $\overrightarrow{B} = \lbrack b_{1},b_{2},....,b_{n}\rbrack$ where $\overrightarrow{B}$ is a $n$-dimensional row vector with $n$ components $b_{1},b_{2},....,b_{n}$.

Example 1

Give an example of a 3-dimensional column vector.

Solution

Assume a point in space is given by its $(x,y,z)$ coordinates. Then if the value of $x = 3,\ y = 2,\ z = 5$, the column vector corresponding to the location of the points is

$$\begin{bmatrix} x \\ y \\ z \\ \end{bmatrix} = \begin{bmatrix} 3 \\ 2 \\ 5 \\ \end{bmatrix} \notag$$

When are two vectors equal?

Two vectors $\overrightarrow{A}$ and $\overrightarrow{B}$ are equal if they are of the same dimension and if their corresponding components are equal.

Given

$$\overrightarrow{A} = \begin{bmatrix} a_{1} \\ a_{2} \\ \vdots \\ a_{n} \\ \end{bmatrix}\notag$$

and

$$\overrightarrow{B} = \begin{bmatrix} b_{1} \\ b_{2} \\ \vdots \\ b_{n} \\ \end{bmatrix}\notag$$

then $\overrightarrow{A} = \overrightarrow{B}$ if $a_{i} = b_{i},\ \ i = 1,2,......,n$.

Example 2

What are the values of the unknown components in $\overrightarrow{B}$ if

$$\overrightarrow{A} = \begin{bmatrix} 2 \\ 3 \\ 4 \\ 1 \\ \end{bmatrix}\notag$$

and

$$\overrightarrow{B} = \begin{bmatrix} b_{1} \\ 3 \\ 4 \\ b_{4} \\ \end{bmatrix}\notag$$

and $\overrightarrow{A} = \overrightarrow{B}$.

Solution

$$b_{1} = 2,b_{4} = 1\notag$$

How do you add two vectors?

Two vectors can be added only if they are of the same dimension and the addition is given by

$$\begin{split} \lbrack A\rbrack + \lbrack B\rbrack &= \begin{bmatrix} a_{1} \\ a_{2} \\ \vdots \\ a_{n} \\ \end{bmatrix} + \begin{bmatrix} b_{1} \\ b_{2} \\ \vdots \\ b_{n} \\ \end{bmatrix}\\ &= \begin{bmatrix} a_{1} + b_{1} \\ a_{2} + b_{2} \\ \vdots \\ a_{n} + b_{n} \\ \end{bmatrix} \end{split}\notag$$

Example 3

Add the two vectors

$$\overrightarrow{A} = \begin{bmatrix} 2 \\ 3 \\ 4 \\ 1 \\ \end{bmatrix}\notag$$

and

$$\overrightarrow{B} = \begin{bmatrix} 5 \\ - 2 \\ 3 \\ 7 \\ \end{bmatrix}\notag$$

Solution

$$\begin{split} \overrightarrow{A} + \overrightarrow{B} &= \begin{bmatrix} 2 \\ 3 \\ 4 \\ 1 \\ \end{bmatrix} + \begin{bmatrix} 5 \\ - 2 \\ 3 \\ 7 \\ \end{bmatrix}\\ &= \begin{bmatrix} 2 + 5 \\ 3 - 2 \\ 4 + 3 \\ 1 + 7 \\ \end{bmatrix}\\ &= \begin{bmatrix} 7 \\ 1 \\ 7 \\ 8 \\ \end{bmatrix} \end{split}\notag$$

Example 4

A store sells three brands of tires: Tirestone, Michigan and Copper. In quarter 1, the sales are given by the column vector

$${\overrightarrow{A}}_{1} = \begin{bmatrix} 25 \\ 5 \\ 6 \\ \end{bmatrix}\notag$$

where the rows represent the three brands of tires sold – Tirestone, Michigan and Copper respectively. In quarter 2, the sales are given by

$${\overrightarrow{A}}_{2} = \begin{bmatrix} 20 \\ 10 \\ 6 \\ \end{bmatrix}\notag$$

What is the total sale of each brand of tire in the first half of the year?

Solution

The total sales would be given by

$$\begin{split} \overrightarrow{C} &= {\overrightarrow{A}}_{1} + {\overrightarrow{A}}_{2}\\ &= \begin{bmatrix} 25 \\ 5 \\ 6 \\ \end{bmatrix} + \begin{bmatrix} 20 \\ 10 \\ 6 \\ \end{bmatrix}\\ &= \begin{bmatrix} 25 + 20 \\ 5 + 10 \\ 6 + 6 \\ \end{bmatrix}\\ &= \begin{bmatrix} 45 \\ 15 \\ 12 \\ \end{bmatrix} \end{split}\notag$$

So, the number of Tirestone tires sold is 45, Michigan is 15 and Copper is 12 in the first half of the year.

What is a null vector?

A null vector (also called zero vector) is where all the components of the vector are zero.

Example 5

Give an example of a null vector or zero vector.

Solution

The vector

$$\begin{bmatrix} 0 \\ 0 \\ 0 \\ 0 \\ \end{bmatrix}\notag$$

is an example of a zero or null vector.

What is a unit vector?

A unit vector $\overrightarrow{U}$ is defined as

$$\overrightarrow{U} = \begin{bmatrix} u_{1} \\ u_{2} \\ \vdots \\ u_{n} \\ \end{bmatrix}\notag$$

where

$$\sqrt{u_{1}^{2} + u_{2}^{2} + u_{3}^{2} + \ldots + u_{n}^{2}} = 1\notag$$

Example 6

Give examples of 3-dimensional unit column vectors.

Solution

Examples include

$$\begin{bmatrix} \frac{1}{\sqrt{3}} \\ \frac{1}{\sqrt{3}} \\ \frac{1}{\sqrt{3}} \\ \end{bmatrix},\begin{bmatrix} 1 \\ 0 \\ 0 \\ \end{bmatrix},\begin{bmatrix} \frac{1}{\sqrt{2}} \\ \frac{1}{\sqrt{2}} \\ 0 \\ \end{bmatrix},\begin{bmatrix} 0 \\ 1 \\ 0 \\ \end{bmatrix},\ \text{etc}.\notag$$

How do youmultiply a vector by a scalar?

If $k$ is a scalar and $\overrightarrow{A}$ is a $n$-dimensional vector, then

$$\begin{split} k\overrightarrow{A} &= k\begin{bmatrix} a_{1} \\ a_{2} \\ \vdots \\ a_{n} \\ \end{bmatrix}\\ &= \begin{bmatrix} ka_{1} \\ ka_{2} \\ \vdots \\ ka_{n} \\ \end{bmatrix} \end{split}\notag$$

Example 7

What is $2\overrightarrow{A}$ if

$$\overrightarrow{A} = \begin{bmatrix} 25 \\ 20 \\ 5 \\ \end{bmatrix}\notag$$

Solution

$$\begin{split} 2\overrightarrow{A} &= 2\begin{bmatrix} 25 \\ 20 \\ 5 \\ \end{bmatrix}\\ &= \begin{bmatrix} 2 \times 25 \\ 2 \times 20 \\ 2 \times 5 \\ \end{bmatrix}\\ &= \begin{bmatrix} 50 \\ 40 \\ 10 \\ \end{bmatrix} \end{split}\notag$$

Example 8

A store sells three brands of tires: Tirestone, Michigan and Copper. In quarter 1, the sales are given by the column vector

$$\overrightarrow{A} = \begin{bmatrix} 25 \\ 25 \\ 6 \\ \end{bmatrix}\notag$$

If the goal is to increase the sales of all tires by at least 25% in the next quarter, how many of each brand should be sold?

Solution

Since the goal is to increase the sales by 25%, one would multiply the $\overrightarrow{A}$ vector by 1.25,

$$\begin{split} \overrightarrow{B} &= 1.25\begin{bmatrix} 25 \\ 25 \\ 6 \\ \end{bmatrix}\\ &= \begin{bmatrix} 31.25 \\ 31.25 \\ 7.5 \\ \end{bmatrix} \end{split}\notag$$

Since the number of tires must be an integer, we can say that the goal of sales is

$$\overrightarrow{B} = \begin{bmatrix} 32 \\ 32 \\ 8 \\ \end{bmatrix}\notag$$

What do you mean by a linear combination of vectors?

Given

$${\overrightarrow{A}}_{1},{\overrightarrow{A}}_{2},......,{\overrightarrow{A}}_{m}\notag$$

as $m$ vectors of same dimension $n$, and if $k_{1},k_{2},...,k_{m}$ are scalars, then

$$k_{1}{\overrightarrow{A}}_{1} + k_{2}{\overrightarrow{A}}_{2} + ....... + k_{m}{\overrightarrow{A}}_{m}\notag$$

is a linear combination of the $m$ vectors.

Example 9

Find the linear combinations

(a)$\ \overrightarrow{A} - \overrightarrow{B}\ \text{and}$

(b)$\ \overrightarrow{A} + \overrightarrow{B} - 3\overrightarrow{C}$

where

$$\overrightarrow{A} = \begin{bmatrix} 2 \\ 3 \\ 6 \\ \end{bmatrix},\overrightarrow{B} = \begin{bmatrix} 1 \\ 1 \\ 2 \\ \end{bmatrix},\overrightarrow{C} = \begin{bmatrix} 10 \\ 1 \\ 2 \\ \end{bmatrix}\notag$$

Solution

(a) $$\begin{split} \ \overrightarrow{A} - \overrightarrow{B} &= \begin{bmatrix} 2 \\ 3 \\ 6 \\ \end{bmatrix} - \begin{bmatrix} 1 \\ 1 \\ 2 \\ \end{bmatrix}\\ &= \begin{bmatrix} 2 - 1 \\ 3 - 1 \\ 6 - 2 \\ \end{bmatrix}\\ &= \begin{bmatrix} 1 \\ 2 \\ 4 \\ \end{bmatrix} \end{split}$$

(b) $$\begin{split} \ \overrightarrow{A} + \overrightarrow{B} - 3\overrightarrow{C} &= \begin{bmatrix} 2 \\ 3 \\ 6 \\ \end{bmatrix} + \begin{bmatrix} 1 \\ 1 \\ 2 \\ \end{bmatrix} - 3\begin{bmatrix} 10 \\ 1 \\ 2 \\ \end{bmatrix}\\ &= \begin{bmatrix} 2 + 1 - 30 \\ 3 + 1 - 3 \\ 6 + 2 - 6 \\ \end{bmatrix}\\ &= \begin{bmatrix} - 27 \\ 1 \\ 2 \\ \end{bmatrix} \end{split}$$

What do you mean by vectors being linearly independent?

A set of vectors ${\overrightarrow{A}}_{1},{\overrightarrow{A}}_{2},\ldots,{\overrightarrow{A}}_{m}$ are considered to be linearly independent if

$$k_{1}{\overrightarrow{A}}_{1} + k_{2}{\overrightarrow{A}}_{2} + ....... + k_{m}{\overrightarrow{A}}_{m} = \overrightarrow{0}\notag$$

has only one solution of

$$k_{1} = k_{2} = ...... = k_{m} = 0\notag$$

Example 10

Are the three vectors

$${\overrightarrow{A}}_{1} = \begin{bmatrix} 25 \\ 64 \\ 144 \\ \end{bmatrix},\ \ {\overrightarrow{A}}_{2} = \begin{bmatrix} 5 \\ 8 \\ 12 \\ \end{bmatrix},\ \ {\overrightarrow{A}}_{3} = \begin{bmatrix} 1 \\ 1 \\ 1 \\ \end{bmatrix}\notag$$

linearly independent?

Solution

Writing the linear combination of the three vectors

$$k_{1}\begin{bmatrix} 25 \\ 64 \\ 144 \\ \end{bmatrix} + k_{2}\begin{bmatrix} 5 \\ 8 \\ 12 \\ \end{bmatrix} + k_{3}\begin{bmatrix} 1 \\ 1 \\ 1 \\ \end{bmatrix} = \begin{bmatrix} 0 \\ 0 \\ 0 \\ \end{bmatrix}\notag$$

gives

$$\begin{bmatrix} 25k_{1} + 5k_{2} + k_{3} \\ 64k_{1} + 8k_{2} + k_{3} \\ 144k_{1} + 12k_{2} + k_{3} \\ \end{bmatrix} = \begin{bmatrix} 0 \\ 0 \\ 0 \\ \end{bmatrix}\notag$$

The above equations have only one solution, $k_{1} = k_{2} = k_{3} = 0$. However, how do we show that this is the only solution? This is shown below.

The above equations are

$$25k_{1} + 5k_{2} + k_{3} = 0 \;\;\;\;\;\;\;(1)\notag$$

$$64k_{1} + 8k_{2} + k_{3} = 0 \;\;\;\;\;\;\;(2)\notag$$

$$144k_{1} + 12k_{2} + k_{3} = 0 \;\;\;\;\;\;\;(3)\notag$$

Subtracting Eqn (1) from Eqn (2) gives

$$39k_{1} + 3k_{2} = 0\notag$$

$$k_{2} = - 13k_{1} \;\;\;\;\;\;\;(4)\notag$$

Multiplying Eqn (1) by 8 and subtracting it from Eqn (2) that is first multiplied by 5 gives

$$120k_{1} - 3k_{3} = 0\notag$$

$$k_{3} = 40k_{1} \;\;\;\;\;\;\;(5)\notag$$

Remember we found Eqn (4) and Eqn (5) just from Eqns (1) and (2).

Substitution of Eqns (4) and (5) in Eqn (3) for $k_{1}$ and $k_{2}$ gives

$$144k_{1} + 12( - 13k_{1}) + 40k_{1} = 0\notag$$

$$28k_{1} = 0\notag$$

$$k_{1} = 0\notag$$

This means that $k_{1}$ has to be zero, and coupled with (4) and (5), $k_{2}$ and $k_{3}$ are also zero. So the only solution is $k_{1} = k_{2} = k_{3} = 0$. The three vectors hence are linearly independent.

Example 11

Are the three vectors

$${\overrightarrow{A}}_{1} = \begin{bmatrix} 1 \\ 2 \\ 5 \\ \end{bmatrix},\ {\overrightarrow{A}}_{2} = \begin{bmatrix} 2 \\ 5 \\ 7 \\ \end{bmatrix},\ {\overrightarrow{A}}_{3} = \begin{bmatrix} 6 \\ 14 \\ 24 \\ \end{bmatrix}\notag$$

linearly independent?

Solution

By inspection,

$${\overrightarrow{A}}_{3} = 2{\overrightarrow{A}}_{1} + 2{\overrightarrow{A}}_{2}\notag$$

or

$$- 2{\overrightarrow{A}}_{1} - 2{\overrightarrow{A}}_{2} + {\overrightarrow{A}}_{3} = \overrightarrow{0}\notag$$

So the linear combination

$$k_{1}{\overrightarrow{A}}_{1} + k_{2}{\overrightarrow{A}}_{2} + k_{3}{\overrightarrow{A}}_{3} = \overrightarrow{0}\notag$$

has a non-zero solution

$$k_{1} = - 2,\ k_{2} = - 2,\ k_{3} = 1\notag$$

Hence, the set of vectors is linearly dependent.

What if I cannot prove by inspection, what do I do? Put the linear combination of three vectors equal to the zero vector,

$$k_{1}\begin{bmatrix} 1 \\ 2 \\ 5 \\ \end{bmatrix} + k_{2}\begin{bmatrix} 2 \\ 5 \\ 7 \\ \end{bmatrix} + k_{3}\begin{bmatrix} 6 \\ 14 \\ 24 \\ \end{bmatrix} = \begin{bmatrix} 0 \\ 0 \\ 0 \\ \end{bmatrix}\notag$$

to give

$$k_{1} + 2k_{2} + 6k_{3} = 0 \;\;\;\;\;\;\;(1)\notag$$

$$2k_{1} + 5k_{2} + 14k_{3} = 0 \;\;\;\;\;\;\;(2)\notag$$

$$5k_{1} + 7k_{2} + 24k_{3} = 0 \;\;\;\;\;\;\;(3)\notag$$

Multiplying Eqn (1) by 2 and subtracting from Eqn (2) gives

$$k_{2} + 2k_{3} = 0\notag$$

$$k_{2} = - 2k_{3} \;\;\;\;\;\;\;(4)\notag$$

Multiplying Eqn (1) by 2.5 and subtracting from Eqn (2) gives

$$- 0.5k_{1} - k_{3} = 0\notag$$

$$k_{1} = - 2k_{3} \;\;\;\;\;\;\;(5)\notag$$

Remember we found Eqn (4) and Eqn (5) just from Eqns (1) and (2).

Substitute Eqn (4) and (5) in Eqn (3) for $k_{1}$ and $k_{2}$ gives

$$5\left( - 2k_{3} \right) + 7\left( - 2k_{3} \right) + 24k_{3} = 0\notag$$

$$- 10k_{3} - 14k_{3} + 24k_{3} = 0\notag$$

$$0 = 0\notag$$

This means any values satisfying Eqns (4) and (5) will satisfy Eqns (1), (2) and (3) simultaneously.

For example, chose

$k_{3} = 6$, then

$k_{2} = - 12$ from Eqn (4), and

$k_{1} = - 12$ from Eqn (5).

Hence we have a nontrivial solution of $\begin{bmatrix} k_{1} & k_{2} & k_{3} \\ \end{bmatrix} = \begin{bmatrix} - 12 & - 12 & 6 \\ \end{bmatrix}$. This implies the three given vectors are linearly dependent. Can you find another nontrivial solution?

What about the following three vectors?

$$\begin{bmatrix} 1 \\ 2 \\ 5 \\ \end{bmatrix},\begin{bmatrix} 2 \\ 5 \\ 7 \\ \end{bmatrix},\begin{bmatrix} 6 \\ 14 \\ 25 \\ \end{bmatrix}\notag$$

Are they linearly dependent or linearly independent?

Note that the only difference between this set of vectors and the previous one is the third entry in the third vector. Hence, equations (4) and (5) are still valid. What conclusion do you draw when you plug in equations (4) and (5) in the third equation: $5k_{1} + 7k_{2} + 25k_{3} = 0$? What has changed?

Example 12

Are the three vectors

$${\overrightarrow{A}}_{1} = \begin{bmatrix} 25 \\ 64 \\ 89 \\ \end{bmatrix},\ {\overrightarrow{A}}_{2} = \begin{bmatrix} 5 \\ 8 \\ 13 \\ \end{bmatrix},\ {\overrightarrow{A}}_{3} = \begin{bmatrix} 1 \\ 1 \\ 2 \\ \end{bmatrix}\notag$$

linearly independent?

Solution

Writing the linear combination of the three vectors and equating to zero vector

$$k_{1}\begin{bmatrix} 25 \\ 64 \\ 89 \\ \end{bmatrix} + k_{2}\begin{bmatrix} 5 \\ 8 \\ 13 \\ \end{bmatrix} + k_{3}\begin{bmatrix} 1 \\ 1 \\ 2 \\ \end{bmatrix} = \begin{bmatrix} 0 \\ 0 \\ 0 \\ \end{bmatrix}\notag$$

gives

$$\begin{bmatrix} 25k_{1} + 5k_{2} + k_{3} \\ 64k_{1} + 8k_{2} + k_{3} \\ 89k_{1} + 13k_{2} + 2k_{3} \\ \end{bmatrix} = \begin{bmatrix} 0 \\ 0 \\ 0 \\ \end{bmatrix}\notag$$

In addition to $k_{1} = k_{2} = k_{3} = 0$, one can find other solutions for which $k_{1},\ k_{2},\ k_{3}$are not equal to zero. For example, $k_{1} = 1,\ k_{2} = - 13,\ k_{3} = 40$ is also a solution as

$$1\begin{bmatrix} 25 \\ 64 \\ 89 \\ \end{bmatrix} - 13\begin{bmatrix} 5 \\ 8 \\ 13 \\ \end{bmatrix} + 40\begin{bmatrix} 1 \\ 1 \\ 2 \\ \end{bmatrix} = \begin{bmatrix} 0 \\ 0 \\ 0 \\ \end{bmatrix}\notag$$

Hence ${\overrightarrow{A}}_{1},\ \ {\overrightarrow{A}}_{2},\ \ {\overrightarrow{A}}_{3}$ are linearly dependent.

What do you mean by the rank of a set of vectors?

From a set of $n$-dimensional vectors, the maximum number of linearly independent vectors in the set is called the rank of the set of vectors. Note that the rank of the vectors can never be greater than the vectors dimension.

Example 13

What is the rank of

$${\overrightarrow{A}}_{1} = \begin{bmatrix} 25 \\ 64 \\ 144 \\ \end{bmatrix},\ {\overrightarrow{A}}_{2} = \begin{bmatrix} 5 \\ 8 \\ 12 \\ \end{bmatrix},\ {\overrightarrow{A}}_{3} = \begin{bmatrix} 1 \\ 1 \\ 1 \\ \end{bmatrix}?\notag$$

Solution

Since we found in Example 2.10 that ${\overrightarrow{A}}_{1},\ {\overrightarrow{A}}_{2},\ {\overrightarrow{A}}_{3}$ are linearly independent, the rank of the set of vectors ${\overrightarrow{A}}_{1},\ {\overrightarrow{A}}_{2},\ {\overrightarrow{A}}_{3}$ is 3. If we were given another vector ${\overrightarrow{A}}_{4}$, the rank of the set of the vectors ${\overrightarrow{A}}_{1},\ {\overrightarrow{A}}_{2},\ {\overrightarrow{A}}_{3},{\overrightarrow{A}}_{4}$ would still be 3 as the rank of a set of vectors is always less than or equal to the dimension of the vectors and that at least ${\overrightarrow{A}}_{1},\ {\overrightarrow{A}}_{2},\ {\overrightarrow{A}}_{3}$ are linearly independent.

Example 14

What is the rank of

$${\overrightarrow{A}}_{1} = \begin{bmatrix} 25 \\ 64 \\ 89 \\ \end{bmatrix},\ {\overrightarrow{A}}_{2} = \begin{bmatrix} 5 \\ 8 \\ 13 \\ \end{bmatrix},\ {\overrightarrow{A}}_{3} = \begin{bmatrix} 1 \\ 1 \\ 2 \\ \end{bmatrix}?\notag$$

Solution

In Example 2.12, we found that ${\overrightarrow{A}}_{1},\ {\overrightarrow{A}}_{2},\ {\overrightarrow{A}}_{3}$ are linearly dependent, the rank of ${\overrightarrow{A}}_{1},\ {\overrightarrow{A}}_{2},\ {\overrightarrow{A}}_{3}$ is hence not 3, and is less than 3. Is it 2? Let us choose two of the three vectors

$${\overrightarrow{A}}_{1} = \begin{bmatrix} 25 \\ 64 \\ 89 \\ \end{bmatrix},\ {\overrightarrow{A}}_{2} = \begin{bmatrix} 5 \\ 8 \\ 13 \\ \end{bmatrix}\notag$$

Linear combination of ${\overrightarrow{A}}_{1}$ and ${\overrightarrow{A}}_{2}$ equal to zero has only one solution – the trivial solution. Therefore, the rank is 2.

Example 15

What is the rank of

$${\overrightarrow{A}}_{1} = \begin{bmatrix} 1 \\ 1 \\ 2 \\ \end{bmatrix},\ {\overrightarrow{A}}_{2} = \begin{bmatrix} 2 \\ 2 \\ 4 \\ \end{bmatrix},\ {\overrightarrow{A}}_{3} = \begin{bmatrix} 3 \\ 3 \\ 5 \\ \end{bmatrix}?\notag$$

Solution

From inspection,

$${\overrightarrow{A}}_{2} = 2{\overrightarrow{A}}_{1},\notag$$

that implies

$$2{\overrightarrow{A}}_{1} - {\overrightarrow{A}}_{2} + 0{\overrightarrow{A}}_{3} = \overrightarrow{0}\notag$$

Hence

$$k_{1}{\overrightarrow{A}}_{1} + k_{2}{\overrightarrow{A}}_{2} + k_{3}{\overrightarrow{A}}_{3} = \overrightarrow{0}\notag$$

has a nontrivial solution.

So ${\overrightarrow{A}}_{1},\ \ {\overrightarrow{A}}_{2},\ \ {\overrightarrow{A}}_{3}$ are linearly dependent, and hence the rank of the three vectors is not 3. Since

$${\overrightarrow{A}}_{2} = 2{\overrightarrow{A}}_{1},\notag$$

${\overrightarrow{A}}_{1}\text{ and }{\overrightarrow{A}}_{2}$ are linearly dependent, but

$$k_{1}{\overrightarrow{A}}_{1} + k_{3}{\overrightarrow{A}}_{3} = \overrightarrow{0}.\notag$$

has trivial solution as the only solution. So ${\overrightarrow{A}}_{1}$ and ${\overrightarrow{A}}_{3}$ are linearly independent. The rank of the above three vectors is 2.

Prove that if a set of vectors contains the null vector, the set of vectors is linearly dependent.

Let ${\overrightarrow{A}}_{1},{\overrightarrow{A}}_{2},.........,{\overrightarrow{A}}_{m}$ be a set of $n$-dimensional vectors, then

$$k_{1}{\overrightarrow{A}}_{1} + k_{2}{\overrightarrow{A}}_{2} + \ \ldots\ + k_{m}{\overrightarrow{A}}_{m} = \overrightarrow{0}\notag$$

is a linear combination of the m vectors. Then assuming if ${\overrightarrow{A}}_{1}$ is the zero or null vector, any value of $k_{1}$ coupled with $k_{2} = k_{3} = \ ..\ .\ = k_{m} = 0$ will satisfy the above equation. Hence, the set of vectors is linearly dependent as more than one solution exists.

Prove that if a set of m vectors is linearly independent, then a subset of the m vectors also has to be linearly independent.

Let this subset of vectors be

$${\overrightarrow{A}}_{a1},{\overrightarrow{A}}_{a2},\ldots,{\overrightarrow{A}}_{\text{ap}}\notag$$

where $p < m$.

Then if this subset of vectors is linearly dependent, the linear combination

$$k_{1}{\overrightarrow{A}}_{a1} + k_{2}{\overrightarrow{A}}_{a2} + \ldots + k_{p}{\overrightarrow{A}}_{\text{ap}} = \overrightarrow{0}\notag$$

has a non-trivial solution.

So

$$k_{1}{\overrightarrow{A}}_{a1} + k_{2}{\overrightarrow{A}}_{a2} + \ldots + k_{p}{\overrightarrow{A}}_{\text{ap}} + 0{\overrightarrow{A}}_{a(p + 1)} + ....... + 0{\overrightarrow{A}}_{\text{am}} = \overrightarrow{0}\notag$$

also has a non-trivial solution too, where ${\overrightarrow{A}}_{a\left( p + 1 \right)},\ldots,{\overrightarrow{A}}_{\text{am}}$are the rest of the $(m - p)$ vectors. However, this is a contradiction. Therefore, a subset of linearly independent vectors cannot be linearly dependent.

Prove that if a set of vectors is linearly dependent, then at least one vector can be written as a linear combination of others.

Let ${\overrightarrow{A}}_{1},{\overrightarrow{A}}_{2},\ldots,{\overrightarrow{A}}_{m}$ be linearly dependent set of vectors, then there exists a set of scalars

$k_{1},\ldots,k_{m}$ not all of which are zero for the linear combination equation

$$k_{1}{\overrightarrow{A}}_{1} + k_{2}{\overrightarrow{A}}_{2} + \ldots + k_{m}{\overrightarrow{A}}_{m} = \overrightarrow{0}.\notag$$

Let $k_{p}$ be one of the non-zero values of $k_{i},\ i = 1,\ldots,m$, that is, $k_{p} \neq 0$, then

$$A_{p} = - \frac{k_{2}}{k_{p}}{\overrightarrow{A}}_{2} - \ \ldots\ - \frac{k_{p - 1}}{k_{p}}{\overrightarrow{A}}_{p - 1} - \frac{k_{p + 1}}{k_{p}}{\overrightarrow{A}}_{p + 1} - \ \ldots\ - \frac{k_{m}}{k_{p}}{\overrightarrow{A}}_{m}\notag$$

and that proves the theorem.

Prove that if the dimension of a set of vectors is less than the number of vectors in the set, then the set of vectors is linearly dependent.

Can you prove it?

How can vectors be used to write simultaneous linear equations?

If a set of $m$ simultaneous linear equations with $n$ unknowns is written as

$$a_{11}x_{1} + \ \ldots\ + a_{1n}x_{n} = c_{1}\notag$$

$$a_{21}x_{1} + \ \ldots\ + a_{2n}x_{n} = c_{2}\notag$$

$$\begin{matrix} \vdots & & & \vdots \\ \vdots & & & \vdots \\ \end{matrix}\notag$$

$$a_{m1}x_{1} + \ \ldots\ + a_{\text{mn}}x_{n} = c_{n}\notag$$

where

$x_{1},x_{2},\ldots,x_{n}$are the unknowns, then in the vector notation they can be written as

$$x_{1}{\overrightarrow{A}}_{1} + x_{2}{\overrightarrow{A}}_{2} + \ldots + x_{n}{\overrightarrow{A}}_{n} = \overrightarrow{C}\notag$$

where

$${\overrightarrow{A}}_{1} = \begin{bmatrix} a_{11} \\ \vdots \\ a_{m1} \\ \end{bmatrix}\notag$$

where

$${\overrightarrow{A}}_{1} = \begin{bmatrix} a_{11} \\ \vdots \\ a_{m1} \\ \end{bmatrix}\notag$$

$${\overrightarrow{A}}_{2} = \begin{bmatrix} a_{12} \\ \vdots \\ a_{m2} \\ \end{bmatrix}\notag$$

$${\overrightarrow{A}}_{n} = \begin{bmatrix} a_{1n} \\ \vdots \\ a_{\text{mn}} \\ \end{bmatrix}\notag$$

$${\overrightarrow{C}}_{1} = \begin{bmatrix} c_{1} \\ \vdots \\ c_{m} \\ \end{bmatrix}\notag$$

The problem now becomes whether you can find the scalars $x_{1},x_{2},.....,x_{n}$ such that the linear combination

$$x_{1}{\overrightarrow{A}}_{1} + .......... + x_{n}{\overrightarrow{A}}_{n}\notag$$

is equal to the $\overrightarrow{C}$, that is

$$x_{1}{\overrightarrow{A}}_{1} + .......... + x_{n}{\overrightarrow{A}}_{n} = \overrightarrow{C}\notag$$

Example 16

Write

$$25x_{1} + 5x_{2} + x_{3} = 106.8\notag$$

$$64x_{1} + 8x_{2} + x_{3} = 177.2\notag$$

$$144x_{1} + 12x_{2} + x_{3} = 279.2\notag$$

as a linear combination of set of vectors equal to another vector.

Solution

$$\begin{bmatrix} 25x_{1} & + 5x_{2} & + x_{3} \\ 64x_{1} & + 8x_{2} & + x_{3} \\ 144x_{1} & + 12x_{2} & + x_{3} \\ \end{bmatrix} = \begin{bmatrix} 106.8 \\ 177.2 \\ 279.2 \\ \end{bmatrix}\notag$$

$$x_{1}\begin{bmatrix} 25 \\ 64 \\ 144 \\ \end{bmatrix} + x_{2}\begin{bmatrix} 5 \\ 8 \\ 12 \\ \end{bmatrix} + x_{3}\begin{bmatrix} 1 \\ 1 \\ 1 \\ \end{bmatrix} = \begin{bmatrix} 106.8 \\ 177.2 \\ 279.2 \\ \end{bmatrix}\notag$$

What is the definition of the dot product of two vectors?

Let $\overrightarrow{A} = \left\lbrack a_{1},a_{2},\ldots,a_{n} \right\rbrack$ and $\overrightarrow{B} = \left\lbrack b_{1},b_{2},\ldots,b_{n} \right\rbrack$ be two n-dimensional vectors. Then the dot product of the two vectors $\overrightarrow{A}$ and $\overrightarrow{B}$ is defined as

$$\overrightarrow{A} \cdot \overrightarrow{B} = a_{1}b_{1} + a_{2}b_{2} + \ldots + a_{n}b_{n} = \sum_{i = 1}^{n}{a_{i}b_{i}}\notag$$

A dot product is also called an inner product.

Example 17

Find the dot product of the two vectors $\overrightarrow{A}$ = $[4, 1, 2, 3]$ and $\overrightarrow{B}$ = $[3, 1, 7, 2].$

Solution

$$\begin{split} \overrightarrow{A} \cdot \overrightarrow{B} &= \lbrack 4,1,2,3\rbrack\ .\ \lbrack 3,1,7,2\rbrack\\ &= \left( 4 \right)\left( 3 \right) + \left( 1 \right)\left( 1 \right) + \left( 2 \right)\left( 7 \right) + \left( 3 \right)\left( 2 \right)\\ &= 33 \end{split}\notag$$

Example 18

A product line needs three types of rubber as given in the table below.

Rubber type	Weight (lbs)	Cost per pound ($)
A B C	200 250 310	20.23 30.56 29.12

Use the definition of a dot product to find the total price of the rubber needed.

Solution

The weight vector is given by

$$\overrightarrow{W} = \lbrack 200,250,310\rbrack\notag$$

and the cost vector is given by

$$\overrightarrow{C} = \lbrack 20.23,30.56,29.12\rbrack\notag$$

The total cost of the rubber would be the dot product of $\overrightarrow{W}$ and $\overrightarrow{C}$.

$$\begin{split} \overrightarrow{W} \cdot \overrightarrow{C} &= \lbrack 200,250,310\rbrack \cdot \lbrack 20.23,30.56,29.12\rbrack\\ &= (200)(20.23) + (250)(30.56) + (310)(29.12)\\ &= 4046 + 7640 + 9027.2\\ &= \text{\$} 20713.20 \end{split}\notag$$

Vectors Quiz

Quiz 1

A set of equations

$$4x_{1} + 7x_{2} + 11x_{3} = 13\notag$$

$$17x_{1} + 39x_{2} + 23x_{3} = 31\notag$$

$$13x_{1} + 67x_{2} + 59x_{3} = 37\notag$$

can also be written as

(A) $x_{1}\begin{bmatrix} 4 \\ 17 \\ 13 \\ \end{bmatrix} + x_{2}\begin{bmatrix} 7 \\ 39 \\ 23 \\ \end{bmatrix} + x_{3}\begin{bmatrix} 11 \\ 23 \\ 59 \\ \end{bmatrix} = \begin{bmatrix} 13 \\ 31 \\ 37 \\ \end{bmatrix}$

(B) $4\begin{bmatrix} x_{1} \\ x_{2} \\ x_{3} \\ \end{bmatrix} + 39\begin{bmatrix} x_{1} \\ x_{2} \\ x_{3} \\ \end{bmatrix} + 59\begin{bmatrix} x_{1} \\ x_{2} \\ x_{3} \\ \end{bmatrix} = \begin{bmatrix} 13 \\ 31 \\ 37 \\ \end{bmatrix}$

(C) $x_{1}\begin{bmatrix} 4 \\ 7 \\ 11 \\ \end{bmatrix} + x_{2}\begin{bmatrix} 17 \\ 39 \\ 23 \\ \end{bmatrix} + x_{3}\begin{bmatrix} 13 \\ 67 \\ 59 \\ \end{bmatrix} = \begin{bmatrix} 13 \\ 31 \\ 37 \\ \end{bmatrix}$

(D) $x_{1}\begin{bmatrix} 13 \\ 17 \\ 4 \\ \end{bmatrix} + x_{2}\begin{bmatrix} 67 \\ 39 \\ 7 \\ \end{bmatrix} + x_{3}\begin{bmatrix} 59 \\ 23 \\ 11 \\ \end{bmatrix} = \begin{bmatrix} 57 \\ 13 \\ 31 \\ \end{bmatrix}$

Quiz 2

The magnitude of the vector, $V = (5, - 3,2)$ is

(A) $4$

(B) $10$

(C) $\sqrt{38}$

(D) $\sqrt{20}$

Quiz 3

The rank of the vector

$$\overset{\rightarrow}{A}\begin{bmatrix} 2 \\ 3 \\ 7 \\ \end{bmatrix},\begin{bmatrix} 6 \\ 9 \\ 21 \\ \end{bmatrix},\begin{bmatrix} 3 \\ 2 \\ 7 \\ \end{bmatrix}\notag$$

is

(A) $1$

(B) $2$

(C) $3$

(D) $4$

Quiz 4

If $\overrightarrow{A} = (5,2,3)$and $\overrightarrow{B} = (6, - 7,3)$, then $4\overrightarrow{A} + 5\overrightarrow{B}$is

(A) $(50, - 5,6)$

(B) $(50, - 27,27)$

(C) $(11, - 5,6)$

(D) $(20,8,12)$

Quiz 5

The dot product of two vectors $\overset{\rightarrow}{A}$ and $\overset{\rightarrow}{B}$

$$\overset{\rightarrow}{A} = 3i + 5j + 7k\notag$$

$$\overset{\rightarrow}{B} = 11i + 13j + 17k\notag$$

most nearly is

(A) $14.80$

(B) $33.00$

(C) $56.00$

(D) $217.0$

Quiz 6

The angle in degrees between two vectors $\overrightarrow{u}$ and $\overrightarrow{v}$

$$\overset{\rightarrow}{u} = 3i + 5j + 7k\notag$$

$$\overset{\rightarrow}{v} = 11i + 13j + 17k\notag$$

most nearly is

(A) $8.124$

(B) $11.47$

(C) $78.52$

(D) $81.88$

Vectors Exercise

Exercise 1

For

$\overrightarrow{A} = \begin{bmatrix} 2 \\ 9 \\ - 7 \\ \end{bmatrix},\overrightarrow{B} = \begin{bmatrix} 3 \\ 2 \\ 5 \\ \end{bmatrix},\overrightarrow{C} = \begin{bmatrix} 1 \\ 1 \\ 1 \\ \end{bmatrix}$

find $\overrightarrow{A} + \overrightarrow{B}$ and $2\overrightarrow{A} - 3\overrightarrow{B} + \overrightarrow{C}$.

Answer

$\begin{bmatrix} 5 \\ 11 \\ - 2 \\ \end{bmatrix}$; $\begin{bmatrix} - 4 \\ 13 \\ - 28 \\ \end{bmatrix}$

Exercise 2

Are

$\overrightarrow{A} = \begin{bmatrix} 1 \\ 1 \\ 1 \\ \end{bmatrix},\overrightarrow{B} = \begin{bmatrix} 1 \\ 2 \\ 5 \\ \end{bmatrix},\overrightarrow{C} = \begin{bmatrix} 1 \\ 4 \\ 25 \\ \end{bmatrix}$

linearly independent?.

What is the rank of the above set of vectors?

Answer

$3$

Exercise 3

Add exercises text here.

Are

$\overrightarrow{A} = \begin{bmatrix} 1 \\ 1 \\ 1 \\ \end{bmatrix},\overrightarrow{B} = \begin{bmatrix} 1 \\ 2 \\ 5 \\ \end{bmatrix},\overrightarrow{C} = \begin{bmatrix} 3 \\ 5 \\ 7 \\ \end{bmatrix}$

linearly independent?.

What is the rank of the above set of vectors?

Answer

3

Exercise 4

Are

$\overrightarrow{A} = \begin{bmatrix} 1 \\ 2 \\ 5 \\ \end{bmatrix},\overrightarrow{B} = \begin{bmatrix} 2 \\ 4 \\ 10 \\ \end{bmatrix},\overrightarrow{C} = \begin{bmatrix} 1.1 \\ 2.2 \\ 5.5 \\ \end{bmatrix}$

linearly independent?

What is the rank of the above set of vectors?

Answer

No;1

Exercise 5

If a set of vectors contains the null vector, the set of vectors is linearly

1. Independent
2. Dependent?

Answer

B

Exercise 6

If a set of vectors is linearly independent, a subset of the vectors is linearly

1. Independent.
2. Dependent.

Answer

A

Exercise 7

If a set of vectors is linearly dependent, then

1. At least one vector can be written as a linear combination of others.
2. At least one vector is a null vector.

Answer

A

Exercise 8

If the dimension of a set of vectors is less than the number of vectors in the set, then the set of vectors is linearly

1. Dependent.
2. Independent.

Answer

A

Exercise 9

Find the dot product of$\overrightarrow{A} = (2,1,2.5,3)$and $\overrightarrow{B} = ( - 3,2,1,2.5)$

Answer

$6$

Exercise 10

If $\overrightarrow{u},\overrightarrow{v},\overrightarrow{w}$ are three nonzero vector of 2-dimensions, then

1. $\overrightarrow{u},\overrightarrow{v},\overrightarrow{w}$ are linearly independent
2. $\overrightarrow{u},\overrightarrow{v},\overrightarrow{w}$ are linearly dependent
3. $\overrightarrow{u},\overrightarrow{v},\overrightarrow{w}$ are unit vectors
4. $k_{1}\overrightarrow{u} + k_{2}\overrightarrow{v} + k_{3}\overrightarrow{v} = \overrightarrow{0}$ has a unique solution.

Answer

B

Exercise 11

$\overrightarrow{u}$and $\overrightarrow{v}$are two non-zero vectors of dimension $n$. Prove that if $\overrightarrow{u}$and $\overrightarrow{v}$are linearly dependent, there is a scalar $q$ such that $\overrightarrow{v} = q\overrightarrow{u}$.

Answer

Hint :

Start with $k_{1}\overrightarrow{u} + k_{2}\overrightarrow{v} = \overrightarrow{0}$

Show that $k_{1} \neq 0$and $k_{2} \neq 0$ because $\overrightarrow{u}$and $\overrightarrow{v}$ are both nonzero.

Hence

$$\begin{split} \overrightarrow{\nu} &= - \frac{k_{1}}{k_{2}}\overrightarrow{u}\\ &=q\overrightarrow{u} \;\;\;\;\;\;\;\ q=- \frac{k_{1}}{k_{2}} \end{split}$$

Exercise 12

$\overrightarrow{u}$and $\overrightarrow{v}$are two non-zero vectors of dimension $n$. Prove that if there is a scalar $q$ such that $\overrightarrow{v} = q\overrightarrow{u}$, then $\overrightarrow{u}$and $\overrightarrow{v}$are linearly dependent.

Answer

Hint:

Since

$\begin{matrix} \overrightarrow{v} = q\overrightarrow{u} \\ \overrightarrow{v} - q\overrightarrow{u} = \overrightarrow{0} \\ \end{matrix}$

$q \neq 0$, otherwise $\overrightarrow{v} = \overrightarrow{0}$

So the equation

$$k_{1}\overrightarrow{v} + k_{2}\overrightarrow{u} = \overrightarrow{0}\notag$$

has a non trivial solution of

$$k_{1} = 1,k_{2} = q \neq 0.\notag$$