Linear Algebra/Matrix Multiplication/Solutions

A=(285)

Solutions

This exercise is recommended for all readers.

Problem 1

Compute, or state "not defined".

1. ${\begin{pmatrix}3&1\\-4&2\end{pmatrix}}{\begin{pmatrix}0&5\\0&0.5\end{pmatrix}}$
2. ${\begin{pmatrix}1&1&-1\\4&0&3\end{pmatrix}}{\begin{pmatrix}2&-1&-1\\3&1&1\\3&1&1\end{pmatrix}}$
3. ${\begin{pmatrix}2&-7\\7&4\end{pmatrix}}{\begin{pmatrix}1&0&5\\-1&1&1\\3&8&4\end{pmatrix}}$
4. ${\begin{pmatrix}5&2\\3&1\end{pmatrix}}{\begin{pmatrix}-1&2\\3&-5\end{pmatrix}}$

Answer

1. ${\begin{pmatrix}0&15.5\\0&-19\end{pmatrix}}$
2. ${\begin{pmatrix}2&-1&-1\\17&-1&-1\end{pmatrix}}$
3. Not defined.
4. ${\begin{pmatrix}1&0\\0&1\end{pmatrix}}$

This exercise is recommended for all readers.

Problem 2

Where

$A={\begin{pmatrix}1&-1\\2&0\\\end{pmatrix}}\quad B={\begin{pmatrix}5&2\\4&4\\\end{pmatrix}}\quad C={\begin{pmatrix}-2&3\\-4&1\\\end{pmatrix}}$

compute or state "not defined".

1. $AB$
2. $(AB)C$
3. $BC$
4. $A(BC)$

Answer

1. ${\begin{pmatrix}1&-2\\10&4\end{pmatrix}}$
2. ${\begin{pmatrix}1&-2\\10&4\end{pmatrix}}{\begin{pmatrix}-2&3\\-4&1\end{pmatrix}}={\begin{pmatrix}6&1\\-36&34\end{pmatrix}}$
3. ${\begin{pmatrix}-18&17\\-24&16\end{pmatrix}}$
4. ${\begin{pmatrix}1&-1\\2&0\end{pmatrix}}{\begin{pmatrix}-18&17\\-24&16\end{pmatrix}}={\begin{pmatrix}6&1\\-36&34\end{pmatrix}}$

Problem 3

Which products are defined?

1. $3\!\times \!2$ times $2\!\times \!3$
2. $2\!\times \!3$ times $3\!\times \!2$
3. $2\!\times \!2$ times $3\!\times \!3$
4. $3\!\times \!3$ times $2\!\times \!2$

Answer

1. Yes.
2. Yes.
3. No.
4. No.

This exercise is recommended for all readers.

Problem 4

Give the size of the product or state "not defined".

1. a $2\!\times \!3$ matrix times a $3\!\times \!1$ matrix
2. a $1\!\times \!12$ matrix times a $12\!\times \!1$ matrix
3. a $2\!\times \!3$ matrix times a $2\!\times \!1$ matrix
4. a $2\!\times \!2$ matrix times a $2\!\times \!2$ matrix

Answer

1. $2\!\times \!1$
2. $1\!\times \!1$
3. Not defined.
4. $2\!\times \!2$

This exercise is recommended for all readers.

Problem 5

Find the system of equations resulting from starting with

${\begin{array}{*{3}{rc}r}h_{1,1}x_{1}&+&h_{1,2}x_{2}&+&h_{1,3}x_{3}&=&d_{1}\\h_{2,1}x_{1}&+&h_{2,2}x_{2}&+&h_{2,3}x_{3}&=&d_{2}\end{array}}$

and making this change of variable (i.e., substitution).

${\begin{array}{*{2}{rc}r}x_{1}&=&g_{1,1}y_{1}&+&g_{1,2}y_{2}\\x_{2}&=&g_{2,1}y_{1}&+&g_{2,2}y_{2}\\x_{3}&=&g_{3,1}y_{1}&+&g_{3,2}y_{2}\end{array}}$

Answer

We have

${\begin{array}{*{3}{rc}r}h_{1,1}\cdot (g_{1,1}y_{1}+g_{1,2}y_{2})&+&h_{1,2}\cdot (g_{2,1}y_{1}+g_{2,2}y_{2})&+&h_{1,3}\cdot (g_{3,1}y_{1}+g_{3,2}y_{2})&=&d_{1}\\h_{2,1}\cdot (g_{1,1}y_{1}+g_{1,2}y_{2})&+&h_{2,2}\cdot (g_{2,1}y_{1}+g_{2,2}y_{2})&+&h_{2,3}\cdot (g_{3,1}y_{1}+g_{3,2}y_{2})&=&d_{2}\end{array}}$

which, after expanding and regrouping about the $y$'s yields this.

${\begin{array}{*{2}{rc}r}(h_{1,1}g_{1,1}+h_{1,2}g_{2,1}+h_{1,3}g_{3,1})y_{1}&+&(h_{1,1}g_{1,2}+h_{1,2}g_{2,2}+h_{1,3}g_{3,2})y_{2}&=&d_{1}\\(h_{2,1}g_{1,1}+h_{2,2}g_{2,1}+h_{2,3}g_{3,1})y_{1}&+&(h_{2,1}g_{1,2}+h_{2,2}g_{2,2}+h_{2,3}g_{3,2})y_{2}&=&d_{2}\end{array}}$

The starting system, and the system used for the substitutions, can be expressed in matrix language.

${\begin{pmatrix}h_{1,1}&h_{1,2}&h_{1,3}\\h_{2,1}&h_{2,2}&h_{2,3}\end{pmatrix}}{\begin{pmatrix}x_{1}\\x_{2}\\x_{3}\end{pmatrix}}=H{\begin{pmatrix}x_{1}\\x_{2}\\x_{3}\end{pmatrix}}={\begin{pmatrix}d_{1}\\d_{2}\end{pmatrix}}\qquad {\begin{pmatrix}g_{1,1}&g_{1,2}\\g_{2,1}&g_{2,2}\\g_{3,1}&g_{3,2}\end{pmatrix}}{\begin{pmatrix}y_{1}\\y_{2}\end{pmatrix}}=G{\begin{pmatrix}y_{1}\\y_{2}\end{pmatrix}}={\begin{pmatrix}x_{1}\\x_{2}\\x_{3}\end{pmatrix}}$

With this, the substitution is ${\vec {d}}=H{\vec {x}}=H(G{\vec {y}})=(HG){\vec {y}}$.

Problem 6

As Definition 2.3 points out, the matrix product operation generalizes the dot product. Is the dot product of a $1\!\times \!n$ row vector and a $n\!\times \!1$ column vector the same as their matrix-multiplicative product?

Answer

Technically, no. The dot product operation yields a scalar while the matrix product yields a $1\!\times \!1$ matrix. However, we usually will ignore the distinction.

This exercise is recommended for all readers.

Problem 7

Represent the derivative map on ${\mathcal {P}}_{n}$ with respect to $B,B$ where $B$ is the natural basis $\langle 1,x,\ldots ,x^{n}\rangle$. Show that the product of this matrix with itself is defined; what the map does it represent?

Answer

The action of $d/dx$ on $B$ is $1\mapsto 0$, $x\mapsto 1$, $x^{2}\mapsto 2x$, ... and so this is its $(n+1)\!\times \!(n+1)$ matrix representation.

${\rm {Rep}}_{B,B}({\frac {d}{dx}})={\begin{pmatrix}0&1&0&&0\\0&0&2&&0\\&&&\ddots \\0&0&0&&n\\0&0&0&&0\end{pmatrix}}$

The product of this matrix with itself is defined because the matrix is square.

${\begin{pmatrix}0&1&0&&0\\0&0&2&&0\\&&&\ddots \\0&0&0&&n\\0&0&0&&0\end{pmatrix}}^{2}={\begin{pmatrix}0&0&2&0&&0\\0&0&0&6&&0\\&&&&\ddots &\\0&0&0&&&n(n-1)\\0&0&0&&&0\\0&0&0&&&0\end{pmatrix}}$

The map so represented is the composition

$p\;{\stackrel {\frac {d}{dx}}{\longmapsto }}\;{\frac {d\,p}{dx}}\;{\stackrel {\frac {d}{dx}}{\longmapsto }}\;{\frac {d^{2}\,p}{dx^{2}}}$

which is the second derivative operation.

Problem 8

Show that composition of linear transformations on $\mathbb {R} ^{1}$ is commutative. Is this true for any one-dimensional space?

Answer

It is true for all one-dimensional spaces. Let $f$ and $g$ be transformations of a one-dimensional space. We must show that $g\circ f\,({\vec {v}})=f\circ g\,({\vec {v}})$ for all vectors. Fix a basis $B$ for the space and then the transformations are represented by $1\!\times \!1$ matrices.

$F={\rm {Rep}}_{B,B}(f)={\begin{pmatrix}f_{1,1}\end{pmatrix}}\qquad G={\rm {Rep}}_{B,B}(g)={\begin{pmatrix}g_{1,1}\end{pmatrix}}$

Therefore, the compositions can be represented as $GF$ and $FG$.

$GF={\rm {Rep}}_{B,B}(g\circ f)={\begin{pmatrix}g_{1,1}f_{1,1}\end{pmatrix}}\qquad FG={\rm {Rep}}_{B,B}(f\circ g)={\begin{pmatrix}f_{1,1}g_{1,1}\end{pmatrix}}$

These two matrices are equal and so the compositions have the same effect on each vector in the space.

Problem 9

Why is matrix multiplication not defined as entry-wise multiplication? That would be easier, and commutative too.

Answer

It would not represent linear map composition; Theorem 2.6 would fail.

This exercise is recommended for all readers.

Problem 10

1. Prove that $H^{p}H^{q}=H^{p+q}$ and $(H^{p})^{q}=H^{pq}$ for positive integers $p,q$.
2. Prove that $(rH)^{p}=r^{p}\cdot H^{p}$ for any positive integer $p$ and scalar $r\in \mathbb {R}$.

Answer

Each follows easily from the associated map fact. For instance, $p$ applications of the transformation $h$, following $q$ applications, is simply $p+q$ applications.

This exercise is recommended for all readers.

Problem 11

1. How does matrix multiplication interact with scalar multiplication: is $r(GH)=(rG)H$? Is $G(rH)=r(GH)$?
2. How does matrix multiplication interact with linear combinations: is $F(rG+sH)=r(FG)+s(FH)$? Is $(rF+sG)H=rFH+sGH$?

Answer

Although these can be done by going through the indices, they are best understood in terms of the represented maps. That is, fix spaces and bases so that the matrices represent linear maps $f,g,h$.

1. Yes; we have both $r\cdot (g\circ h)\,({\vec {v}})=r\cdot g(\,h({\vec {v}})\,)=(r\cdot g)\circ h\,({\vec {v}})$ and $g\circ (r\cdot h)\,({\vec {v}})=g(\,r\cdot h({\vec {v}})\,)=r\cdot g(h({\vec {v}}))=r\cdot (g\circ h)\,({\vec {v}})$ (the second equality holds because of the linearity of $g$).
2. Both answers are yes. First, $f\circ (rg+sh)$ and $r\cdot (f\circ g)+s\cdot (f\circ h)$ both send ${\vec {v}}$ to $r\cdot f(g({\vec {v}}))+s\cdot f(h({\vec {v}}))$; the calculation is as in the prior item (using the linearity of $f$ for the first one). For the other, $(rf+sg)\circ h$ and $r\cdot (f\circ h)+s\cdot (g\circ h)$ both send ${\vec {v}}$ to $r\cdot f(h({\vec {v}}))+s\cdot g(h({\vec {v}}))$.

Problem 12

We can ask how the matrix product operation interacts with the transpose operation.

1. Show that ${{(GH)}^{\rm {trans}}}={{H}^{\rm {trans}}}{{G}^{\rm {trans}}}$.
2. A square matrix is symmetric if each $i,j$ entry equals the $j,i$ entry, that is, if the matrix equals its own transpose. Show that the matrices $H{{H}^{\rm {trans}}}$ and ${{H}^{\rm {trans}}}H$ are symmetric.

Answer

We have not seen a map interpretation of the transpose operation, so we will verify these by considering the entries.

1. The $i,j$ entry of ${{GH}^{\rm {trans}}}$ is the $j,i$ entry of $GH$, which is the dot product of the $j$-th row of $G$ and the $i$-th column of $H$. The $i,j$ entry of ${{H}^{\rm {trans}}}{{G}^{\rm {trans}}}$ is the dot product of the $i$-th row of ${{H}^{\rm {trans}}}$ and the $j$-th column of ${{G}^{\rm {trans}}}$, which is the dot product of the $i$-th column of $H$ and the $j$-th row of $G$. Dot product is commutative and so these two are equal.
2. By the prior item each equals its transpose, e.g., ${{(H{{H}^{\rm {trans}}})}^{\rm {trans}}}={{{H}^{\rm {trans}}}^{\rm {trans}}}{{H}^{\rm {trans}}}=H{{H}^{\rm {trans}}}$.

This exercise is recommended for all readers.

Problem 13

Rotation of vectors in $\mathbb {R} ^{3}$ about an axis is a linear map. Show that linear maps do not commute by showing geometrically that rotations do not commute.

Answer

Consider $r_{x},r_{y}:\mathbb {R} ^{3}\to \mathbb {R} ^{3}$ rotating all vectors $\pi /2$ radians counterclockwise about the $x$ and $y$ axes (counterclockwise in the sense that a person whose head is at ${\vec {e}}_{1}$ or ${\vec {e}}_{2}$ and whose feet are at the origin sees, when looking toward the origin, the rotation as counterclockwise).

Rotating $r_{x}$ first and then $r_{y}$ is different than rotating $r_{y}$ first and then $r_{x}$. In particular, $r_{x}({\vec {e}}_{3})=-{\vec {e}}_{2}$ so $r_{y}\circ r_{x}({\vec {e}}_{3})=-{\vec {e}}_{2}$, while $r_{y}({\vec {e}}_{3})={\vec {e}}_{1}$ so $r_{x}\circ r_{y}({\vec {e}}_{3})={\vec {e}}_{1}$, and hence the maps do not commute.

Problem 14

In the proof of Theorem 2.12 some maps are used. What are the domains and codomains?

Answer

It doesn't matter (as long as the spaces have the appropriate dimensions).

For associativity, suppose that $F$ is $m\!\times \!r$, that $G$ is $r\!\times \!n$, and that $H$ is $n\!\times \!k$. We can take any $r$ dimensional space, any $m$ dimensional space, any $n$ dimensional space, and any $k$ dimensional space— for instance, $\mathbb {R} ^{r}$, $\mathbb {R} ^{m}$, $\mathbb {R} ^{n}$, and $\mathbb {R} ^{k}$ will do. We can take any bases $A$, $B$, $C$, and $D$, for those spaces. Then, with respect to $C,D$ the matrix $H$ represents a linear map $h$, with respect to $B,C$ the matrix $G$ represents a $g$, and with respect to $A,B$ the matrix $F$ represents an $f$. We can use those maps in the proof.

The second half is done similarly, except that $G$ and $H$ are added and so we must take them to represent maps with the same domain and codomain.

Problem 15

How does matrix rank interact with matrix multiplication?

1. Can the product of rank $n$ matrices have rank less than $n$? Greater?
2. Show that the rank of the product of two matrices is less than or equal to the minimum of the rank of each factor.

Answer

1. The product of rank $n$ matrices can have rank less than or equal to $n$ but not greater than $n$. To see that the rank can fall, consider the maps $\pi _{x},\pi _{y}:\mathbb {R} ^{2}\to \mathbb {R} ^{2}$ projecting onto the axes. Each is rank one but their composition $\pi _{x}\circ \pi _{y}$, which is the zero map, is rank zero. That can be translated over to matrices representing those maps in this way.

   ${\rm {Rep}}_{{\mathcal {E}}_{2},{\mathcal {E}}_{2}}(\pi _{x})\cdot {\rm {Rep}}_{{\mathcal {E}}_{2},{\mathcal {E}}_{2}}(\pi _{y})={\begin{pmatrix}1&0\\0&0\end{pmatrix}}{\begin{pmatrix}0&0\\0&1\end{pmatrix}}={\begin{pmatrix}0&0\\0&0\end{pmatrix}}$

   To prove that the product of rank $n$ matrices cannot have rank greater than $n$, we can apply the map result that the image of a linearly dependent set is linearly dependent. That is, if $h:V\to W$ and $g:W\to X$ both have rank $n$ then a set in the range ${\mathcal {R}}(g\circ h)$ of size larger than $n$ is the image under $g$ of a set in $W$ of size larger than $n$ and so is linearly dependent (since the rank of $h$ is $n$). Now, the image of a linearly dependent set is dependent, so any set of size larger than $n$ in the range is dependent. (By the way, observe that the rank of $g$ was not mentioned. See the next part.)
2. Fix spaces and bases and consider the associated linear maps $f$ and $g$. Recall that the dimension of the image of a map (the map's rank) is less than or equal to the dimension of the domain, and consider the arrow diagram.

   ${\begin{matrix}V&{\stackrel {f}{\longmapsto }}&{\mathcal {R}}(f)&{\stackrel {g}{\longmapsto }}&{\mathcal {R}}(g\circ f)\end{matrix}}$

   First, the image of ${\mathcal {R}}(f)$ must have dimension less than or equal to the dimension of ${\mathcal {R}}(f)$, by the prior sentence. On the other hand, ${\mathcal {R}}(f)$ is a subset of the domain of $g$, and thus its image has dimension less than or equal the dimension of the domain of $g$. Combining those two, the rank of a composition is less than or equal to the minimum of the two ranks. The matrix fact follows immediately.

Problem 16

Is "commutes with" an equivalence relation among $n\!\times \!n$ matrices?

Answer

The "commutes with" relation is reflexive and symmetric. However, it is not transitive: for instance, with

$G={\begin{pmatrix}1&2\\3&4\end{pmatrix}}\quad H={\begin{pmatrix}1&0\\0&1\end{pmatrix}}\quad J={\begin{pmatrix}5&6\\7&8\end{pmatrix}}$

$G$ commutes with $H$ and $H$ commutes with $J$, but $G$ does not commute with $J$.

This exercise is recommended for all readers.

Problem 17

(This will be used in the Matrix Inverses exercises.) Here is another property of matrix multiplication that might be puzzling at first sight.

1. Prove that the composition of the projections $\pi _{x},\pi _{y}:\mathbb {R} ^{3}\to \mathbb {R} ^{3}$ onto the $x$ and $y$ axes is the zero map despite that neither one is itself the zero map.
2. Prove that the composition of the derivatives $d^{2}/dx^{2},\,d^{3}/dx^{3}:{\mathcal {P}}_{4}\to {\mathcal {P}}_{4}$ is the zero map despite that neither is the zero map.
3. Give a matrix equation representing the first fact.
4. Give a matrix equation representing the second.

When two things multiply to give zero despite that neither is zero, each is said to be a zero divisor.

Answer

1. Either of these.

   ${\begin{pmatrix}x\\y\\z\end{pmatrix}}{\stackrel {\pi _{x}}{\longmapsto }}{\begin{pmatrix}x\\0\\0\end{pmatrix}}{\stackrel {\pi _{y}}{\longmapsto }}{\begin{pmatrix}0\\0\\0\end{pmatrix}}\qquad {\begin{pmatrix}x\\y\\z\end{pmatrix}}{\stackrel {\pi _{y}}{\longmapsto }}{\begin{pmatrix}0\\y\\0\end{pmatrix}}{\stackrel {\pi _{x}}{\longmapsto }}{\begin{pmatrix}0\\0\\0\end{pmatrix}}$

2. The composition is the fifth derivative map $d^{5}/dx^{5}$ on the space of fourth-degree polynomials.
3. With respect to the natural bases,

   ${\rm {Rep}}_{{\mathcal {E}}_{3},{\mathcal {E}}_{3}}(\pi _{x})={\begin{pmatrix}1&0&0\\0&0&0\\0&0&0\end{pmatrix}}\qquad {\rm {Rep}}_{{\mathcal {E}}_{3},{\mathcal {E}}_{3}}(\pi _{y})={\begin{pmatrix}0&0&0\\0&1&0\\0&0&0\end{pmatrix}}$

   and their product (in either order) is the zero matrix.
4. Where $B=\langle 1,x,x^{2},x^{3},x^{4}\rangle$,

   ${\rm {Rep}}_{B,B}({\frac {d^{2}}{dx^{2}}})={\begin{pmatrix}0&0&2&0&0\\0&0&0&6&0\\0&0&0&0&12\\0&0&0&0&0\\0&0&0&0&0\end{pmatrix}}\qquad {\rm {Rep}}_{B,B}({\frac {d^{3}}{dx^{3}}})={\begin{pmatrix}0&0&0&6&0\\0&0&0&0&24\\0&0&0&0&0\\0&0&0&0&0\\0&0&0&0&0\end{pmatrix}}$

   and their product (in either order) is the zero matrix.

Problem 18

Show that, for square matrices, $(S+T)(S-T)$ need not equal $S^{2}-T^{2}$.

Answer

Note that $(S+T)(S-T)=S^{2}-ST+TS-T^{2}$, so a reasonable try is to look at matrices that do not commute so that $-ST$ and $TS$ don't cancel: with

$S={\begin{pmatrix}1&2\\3&4\end{pmatrix}}\quad T={\begin{pmatrix}5&6\\7&8\end{pmatrix}}$

we have the desired inequality.

$(S+T)(S-T)={\begin{pmatrix}-56&-56\\-88&-88\end{pmatrix}}\qquad S^{2}-T^{2}={\begin{pmatrix}-60&-68\\-76&-84\end{pmatrix}}$

This exercise is recommended for all readers.

Problem 19

Represent the identity transformation ${\mbox{id}}:V\to V$ with respect to $B,B$ for any basis $B$. This is the identity matrix $I$. Show that this matrix plays the role in matrix multiplication that the number $1$ plays in real number multiplication: $HI=IH=H$ (for all matrices $H$ for which the product is defined).

Answer

Because the identity map acts on the basis $B$ as ${\vec {\beta }}_{1}\mapsto {\vec {\beta }}_{1}$, ..., ${\vec {\beta }}_{n}\mapsto {\vec {\beta }}_{n}$, the representation is this.

${\begin{pmatrix}1&0&0&&0\\0&1&0&&0\\0&0&1&&0\\&&&\ddots \\0&0&0&&1\end{pmatrix}}$

The second part of the question is obvious from Theorem 2.6.

Problem 20

In real number algebra, quadratic equations have at most two solutions. That is not so with matrix algebra. Show that the $2\!\times \!2$ matrix equation $T^{2}=I$ has more than two solutions, where $I$ is the identity matrix (this matrix has ones in its $1,1$ and $2,2$ entries and zeroes elsewhere; see Problem 19).

Answer

Here are four solutions.

$T={\begin{pmatrix}\pm 1&0\\0&\pm 1\end{pmatrix}}$

Problem 21

1. Prove that for any $2\!\times \!2$ matrix $T$ there are scalars $c_{0},\dots ,c_{4}$ that are not all $0$ such that the combination $c_{4}T^{4}+c_{3}T^{3}+c_{2}T^{2}+c_{1}T+c_{0}I$ is the zero matrix (where $I$ is the $2\!\times \!2$ identity matrix, with $1$'s in its $1,1$ and $2,2$ entries and zeroes elsewhere; see Problem 19).
2. Let $p(x)$ be a polynomial $p(x)=c_{n}x^{n}+\dots +c_{1}x+c_{0}$. If $T$ is a square matrix we define $p(T)$ to be the matrix $c_{n}T^{n}+\dots +c_{1}T+I$ (where $I$ is the appropriately-sized identity matrix). Prove that for any square matrix there is a polynomial such that $p(T)$ is the zero matrix.
3. The minimal polynomial $m(x)$ of a square matrix is the polynomial of least degree, and with leading coefficient $1$, such that $m(T)$ is the zero matrix. Find the minimal polynomial of this matrix.

   ${\begin{pmatrix}{\sqrt {3}}/2&-1/2\\1/2&{\sqrt {3}}/2\end{pmatrix}}$

   (This is the representation with respect to ${\mathcal {E}}_{2},{\mathcal {E}}_{2}$, the standard basis, of a rotation through $\pi /6$ radians counterclockwise.)

Answer

1. The vector space ${\mathcal {M}}_{2\!\times \!2}$ has dimension four. The set $\{T^{4},\dots ,T,I\}$ has five elements and thus is linearly dependent.
2. Where $T$ is $n\!\times \!n$, generalizing the argument from the prior item shows that there is such a polynomial of degree $n^{2}$ or less, since $\{T^{n^{2}},\dots ,T,I\}$ is a $n^{2}+1$-member subset of the $n^{2}$-dimensional space ${\mathcal {M}}_{n\!\times \!n}$.
3. First compute the powers

   $T^{2}={\begin{pmatrix}1/2&-{\sqrt {3}}/2\\{\sqrt {3}}/2&1/2\end{pmatrix}}\qquad T^{3}={\begin{pmatrix}0&-1\\1&0\end{pmatrix}}\qquad T^{4}={\begin{pmatrix}-1/2&-{\sqrt {3}}/2\\{\sqrt {3}}/2&-1/2\end{pmatrix}}$

   (observe that rotating by $\pi /6$ three times results in a rotation by $\pi /2$, which is indeed what $T^{3}$ represents). Then set $c_{4}T^{4}+c_{3}T^{3}+c_{2}T^{2}+c_{1}T+c_{0}I$ equal to the zero matrix

   ${\begin{pmatrix}-1/2&-{\sqrt {3}}/2\\{\sqrt {3}}/2&-1/2\end{pmatrix}}c_{4}+{\begin{pmatrix}0&-1\\1&0\end{pmatrix}}c_{3}+{\begin{pmatrix}1/2&-{\sqrt {3}}/2\\{\sqrt {3}}/2&1/2\end{pmatrix}}c_{2}+{\begin{pmatrix}{\sqrt {3}}/2&-1/2\\1/2&{\sqrt {3}}/2\end{pmatrix}}c_{1}+{\begin{pmatrix}1&0\\0&1\end{pmatrix}}c_{0}$

   $={\begin{pmatrix}0&0\\0&0\end{pmatrix}}$

   to get this linear system.

   ${\begin{array}{*{5}{rc}r}-(1/2)c_{4}&&&+&(1/2)c_{2}&+&({\sqrt {3}}/2)c_{1}&+&c_{0}&=&0\\-({\sqrt {3}}/2)c_{4}&-&c_{3}&-&({\sqrt {3}}/2)c_{2}&-&(1/2)c_{1}&&&=&0\\({\sqrt {3}}/2)c_{4}&+&c_{3}&+&({\sqrt {3}}/2)c_{2}&+&(1/2)c_{1}&&&=&0\\-(1/2)c_{4}&&&+&(1/2)c_{2}&+&({\sqrt {3}}/2)c_{1}&+&c_{0}&=&0\end{array}}$

   Apply Gaussian reduction.

   ${\begin{array}{rcl}&{\xrightarrow[{}]{-\rho _{1}+\rho _{4}}}\;{\xrightarrow[{}]{\rho _{2}+\rho _{3}}}&{\begin{array}{*{5}{rc}r}-(1/2)c_{4}&&&+&(1/2)c_{2}&+&({\sqrt {3}}/2)c_{1}&+&c_{0}&=&0\\-({\sqrt {3}}/2)c_{4}&-&c_{3}&-&({\sqrt {3}}/2)c_{2}&-&(1/2)c_{1}&&&=&0\\&&&&&&&&0&=&0\\&&&&&&&&0&=&0\end{array}}\\&\;{\xrightarrow[{}]{-{\sqrt {3}}\rho _{1}+\rho _{2}}}&{\begin{array}{*{5}{rc}r}-(1/2)c_{4}&&&+&(1/2)c_{2}&+&({\sqrt {3}}/2)c_{1}&+&c_{0}&=&0\\&-&c_{3}&-&{\sqrt {3}}c_{2}&-&2c_{1}&-&{\sqrt {3}}c_{0}&=&0\\&&&&&&&&0&=&0\\&&&&&&&&0&=&0\end{array}}\end{array}}$

   Setting $c_{4}$, $c_{3}$, and $c_{2}$ to zero makes $c_{1}$ and $c_{0}$ also come out to be zero so no degree one or degree zero polynomial will do. Setting $c_{4}$ and $c_{3}$ to zero (and $c_{2}$ to one) gives a linear system

   ${\begin{array}{*{3}{rc}r}(1/2)&+&({\sqrt {3}}/2)c_{1}&+&c_{0}&=&0\\-{\sqrt {3}}&-&2c_{1}&-&{\sqrt {3}}c_{0}&=&0\end{array}}$

   that can be solved with $c_{1}=-{\sqrt {3}}$ and $c_{0}=1$. Conclusion: the polynomial $m(x)=x^{2}-{\sqrt {3}}x+1$ is minimal for the matrix $T$.

Problem 22

The infinite-dimensional space ${\mathcal {P}}$ of all finite-degree polynomials gives a memorable example of the non-commutativity of linear maps. Let $d/dx:{\mathcal {P}}\to {\mathcal {P}}$ be the usual derivative and let $s:{\mathcal {P}}\to {\mathcal {P}}$ be the shift map.

$a_{0}+a_{1}x+\dots +a_{n}x^{n}\;{\stackrel {s}{\longmapsto }}\;0+a_{0}x+a_{1}x^{2}+\dots +a_{n}x^{n+1}$

Show that the two maps don't commute $d/dx\circ s\neq s\circ d/dx$; in fact, not only is $(d/dx\circ s)-(s\circ d/dx)$ not the zero map, it is the identity map.

Answer

The check is routine:

$a_{0}+a_{1}x+\dots +a_{n}x^{n}{\stackrel {s}{\longmapsto }}a_{0}x+a_{1}x^{2}+\dots +a_{n}x^{n+1}{\stackrel {d/dx}{\longmapsto }}a_{0}+2a_{1}x+\dots +(n+1)a_{n}x^{n}$

while

$a_{0}+a_{1}x+\dots +a_{n}x^{n}{\stackrel {d/dx}{\longmapsto }}a_{1}+\dots +na_{n}x^{n-1}{\stackrel {s}{\longmapsto }}a_{1}x+\dots +a_{n}x^{n}$

so that under the map $(d/dx\circ s)-(s\circ d/dx)$ we have $a_{0}+a_{1}x+\dots +a_{n}x^{n}\mapsto a_{0}+a_{1}x+\dots +a_{n}x^{n}$.

Problem 23

Recall the notation for the sum of the sequence of numbers $a_{1},a_{2},\dots ,a_{n}$.

$\sum _{i=1}^{n}a_{i}=a_{1}+a_{2}+\dots +a_{n}$

In this notation, the $i,j$ entry of the product of $G$ and $H$ is this.

$p_{i,j}=\sum _{k=1}^{r}g_{i,k}h_{k,j}$

Using this notation,

1. reprove that matrix multiplication is associative;
2. reprove Theorem 2.6.

Answer

1. Tracing through the remark at the end of the subsection gives that the $i,j$ entry of $(FG)H$ is this $\sum _{t=1}^{s}{\bigl (}\sum _{k=1}^{r}f_{i,k}g_{k,t}{\bigr )}h_{t,j}=\sum _{t=1}^{s}\sum _{k=1}^{r}(f_{i,k}g_{k,t})h_{t,j}=\sum _{t=1}^{s}\sum _{k=1}^{r}f_{i,k}(g_{k,t}h_{t,j})$

   $=\sum _{k=1}^{r}\sum _{t=1}^{s}f_{i,k}(g_{k,t}h_{t,j})=\sum _{k=1}^{r}f_{i,k}{\bigl (}\sum _{t=1}^{s}g_{k,t}h_{t,j}{\bigr )}$

   (the first equality comes from using the distributive law to multiply through the $h$'s, the second equality is the associative law for real numbers, the third is the commutative law for reals, and the fourth equality follows on using the distributive law to factor the $f$'s out), which is the $i,j$ entry of $F(GH)$.
2. The $k$-th component of $h({\vec {v}})$ is

   $\sum _{j=1}^{n}h_{k,j}v_{j}$

   and so the $i$-th component of $g\circ h\,({\vec {v}})$ is this

   $\sum _{k=1}^{r}g_{i,k}{\bigl (}\sum _{j=1}^{n}h_{k,j}v_{j}{\bigr )}=\sum _{k=1}^{r}\sum _{j=1}^{n}g_{i,k}h_{k,j}v_{j}=\sum _{k=1}^{r}\sum _{j=1}^{n}(g_{i,k}h_{k,j})v_{j}$

   $=\sum _{j=1}^{n}\sum _{k=1}^{r}(g_{i,k}h_{k,j})v_{j}=\sum _{j=1}^{n}(\sum _{k=1}^{r}g_{i,k}h_{k,j})\,v_{j}$

   (the first equality holds by using the distributive law to multiply the $g$'s through, the second equality represents the use of associativity of reals, the third follows by commutativity of reals, and the fourth comes from using the distributive law to factor the $v$'s out).