AATA Matrix Groups

Section 12.1 Matrix Groups

Subsection Some Facts from Linear Algebra

Before we study matrix groups, we must recall some basic facts from linear algebra. One of the most fundamental ideas of linear algebra is that of a linear transformation. A linear transformation or linear map

T : R^{n} \to R^{m}

is a map that preserves vector addition and scalar multiplication; that is, for vectors

x

and

y

R^{n}

and a scalar

α \in R,

\begin{aligned} T (x + y) & = T (x) + T (y) \\ T (α y) & = α T (y) . \end{aligned}

🔗

m \times n

matrix with entries in

R

represents a linear transformation from

R^{n}

R^{m} .

If we write vectors

x = (x_{1}, \dots, x_{n})^{t}

and

y = (y_{1}, \dots, y_{n})^{t}

R^{n}

as column matrices, then an

m \times n

matrix

A = (\begin{matrix} a_{11} & a_{12} & \dots & a_{1 n} \\ a_{21} & a_{22} & \dots & a_{2 n} \\ ⋮ & ⋮ & ⋱ & ⋮ \\ a_{m 1} & a_{m 2} & \dots & a_{m n} \end{matrix})

🔗

maps the vectors to

R^{m}

linearly by matrix multiplication. Observe that if

α

is a real number,

A (x + y) = A x + A y and α A x = A (α x),

🔗

where

x = (\begin{matrix} x_{1} \\ x_{2} \\ ⋮ \\ x_{n} \end{matrix}) .

🔗

We will often abbreviate the matrix

A

by writing

(a_{i j}) .

🔗

Conversely, if

T : R^{n} \to R^{m}

is a linear map, we can associate a matrix

A

with

T

by considering what

T

does to the vectors

\begin{aligned} e_{1} & = (1, 0, \dots, 0)^{t} \\ e_{2} & = (0, 1, \dots, 0)^{t} \\ ⋮ \\ e_{n} & = (0, 0, \dots, 1)^{t} . \end{aligned}

🔗

We can write any vector

x = (x_{1}, \dots, x_{n})^{t}

x_{1} e_{1} + x_{2} e_{2} + \dots + x_{n} e_{n} .

🔗

Consequently, if

\begin{aligned} T (e_{1}) & = (a_{11}, a_{21}, \dots, a_{m 1})^{t}, \\ T (e_{2}) & = (a_{12}, a_{22}, \dots, a_{m 2})^{t}, \\ ⋮ \\ T (e_{n}) & = (a_{1 n}, a_{2 n}, \dots, a_{m n})^{t}, \end{aligned}

🔗

then

\begin{aligned} T (x) & = T (x_{1} e_{1} + x_{2} e_{2} + \dots + x_{n} e_{n}) \\ = x_{1} T (e_{1}) + x_{2} T (e_{2}) + \dots + x_{n} T (e_{n}) \\ = {(\sum_{k = 1}^{n} a_{1 k} x_{k}, \dots, \sum_{k = 1}^{n} a_{m k} x_{k})}^{t} \\ = A x . \end{aligned}

🔗

Example 12.1.

🔗

If we let

T : R^{2} \to R^{2}

be the map given by

T (x_{1}, x_{2}) = (2 x_{1} + 5 x_{2}, - 4 x_{1} + 3 x_{2}),

🔗

the axioms that

T

must satisfy to be a linear transformation are easily verified. The column vectors

T e_{1} = (2, - 4)^{t}

and

T e_{2} = (5, 3)^{t}

tell us that

T

is given by the matrix

A = (\begin{matrix} 2 & 5 \\ - 4 & 3 \end{matrix}) .

🔗

Since we are interested in groups of matrices, we need to know which matrices have multiplicative inverses. Recall that an

n \times n

matrix

A

is invertible exactly when there exists another matrix

A^{- 1}

such that

A A^{- 1} = A^{- 1} A = I,

where

I = (\begin{matrix} 1 & 0 & \dots & 0 \\ 0 & 1 & \dots & 0 \\ ⋮ & ⋮ & ⋱ & ⋮ \\ 0 & 0 & \dots & 1 \end{matrix})

🔗

is the

n \times n

identity matrix. From linear algebra we know that

A

is invertible if and only if the determinant of

A

is nonzero. Sometimes an invertible matrix is said to be nonsingular.

🔗

Example 12.2.

🔗

A

is the matrix

(\begin{matrix} 2 & 1 \\ 5 & 3 \end{matrix}),

🔗

then the inverse of

A

A^{- 1} = (\begin{matrix} 3 & - 1 \\ - 5 & 2 \end{matrix}) .

🔗

We are guaranteed that

A^{- 1}

exists, since

det (A) = 2 \cdot 3 - 5 \cdot 1 = 1

is nonzero.

🔗

Some other facts about determinants will also prove useful in the course of this chapter. Let

A

and

B

n \times n

matrices. From linear algebra we have the following properties of determinants.

The determinant is a homomorphism into the multiplicative group of real numbers; that is, $det (A B) = (det A) (det B) .$
If $A$ is an invertible matrix, then $det (A^{- 1}) = 1 / det A .$
If we define the transpose of a matrix $A = (a_{i j})$ to be $A^{t} = (a_{j i}),$ then $det (A^{t}) = det A .$
Let $T$ be the linear transformation associated with an $n \times n$ matrix $A .$ Then $T$ multiplies volumes by a factor of $| det A | .$ In the case of $R^{2},$ this means that $T$ multiplies areas by $| det A | .$

🔗

Linear maps, matrices, and determinants are covered in any elementary linear algebra text; however, if you have not had a course in linear algebra, it is a straightforward process to verify these properties directly for

2 \times 2

matrices, the case with which we are most concerned.

🔗

Subsection The General and Special Linear Groups

🔗

The set of all

n \times n

invertible matrices forms a group called the general linear group. We will denote this group by

G L_{n} (R) .

The general linear group has several important subgroups. The multiplicative properties of the determinant imply that the set of matrices with determinant one is a subgroup of the general linear group. Stated another way, suppose that

det (A) = 1

and

det (B) = 1 .

Then

det (A B) = det (A) det (B) = 1

and

det (A^{- 1}) = 1 / det A = 1 .

This subgroup is called the special linear group and is denoted by

S L_{n} (R) .

🔗

Example 12.3.

🔗

Given a

2 \times 2

matrix

A = (\begin{matrix} a & b \\ c & d \end{matrix}),

🔗

the determinant of

A

a d - b c .

The group

G L_{2} (R)

consists of those matrices in which

a d - b c \neq 0 .

The inverse of

A

A^{- 1} = \frac{1}{a d - b c} (\begin{matrix} d & - b \\ - c & a \end{matrix}) .

🔗

A

is in

S L_{2} (R),

then

A^{- 1} = (\begin{matrix} d & - b \\ - c & a \end{matrix}) .

🔗

Geometrically,

S L_{2} (R)

is the group that preserves the areas of parallelograms. Let

A = (\begin{matrix} 1 & 1 \\ 0 & 1 \end{matrix})

🔗

be in

S L_{2} (R) .

In Figure 12.4, the unit square corresponding to the vectors

x = (1, 0)^{t}

and

y = (0, 1)^{t}

is taken by

A

to the parallelogram with sides

(1, 0)^{t}

and

(1, 1)^{t};

that is,

A x = (1, 0)^{t}

and

A y = (1, 1)^{t} .

Notice that these two parallelograms have the same area.

A square on set of axes with the left edge a vector from the origin to (0,1) and bottom edge a vector from the origin to (1,0). — 🔗
Figure 12.4. $S L_{2} (R)$ acting on the unit square

A parallelogram on set of axes with the left edge a vector from the origin to (1,1) and bottom edge a vector from the origin to (1,0). — 🔗
Figure 12.4. $S L_{2} (R)$ acting on the unit square

🔗

Subsection The Orthogonal Group $O (n)$

🔗

Another subgroup of

G L_{n} (R)

is the orthogonal group. A matrix

A

is orthogonal if

A^{- 1} = A^{t} .

The orthogonal group consists of the set of all orthogonal matrices. We write

O (n)

for the

n \times n

orthogonal group. We leave as an exercise the proof that

O (n)

is a subgroup of

G L_{n} (R) .

🔗

Example 12.5.

🔗

The following matrices are orthogonal:

(\begin{matrix} 3 / 5 & - 4 / 5 \\ 4 / 5 & 3 / 5 \end{matrix}), (\begin{matrix} 1 / 2 & - \sqrt{3} / 2 \\ \sqrt{3} / 2 & 1 / 2 \end{matrix}), (\begin{matrix} - 1 / \sqrt{2} & 0 & 1 / \sqrt{2} \\ 1 / \sqrt{6} & - 2 / \sqrt{6} & 1 / \sqrt{6} \\ 1 / \sqrt{3} & 1 / \sqrt{3} & 1 / \sqrt{3} \end{matrix}) .

🔗

There is a more geometric way of viewing the group

O (n) .

The orthogonal matrices are exactly those matrices that preserve the length of vectors. We can define the length of a vector using the Euclidean inner product, or dot product, of two vectors. The Euclidean inner product of two vectors

x = (x_{1}, \dots, x_{n})^{t}

and

y = (y_{1}, \dots, y_{n})^{t}

⟨ x, y ⟩ = x^{t} y = (x_{1}, x_{2}, \dots, x_{n}) (\begin{matrix} y_{1} \\ y_{2} \\ ⋮ \\ y_{n} \end{matrix}) = x_{1} y_{1} + \dots + x_{n} y_{n} .

🔗

We define the length of a vector

x = (x_{1}, \dots, x_{n})^{t}

to be

‖ x ‖ = \sqrt{⟨ x, x ⟩} = \sqrt{x_{1}^{2} + \dots + x_{n}^{2}} .

🔗

Associated with the notion of the length of a vector is the idea of the distance between two vectors. We define the distance between two vectors

x

and

y

to be

‖ x - y ‖ .

We leave as an exercise the proof of the following proposition about the properties of Euclidean inner products.

🔗

Proposition 12.6.

🔗

Let

x,

y,

and

w

be vectors in

R^{n}

and

α \in R .

Then

$⟨ x, y ⟩ = ⟨ y, x ⟩ .$
$⟨ x, y + w ⟩ = ⟨ x, y ⟩ + ⟨ x, w ⟩ .$
$⟨ α x, y ⟩ = ⟨ x, α y ⟩ = α ⟨ x, y ⟩ .$
$⟨ x, x ⟩ \geq 0$ with equality exactly when $x = 0 .$
If $⟨ x, y ⟩ = 0$ for all $x$ in $R^{n},$ then $y = 0 .$

🔗

Example 12.7.

🔗

The vector

x = (3, 4)^{t}

has length

\sqrt{3^{2} + 4^{2}} = 5 .

We can also see that the orthogonal matrix

A = (\begin{matrix} 3 / 5 & - 4 / 5 \\ 4 / 5 & 3 / 5 \end{matrix})

🔗

preserves the length of this vector. The vector

A x = (- 7 / 5, 24 / 5)^{t}

also has length 5.

🔗

Since

det (A A^{t}) = det (I) = 1

and

det (A) = det (A^{t}),

the determinant of any orthogonal matrix is either

1

- 1 .

Consider the column vectors

a_{j} = (\begin{matrix} a_{1 j} \\ a_{2 j} \\ ⋮ \\ a_{n j} \end{matrix})

🔗

of the orthogonal matrix

A = (a_{i j}) .

Since

A A^{t} = I,

⟨ a_{r}, a_{s} ⟩ = δ_{r s},

where

δ_{r s} = {\begin{cases} 1 & r = s \\ 0 & r \neq s \end{cases}

🔗

is the Kronecker delta. Accordingly, column vectors of an orthogonal matrix all have length 1; and the Euclidean inner product of distinct column vectors is zero. Any set of vectors satisfying these properties is called an orthonormal set. Conversely, given an

n \times n

matrix

A

whose columns form an orthonormal set, it follows that

A^{- 1} = A^{t} .

🔗

We say that a matrix

A

is distance-preserving, length-preserving, or inner product-preserving when

‖ A x - A y ‖ = ‖ x - y ‖,

‖ A x ‖ = ‖ x ‖,

⟨ A x, A y ⟩ = ⟨ x, y ⟩,

respectively. The following theorem, which characterizes the orthogonal group, says that these notions are the same.

🔗

Theorem 12.8.

🔗

Let

A

be an

n \times n

matrix. The following statements are equivalent.

The columns of the matrix $A$ form an orthonormal set.
$A^{- 1} = A^{t} .$
For vectors $x$ and $y,$ $⟨ A x, A y ⟩ = ⟨ x, y ⟩ .$
For vectors $x$ and $y,$ $‖ A x - A y ‖ = ‖ x - y ‖ .$
For any vector $x,$ $‖ A x ‖ = ‖ x ‖ .$

Proof.

We have already shown (1) and (2) to be equivalent.

(2) \Rightarrow (3) .

\begin{aligned} ⟨ A x, A y ⟩ & = (A x)^{t} A y \\ = x^{t} A^{t} A y \\ = x^{t} y \\ = ⟨ x, y ⟩ . \end{aligned}

(3) \Rightarrow (2) .

First,

⟨ A x, A y ⟩ = (A x)^{t} A y = x^{t} A^{t} A y = x^{t} y .

M

is any

n \times n

matrix, then

e_{i}^{t} M e_{j}^{t} = M_{i j},

where

M_{i j}

is the

i j

th entry of the matrix

M .

Noticing that

x^{t} A^{t} A y = x^{t} y,

let

x = e_{i}

and

y = e_{j} .

Then

e_{i}^{t} A^{t} A e_{j} = e_{i}^{t} e_{j} .

Thus, the

i j

th component of

A^{t} A

1

when

i = j

and

0

otherwise. In other words

A^{t} A = I,

and

A^{- 1} = A^{t} .

(3) \Rightarrow (4) .

A

is inner product-preserving, then

A

is distance-preserving, since

\begin{aligned} ‖ A x - A y ‖^{2} & = ‖ A (x - y) ‖^{2} \\ = ⟨ A (x - y), A (x - y) ⟩ \\ = ⟨ x - y, x - y ⟩ \\ = ‖ x - y ‖^{2} . \end{aligned}

(4) \Rightarrow (5) .

A

is distance-preserving, then

A

is length-preserving. Letting

y = 0,

we have

‖ A x ‖ = ‖ A x - A y ‖ = ‖ x - y ‖ = ‖ x ‖ .

(5) \Rightarrow (3) .

We use the following identity to show that length-preserving implies inner product-preserving:

⟨ x, y ⟩ = \frac{1}{2} [‖ x + y ‖^{2} - ‖ x ‖^{2} - ‖ y ‖^{2}] .

Observe that

\begin{aligned} ⟨ A x, A y ⟩ & = \frac{1}{2} [‖ A x + A y ‖^{2} - ‖ A x ‖^{2} - ‖ A y ‖^{2}] \\ = \frac{1}{2} [‖ A (x + y) ‖^{2} - ‖ A x ‖^{2} - ‖ A y ‖^{2}] \\ = \frac{1}{2} [‖ x + y ‖^{2} - ‖ x ‖^{2} - ‖ y ‖^{2}] \\ = ⟨ x, y ⟩ . \end{aligned}

$Two side-by figures. The figure on the left is a set of axes with an arrow pointing up and right from the origin to (a,b) and the second arrow pointing down and right from the origin to a point (a, -b). The figure on the right is a set of axes with an arrow pointed up and right from the origin to (cosine theta, sine theta) and an arrow point up and left at a right angle to the first vector from the origin to (sine theta, minus cosine theta).$

🔗

Figure 12.9.

O (2)

acting on

R^{2}

🔗

Example 12.10.

🔗

Let us examine the orthogonal group on

R^{2}

a bit more closely. An element

A \in O (2)

is determined by its action on

e_{1} = (1, 0)^{t}

and

e_{2} = (0, 1)^{t} .

A e_{1} = (a, b)^{t},

then

a^{2} + b^{2} = 1,

since the length of a vector must be preserved when it is multiplied by

A .

Since multiplication of an element of

O (2)

preserves length and orthogonality,

A e_{2} = \pm (- b, a)^{t} .

If we choose

A e_{2} = (- b, a)^{t},

then

A = (\begin{matrix} a & - b \\ b & a \end{matrix}) = (\begin{matrix} \cos θ & - \sin θ \\ \sin θ & \cos θ \end{matrix}),

🔗

where

0 \leq θ < 2 π .

The matrix

A

rotates a vector in

R^{2}

counterclockwise about the origin by an angle of

θ

(Figure 12.9).

🔗

If we choose

A e_{2} = (b, - a)^{t},

then we obtain the matrix

B = (\begin{matrix} a & b \\ b & - a \end{matrix}) = (\begin{matrix} \cos θ & \sin θ \\ \sin θ & - \cos θ \end{matrix}) .

🔗

Here,

det B = - 1

and

B^{2} = (\begin{matrix} 1 & 0 \\ 0 & 1 \end{matrix}) .

🔗

A reflection about the horizontal axis is given by the matrix

C = (\begin{matrix} 1 & 0 \\ 0 & - 1 \end{matrix}),

🔗

and

B = A C

(see Figure 12.9). Thus, a reflection about a line

ℓ

is simply a reflection about the horizontal axis followed by a rotation.

🔗

Two of the other matrix or matrix-related groups that we will consider are the special orthogonal group and the group of Euclidean motions. The special orthogonal group,

S O (n),

is just the intersection of

O (n)

and

S L_{n} (R);

that is, those elements in

O (n)

with determinant one. The Euclidean group,

E (n),

can be written as ordered pairs

(A, x),

where

A

is in

O (n)

and

x

is in

R^{n} .

We define multiplication by

(A, x) (B, y) = (A B, A y + x) .

🔗

The identity of the group is

(I, 0);

the inverse of

(A, x)

(A^{- 1}, - A^{- 1} x) .

In Exercise 12.4.6, you are asked to check that

E (n)

is indeed a group under this operation.

$A set of axes with an arrow pointing up and right from the origin to a point x.$

$A set of axes with an arrow of the same length and same direction as in the previous diagram from a point to the right and above the origin to a point x + y.$