Matrices and Vectors: A new beginning

Vectors

Here we introduce vectors and the notation that we use for vectors. We then give some facts about real vectors before discussing the complex vectors used in quantum mechanics.

Vectors Defining and Representing

You may have heard of the definition of a vector as a quantity with both magnitude and direction. While this is true and often used in science classes, our purpose is different. So we will simply define a vector as a set of numbers that is written in an row or a column. When the vector is written as a row of numbers, it is called a row vector and when it is written as a set of numbers in a column, it is called a column vector. As we will see, these two can have the same set of numbers, but each can be used in a slightly different way.

Examples

This is an example of a row vector Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle \vec{v} = (2,4,3). }

This is an example of a column vector ${\vec {w}}=\left({\begin{array}{c}1\\5\\4\end{array}}\right).$

Real Vectors

If you are familiar with vectors, the simple definition of a vector --- an object that has magnitude and direction --- is helpful to keep in mind even when dealing with complex and/or abstract vectors as we will here. However, this is not necessary and we will see how to perform all of the operations that we need just using our arrays of numbers. In three dimensional space, a vector is often written as

${\vec {v}}=v_{x}{\hat {x}}+v_{y}{\hat {y}}+v_{z}{\hat {z}},$

where the hat (${\hat {\cdot }}\,\!$) denotes a unit vector and the components $v_{i}\,\!$, $i=x,y,z\,\!$ are just numbers. The unit vectors are also known as basis vectors. The unit vectors have magnitude equal to one. (The magnitude is the size, or length of a vector.) So that if the vector ${\hat {v}}\,\!$ is a unit vector, then $v_{x}^{2}+v_{y}^{2}+v_{z}^{2}=1\,\!$

Vector Operations

Adding Vectors

When adding vectors, it is important to note that you can only add vectors if they are the same type. (No adding "apples and oranges" so to speak.) So you can add two vectors that are both column vectors and have three entries. You can't add a column vector to a row vector and you can't add a vector with two components to a vector with three components.

Products of Vectors

The inner product, or dot product, for two real three-dimensional vectors,

${\vec {v}}=v_{x}{\hat {x}}+v_{y}{\hat {y}}+v_{z}{\hat {z}},\;\;{\vec {w}}=w_{x}{\hat {x}}+w_{y}{\hat {y}}+w_{z}{\hat {z}},$

can be computed as follows:

${\vec {v}}\cdot {\vec {w}}=v_{x}w_{x}+v_{y}w_{y}+v_{z}w_{z}.$

For the inner product of ${\vec {v}}\,\!$ with itself, we get the square of the magnitude of ${\vec {v}}\,\!$, denoted $|{\vec {v}}|^{2}\,\!$:

$|{\vec {v}}|^{2}={\vec {v}}\cdot {\vec {v}}=v_{x}v_{x}+v_{y}v_{y}+v_{z}v_{z}=v_{x}^{2}+v_{y}^{2}+v_{z}^{2}.$

If we want a unit vector in the direction of Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle \vec{v}\,\!} , we can simply divide it by its magnitude:

Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle \hat{v} = \frac{\vec{v}}{|\vec{v}|}. }

Now, of course, Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle \hat{v}\cdot\hat{v}= 1\,\!} , which can easily be checked.

There are several ways to represent a vector. The ones we will use most often are column and row vector notations. So, for example, we could write the vector above as

${\vec {v}}=\left({\begin{array}{c}v_{x}\\v_{y}\\v_{z}\end{array}}\right).$

In this case, our unit vectors are represented by the following:

Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle \hat{x} = \left(\begin{array}{c} 1 \\ 0 \\ 0 \end{array}\right), \;\; \hat{y} = \left(\begin{array}{c} 0 \\ 1 \\ 0 \end{array}\right), \;\; \hat{z} = \left(\begin{array}{c} 0 \\ 0 \\ 1 \end{array}\right). \,\!}

We next turn to the subject of complex vectors and the relevant notation. We will see how to compute the inner product later, since some other definitions are required.

Complex Vectors

For complex vectors in quantum mechanics, Dirac notation is used most often. This notation uses a Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle \left\vert \cdot \right\rangle\,\!} , called a ket, for a vector. So our vector Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle \vec{v}\,\!} would be

$\left\vert v\right\rangle =\left({\begin{array}{c}v_{x}\\v_{y}\\v_{z}\end{array}}\right).$

For qubits, i.e. two-state quantum systems, complex vectors will often be used:

	Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle \begin{align} \left\vert \psi \right\rangle &= \left(\begin{array}{c} \alpha \\ \beta \end{array}\right) \\ &=\alpha \left\vert 0\right\rangle + \beta\left\vert 1\right\rangle,\end{align}}	(C.1)

where

Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle \left\vert 0\right\rangle = \left(\begin{array}{c} 1 \\ 0 \end{array}\right), \;\;\mbox{and} \;\; \left\vert 1\right\rangle = \left(\begin{array}{c} 0 \\ 1 \end{array}\right) }

are the basis vectors. The two numbers Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle \alpha\,\!} and $\beta \,\!$ are complex numbers, so the vector is said to be a complex vector.

Matrices

Basic Definition and Representations

A matrix is an array of numbers of the following form with columns, col. 1, col. 2, etc., and rows, row 1, row 2, etc. The entries for the matrix are labeled by the row and column. So the entry of a matrix Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle A} will be $a_{ij}$ where Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle i} is the row and Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle j} is the column where the number $a_{ij}$ is found. This is how it looks:

$A={\begin{array}{c}{\scriptstyle {row\;1}}\\{\scriptstyle {row\;2}}\\\vdots \\{\scriptstyle {row\;m}}\end{array}}{\overset {{\scriptstyle {col.\;1}}\;\;\;{\scriptstyle {col.\;2}}\;\;\;\;{\displaystyle {\cdots }}\;\;\;\;\;{\scriptstyle {col.\;n}}}{\left({\begin{array}{cccc}a_{11}&a_{12}&\cdots &a_{1n}\\a_{21}&a_{22}&\cdots &a_{2n}\\\vdots &\vdots &\ddots &\vdots \\a_{m1}&a_{m2}&\cdots &a_{mn}\end{array}}\right)}}.\,\!$

Notice that we represent the whole matrix with a capital letter Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle A} . We could also represent it using all of the entries, this array of numbers seen in the equation above. Another way to represent it is to write it as Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle (a_{ij})} . By this we mean that it is the array of numbers in the parentheses.

Matrix Addition

Matrix addition is performed by adding each element of one matrix with the corresponding element in another matrix. Let our two matrices be $A$ as above, and Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle B} . To represent these in an array,

$A=\left({\begin{array}{cccc}a_{11}&a_{12}&\cdots &a_{1n}\\a_{21}&a_{22}&\cdots &a_{2n}\\\vdots &\vdots &\ddots &\vdots \\a_{m1}&a_{m2}&\cdots &a_{mn}\end{array}}\right),\;\;\;\;B=\left({\begin{array}{cccc}b_{11}&b_{12}&\cdots &b_{1n}\\b_{21}&b_{22}&\cdots &b_{2n}\\\vdots &\vdots &\ddots &\vdots \\b_{m1}&b_{m2}&\cdots &b_{mn}\end{array}}\right).\,\!$

The the sum, which we could call Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle C= A+B} is given by

Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle A + B = \left(\begin{array}{cccc} a_{11} & a_{12} & \cdots & a_{1n} \\ a_{21} & a_{22} & \cdots & a_{2n} \\ \vdots & \vdots & \ddots & \vdots \\ a_{m1} & a_{m2} & \cdots & a_{mn} \end{array}\right) + \left(\begin{array}{cccc} b_{11} & b_{12} & \cdots & b_{1n} \\ b_{21} & b_{22} & \cdots & b_{2n} \\ \vdots & \vdots & \ddots & \vdots \\ b_{m1} & b_{m2} & \cdots & b_{mn} \end{array}\right) = \left(\begin{array}{cccc} a_{11} + b_{11} & a_{12}+b_{12} & \cdots & a_{1n}+b_{1n} \\ a_{21}+b_{21} & a_{22}+b_{22} & \cdots & a_{2n}+b_{2n} \\ \vdots & \vdots & \ddots & \vdots \\ a_{m1}+b_{m1} & a_{m2}+b_{m2} & \cdots & a_{mn}+b_{mn} \end{array}\right). \,\!}

In other words, the sum gives $c_{11}=a_{11}+b_{11}\,\!$, etc. We add them component by component like we do vectors.

Notation

There are many aspects of linear algebra that are quite useful in quantum mechanics. We will briefly discuss several of these aspects here. First, some definitions and properties are provided that will be useful. Some familiarity with matrices will be assumed, although many basic definitions are also included.

Let us denote some Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle m\times n\,\!} matrix by $A\,\!$. The set of all Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle m\times n\,\!} matrices with real entries is Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle M(m\times n,\mathbb{R})\,\!} . Such matrices are said to be real since they have all real entries. Similarly, the set of Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle m\times n\,\!} complex matrices is $M(m\times n,\mathbb {C} )\,\!$. For the set of square Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle n\times n\,\!} complex matrices, we simply write Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle M(n,\mathbb{C})\,\!} .

We will also refer to the set of matrix elements, Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle a_{ij}\,\!} , where the first index ($i\,\!$ in this case) labels the row and the second $(j)\,\!$ labels the column. Thus the element $a_{23}\,\!$ is the element in the second row and third column. A comma is inserted if there is some ambiguity. For example, in a large matrix the element in the 2nd row and 12th column is written as $a_{2,12}\,\!$ to distinguish between the 21st row and 2nd column.

The Identity Matrix

An identity matrix has the property that when it is multiplied by any matrix, that matrix is unchanged. That is, for any matrix $A\,\!$,

$\mathbb {I} A=A\mathbb {I} =A.\,\!$

Such an identity matrix always has ones along the diagonal and zeroes everywhere else. For example, the $3\times 3\,\!$ identity matrix is

$\mathbb {I} =\left({\begin{array}{ccc}1&0&0\\0&1&0\\0&0&1\end{array}}\right).\,\!$

It is straight-forward to verify that any $3\times 3\,\!$ matrix is not changed when multiplied by the identity matrix.

Complex Conjugate

The complex conjugate of a matrix is the matrix with each element replaced by its complex conjugate. In other words, to take the complex conjugate of a matrix, one takes the complex conjugate of each entry in the matrix. We denote the complex conjugate with a star, like this: $A^{*}\,\!$. For example,

	Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle \begin{align} A^* &=& \left(\begin{array}{ccc} a_{11} & a_{12} & a_{13} \\ a_{21} & a_{22} & a_{23} \\ a_{31} & a_{32} & a_{33} \end{array}\right)^* \\ &=& \left(\begin{array}{ccc} a_{11}^* & a_{12}^* & a_{13}^* \\ a_{21}^* & a_{22}^* & a_{23}^* \\ a_{31}^* & a_{32}^* & a_{33}^* \end{array}\right). \end{align} \,\!}	(C.2)

(Notice that the notation for a matrix is a capital letter, whereas the entries are represented by lower case letters.)

Transpose

The transpose of a matrix is the same set of elements, but now the first row becomes the first column, the second row becomes the second column, and so on. Thus the rows and columns are interchanged. For example, for a square $3\times 3\,\!$ matrix, the transpose is given by

	${\begin{aligned}A^{T}&=&\left({\begin{array}{ccc}a_{11}&a_{12}&a_{13}\\a_{21}&a_{22}&a_{23}\\a_{31}&a_{32}&a_{33}\end{array}}\right)^{T}\\&=&\left({\begin{array}{ccc}a_{11}&a_{21}&a_{31}\\a_{12}&a_{22}&a_{32}\\a_{13}&a_{23}&a_{33}\end{array}}\right).\end{aligned}}\,\!$	(C.3)

Hermitian Conjugate

The complex conjugate and transpose of a matrix is called the Hermitian conjugate, or simply the dagger of a matrix. It is called the dagger because the symbol used to denote it, ($\dagger \,\!$):

	$(A^{T})^{*}=(A^{*})^{T}\equiv A^{\dagger }.\,\!$	(C.4)

For our $3\times 3\,\!$ example,

$A^{\dagger }=\left({\begin{array}{ccc}a_{11}^{*}&a_{21}^{*}&a_{31}^{*}\\a_{12}^{*}&a_{22}^{*}&a_{32}^{*}\\a_{13}^{*}&a_{23}^{*}&a_{33}^{*}\end{array}}\right).\,\!$

If a matrix is its own Hermitian conjugate, i.e. $A^{\dagger }=A\,\!$, then we call it a Hermitian matrix. (Clearly this is only possible for square matrices.) Hermitian matrices are very important in quantum mechanics since their eigenvalues are real. (See Sec.(Eigenvalues and Eigenvectors).)

Index Notation

Very often we write the product of two matrices Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle A\,\!} and $B\,\!$ simply as Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle AB\,\!} and let $C=AB\,\!$. However, it is also quite useful to write this in component form. In this case, if these are $n\times n\,\!$ matrices, the component form will be

$c_{ik}=\sum _{j=1}^{n}a_{ij}b_{jk}.\,\!$

This says that the element in the $i^{\mbox{th}}\,\!$ row and $j^{\mbox{th}}\,\!$ column of the matrix $C\,\!$ is the sum $\sum _{j=1}^{n}a_{ij}b_{jk}\,\!$. The transpose of $C\,\!$ has elements

$c_{ki}=\sum _{j=1}^{n}a_{kj}b_{ji}.\,\!$

Now if we were to transpose Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle A\,\!} and $B\,\!$ as well, this would read

$c_{ki}=\sum _{j=1}^{n}(a_{jk})^{T}(b_{ij})^{T}=\sum _{j=1}^{n}b_{ij}^{T}a_{jk}^{T}.\,\!$

This gives us a way of seeing the general rule that

$C^{T}=B^{T}A^{T}.\,\!$

It follows that

$C^{\dagger }=B^{\dagger }A^{\dagger }.\,\!$

The Trace

The trace of a matrix is the sum of the diagonal elements and is denoted ${\mbox{Tr}}\,\!$. So for example, the trace of an $n\times n\,\!$ matrix $A\,\!$ is

${\mbox{Tr}}(A)=\sum _{i=1}^{n}a_{ii}\,\!$.

Some useful properties of the trace are the following:

1. ${\mbox{Tr}}(AB)={\mbox{Tr}}(BA)\,\!$
2. ${\mbox{Tr}}(A+B)={\mbox{Tr}}(A)+{\mbox{Tr}}(B)\,\!$.

Using the first of these results,

${\mbox{Tr}}(UAU^{-1})={\mbox{Tr}}(U^{-1}UA)={\mbox{Tr}}(A).\,\!$

This relation is used so often that we state it here explicitly.

The Determinant

For a square matrix, the determinant is quite a useful thing. For example, an $n\times n\,\!$ matrix is invertible if and only if its determinant is not zero. So let us define the determinant and give some properties and examples.

The determinant of a $2\times 2\,\!$ matrix,

	$N=\left({\begin{array}{cc}a&b\\c&d\end{array}}\right),\,\!$	(C.5)

is given by

	$\det(N)=ad-bc.\,\!$	(C.6)

Higher-order determinants can be written in terms of smaller ones in a recursive way. For example, let

$M=\left({\begin{array}{ccc}m_{11}&m_{12}&m_{13}\\m_{21}&m_{22}&m_{23}\\m_{31}&m_{32}&m_{33}\end{array}}\right).\,\!$

Then

$\det(M)=m_{11}\det \left({\begin{array}{cc}m_{22}&m_{23}\\m_{32}&m_{33}\end{array}}\right)-m_{12}\det \left({\begin{array}{cc}m_{21}&m_{23}\\m_{31}&m_{33}\end{array}}\right)+m_{13}\det \left({\begin{array}{cc}m_{21}&m_{22}\\m_{31}&m_{32}\end{array}}\right).\,\!$

The determinant of a matrix $A\,\!$ can be also be written in terms of its components as

	$\det(A)=\sum _{i,j,k,l,...}\epsilon _{ijkl...}a_{1i}a_{2j}a_{3k}a_{4l}...,\,\!$	(C.7)

where the symbol

	$\epsilon _{ijkl...}={\begin{cases}+1,\;{\mbox{if }}\;ijkl...=1234...({\mbox{in order, or any even number of permutations}}),\\-1,\;{\mbox{if }}\;ijkl...=2134...({\mbox{or any odd number of permutations}}),\\\;\;\;0,\;{\mbox{otherwise}},\;({\mbox{meaning any index is repeated}}).\end{cases}}\,\!$	(C.8)

Let us consider the example of the $3\times 3\,\!$ matrix $A\,\!$ given above. The determinant can be calculated by

$\det(A)=\sum _{i,j,k}\epsilon _{ijk}a_{1i}a_{2j}a_{3k},\,\!$

where, explicitly,

	$\epsilon _{ijk}={\begin{cases}+1,\;{\mbox{if }}\;ijk=123,231,\;{\mbox{or}}\;312,({\mbox{These are even permutations of }}123),\\-1,\;{\mbox{if }}\;ijk=213,132,\;{\mbox{or}}\;321({\mbox{These are odd permuations of }}123),\\\;\;\;0,\;{\mbox{otherwise}},\;({\mbox{meaning any index is repeated}}),\end{cases}}\,\!$	(C.9)

so that

	${\begin{aligned}\det(A)&=&\epsilon _{123}a_{11}a_{22}a_{33}+\epsilon _{132}a_{11}a_{23}a_{32}+\epsilon _{231}a_{12}a_{23}a_{31}\\&&+\epsilon _{213}a_{12}a_{21}a_{33}+\epsilon _{312}a_{13}a_{21}a_{32}+\epsilon _{321}a_{13}a_{22}a_{31}.\end{aligned}}\,\!$	(C.10)

Now given the values of $\epsilon _{ijk}\,\!$ in Eq. C.9, this is

$\det(A)=a_{11}a_{22}a_{33}-a_{11}a_{23}a_{32}+a_{12}a_{23}a_{31}-a_{12}a_{21}a_{33}+a_{13}a_{21}a_{32}-a_{13}a_{22}a_{31}.\,\!$

The determinant has several properties that are useful to know. A few are listed here:

1. The determinant of the transpose of a matrix is the same as the determinant of the matrix itself: $\det(A)=\det(A^{T}).\,\!$
2. The determinant of a product is the product of determinants: $\det(AB)=\det(A)\det(B).\,\!$

From this last property, another specific property can be derived. If we take the determinant of the product of a matrix and its inverse, we find

$\det(UU^{-1})=\det(U)\det(U^{-1})=\det(\mathbb {I} )=1,\,\!$

since the determinant of the identity is one. This implies that

$\det(U^{-1})={\frac {1}{\det(U)}}.\,\!$

The Inverse of a Matrix

The inverse of a square matrix $A\,\!$ is another matrix, denoted $A^{-1}\,\!$, such that

$AA^{-1}=A^{-1}A=\mathbb {I} ,\,\!$

where $\mathbb {I} \,\!$ is the identity matrix consisting of zeroes everywhere except the diagonal, which has ones. For example, the $3\times 3\,\!$ identity matrix is

$\mathbb {I} _{3}=\left({\begin{array}{ccc}1&0&0\\0&1&0\\0&0&1\end{array}}\right).\,\!$

It is important to note that a matrix is invertible if and only if its determinant is nonzero. Thus one only needs to calculate the determinant to see if a matrix has an inverse or not.

Hermitian Matrices

Hermitian matrices are important for a variety of reasons; primarily, it is because their eigenvalues are real. Thus Hermitian matrices are used to represent density operators and density matrices, as well as Hamiltonians. The density operator is a positive semi-definite Hermitian matrix (it has no negative eigenvalues) that has its trace equal to one. In any case, it is often desirable to represent $N\times N\,\!$ Hermitian matrices using a real linear combination of a complete set of $N\times N\,\!$ Hermitian matrices. A set of $N\times N\,\!$ Hermitian matrices is complete if any Hermitian matrix can be represented in terms of the set. Let $\{\lambda _{i}\}\,\!$ be a complete set. Then any Hermitian matrix can be represented by $\sum _{i}a_{i}\lambda _{i}\,\!$. The set can always be taken to be a set of traceless Hermitian matrices and the identity matrix. This is convenient for the density matrix (its trace is one) because the identity part of an $N\times N\,\!$ Hermitian matrix is $(1/N)\mathbb {I} \,\!$ if we take all others in the set to be traceless. For the Hamiltonian, the set consists of a traceless part and an identity part where identity part just gives an overall phase which can often be neglected.

One example of such a set which is extremely useful is the set of Pauli matrices. These are discussed in detail in Chapter 2 and in particular in Section 2.4.

Unitary Matrices

A unitary matrix $U\,\!$ is one whose inverse is also its Hermitian conjugate, $U^{\dagger }=U^{-1}\,\!$, so that

$U^{\dagger }U=UU^{\dagger }=\mathbb {I} .\,\!$

If the unitary matrix also has determinant one, it is said to be a special unitary matrix. The set of $n\times n\,\!$ unitary matrices is denoted $U(n)\,\!$ and the set of special unitary matrices is denoted $SU(n)\,\!$.

Unitary matrices are particularly important in quantum mechanics because they describe the evolution of quantum states. They have this ability due to the fact that the rows and columns of unitary matrices (viewed as vectors) are orthonormal. (This is made clear in an example below.) This means that when they act on a basis vector of the form

	$\left\vert j\right\rangle =\left({\begin{array}{c}0\\0\\\vdots \\1\\\vdots \\0\end{array}}\right),\,\!$	(C.11)

with a single 1, in say the $j$th spot, and zeroes everywhere else, the result is a normalized complex vector. Acting on a set of orthonormal vectors of the form given in Eq.(C.11) will produce another orthonormal set.

Let us consider the example of a Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle 2\times 2\,\!} unitary matrix,

	Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle U = \left(\begin{array}{cc} a & b \\ c & d \end{array}\right). \,\!}	(C.12)

The inverse of this matrix is the Hermitian conjugate,

	Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle U ^{-1} = U^\dagger = \left(\begin{array}{cc} a^* & c^* \\ b^* & d^* \end{array}\right), \,\!}	(C.13)

provided that the matrix Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle U\,\!} satisfies the constraints

	Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle \begin{align} |a|^2 + |b|^2 = 1, \; & \; ac^*+bd^* =0 \\ ca^*+db^*=0, \; & \; |c|^2 + |d|^2 =1, \end{align}\,\!}	(C.14)

and

	Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle \begin{align} |a|^2 + |c|^2 = 1, \; & \; ba^*+dc^* =0 \\ b^*a+d^*c=0, \; & \; |b|^2 + |d|^2 =1. \end{align}\,\!}	(C.15)

Looking at each row as a vector, the constraints in Eq.(C.14) are the orthonormality conditions for the vectors forming the rows. Similarly, the constraints in Eq.(C.15) are the orthonormality conditions for the vectors forming the columns.

Inner and Outer Products

Now that we have a definition for the Hermitian conjugate, we consider the case for a Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle 1\times n\,\!} matrix, i.e. a vector. In Dirac notation, this is

Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle \left\vert\psi\right\rangle = \left(\begin{array}{c} \alpha \\ \beta \end{array}\right). \,\!}

The Hermitian conjugate comes up so often that we use the following notation for vectors:

Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle \left\langle \psi\right\vert = (\left\vert\psi\right\rangle)^\dagger = \left(\begin{array}{c} \alpha \\ \beta \end{array}\right)^\dagger = \left( \alpha^*, \; \beta^* \right). \,\!}

This is a row vector and in Dirac notation is denoted by the symbol $\left\langle \cdot \right\vert \!$, which is called a bra. Let us consider a second complex vector,

Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle \left\vert\phi\right\rangle = \left(\begin{array}{c} \gamma \\ \delta \end{array}\right). \,\!}

The inner product between Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle \left\vert\psi\right\rangle\,\!} and Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle \left\vert\phi\right\rangle\,\!} is computed as follows:

	Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle \begin{align} \left\langle\phi\mid\psi\right\rangle & \equiv (\left\vert\phi\right\rangle)^\dagger\left\vert\psi \right\rangle \\ &= (\gamma^*,\delta^*) \left(\begin{array}{c} \alpha \\ \beta \end{array}\right) \\ &= \gamma^*\alpha + \delta^*\beta. \end{align} }	(C.16)

The outer product between these same two vectors is

Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle \begin{align} (\left\vert \phi \right\rangle )(\left\vert \psi \right\rangle)^\dagger &= \left\vert \phi \right\rangle \left\langle \psi \right\vert \\ &= \left(\begin{array}{c} \gamma \\ \delta \end{array}\right) \left(\begin{array}{c} \alpha \\ \beta \end{array}\right)^\dagger \\ &= \left(\begin{array}{c} \gamma \\ \delta \end{array}\right) \left(\begin{array}{cc} \alpha^* & \beta^* \end{array}\right) \\ &= \left(\begin{array}{cc} \gamma\alpha^* & \gamma\beta^* \\ \delta\alpha^* & \delta\beta^* \end{array}\right) \end{align}\;\!}