Unit 5 - VZHK
Unit 5 - VZHK
Matrix Diagonalization
Vita Zhukova
Eigenvalues and Eigenvectors. Definition
a11 a12 ... a1n
a 21 a 22 ... a 2 n
Let A be a square matrix of order n: A
. . . .
a n1 an2 ... a nn
A n •n x n •1
The equality Ax x
can be also expressed as Ax x 0 , where ( A I )x 0
• In order to be the vector x a non null vector, the determinant has to be (A I) 0
In this case, we will have C.U, that receives the name of “Characteristic Equation”. The
development of the determinant leads to the polinomial in of degree n that admits n
solutions for , the n matrix eigenvalues.
Eigenvalues and Eigenvectors. Example
The eigenvalues and eigenvectors are those for which the following
expression is satisfied: Ax x , where x 0
How to find eigenvalues and eigenvectors
We want the system Ax x ( A I )x 0 to be consistent underdetermined,
for which there will be solutions different to the trivial ones.
For that, the matrix ( A I ), has not to be of the máximum Rank, that is, we look for
( A I ) 0
3 0 1 1 0 0 3 0 1
0 1 1 0 1 0 0 1 1 3 1 5 0
0 0 5 0 0 1 5
0 0
How to find eigenvalues and eigenvectors
Therefore, the determinant will be equal to 0 and the system will be consistent
underdetermined if: 3 1 5 0
A x 3x ( A 3I ) x 0
3 0 1 x 1 0 0 x 0 0 0 1 x 0
0 1 1 y 3 0 1 0 y 0 0 4 1 y 0
0 0 5 z 0 0 1 z 0 0 0 2 z 0
How to find eigenvalues and eigenvectors
The matrix rank is equal to 2, we will have to
0 0 1 x 0
0 4 1 y 0 parametrize 1 of unknowns.
0 0 2 z 0
The system is the following:
3 0 1 3 0 1 3
A 0 1 1 0 1 1 0 0 3 0
0 0 5 0 0 5 0 0 0
Ax x
How to find eigenvalues and eigenvectors
Now, we look for eigenvectors associated to 2 1 , that will be all vectos for
which the following expression is satisfied:
A x 1x ( A 1I ) x 0
3 0 1 x 1 0 0 x 0 4 0 1 x 0
0 1 1 y 1 0 1 0 y 0 0 0 1 y 0
0 0 5 z 0 0 1 z 0 0 0 6 z 0
How to find eigenvalues and eigenvectors
4 0 1 x 0
The matrix rank is equal to 2, we will have to
0 0 1 y 0 parametrize 1 of unknowns.
0 0 6 z 0
The system is the following:
4 x z 0
x 0 Therefore, the eigenvectors associated to eigenvalue
z0 z 0 -1 are vectors (x,y,z) where y=0 and z=0, x=α being a
6z 0 parameter.
x 0 0
The eigenvectors associated to eigenvalue -1 are all
y 1 vectors proportional to the vector (0,1,0). It is a vector
z 0 0
subspace of dimention equal to 1.
How to find eigenvalues and eigenvectors
That is, the matrix A multiplies by the scalar -1 any vector that belongs to a
vectorial subspace generated by (0,1,0). Let´s see it:
3 0 1 3 0 1 0 0 0
A 0 1 1 0 1 1 1
0 0 5 0 0 5 0 0 0
Ax x
How to find eigenvalues and eigenvectors
Now, we look for eigenvectors associated to 3 5 , that will be all vectos for
which the following expression is satisfied:
Ax 5x ( A 5I ) x 0
3 0 1 x 1 0 0 x 0 2 0 1 x 0
0 1 1 y 5 0 1 0 y 0 0 6 1 y 0
0 0 5 z 0 0 1 z 0 0
0 0 z 0
How to find eigenvalues and eigenvectors
2 0 1 x 0
The matrix rank is equal to 2, we will have to
0 6 1 y 0 parametrize 1 of unknowns.
0
0 0 z 0
The system is the following:
1
x
2 x 2 3
2
2x z 0 1
y y 1 , 6
6 y z 0 6 z 6 6
1 6
z
How to find eigenvalues and eigenvectors
That is, the matrix A multiplies by the scalar 5 any vector that belongs to a
vectorial subspace generated by (3,1,6). Let´s see:
3 0 1 3 0 1 3 15 3
A 0 1 1 0 1 1 1 5 5 1
0 0 5 0 0 5 6 30 6
Ax x
How to find eigenvalues and eigenvectors
Let’s see the case in which we have a matrix with repeated eigenvalues, to
learn what are its associated eigenvectors, let:
3 1 1
A 1 1 1
1 1 1
The eigenvalues and eigenvectors are those for which the following
expression is satisfied: Ax x , where x 0
How to find eigenvalues and eigenvectors
We want the system Ax x ( A I )x 0 to be consistent undetermined,
for which there will be solutions different to the trivial ones.
For that, the matrix ( A I ), hasn’t to be of the máximum Rank,that is, we look for
( A I ) 0
3 1 1 1 0 0 3 1 1
1 1 1 0 1 0 1 1 1 5 8 4 0
3 2
1 1 1 0 0 1 1 1
1
How to find eigenvalues and eigenvectors
Therefore, the determinant will be equal to 0 and the system will be consistent
underdetermined if: 5 8 4 0 1 2 0
3 2 2
That is, if: 1 1, 2 2 (double) , that are 2 eigenvalues associated to the matriz
A where one of them is double.
How to find eigenvalues and eigenvectors
Let’s look for eigenvalues associated to 1 1 , that will be all vectos for which
the following expression is satisfied: A x 1x ( A 1I ) x 0
3 1 1 x 1 0 0 x 0 2 1 1 x 0
1 1 1 y 1 0 1 0 y 0 1 0 1 y 0
1 1 1 z 0 0 1 z 0 1 1 0 z 0
How to find eigenvalues and eigenvectors
2 1 1 x 0 The matrix rank is equal to 2, we will have to
1 0 1 y 0 parametrize 1 of unknowns.
1 1 0 z 0 The system is the following:
2 x y z 0 2 y z 0 y 2 z
xz 0 z0 z
x 1
The eigenvectors associated to eigenvalue 1 are all
y 1 vectors proportional to the vector (1,1,1). It is a vector
z 1
subspace of dimention equal to 1.
How to find eigenvalues and eigenvectors
That is, the matrix A multiplies by the scalar 1 any vector that belongs to a
vectorial subspace generated by (1,1,1). Let´s see:
3 1 1 3 1 1
A 1 1 1 1 1 1 1
1 1 1 1 1 1
Ax x
How to find eigenvalues and eigenvectors
Now, we look for eigenvectors associated to 2 2 , that will be all vectos for
which the following expression is satisfied:
Ax 2 x ( A 2 I )x 0
3 1 1 x 1 0 0 x 0 1 1 1 x 0
1 1 1 y 2 0 1 0 y 0 1 1 1 y 0
1 1 1 z 0 0 1 z 0 1 1 1 z 0
How to find eigenvalues and eigenvectors
1 1 1 x 0 The matrix rank is equal to 1, we will have to
1 1 1 y 0 parametrize 2 of unknowns.
1 1 1 z 0
The system is the following:
x y z 0 x x 0 1 0
x y z 0 y y 0 0 1
x y z 0
z z 1 1
3 1 1 3 1 1 2
A 1 1 1 1 1 1 2 2
1 1 1 1 1 1 2
Ax x
Eigenvalues. Properties
1.- The eigenvalue associated to an eigenvector is unique.
1 2
1 x 2 x ( 1 2 )x 0
x 0
Being x an eigenvalue, it has to be different to zero.
Hence, the solution has to be 1 2
Eigenvalues. Properties
d1 0 ... 0
0 d2 ... 0
0
... ... ... ...
0 0 ... d n
3 0 0 1 0 0 x1 0 3 0 0 x1 0
0 1 0 0 1 0 x2 0 0 1 0 x2 0
0 0 2 0 0 1 x3 0 0 0 2 x3 0
Eigenvalues and Eigenvectors of a Diagonal Matrix
3 0 0
0 1 0 0 (3 )(1 )(2 ) 0
0 0 2
Now we look for eigenvectors associated to 1 3 , that will be all vectors for
which the following expression is satisfied:
A x 3x ( A 3 I )x 0
3 0 0 x 1 0 0 x 0 0 0 0 x 0
0 1 0 y 3 0 1 0 y 0 0 1 0 y 0
0 0 2 z 0 0 1 z 0 0 0 2 z 0
Eigenvalues and Eigenvectors of a Diagonal Matrix
x x 1
y0 y0
y: y 0 0
z 2z 0 z0 z 0 0
A=P-1BP
Because A and D are similar matrices, the eigenvalues of the matrix D are also
the eigenvalues of the matrix A: 1 , 2 ,..., n
.
Similar Matrices. Properties
Given that the eigenvalues of the diagonal matrix D coincide with the elements
of the main diagonal, we get:
1 0 ... 0
0 2 ... 0
D
0 0 ... 0
0 0 ... n
Similar Matrices. Properties
2. If two matrices are similar, they have the same determinant and the
same trace.
1
If A is diagoanlizable, D C AC such that A and D are similar.
n n
Since A and D are similar, this property tells us that A and D are similar
1
and also D C A C
n n
A=CDC-1
That is, we need to find a diagonal matrix that is similar to A, which is the
same as to find a diagonal matrix D for which there exists a transition matrix C
such that A=CDC-1.
Example. Matrix Diagonalization
1 0 6
1 3 v1 0 ; 2 1 v2 1 ; 3 5 v3 2
0 0 12
Example. Matrix Diagonalization
According to the properties of the eigenvalues and eigenvectors, we know that
eigenvectors that correspond to different eigenvalues are linearly independent.
Since this is the case, all eigenvectors are independent and, therefore, the
matrix A is diagonalizable with A=CDC-1, being
3 0 1 3 0 0 1 0 6
A 0 1 1 D 0 1 0 C 0 1 2
0 0 5 0 0 5 0 0 12
Matrix Power through Diagonalization
One of the properties of the similar matrices is that the power matrices are
also similar, that in case of diagonalizable matrices makes the calculus of
the power matrix easily.
1 n 5 n 3n
1 0 3 0
3n 0 3 5
n
2 2
n 1 5 1
n n
0 1 n
25 0 1 0 1 n
0 6 6
0 12 5n 1
0 0 5 n
0 0
12
Matrix Power through Diagonalization
Point out that in order to obtain the given result it is almost impossible to
develop the n-th multiplication of
3 0 1
A 0 1 1
0 0 5
Diagonalization of Symmetric Matrix
The matrix diagonalization has 2 peculiarities:
y1
y1 v1 u1
y1
y2
y 2 v 2 (u1 v 2 ) u1 u 2
y2
y3
y 3 v 3 (u1 v 3 ) u1 (u 2 v 3 ) u 2 u 3
y3
...
Example. Diagonalization of Symmetric Matrix
1 0 0
Let’s see if the matrix A 0 2 1 is diagonalizable.
0 1 2
For this, we look for the diagonal matrix D, the transition matrix C, and the
transition orthogonal matrix U.
1 0 0 1 0 0 1 0 0
0 2 1 0 1 0 0 2 1 1 2 1 0
2
0 1 2 0 0 1 1 2
0
Example. Diagonalization of Symmetric Matrix
1 0 0 1 0 0 1 0 0
0 2 1 0 1 0 0 2 1 1 2 1 0
2
0 1 2 0 0 1 1 2
0
1 2
2
1 1 3 4 1 1 3 0
2
We firstly look for eigenvectors associated to 1 3 that will be all vectos for
which the following expression is satisfied:
A x 3x ( A 3I ) x 0
1 0 0 x 1 0 0 x 0 2 0 0 x 0
0 2 1 y 3 0 1 0 y 0 0 1 1 y 0
0 1 2 z 0 0 1 z 0 0 1 1 z 0
Example:How to obtain eigenvalues and eigenvectors
2 0 0 x 0 The matrix rank is equal to 2, we will have to
0 1 1 y 0 parametrize 1 of unknowns (and eliminate the last
0 1 1 z 0
equation).
Ax x ( A I )x 0
1 0 0 x 1 0 0 x 0 0 0 0 x 0
0 2 1 y 1 0 1 0 y 0 0 1 1 y 0
0 1 2 z 0 0 1 z 0 0 1 1 z 0
Example. Diagonalization of Symmetric Matrix
0 0 0 x 0 The matrix rank is equal to 1, we will have to
0 1 1 y 0 parametrize 2 of unknowns.
0 1 1 z 0 The system is the following:
x x 0 1 0
y z 0
y y 0 0 1
y z 0
z z 0 0 1
D=C-1AC, where
0 1 0
1 0 1
1 0 1
0 0
u 1 v
w 1 1
1u ;1v 0 ;1w
u 1 1 2
2 2 v 1
2 w 1 1 2
2 2
1 0 1
2 2
Example. Diagonalization of Symmetric Matrix
Once we get orthonormal vectors, we can use the transition orthogonal
matrix by diagonalizing our orthogonal matrix A as D=UtAU, since for an
orthogonal matrix U, its inverse matrix coincides with the transposed matrix:
1 1
1 0 0 3 0 0 0 1 0 0
1 1 t 1
2 2
A 0 2 1 , D 0 1 0 ,U 0 , U U 1 0 0
0 1 2 0 0 1
2 2
0 1 1
1 1
0 2 2
2 2