Lecture (1)
Linear Algebra
MATH 402
MATH402 week (1)
References Book
2
MATH402 week (1)
Contents
Lecture No. Topic
3
1 Systems of Linear Equations
2 Matrices
3 Solving Systems of Linear Equations
4 Determinants and Applications
5-6 Basic properties of Vector Spaces
7 Linear Transformations
8 Affine Spaces
9 Norm, Distance and Orthogonality
10 The Gram-Schmidt process and QR factorization
11 Eigenvalues & Eigenvectors
12 Diagonalization
13 LU decomposition and Cholesky Decomposition
14 week Singular
MATH402 (1) Value Decomposition (SVD) Sunday, August 25, 2024
Grade Distribution
4
ASSESSMENT TASKS MARKS PROPORTION
Midterm Exam 20%
Quizzes (x2) 20%
Participation 5%
Assignments (x3) 15%
Final exam 40%
Total 100%
MATH402 week (1) Sunday, August 25, 2024
Applications of Linear Algebra in Computer Science
5
Linear algebra provides concepts that are crucial to many
areas of computer science, including
• Internet search
• Graph analysis
• Machine learning
• Graphics
• Bioinformatics
• Scientific computing
• Data mining
• Computer vision
• Speech recognition
• Compilers
• Parallel computing
MATH402 week (1) Sunday, August 25, 2024
Outline
6
Ch 1: Systems of Linear Equations and Matrices
Linear Equations
MATH402 week (1) Sunday, August 25, 2024
System of Linear Equations
7
▪ A linear equation in the variables 𝑥1 , … , 𝑥𝑛 is an
equation that can be written in the form
𝑎1 𝑥1 + 𝑎2 𝑥2 + ⋯ + 𝑎𝑛 𝑥𝑛 = 𝑏 ,
where b and the coefficients 𝑎1 , … , 𝑎𝑛 are real or
complex numbers that are usually known in advance.
Example: 𝑥1 − 3𝑥2 = −4 Linear Equation
2𝑥 3 + 3𝑦 −1 + 𝑧 = 8 Non-Linear Equation
MATH402 week (1) Sunday, August 25, 2024
System of Linear Equations
8
▪ A system of linear equations (or a linear system) is
a collection of one or more linear equations involving
the same variables.
2x – y = 6 and x + 3y = 10
MATH402 week (1) Sunday, August 25, 2024
Solution of a System
9
Example: Determine whether the point (– 3, 1) is a solution of the
system:
x – y = – 4 and 2x + 10y = 4
Solution
• Plug the values into the equations.
First equation: – 3 – 1 = – 4 true
Second equation: 2(– 3) + 10(1) = – 6 + 10 = 4 true
• Since the point (– 3, 1) produces a true statement in both
equations, it is a solution.
MATH402 week (1) Sunday, August 25, 2024
Solution of a System
10
Example: Determine whether the point (4, 2) is a solution of the
system:
2x – 5y = – 2 and 3x + 4y = 4
Solution
Plug the values into the equations
First equation: 2(4) – 5(2) = 8 – 10 = – 2 true
Second equation: 3(4) + 4(2) = 12 + 8 = 20 4 false
Since the point (4, 2) produces a false statement in one equation, it
is NOT a solution of the given system
MATH402 week (1) Sunday, August 25, 2024
Finding a Solution by Graphing
2x – y = 6
11 y
Example: Solve the (-5, 5)
following system of
(-2, 4) (6, 6)
equations by graphing.
x + 3y = 10
2x – y = 6 and (4, 2)
(1, 3)
x + 3y = 10
x
Solution: (3, 0)
First, graph 2x – y = 6.
Second, graph x + 3y = 10.
The lines APPEAR to intersect (0, -6)
at (4, 2).
Continued.
MATH402 week (1) Sunday, August 25, 2024
Finding a Solution by Graphing
12
Although the solution to the system of equations appears
to be (4, 2), you still need to check the answer by
substituting x = 4 and y = 2 into the two equations.
First equation,
2(4) – 2 = 8 – 2 = 6 true
Second equation,
4 + 3(2) = 4 + 6 = 10 true
The point (4, 2) is a solution of the system.
MATH402 week (1) Sunday, August 25, 2024
Finding a Solution by Graphing
13 y
Example:
Solve the following system
of equations by graphing. (6, 4)
– x + 3y = 6 and
(0, 2)
3x – 9y = 9 (6, 1)
(3, 0)
Solution: x
(-6, 0)
(0, -1)
First, graph – x + 3y = 6.
Second, graph 3x – 9y = 9.
The lines APPEAR to be parallel.
Continued.
MATH402 week (1) Sunday, August 25, 2024
Finding a Solution by Graphing
14
Although the lines appear to be parallel, you still need to check that they
have the same slope. You can do this by solving for y.
First equation, –x + 3y = 6
3y = x + 6 (add x to both sides)
1
y= x+2 (divide both sides by 3)
3
Second equation, 3x – 9y = 9
–9y = –3x + 9 (subtract 3x from both sides)
1
y= x–1 (divide both sides by –9)
3
1
Both lines have a slope of so they are parallel.
3
Moreover, the y-intercepts are different, so these lines do not intersect.
Hence, there is no solution to the system.
MATH402 week (1) Sunday, August 25, 2024
Finding a Solution by Graphing
15 y
Example:
Solve the following system
of equations by graphing.
x = 3y – 1 and (5, 2)
2x – 6y = –2
(-1, 0) (2, 1)
Solution: x
(-4, -1)
First, graph x = 3y – 1. (7, -2)
Second, graph 2x – 6y = –2.
The lines APPEAR to be identical.
Continued.
MATH402 week (1) Sunday, August 25, 2024
Finding a Solution by Graphing
16
Although the lines appear to be identical, you still need to check
that they are identical equations. You can do this by solving for y.
First equation, x = 3y – 1
3y = x + 1 (add 1 to both sides)
1 1
y= x+ (divide both sides by 3)
3 3
Second equation, 2x – 6y = – 2
–6y = – 2x – 2 (subtract 2x from both sides)
1 1
y= x+ (divide both sides by – 6)
3 3
The two equations are identical, so the graphs must be identical.
There are an infinite number of solutions to the system (all the
points on the line).
MATH402 week (1) Sunday, August 25, 2024
Solving Linear Systems by Graphing
17
There are three possible situations for a system of linear equations in two
variables that have been graphed:
1) The two graphs intersect at a single point.
The coordinates give the solution of the system.
In this case, the solution is “consistent” and the equations are
“independent”.
2) The graphs are parallel lines. (Slopes are equal)
In this case the system is “inconsistent” and the solution set is empty ∅.
3) The graphs are the same line. (Slopes and y-intercepts are the same)
In this case, the equations are “dependent” and the solution set is an
infinite set of ordered pairs.
MATH402 week (1) Sunday, August 25, 2024
Solving Linear Systems by Graphing
18
Let's summarize! There are 4 steps to solve a linear system using a graph.
Solve both equations for y, so that
Step 1: Put both equations in slope -
each equation looks like
intercept form.
y = mx + b.
Use the slope and y - intercept for
Step 2: Graph both equations
each equation in step 1. Be sure to
on the same coordinate plane.
use a ruler and graph paper!
Step 3: Estimate where the graphs
This is the solution! LABEL it!
intersect.
Substitute the x and y values into both
Step 4: Check to make sure your equations to verify the point is a
solution makes both equations true. solution to both equations.
MATH402 week (1) Sunday, August 25, 2024
System of Linear Equations
19
▪ A system of linear equations has
1. no solution, or
2. exactly one solution, or
3. infinitely many solutions.
▪ A system of linear equations is said to be consistent if
it has either one solution or infinitely many solutions.
▪ A system of linear equation is said to be inconsistent
if it has no solution.
MATH402 week (1) Sunday, August 25, 2024
System of Linear Equations
20
Example: How many solutions does the following system have?
3x + y = 1 and 3x + 2y = 6
Solution: Write each equation in slope-intercept form.
First equation, 3x + y = 1
y = –3x + 1 (subtract 3x from both sides)
Second equation, 3x + 2y = 6
2y = –3x + 6 (subtract 3x from both sides)
3 (divide both sides by 2)
𝑦=− 𝑥+3
2
The lines are intersecting lines (since they have different slopes),
so there is one solution.
MATH402 week (1) Sunday, August 25, 2024
Matrix Notation
21
▪ The essential information of a linear system can be recorded
compactly in a rectangular array called a matrix.
▪ For the following system of equations,
𝑥1 − 2𝑥2 + 𝑥3 = 0
2𝑥2 − 8𝑥3 = 8
−4𝑥1 + 5𝑥2 + 9𝑥3 = −9,
1 −2 1
the matrix 0 2 −8 is called the coefficient matrix of the
−4 5 9
system.
MATH402 week (1) Sunday, August 25, 2024
Matrix Notation
22
▪ An augmented matrix of a system consists of the coefficient
matrix with an added column containing the constants from the
right sides of the equations.
▪ For the system of equations,
𝑥1 − 2𝑥2 + 𝑥3 = 0
2𝑥2 − 8𝑥3 = 8
−4𝑥1 + 5𝑥2 + 9𝑥3 = −9,
1 −2 1 0
0 2 −8 8 is called the augmented matrix.
−4 5 9 −9
MATH402 week (1) Sunday, August 25, 2024
