LECTURE 3

VECTOR SPACES
DUONG MINH BUI, PH.D
LECTURER IN ELECTRICAL POWER ENGINEERING
VIETNAMESE - GERMAN UNIVERSITY, BINH DUONG PROVINCE, VIETNAM
EMAIL: [email protected]
 CONTENTS
• Vectors in Rn
• Spaces and Subspaces
• Four Fundamental Subspaces
• Linear Independence
• Basis and Dimension
• Rank of a Matrix and Systems of Linear Equations
• Classical Least Squares
• Linear Transformations
• Change of Basis and Similarity
• Invariant Subspaces
• Applications of Vector Spaces
4/28/2022 2
 PART 1 - EUCLIDEAN VECTOR SPACES
• Vectors in 2-Space, 3-Space, and n-Space
• Norm, Dot Product, and Distance in Rn
• Cross Product

4/28/2022 3
 1. VECTORS IN 2-SPACE, 3-SPACE, AND N-SPACE (1)
1.1 Geometric Vectors
• Engineers and physicists represent vectors in two dimensions (also called 2-space) or
in three dimensions (also called 3-space) by arrows.
• The direction of the arrowhead specifies the direction of the vector and the length of
the arrow specifies the magnitude. Mathematicians call these geometric vectors.
• The tail of the arrow is called the initial point of the vector and the tip for the
terminal point.

(TIP)

(TAIL)

4/28/2022 4
 1. VECTORS IN 2-SPACE, 3-SPACE, AND N-SPACE (2)
1.2 Vector Addition

4/28/2022 5
 1. VECTORS IN 2-SPACE, 3-SPACE, AND N-SPACE (3)
1.3 Vector Subtraction

4/28/2022 6
 1. VECTORS IN 2-SPACE, 3-SPACE, AND N-SPACE (4)
1.4 Scalar Multiplication

4/28/2022 7
 1. VECTORS IN 2-SPACE, 3-SPACE, AND N-SPACE (5)
1.5 Parallel and Collinear Vectors
• Suppose that v and w are vectors in 2-space or 3-space with a common initial
point. If one of the vectors is a scalar multiple of the other, then the vectors lie on
a common line, so it is reasonable to say that they are collinear.

4/28/2022 8
 1. VECTORS IN 2-SPACE, 3-SPACE, AND N-SPACE (6)
1.6 Sums of Three or More Vectors

4/28/2022 9
 1. VECTORS IN 2-SPACE, 3-SPACE, AND N-SPACE (7)
1.7 Vectors in Coordinate Systems

4/28/2022 10
 1. VECTORS IN 2-SPACE, 3-SPACE, AND N-SPACE (8)
1.8 Vectors Whose Initial Point Is Not at the Origin

4/28/2022 11
 1. VECTORS IN 2-SPACE, 3-SPACE, AND N-SPACE (9)
1.8 Vectors Whose Initial Point Is Not at the Origin (cont.)

4/28/2022 12
 1. VECTORS IN 2-SPACE, 3-SPACE, AND N-SPACE (10)
1.9 n-Space

4/28/2022 13
 1. VECTORS IN 2-SPACE, 3-SPACE, AND N-SPACE (11)
1.10 Operations on Vectors in Rn

4/28/2022 14
 1. VECTORS IN 2-SPACE, 3-SPACE, AND N-SPACE (12)
1.10 Operations on Vectors in Rn (cont.)

4/28/2022 15
 1. VECTORS IN 2-SPACE, 3-SPACE, AND N-SPACE (13)
1.10 Operations on Vectors in Rn (cont.)

4/28/2022 16
 1. VECTORS IN 2-SPACE, 3-SPACE, AND N-SPACE (14)
1.11 Linear Combinations

4/28/2022 17
 1. VECTORS IN 2-SPACE, 3-SPACE, AND N-SPACE (15)
1.12 Alternative Notations for Vectors

4/28/2022 18
EXERCISES (1)

4/28/2022 19
EXERCISES (2)

4/28/2022 20
EXERCISES (3)

4/28/2022 21
 2. NORM, DOT PRODUCT, AND DISTANCE IN RN (1)
2.1 Norm of a Vector

4/28/2022 22
 2. NORM, DOT PRODUCT, AND DISTANCE IN RN (2)
2.1 Norm of a Vector (cont.)

4/28/2022 23
 2. NORM, DOT PRODUCT, AND DISTANCE IN RN (3)
2.1 Norm of a Vector (cont.)
The following three familiar facts about vectors in 2 and 3:
• Distances are nonnegative.
• The zero vector is the only vector of length zero.
• Multiplying a vector by a scalar multiplies its length by the absolute value of
that scalar.

4/28/2022 24
 2. NORM, DOT PRODUCT, AND DISTANCE IN RN (4)
2.2 Unit Vectors

• A vector of norm 1 is called a unit vector.

• If v is any nonzero vector in n, then defines a unit vector that is in the

4/28/2022 25
 2. NORM, DOT PRODUCT, AND DISTANCE IN RN (5)
2.2 Unit Vectors (cont.)

4/28/2022 26
 2. NORM, DOT PRODUCT, AND DISTANCE IN RN (6)
2.3 The Standard Unit Vectors

4/28/2022 27
 2. NORM, DOT PRODUCT, AND DISTANCE IN RN (7)
2.3 The Standard Unit Vectors (cont.)

4/28/2022 28
 2. NORM, DOT PRODUCT, AND DISTANCE IN RN (8)
2.4 Distance in Rn

4/28/2022 29
 2. NORM, DOT PRODUCT, AND DISTANCE IN RN (9)
2.4 Distance in Rn (cont.)

4/28/2022 30
 2. NORM, DOT PRODUCT, AND DISTANCE IN RN (10)
2.5 Dot Product

4/28/2022 31
2. NORM, DOT PRODUCT, AND DISTANCE IN RN (11)
2.5 Dot Product (cont.)

4/28/2022 32
2. NORM, DOT PRODUCT, AND DISTANCE IN RN (12)
2.6 Component Form of the Dot Product

4/28/2022 33
2. NORM, DOT PRODUCT, AND DISTANCE IN RN (13)
2.6 Component Form of the Dot Product (cont.)

4/28/2022 34
2. NORM, DOT PRODUCT, AND DISTANCE IN RN (14)
2.7 Algebraic Properties of the Dot Product

4/28/2022 35
2. NORM, DOT PRODUCT, AND DISTANCE IN RN (15)
2.8 Cauchy–Schwarz Inequality and Angles in Rn

4/28/2022 36
2. NORM, DOT PRODUCT, AND DISTANCE IN RN (16)
2.9 Geometry in Rn

4/28/2022 37
2. NORM, DOT PRODUCT, AND DISTANCE IN RN (17)
2.10 Dot Products as Matrix Multiplication

4/28/2022 38
2. NORM, DOT PRODUCT, AND DISTANCE IN RN (18)
2.10 Dot Products as Matrix Multiplication (cont.)

4/28/2022 39
 3. CROSS PRODUCT (1)
3.1 Cross Product of Vectors

1 2 3
1 2 3

4/28/2022 40
 3. CROSS PRODUCT (2)
3.1 Cross Product of Vectors (cont.)

4/28/2022 41
 3. CROSS PRODUCT (3)
3.1 Cross Product of Vectors (cont.)

4/28/2022 42
 3. CROSS PRODUCT (4)
3.2 Determinant Form of Cross Product

4/28/2022 43
 3. CROSS PRODUCT (5)
3.3 Geometric Interpretation of Cross Product

4/28/2022 44
 3. CROSS PRODUCT (6)
3.3 Geometric Interpretation of Cross Product (cont.)

4/28/2022 45
 3. CROSS PRODUCT (7)
3.3 Geometric Interpretation of Cross Product (cont.)

4/28/2022 46
 3. CROSS PRODUCT (8)
3.3 Geometric Interpretation of Cross Product (cont.)

4/28/2022 47
 3. CROSS PRODUCT (9)
3.4 Geometric Interpretation of Determinants

4/28/2022 48
 3. CROSS PRODUCT (10)
3.4 Geometric Interpretation of Determinants (cont.)

4/28/2022 49
EXERCISES (4)

4/28/2022 50
THANK YOU VERY MUCH

4/28/2022 51