LECTURE 3
VECTOR SPACES
DUONG MINH BUI, PH.D
LECTURER IN ELECTRICAL POWER ENGINEERING
VIETNAMESE - GERMAN UNIVERSITY, BINH DUONG PROVINCE, VIETNAM
EMAIL: [email protected]
CONTENTS
• Vectors in Rn
• Spaces and Subspaces (Invariant Subspaces)
• Four Fundamental Subspaces
• Spanning Sets and Linear Independence
• Basis and Dimension (Change of Basis and Similarity)
• Rank of a Matrix and Systems of Linear Equations
• Linear Transformations
• Classical Least Squares
• Applications of Vector Spaces
5/2/2022 2
PART 2 - GENERAL VECTOR SPACES
• Spaces and Subspaces (Invariant Subspaces)
• Spanning Sets and Linear Independence
• Basis and Dimension (Change of Basis and Similarity)
• Rank of a Matrix and Systems of Linear Equations
• Linear Transformations
• Classical Least Squares
• Applications of Vector Spaces
5/2/2022 3
1. REAL VECTOR SPACES (1)
1.1 Define a vector space and recognize some important vector spaces
• Any set that satisfies these properties (or
axioms) is called a vector space, and
the objects in the set are vectors.
• It is important to realize that the
definition of a vector space below is
precisely that — a definition.
5/2/2022 4
1. REAL VECTOR SPACES (2)
1.1 Define a vector space and recognize some important vector spaces (cont.)
5/2/2022 5
1. REAL VECTOR SPACES (3)
1.1 Define a vector space and recognize some important vector spaces (cont.)
• Zero vector space:
5/2/2022 6
1. REAL VECTOR SPACES (4)
1.1 Define a vector space and recognize some important vector spaces (cont.)
• Rn is vector space:
5/2/2022 7
1. REAL VECTOR SPACES (5)
1.1 Define a vector space and recognize some important vector spaces (cont.)
• The Vector Space of “Infinite Sequences of Real Numbers”
5/2/2022 8
1. REAL VECTOR SPACES (6)
1.1 Define a vector space and recognize some important vector spaces (cont.)
• The Vector Space of “2 × 2 Matrices”
5/2/2022 9
1. REAL VECTOR SPACES (7)
1.1 Define a vector space and recognize some important vector spaces (cont.)
• The Vector Space of " × Matrices”:
5/2/2022 10
1. REAL VECTOR SPACES (8)
1.1 Define a vector space and recognize some important vector spaces (cont.)
• The Vector Space of “Real-Valued Functions” (the Vector Space of continuous):
5/2/2022 11
1. REAL VECTOR SPACES (9)
1.1 Define a vector space and recognize some important vector spaces (cont.)
• The Vector Space of “all Polynomials of Degree 2 or less”
5/2/2022 12
1. REAL VECTOR SPACES (10)
1.1 Define a vector space and recognize some important vector spaces (cont.)
• A Set That Is NOT a Vector Space IF:
5/2/2022 13
1. REAL VECTOR SPACES (11)
1.1 Define a vector space and recognize some important vector spaces (cont.)
• An Unusual Vector Space - Let be the set of positive real numbers
5/2/2022 14
1. REAL VECTOR SPACES (12)
1.1 Define a vector space and recognize some important vector spaces (cont.)
• Summary of Important Vector Spaces
5/2/2022 15
1. REAL VECTOR SPACES (13)
1.1 Define a vector space and recognize some important vector spaces (cont.)
5/2/2022 16
1. REAL VECTOR SPACES (14)
1.2 Sets that are NOT Vector Spaces
The Set of Integers is NOT a Vector Space:
“An integer is a whole number (not a fractional number) that can be positive,
negative, or zero.”
5/2/2022 17
1. REAL VECTOR SPACES (15)
1.2 Sets that are NOT Vector Spaces (cont.)
• The Set of Second-Degree polynomials is not a Vector Space:
5/2/2022 18
1. REAL VECTOR SPACES (16)
1.2 Sets that are NOT Vector Spaces (cont.)
• A Set that is not a Vector Space:
5/2/2022 19
EXERCISES (1)
5/2/2022 20
2. SUBSPACES OF VECTOR SPACES (1)
• Determine whether a subset W of a vector space V is a subspace of V.
• Determine subspaces of Rn.
5/2/2022 21
2. SUBSPACES OF VECTOR SPACES (2)
2.1 Subpaces
5/2/2022 22
2. SUBSPACES OF VECTOR SPACES (3)
2.1 Subpaces (cont.)
5/2/2022 23
2. SUBSPACES OF VECTOR SPACES (4)
2.1 Subpaces (cont.)
5/2/2022 24
2. SUBSPACES OF VECTOR SPACES (5)
2.1 Subpaces (cont.)
5/2/2022 25
2. SUBSPACES OF VECTOR SPACES (6)
2.1 Subpaces (cont.)
(symmetric matrices, upper/lower triangular
matrices, and diagonal matrices)
5/2/2022 26
2. SUBSPACES OF VECTOR SPACES (7)
2.1 Subpaces (cont.) The Set of Singular Matrices is not a Subspace of Mn,n
5/2/2022 27
2. SUBSPACES OF VECTOR SPACES (8)
2.1 Subpaces (cont.)
5/2/2022 28
2. SUBSPACES OF VECTOR SPACES (9)
2.1 Subpaces (cont.)
5/2/2022 29
2. SUBSPACES OF VECTOR SPACES (10)
2.2 Subspace of Rn
5/2/2022 30
2. SUBSPACES OF VECTOR SPACES (11)
2.2 Subspace of Rn (cont.)
5/2/2022 31
2. SUBSPACES OF VECTOR SPACES (12)
2.2 Subspace of Rn (cont.)
• A subspace of R2 is the one that passes through the origin.
• If W is a subset of R2, then it is a subspace if and only if it has one of the forms
listed below.
5/2/2022 32
2. SUBSPACES OF VECTOR SPACES (13)
2.2 Subspace of Rn (cont.)
• Note that the graph of each subset is a plane in R3, but the only subset that is a
subspace is the one represented by a plane that passes through the origin. A subset
W of R3 is a subspace of R3 if and only if it has one of the forms listed below.
5/2/2022 33
2. SUBSPACES OF VECTOR SPACES (14)
2.2 Subspace of Rn (cont.)
5/2/2022 34
EXERCISES (2)
1-4,
5/2/2022 35
EXERCISES (3)
5/2/2022 36
3. SPANNING SETS AND LINEAR INDEPENDENCE (1)
• Write a linear combination of a set of vectors in a vector space V.
• Determine whether a set S of vectors in a vector space V is a spanning set of V.
• Determine whether a set S of vectors in a vector space V is linearly independent.
5/2/2022 37
3. SPANNING SETS AND LINEAR INDEPENDENCE (2)
3.1 Linear Combinations of Vectors in a Vector space
5/2/2022 38
3. SPANNING SETS AND LINEAR INDEPENDENCE (3)
3.1 Linear Combinations of Vectors in a Vector space (cont.)
5/2/2022 39
3. SPANNING SETS AND LINEAR INDEPENDENCE (4)
3.1 Linear Combinations of Vectors in a Vector space (cont.)
5/2/2022 40
3. SPANNING SETS AND LINEAR INDEPENDENCE (5)
3.1 Linear Combinations of Vectors in a Vector space (cont.)
5/2/2022 41
3. SPANNING SETS AND LINEAR INDEPENDENCE (6)
3.2 Spanning Sets
5/2/2022 42
3. SPANNING SETS AND LINEAR INDEPENDENCE (7)
3.2 Spanning Sets (cont.)
5/2/2022 43
3. SPANNING SETS AND LINEAR INDEPENDENCE (8)
3.2 Spanning Sets (cont.)
5/2/2022 44
3. SPANNING SETS AND LINEAR INDEPENDENCE (9)
3.2 Spanning Sets (cont.)
5/2/2022 45
3. SPANNING SETS AND LINEAR INDEPENDENCE (10)
3.2 Spanning Sets (cont.)
The set S1 spans R3 whereas the set S2 does not. The reason for this difference can
be seen in Figure. The vectors in S2 lie in a common plane; the vectors in S1 do not.
What is the
common
plane?
5/2/2022 46
3. SPANNING SETS AND LINEAR INDEPENDENCE (11)
3.2 Spanning Sets (cont.)
5/2/2022 47
3. SPANNING SETS AND LINEAR INDEPENDENCE (12)
3.2 Spanning Sets (cont.)
A procedure for identifying spanning sets
5/2/2022 48
3. SPANNING SETS AND LINEAR INDEPENDENCE (13)
3.2 Spanning Sets (cont.)
A procedure for identifying spanning sets (cont.)
Because det(A) = 0; S does not span P2.
5/2/2022 49
3. SPANNING SETS AND LINEAR INDEPENDENCE (14)
3.2 Spanning Sets (cont.)
5/2/2022 50
3. SPANNING SETS AND LINEAR INDEPENDENCE (15)
3.2 Spanning Sets (cont.)
5/2/2022 51
3. SPANNING SETS AND LINEAR INDEPENDENCE (16)
3.2 Spanning Sets (cont.)
5/2/2022 52
3. SPANNING SETS AND LINEAR INDEPENDENCE (17)
More examples:
5/2/2022 53
3. SPANNING SETS AND LINEAR INDEPENDENCE (18)
More examples (cont.)
5/2/2022 54
3. SPANNING SETS AND LINEAR INDEPENDENCE (19)
3.3 Linear Dependence and Linear Independence (phụ thuộc/độc lập tuyến tính)
5/2/2022 55
3. SPANNING SETS AND LINEAR INDEPENDENCE (20)
3.3 Linear Dependence and Linear Independence (cont.)
5/2/2022 56
3. SPANNING SETS AND LINEAR INDEPENDENCE (21)
3.3 Linear Dependence and Linear Independence (cont.)
5/2/2022 57
3. SPANNING SETS AND LINEAR INDEPENDENCE (22)
3.3 Linear Dependence and Linear Independence (cont.)
5/2/2022 58
3. SPANNING SETS AND LINEAR INDEPENDENCE (23)
5/2/2022 59
3. SPANNING SETS AND LINEAR INDEPENDENCE (24)
3.3 Linear Dependence and Linear Independence (cont.)
5/2/2022 60
3. SPANNING SETS AND LINEAR INDEPENDENCE (25)
3.3 Linear Dependence and Linear Independence (cont.)
5/2/2022 61
3. SPANNING SETS AND LINEAR INDEPENDENCE (26)
3.3 Linear Dependence and Linear Independence (cont.)
5/2/2022 62
3. SPANNING SETS AND LINEAR INDEPENDENCE (27)
5/2/2022 63
3. SPANNING SETS AND LINEAR INDEPENDENCE (28)
5/2/2022 64
4. MORE LINEAR INDEPENDENCE (1)
4.1 A Geometric Interpretation of Linear Independence
5/2/2022 65
4. MORE LINEAR INDEPENDENCE (2)
4.1 A Geometric Interpretation of Linear Independence (cont.)
5/2/2022 66
4. MORE LINEAR INDEPENDENCE (3)
4.2 Linear Independence of Functions
5/2/2022 67
4. MORE LINEAR INDEPENDENCE (4)
4.2 Linear Independence of Functions (cont.)
5/2/2022 68
4. MORE LINEAR INDEPENDENCE (5)
4.2 Linear Independence of Functions (cont.)
5/2/2022 69
EXERCISES (4)
5/2/2022 70
EXERCISES (5)
5/2/2022 71
EXERCISES (6)
5/2/2022 72
HOMEWORK (1)
5/2/2022 73
HOMEWORK (2)
5/2/2022 74
HOMEWORK (3)
5/2/2022 75
THANK YOU VERY MUCH
5/2/2022 76