ENGI 7825: Linear Algebra Review
Linear Independence
Adapted from Notes Developed by Martin Scharlemann
June 8, 2015
1/9
Background thoughts:
If two non-trivial vectors ~x1 , ~x2 both lie on the same line, then
Span{~x1 , ~x2 } is just that line.
On the other hand, if they don’t lie on the same line, then
Span{~x1 , ~x2 } consists of an entire plane.
So the span of two vectors may be a plane, or it could be
something simpler: either a line, or even just ~0 in the case that
~x1 = ~0 = ~x2 .
2/9
Similarly, if three non-trivial vectors ~x1 , ~x2 , ~x3 ∈ R3 all lie on the
same line, then Span{~x1 , ~x2 , ~x3 } is just that line.
If they don’t all lie on the same line, but lie on the same plane,
then Span{~x1 , ~x2 , ~x3 } is just that plane.
If they don’t all lie in the same plane, then Span{~x1 , ~x2 , ~x3 } is R3 .
3/9
Definition
A set of vectors {~v1 , . . . , ~vk } in Rm is linearly independent if and
only if the only solution to the equation
c1 ~v1 + · · · + ck ~vk = ~0
is the solution ci = 0 for 1 ≤ i ≤ k.
Conversely, the set of vectors {~v1 , . . . , ~vk } is linearly dependent if
there are real numbers c1 , ..., ck , not all zero, such that
c1 ~v1 + · · · + ck ~vk = ~0.
Idea: if the set is linearly independent, then the span is as big as
possible.
If the set is linearly dependent then the span is somehow “thinner”;
you could even remove some vectors and not change the span.
4/9
In pictures:
v2
v1
v3
{~v1 , ~v2 , ~v3 } linearly dependent.
5/9
v2
v1
v3
{~v1 , ~v2 , ~v3 } linearly independent.
6/9
Property 1: If even a single ~vi = ~0 then {~v1 , . . . , ~vk } is linearly
dependent. Why?
Suppose that ~v1 = ~0. Then
1~v1 + 0~v2 + 0~v3 · · · + 0~vk = ~0
yet c1 = 1 6= 0.
Property 2: If even a single ~vi is a multiple of a different ~vj then
{~v1 , . . . , ~vk } is linearly dependent. Example: Let ~v2 = 5~v1 . Then
5~v1 − ~v2 + 0~v3 · · · + 0~vk = ~0
yet c1 = 5 6= 0 (and also c2 = −1 6= 0).
Property 3: If any subset of {~v1 , . . . , ~vk } is linearly dependent, so
is the whole set.
Question: Is this set of vectors linearly dependent, or linearly
independent?
2 3
3 , 4
4 5
A) Dependent since they are 2 vectors in R3 and 2 < 3.
B) Independent since they are 2 vectors in R3 and 2 < 3.
C) Dependent because one is a multiple of the other.
D) Independent because neither is a multiple of the other.
E) Independent because one is a multiple of the other.
Answer: D
8/9
Question: Is this set of vectors linearly dependent, or linearly
independent? (There are two correct answers.)
1 2 −3
2 , 4 , −5
5 10 −13
A) Independent since they are 3 vectors in R3 .
B) Dependent because one is a multiple of the other.
C) Dependent because a subset is dependent.
D) Independent because a subset is independent.
Answer: B and C
9/9