Recall that we know how to add two signal/vectors and scale a
vector/signal.
A vector space
VV is a non empty subset of vectors
such that given xx,
y∈V
y
V
,
then
(x+y)∈V
x
y
V
, and given
x∈V
x
V
,
and a scalar αα, then
αx∈V
α
x
V
.
In other words, a vector space is closed under
addition and scaling.
Depending on whether
α∈R
α
or C we can distinguish real
vectors spaces from complex vector spaces.
R,
R2
2
,
R3
3
,
......
RN
N
C,
C2
2
,
C3
3
,
......
CN
N
a line in
R2
2
through the origin
a line in
R3
3
through the origin
a plane in
R3
3
through the origin
...
0
0
A subspace of a vector space is a
subset of the vectors that is itself a vector space.
Vectors lying in a line through the origin in
R2
2
:
Fundamental idea in DSP: split the vector space of all
signals into "signal space" and "noise space".
Why is this reasonable?
Show that the set of all linear combinations of
MM vectors in
RN
N
is a vector space.
If a vector space consists of all linear combinations of
MM vectors, then these vectors
span the vector space. In other words, the
spanning vectors can generate a vector in the vector space.
The vector
11
1
1
spans this subspace in
R2
2
:
The canonical δδ basis,
δ
0
...
δ
N−1
δ
0
...
δ
N
1
,
span
RN
N
.
Can
M<N
M
N
vectors span
RN
N
?
Do
M≥N
M
N
vectors always span
RN
N
?
Is
RN
N
a subspace if
CN
N
?