Skip to content Skip to navigation

OpenStax-CNX

You are here: Home » Content » Column Space

Navigation

Lenses

What is a lens?

Definition of a lens

Lenses

A lens is a custom view of the content in the repository. You can think of it as a fancy kind of list that will let you see content through the eyes of organizations and people you trust.

What is in a lens?

Lens makers point to materials (modules and collections), creating a guide that includes their own comments and descriptive tags about the content.

Who can create a lens?

Any individual member, a community, or a respected organization.

What are tags? tag icon

Tags are descriptors added by lens makers to help label content, attaching a vocabulary that is meaningful in the context of the lens.

This content is ...

Affiliated with (What does "Affiliated with" mean?)

This content is either by members of the organizations listed or about topics related to the organizations listed. Click each link to see a list of all content affiliated with the organization.
  • Rice Digital Scholarship

    This module is included in aLens by: Digital Scholarship at Rice UniversityAs a part of collection: "Matrix Analysis"

    Click the "Rice Digital Scholarship" link to see all content affiliated with them.

Also in these lenses

  • Lens for Engineering

    This module is included inLens: Lens for Engineering
    By: Sidney Burrus

    Click the "Lens for Engineering" link to see all content selected in this lens.

Recently Viewed

This feature requires Javascript to be enabled.
 

Column Space

Module by: Doug Daniels, Steven J. Cox. E-mail the authors

Summary: This module defines precisely what a column space is, gives an example of one, and then a method for finding one given an arbitrary matrix.

The Column Space

We begin with the simple geometric interpretation of matrix-vector multiplication. Namely, the multiplication of the n-by-1 vector xx by the m-by-n matrix A A produces a linear combination of the columns of A A. More precisely, if a j a j denotes the j jth column of A A, then

Ax=( a1a2an )( x1 x2 xn )=x1a1+x2a2++xnan A x a1 a2 an x1 x2 xn x1 a1 x2 a2 xn an
(1)
The picture that I wish to place in your mind's eye is that Ax A x lies in the subspace spanned by the columns of A A. This subspace occurs so frequently that we find it useful to distinguish it with a definition.

Definition 1: Column Space
The column space of the m-by-n matrix S is simply the span of the its columns, i.e. RaS Sx x R n Ra S S x x R n . This is a subspace of m m . The notation Ra Ra stands for range in this context.

Example

Let us examine the matrix:

A=( 0100 -1010 0001 ) A 0100 -1010 0001
(2)
The column space of this matrix is:
RaA= x 1 ( 0 -1 0 )+ x 2 ( 1 0 0 )+ x 3 ( 0 1 0 )+ x 4 ( 0 0 1 ) x 4 Ra A x 4 x 1 0 -1 0 x 2 1 0 0 x 3 0 1 0 x 4 0 0 1
(3)

As the third column is simply a multiple of the first, we may write:

RaA= x 1 ( 0 1 0 )+ x 2 ( 1 0 0 )+ x 3 ( 0 0 1 ) x 3 Ra A x 3 x 1 0 1 0 x 2 1 0 0 x 3 0 0 1
(4)

As the three remaining columns are linearly independent we may go no further. In this case, RaA Ra A comprises all of 3 3 .

Method for Finding a Basis

To determine the basis for RaA Ra A (where A A is an arbitrary matrix) we must find a way to discard its dependent columns. In the example above, it was easy to see that columns 1 and 3 were colinear. We seek, of course, a more systematic means of uncovering these, and perhaps other less obvious, dependencies. Such dependencies are more easily discerned from the row reduced form. In the reduction of the above problem, we come very easily to the matrix

A red =( -1010 0100 0001 ) A red -1010 0100 0001
(5)
Once we have done this, we can recognize that the pivot column are the linearly independent columns of A red A red . One now asks how this might help us distinguish the independent columns of A A. For, although the rows of A red A red are linear combinations of the rows of A A, no such thing is true with respect to the columns. The answer is: pay attention to the indices of the pivot columns. In our example, columns {1, 2, 4} are the pivot columns of A red A red and hence the first, second, and fourth columns of A A, i.e.,
( 0 -1 0 )( 1 0 0 )( 0 0 1 ) 0 -1 0 1 0 0 0 0 1
(6)
comprise a basis for RaA Ra A . In general:

Definition 2: A Basis for the Column Space
Suppose A A is m-by-n. If columns c j j= 1 , ... , r j 1 , ... , r c j are the pivot columns of A red A red then columns c j j= 1 , ... , r j 1 , ... , r c j of A A constitute a basis for RaA Ra A .

Content actions

Download module as:

Add module to:

My Favorites (?)

'My Favorites' is a special kind of lens which you can use to bookmark modules and collections. 'My Favorites' can only be seen by you, and collections saved in 'My Favorites' can remember the last module you were on. You need an account to use 'My Favorites'.

| A lens I own (?)

Definition of a lens

Lenses

A lens is a custom view of the content in the repository. You can think of it as a fancy kind of list that will let you see content through the eyes of organizations and people you trust.

What is in a lens?

Lens makers point to materials (modules and collections), creating a guide that includes their own comments and descriptive tags about the content.

Who can create a lens?

Any individual member, a community, or a respected organization.

What are tags? tag icon

Tags are descriptors added by lens makers to help label content, attaching a vocabulary that is meaningful in the context of the lens.

| External bookmarks