<?xml version="1.0" encoding="utf-8"?>
<!DOCTYPE document PUBLIC "-//CNX//DTD CNXML 0.5 plus MathML//EN" "http://cnx.rice.edu/cnxml/0.5/DTD/cnxml_mathml.dtd">
<document xmlns="http://cnx.rice.edu/cnxml" xmlns:m="http://www.w3.org/1998/Math/MathML" xmlns:md="http://cnx.rice.edu/mdml/0.4" xmlns:bib="http://bibtexml.sf.net/" id="m10297"> 
  
  <name>Subspaces</name> 
  
  <metadata>
  <md:version>2.5</md:version>
  <md:created>2001/08/09</md:created>
  <md:revised>2002/08/02 00:00:00.005 GMT-5</md:revised>
  <md:authorlist>
      <md:author id="rainking">
      <md:firstname>Doug</md:firstname>
      
      <md:surname>Daniels</md:surname>
      <md:email>rainking@alumni.rice.edu</md:email>
    </md:author>
      <md:author id="cox">
      <md:firstname>Steven</md:firstname>
      
      <md:surname>Cox</md:surname>
      <md:email>cox@rice.edu</md:email>
    </md:author>
  </md:authorlist>

  <md:maintainerlist>
    <md:maintainer id="rainking">
      <md:firstname>Doug</md:firstname>
      
      <md:surname>Daniels</md:surname>
      <md:email>rainking@alumni.rice.edu</md:email>
    </md:maintainer>
    <md:maintainer id="markb">
      <md:firstname>Mark</md:firstname>
      
      <md:surname>Barrett</md:surname>
      <md:email>markb@alumni.rice.edu</md:email>
    </md:maintainer>
    <md:maintainer id="cox">
      <md:firstname>Steven</md:firstname>
      
      <md:surname>Cox</md:surname>
      <md:email>cox@rice.edu</md:email>
    </md:maintainer>
  </md:maintainerlist>
  
  <md:keywordlist>
    <md:keyword>subspace</md:keyword>
    <md:keyword>span</md:keyword>
    <md:keyword>linear independence</md:keyword>
    <md:keyword>basis</md:keyword>
    <md:keyword>dimension</md:keyword>
    <md:keyword>gauss</md:keyword>
    <md:keyword>gaussian</md:keyword>
    <md:keyword>gaussian elimination</md:keyword>
    <md:keyword>matrix methods</md:keyword>
    <md:keyword>matrix</md:keyword>
    <md:keyword>operations</md:keyword>
    <md:keyword>matrix reduction</md:keyword>
  </md:keywordlist>

  <md:abstract>This module defines subspaces, span, linear independence, bases and dimension.</md:abstract>
</metadata>

  <content>
    <section id="definition">
      <name>Subspace</name>
    
      <para id="p1">
	A subspace is a subset of a <cnxn document="m10298" strength="5">vector space</cnxn> that is itself a vector
	space. The simplest example is a line through the origin in
	the plane.  For the line is definitely a subset and if we add
	any two vectors on the line we remain on the line and if we
	multiply any vector on the line by a scalar we remain on the
	line. The same could be said for a line or plane through the
	origin in 3 space. As we shall be travelling in spaces with
	many many dimensions it pays to have a general definition.
	
	<definition id="defn1">
	  <term>A subset <m:math><m:ci>S</m:ci></m:math> of a vector
	  space <m:math><m:ci>V</m:ci></m:math> is a subspace of
	  <m:math><m:ci>V</m:ci></m:math> when</term> <meaning>if
	  <m:math><m:ci>x</m:ci></m:math> and
	  <m:math><m:ci>y</m:ci></m:math> belong to
	  <m:math><m:ci>S</m:ci></m:math> then so does 

	      <m:math>
		<m:apply>
		  <m:plus/>
		  <m:ci>x</m:ci>
		  <m:ci>y</m:ci>
		</m:apply>
	      </m:math>.</meaning>
	    <meaning>if <m:math><m:ci>x</m:ci></m:math> belongs
	  to <m:math><m:ci>S</m:ci></m:math> and
	  <m:math><m:ci>t</m:ci></m:math> is real then
	      <m:math>
		<m:apply>
		  <m:times/>
		  <m:ci>t</m:ci>
		  <m:ci>x</m:ci>
		</m:apply>
	      </m:math> belong to
	  <m:math><m:ci>S</m:ci></m:math>.</meaning>
	</definition>
	
	As these are oftentimes unwieldy objects it pays to look for a
	handful of vectors from which the entire subset may be generated.
	For example, the set of <m:math><m:ci>x</m:ci></m:math> for which 
	<m:math display="inline">
	  <m:apply><m:eq/>
	    <m:apply><m:plus/>
	      <m:ci><m:msub>
		  <m:mi>x</m:mi>
		  <m:mn>1</m:mn>
		</m:msub></m:ci>
	      <m:ci><m:msub>
		  <m:mi>x</m:mi>
		  <m:mn>2</m:mn>
		</m:msub></m:ci>
	      <m:ci><m:msub>
		  <m:mi>x</m:mi>
		  <m:mn>3</m:mn>
		</m:msub></m:ci>
	      <m:ci><m:msub>
		  <m:mi>x</m:mi>
		  <m:mn>4</m:mn>
		</m:msub></m:ci>
	    </m:apply>
	    <m:cn>0</m:cn>
	  </m:apply>
	</m:math>
	constitutes a subspace of
	<m:math display="inline">
	  <m:ci><m:msup>
	      <m:mi>ℝ</m:mi>
	      <m:mn>4</m:mn>
	    </m:msup></m:ci>
	</m:math>.    
	Can you 'see' this set? Do you 'see' that
	<m:math display="block">
	  <m:vector>
	    <m:cn>-1</m:cn><m:cn>-1</m:cn><m:cn>0</m:cn><m:cn>0</m:cn>
	  </m:vector>
	</m:math>
	and
	<m:math display="block">
	  <m:vector>
	    <m:cn>-1</m:cn><m:cn>0</m:cn><m:cn>1</m:cn><m:cn>0</m:cn>
	  </m:vector>
	</m:math>
	and
	<m:math display="block">
	  <m:vector>
	    <m:cn>-1</m:cn><m:cn>0</m:cn><m:cn>0</m:cn><m:cn>1</m:cn>
	  </m:vector>
	</m:math> not only belong to a set but in fact generate all
	possible elements?  More precisely, we say that these vectors
	<term>span</term> the subspace of all possible solutions.
	
	<definition id="defn2">
	  <term>Span</term>
	  <meaning>A finite collection
	    <m:math display="inline">
	      <m:set>
		<m:ci><m:msub>
		    <m:mi>s</m:mi>
		    <m:mn>1</m:mn>
		  </m:msub></m:ci>
		<m:ci><m:msub>
		    <m:mi>s</m:mi>
		    <m:mn>2</m:mn>
		  </m:msub></m:ci>
		<m:ci>…</m:ci>
		<m:ci><m:msub>
		    <m:mi>s</m:mi>
		    <m:mi>n</m:mi>
		  </m:msub></m:ci>
	      </m:set>
	    </m:math>
	    <!-- {s_1,s_2,...,s_n}--> of vectors in the subspace
	    <m:math display="inline"><m:ci>S</m:ci></m:math> is said
	    to span <m:math display="inline"><m:ci>S</m:ci></m:math>
	    if each element of <m:math display="inline"><m:ci>S</m:ci></m:math> can be written as
	    a linear combination of these vectors. That is, if for
	    each
	    <m:math display="inline">
	      <m:apply><m:in/>
		<m:ci>s</m:ci>
		<m:ci>S</m:ci>
	      </m:apply>
	    </m:math> there exist
	    <m:math display="inline"><m:ci>n</m:ci></m:math> reals 
	    <m:math display="inline">
	      <m:set>
		<m:ci><m:msub>
		    <m:mi>x</m:mi>
		    <m:mn>1</m:mn>
		  </m:msub></m:ci>
		<m:ci><m:msub>
		    <m:mi>x</m:mi>
		    <m:mn>2</m:mn>
		  </m:msub></m:ci>
		<m:ci>…</m:ci>
		<m:ci><m:msub>
		    <m:mi>x</m:mi>
		    <m:mi>n</m:mi>
		  </m:msub></m:ci>
	      </m:set>
	    </m:math>
	    <!--x_1,x_2,...,x_n--> 
	    
	    such that 
	    <m:math display="inline">
	      <m:apply><m:eq/>
		<m:ci>s</m:ci>
		<m:apply><m:plus/>
		  <m:apply><m:times/>
		    <m:ci><m:msub>
			<m:mi>x</m:mi>
			<m:mn>1</m:mn>
		      </m:msub></m:ci>
		    <m:ci><m:msub>
			<m:mi>s</m:mi>
			<m:mn>1</m:mn>
		      </m:msub></m:ci>
		  </m:apply>
		  <m:apply><m:times/>
		    <m:ci><m:msub>
			<m:mi>x</m:mi>
			<m:mn>2</m:mn>
		      </m:msub></m:ci>
		    <m:ci><m:msub>
			<m:mi>s</m:mi>
			<m:mn>2</m:mn>
		      </m:msub></m:ci>
		  </m:apply>
		  <m:ci>…</m:ci>
		  <m:apply><m:times/>
		    <m:ci><m:msub>
			<m:mi>x</m:mi>
			<m:mi>n</m:mi>
		      </m:msub></m:ci>
		    <m:ci><m:msub>
			<m:mi>s</m:mi>
			<m:mi>n</m:mi>
		      </m:msub></m:ci>
		  </m:apply>
		</m:apply>
	      </m:apply>
	    </m:math>.
	    <!--s = x_1s_1 + x_2s_2 + ... x_ns_n-->
	  </meaning>
	</definition>
	
	When attempting to generate a subspace as the span of a
	handful of vectors it is natural to ask what is the fewest
	number possible. The notion of linear independence helps us
	clarify this issue.
	
	<definition id="defn3">
	  <term>Linear Independence</term>
	  <meaning>A finite collection
	    <m:math display="inline">
	      <m:set>
		<m:ci><m:msub>
		    <m:mi>s</m:mi>
		    <m:mn>1</m:mn>
		  </m:msub></m:ci>
		<m:ci><m:msub>
		    <m:mi>s</m:mi>
		    <m:mn>2</m:mn>
		  </m:msub></m:ci>
		<m:ci>…</m:ci>
		<m:ci><m:msub>
		    <m:mi>s</m:mi>
		    <m:mi>n</m:mi>
		  </m:msub></m:ci>
	      </m:set>
	    </m:math> <!--{s_1,s_2,...,s_n}--> of vectors is said to
	    be linearly independent when the only reals,
	    <m:math display="inline">
	      <m:set>
		<m:ci><m:msub>
		    <m:mi>x</m:mi>
		    <m:mn>1</m:mn>
		  </m:msub></m:ci>
		<m:ci><m:msub>
		    <m:mi>x</m:mi>
		    <m:mn>2</m:mn>
		  </m:msub></m:ci>
		<m:ci>…</m:ci>
		<m:ci><m:msub>
		    <m:mi>x</m:mi>
		    <m:mi>n</m:mi>
		  </m:msub></m:ci>
	      </m:set>
	    </m:math>
	    <!--x_1,x_2,...,x_n--> for which 
	    <m:math display="inline">
	      <m:apply><m:eq/>
		<m:apply><m:plus/>
		  <m:apply><m:times/>
		    <m:ci><m:msub>
			<m:mi>x</m:mi>
			<m:mn>1</m:mn>
		      </m:msub></m:ci>
		  </m:apply>
		  <m:apply><m:times/>
		    <m:ci><m:msub>
			<m:mi>x</m:mi>
			<m:mn>2</m:mn>
		      </m:msub></m:ci>
		  </m:apply>
		  <m:ci>…</m:ci>
		  <m:apply><m:times/>
		    <m:ci><m:msub>
			<m:mi>x</m:mi>
			<m:mi>n</m:mi>
		      </m:msub></m:ci>
		  </m:apply>
		</m:apply>
		<m:cn>0</m:cn>
	      </m:apply>
	    </m:math><!--x_1s_1 + x_2s_2 + ... x_ns_n =0-->
	    are 
	    <m:math display="inline">
	      <m:apply><m:eq/>
		<m:ci><m:msub>
		    <m:mi>x</m:mi>
		    <m:mn>1</m:mn>
		  </m:msub></m:ci>
		<m:ci><m:msub>
		    <m:mi>x</m:mi>
		    <m:mn>2</m:mn>
		  </m:msub></m:ci>
		<m:ci>…</m:ci>
		<m:ci><m:msub>
		    <m:mi>x</m:mi>
		    <m:mi>n</m:mi>
		  </m:msub></m:ci>
		<m:cn>0</m:cn>
	      </m:apply>
	    </m:math>.
	    <!--x_1=x_2=...=x_n=0--> In other words, when the
	    <cnxn document="m10293" strength="5">null space</cnxn> 
	    of the matrix whose columns are
	    <m:math display="inline">
	      <m:set>
		<m:ci><m:msub>
		    <m:mi>s</m:mi>
		    <m:mn>1</m:mn>
		  </m:msub></m:ci>
		<m:ci><m:msub>
		    <m:mi>s</m:mi>
		    <m:mn>2</m:mn>
		  </m:msub></m:ci>
		<m:ci>…</m:ci>
		<m:ci><m:msub>
		    <m:mi>s</m:mi>
		    <m:mi>n</m:mi>
		  </m:msub></m:ci>
	      </m:set>
	    </m:math> <!--s_1,s_2,...,s_n--> contains only the zero vector.
	  </meaning>
	</definition>
	
	Combining these definitions, we arrive at the precise notion of a
	'generating set.'

	<definition id="defn4">
	  <term>Basis</term>
	  <meaning>Any linearly independent spanning set of a subspace 
	    <m:math display="inline"><m:ci>S</m:ci></m:math> is called
	    a basis of 
	    <m:math display="inline"><m:ci>S</m:ci></m:math>.
	  </meaning>
	</definition>

	Though a subspace may have many bases they all have one thing
	in common:
	
	<definition id="defn5">
	  <term>Dimension</term> <meaning>The dimension of a subspace
	  is the number of elements in its basis.
	  </meaning>
	</definition>
      </para>
    </section>
  </content>
</document>
