<?xml version="1.0" encoding="utf-8" standalone="no"?>
<!DOCTYPE document PUBLIC "-//CNX//DTD CNXML 0.5 plus MathML//EN" "http://cnx.rice.edu/cnxml/0.5/DTD/cnxml_mathml.dtd">
<document xmlns="http://cnx.rice.edu/cnxml" xmlns:md="http://cnx.rice.edu/mdml/0.4" xmlns:m="http://www.w3.org/1998/Math/MathML" xmlns:bib="http://bibtexml.sf.net/" id="m10742">
  
  <name>Eigen-stuff in a Nutshell</name>
  
  <metadata>
  <md:version>2.3</md:version>
  <md:created>2002/07/17</md:created>
  <md:revised>2003/07/24 10:54:43 GMT-5</md:revised>
  <md:authorlist>
      <md:author id="mjhaag">
      <md:firstname>Michael</md:firstname>
      
      <md:surname>Haag</md:surname>
      <md:email>mjhaag@rice.edu</md:email>
    </md:author>
      <md:author id="jrom">
      <md:firstname>Justin</md:firstname>
      
      <md:surname>Romberg</md:surname>
      <md:email>jrom@rice.edu</md:email>
    </md:author>
  </md:authorlist>

  <md:maintainerlist>
    <md:maintainer id="jrom">
      <md:firstname>Justin</md:firstname>
      
      <md:surname>Romberg</md:surname>
      <md:email>jrom@rice.edu</md:email>
    </md:maintainer>
    <md:maintainer id="richb">
      <md:firstname>Richard</md:firstname>
      <md:othername>G.</md:othername>
      <md:surname>Baraniuk</md:surname>
      <md:email>richb@rice.edu</md:email>
    </md:maintainer>
    <md:maintainer id="mjhaag">
      <md:firstname>Michael</md:firstname>
      
      <md:surname>Haag</md:surname>
      <md:email>mjhaag@rice.edu</md:email>
    </md:maintainer>
    <md:maintainer id="mariyah">
      <md:firstname>Mariyah</md:firstname>
      
      <md:surname>Poonawala</md:surname>
      <md:email>mariyah@rice.edu</md:email>
    </md:maintainer>
    <md:maintainer id="prash">
      <md:firstname>Prashant</md:firstname>
      
      <md:surname>Singh</md:surname>
      <md:email>prash@ece.rice.edu</md:email>
    </md:maintainer>
  </md:maintainerlist>
  
  <md:keywordlist>
    <md:keyword>eigen</md:keyword>
    <md:keyword>eigenfunction</md:keyword>
    <md:keyword>eigenfunctions</md:keyword>
    <md:keyword>eigenvalue</md:keyword>
    <md:keyword>eigenvalues</md:keyword>
    <md:keyword>eigenvector</md:keyword>
    <md:keyword>eigenvectors</md:keyword>
    <md:keyword>LTI</md:keyword>
    <md:keyword>span</md:keyword>
    <md:keyword>system</md:keyword>
  </md:keywordlist>

  <md:abstract>This module provides a brief overview and review of the importance of eigenvectors and eigenvalues in analyzing and understanding LTI systems.
</md:abstract>
</metadata>


  <content>
    <section id="sec1">
      <name>A Matrix and its Eigenvector</name>
      <para id="p1_s1">
	The reason we are stressing <cnxn document="m10736" strength="8">eigenvectors</cnxn> and their importance is
	because the action of a matrix <m:math><m:ci>A</m:ci></m:math>
	on one of its eigenvectors <m:math><m:ci type="vector">v</m:ci></m:math> is

	<list id="list1" type="enumerated">
	  <item>
	    extremely easy (and fast) to calculate
	    
	    <equation id="eq1">
	      <m:math>
		<m:apply>
		  <m:eq/>
		  <m:apply>
		    <m:times/>
		    <m:ci>A</m:ci>
		    <m:ci type="vector">v</m:ci>
		  </m:apply>
		  <m:apply>
		    <m:times/>
		    <m:ci>λ</m:ci>
		    <m:ci type="vector">v</m:ci>
		  </m:apply>
		</m:apply>
	      </m:math>
	    </equation>
	    
	    just <emphasis>multiply</emphasis> <m:math><m:ci type="vector">v</m:ci></m:math> by
	    <m:math><m:ci>λ</m:ci> </m:math>.
	  </item>

	  <item>
	    easy to interpret:  <m:math><m:ci>A</m:ci></m:math> just
	    <emphasis>scales</emphasis> <m:math><m:ci type="vector">v</m:ci></m:math>, keeping its direction
	    constant and only altering the vector's length.
	  </item>
	</list>

	If only every vector were an eigenvector of
	<m:math><m:ci>A</m:ci></m:math>....

      </para>   
    </section>

    <section id="sec2">
      <name>Using Eigenvectors' Span</name>
      <para id="p1_sec2">
	Of course, not every vector can be ... BUT ... For certain
	matrices (including ones with distinct eigenvalues,
	<m:math><m:ci>λ</m:ci></m:math>'s), their eigenvectors
	<cnxn document="m10734" target="span_sec" strength="7">span</cnxn> 
	<m:math display="inline">
	  <m:apply>
	    <m:power/>
	    <m:complexes/>
	    <m:ci>n</m:ci>
	  </m:apply>
	</m:math>, meaning that for <emphasis>any</emphasis>
	<m:math display="inline">
	  <m:apply>
	    <m:in/>
	    <m:ci type="vector">x</m:ci>
	    <m:apply>
	      <m:power/>
	      <m:complexes/>
	      <m:ci>n</m:ci>
	    </m:apply>
	  </m:apply>
	</m:math>, we can find 
	<m:math display="inline">
	  <m:apply>
	    <m:in/>
	    <m:apply>
	      <m:set>
		<m:ci><m:msub>
		  <m:mi>α</m:mi>
		  <m:mn>1</m:mn>
		</m:msub></m:ci>
		<m:ci><m:msub>
		  <m:mi>α</m:mi>
		  <m:mn>2</m:mn>
		</m:msub></m:ci>
		<m:ci><m:msub>
		  <m:mi>α</m:mi>
		  <m:mi>n</m:mi>
		</m:msub></m:ci>
	      </m:set>
	    </m:apply>
	    <m:complexes/>
	  </m:apply>
	</m:math>
	such that:

	<equation id="eq2">
	  <m:math>
	    <m:apply>
	      <m:eq/>
	      <m:ci type="vector">x</m:ci>
	      <m:apply>
		<m:plus/>
		<m:apply>
		  <m:times/>
		  <m:ci><m:msub>
		    <m:mi>α</m:mi>
		    <m:mn>1</m:mn>
		  </m:msub></m:ci>
		  <m:ci type="vector">
		    <m:msub>
		      <m:mi>v</m:mi>
		      <m:mn>1</m:mn>
		    </m:msub>
		  </m:ci>
		</m:apply>
		<m:apply>
		  <m:times/>
		  <m:ci><m:msub>
		    <m:mi>α</m:mi>
		    <m:mn>2</m:mn>
		  </m:msub></m:ci>
		  <m:ci type="vector">
		    <m:msub>
		      <m:mi>v</m:mi>
		      <m:mn>2</m:mn>
		    </m:msub>
		  </m:ci>
		</m:apply>
		<m:ci>…</m:ci>
		<m:apply>
		  <m:times/>
		  <m:ci><m:msub>
		    <m:mi>α</m:mi>
		    <m:mi>n</m:mi>
		  </m:msub></m:ci>
		  <m:ci type="vector">
		    <m:msub>
		      <m:mi>v</m:mi>
		      <m:mi>n</m:mi>
		    </m:msub>
		  </m:ci>
		</m:apply>
	      </m:apply>
	    </m:apply>
	  </m:math>
	</equation>

	Given <cnxn target="eq2" strength="7"/>, we can rewrite
	<m:math>
	  <m:apply>
	    <m:eq/>
	    <m:apply>
	      <m:times/>
	      <m:ci>A</m:ci>
	      <m:ci type="vector">x</m:ci>
	    </m:apply>
	    <m:ci type="vector">b</m:ci>
	  </m:apply>
	</m:math>.  This equation is modeled in our LTI system
	pictured below:
      </para>
      
      <figure id="fig1">
	<media type="image/png" src="eigv_sys.png"/>
	<caption>
	  LTI System.
	</caption>
      </figure>

      <para id="p2_sec2">
	<m:math display="block">
	  <m:apply>
	    <m:eq/>
	    <m:ci type="vector">x</m:ci>
	    <m:apply>
	      <m:sum/>
	      <m:domainofapplication>
		<m:ci>i</m:ci>
	      </m:domainofapplication>
	      <m:apply>
		<m:times/>
		<m:ci><m:msub>
		  <m:mi>α</m:mi>
		  <m:mi>i</m:mi>
		</m:msub></m:ci>
		<m:ci type="vector">
		  <m:msub>
		    <m:mi>v</m:mi>
		    <m:mi>i</m:mi>
		  </m:msub>
		</m:ci>
	      </m:apply>
	    </m:apply>
	  </m:apply>
	</m:math>

	<m:math display="block">
	  <m:apply>
	    <m:eq/>
	    <m:ci>b</m:ci>
	    <m:apply>
	      <m:sum/>
	      <m:domainofapplication>
		<m:ci>i</m:ci>
	      </m:domainofapplication>
	      <m:apply>
		<m:times/>
		<m:ci><m:msub>
		  <m:mi>α</m:mi>
		  <m:mi>i</m:mi>
		</m:msub></m:ci>
		<m:ci><m:msub>
		  <m:mi>λ</m:mi>
		  <m:mi>i</m:mi>
		</m:msub></m:ci>
		<m:ci type="vector">
		  <m:msub>
		    <m:mi>v</m:mi>
		    <m:mi>i</m:mi>
		  </m:msub>
		</m:ci>
	      </m:apply>
	    </m:apply>
	  </m:apply>
	</m:math>
	
	The LTI system above represents our <cnxn target="eq1" strength="7"/>.  Below is an illustration of the steps taken
	to go from <m:math><m:ci type="vector">x</m:ci></m:math> to 
	<m:math><m:ci type="vector">b</m:ci></m:math>.
	
	<m:math display="block">
	  <m:apply>
	    <m:tendsto/>
	    <m:apply>
	      <m:tendsto/>
	      <m:apply>
		<m:tendsto/>
		<m:ci type="vector">x</m:ci>
		<m:apply>
		  <m:apply>
		    <m:eq/>
		    <m:ci type="vector">α</m:ci>
		    <m:apply>
		      <m:times/>
		      <m:apply>
			<m:power/>
			<m:ci>V</m:ci>
			<m:cn>-1</m:cn>
		      </m:apply>
		      <m:ci type="vector">x</m:ci>
		    </m:apply>
		  </m:apply>
		</m:apply>
	      </m:apply>
	      <m:apply>
		<m:apply>
		<m:times/>
		<m:ci>Λ</m:ci>
		 <m:apply>
		  <m:power/>
		  <m:ci>V</m:ci>
		  <m:cn>-1</m:cn>
		</m:apply>
		<m:ci type="vector">x</m:ci>
	      </m:apply>
	      </m:apply>
	    </m:apply>
	    <m:apply>
	      <m:eq/>
	      <m:apply>
		<m:times/>
		<m:ci>V</m:ci>
		<m:ci>Λ</m:ci>
		<m:apply>
		  <m:power/>
		  <m:ci>V</m:ci>
		  <m:cn>-1</m:cn>
		</m:apply>
		<m:ci type="vector">x</m:ci>
	      </m:apply>
	      <m:ci type="vector">b</m:ci>
	    </m:apply>
	  </m:apply>
	</m:math>

	where the three steps (arrows) in the above illustration represent
	the following three operations:
	<list id="inter_list" type="enumerated">
	  <item>
	    Transform <m:math><m:ci type="vector">x</m:ci> </m:math>
	    using
	    <m:math>
	      <m:apply>
		<m:power/>
		<m:ci>V</m:ci>
		<m:cn>-1</m:cn>
	      </m:apply>
	    </m:math> - yields 
	    <m:math><m:ci type="vector">α</m:ci></m:math>
	  </item>
	  <item>
	    Action of <m:math><m:ci>A</m:ci></m:math> in new basis -
	    a multiplication by <m:math><m:ci>Λ</m:ci>
	    </m:math>
	  </item>
	  <item>
	    Translate back to old basis - inverse transform using a
	    multiplication by <m:math><m:ci>V</m:ci> </m:math>, which
	    gives us <m:math><m:ci type="vector">b</m:ci></m:math>
	  </item>
	</list>

      </para>
    </section>

  </content>
</document>
