<?xml version="1.0" encoding="utf-8"?>
<!DOCTYPE document PUBLIC "-//CNX//DTD CNXML 0.5 plus MathML//EN" "http://cnx.rice.edu/cnxml/0.5/DTD/cnxml_mathml.dtd">
<document xmlns="http://cnx.rice.edu/cnxml" xmlns:md="http://cnx.rice.edu/mdml/0.4" xmlns:m="http://www.w3.org/1998/Math/MathML" xmlns:bib="http://bibtexml.sf.net/" id="m10784">

  <name>Fourier Analysis in Complex Spaces</name>

  <metadata>
  <md:version>2.7</md:version>
  <md:created>2002/08/05</md:created>
  <md:revised>2006/09/28 13:18:29.284 GMT-5</md:revised>
  <md:authorlist>
      <md:author id="mjhaag">
      <md:firstname>Michael</md:firstname>
      
      <md:surname>Haag</md:surname>
      <md:email>mjhaag@rice.edu</md:email>
    </md:author>
      <md:author id="jrom">
      <md:firstname>Justin</md:firstname>
      
      <md:surname>Romberg</md:surname>
      <md:email>jrom@rice.edu</md:email>
    </md:author>
  </md:authorlist>

  <md:maintainerlist>
    <md:maintainer id="mjhaag">
      <md:firstname>Michael</md:firstname>
      
      <md:surname>Haag</md:surname>
      <md:email>mjhaag@rice.edu</md:email>
    </md:maintainer>
    <md:maintainer id="jrom">
      <md:firstname>Justin</md:firstname>
      
      <md:surname>Romberg</md:surname>
      <md:email>jrom@rice.edu</md:email>
    </md:maintainer>
    <md:maintainer id="richb">
      <md:firstname>Richard</md:firstname>
      <md:othername>G.</md:othername>
      <md:surname>Baraniuk</md:surname>
      <md:email>richb@rice.edu</md:email>
    </md:maintainer>
    <md:maintainer id="mariyah">
      <md:firstname>Mariyah</md:firstname>
      
      <md:surname>Poonawala</md:surname>
      <md:email>mariyah@rice.edu</md:email>
    </md:maintainer>
    <md:maintainer id="prash">
      <md:firstname>Prashant</md:firstname>
      
      <md:surname>Singh</md:surname>
      <md:email>prash@ece.rice.edu</md:email>
    </md:maintainer>
    <md:maintainer id="rvonborries">
      <md:firstname>Ricardo</md:firstname>
      <md:othername>F.</md:othername>
      <md:surname>von Borries</md:surname>
      <md:email>rvonborries@utep.edu</md:email>
    </md:maintainer>
  </md:maintainerlist>
  
  <md:keywordlist>
    <md:keyword>aliasing</md:keyword>
    <md:keyword>basis</md:keyword>
    <md:keyword>complex</md:keyword>
    <md:keyword>complex sinusoids</md:keyword>
    <md:keyword>discrete</md:keyword>
    <md:keyword>discrete time fourier series</md:keyword>
    <md:keyword>dtfs</md:keyword>
    <md:keyword>fourier</md:keyword>
    <md:keyword>fourier analysis</md:keyword>
    <md:keyword>fourier series</md:keyword>
    <md:keyword>harmonic</md:keyword>
    <md:keyword>harmonic sinusoids</md:keyword>
    <md:keyword>orthonormal</md:keyword>
    <md:keyword>orthonormal basis</md:keyword>
  </md:keywordlist>

  <md:abstract>This modules derives the Discrete-Time Fourier Series (DTFS), which is a fourier series type expansion for discrete-time, periodic functions. The module also takes some time to review complex sinusoids which will be used as our basis.</md:abstract>
</metadata>

  <content>
    <section id="intro">
      <name>Introduction</name>
      <para id="p1_int">
	By now you should be familiar with the derivation of the <cnxn document="m10496" strength="8">Fourier series</cnxn> for
	continuous-time, <cnxn document="m10744" strength="8">periodic</cnxn> functions.  This derivation leads
	us to the following equations that you should be quite
	familiar with:

	<equation id="eq1">
	  <m:math>
	    <m:apply>
	      <m:eq/>
	      <m:apply>
		<m:ci type="fn">f</m:ci>
		<m:ci>t</m:ci>
	      </m:apply>
	      <m:apply>
		<m:sum/>
		<m:bvar>
		  <m:ci>n</m:ci>
		</m:bvar>
		<m:domainofapplication>
		  <m:ci>n</m:ci>
		</m:domainofapplication>
		<m:apply>
		  <m:times/>
		  <m:msub>
		    <m:mi>c</m:mi>
		    <m:mi>n</m:mi>
		  </m:msub>
		  <m:apply>
		    <m:exp/>
		    <m:apply>
		      <m:times/>
		      <m:imaginaryi/>
		      <m:ci><m:msub>
			  <m:mi>ω</m:mi>
			  <m:mn>0</m:mn>
			</m:msub></m:ci>
		      <m:ci>n</m:ci>
		      <m:ci>t</m:ci>
		    </m:apply>
		  </m:apply>
		</m:apply>
	      </m:apply>
	    </m:apply>
	  </m:math>
	</equation>
      
	<equation id="eq2">
	  <m:math>
	    <m:apply>
	      <m:eq/>
	      <m:ci><m:msub>
		  <m:mi>c</m:mi>
		  <m:mi>n</m:mi>
		</m:msub></m:ci>
	      <m:apply>
		<m:times/>
		<m:apply>
		  <m:divide/>
		  <m:cn>1</m:cn>
		  <m:ci>T</m:ci>
		</m:apply>
		<m:apply>
		  <m:int/>
		  <m:bvar>
		    <m:ci>t</m:ci>
		  </m:bvar>
		  <m:domainofapplication>
		    <m:ci>n</m:ci>
		  </m:domainofapplication>
		  <m:apply>
		    <m:times/>
		    <m:apply>
		      <m:ci type="fn">f</m:ci>
		      <m:ci>t</m:ci>
		    </m:apply>
		    <m:apply>
		      <m:exp/>
		      <m:apply>
			<m:minus/>
			<m:apply>
			  <m:times/>
			  <m:imaginaryi/>
			  <m:ci><m:msub>
			      <m:mi>ω</m:mi>
			      <m:mn>0</m:mn>
			    </m:msub></m:ci>
			  <m:ci>n</m:ci>
			  <m:ci>t</m:ci>
			</m:apply>
		      </m:apply>
		    </m:apply>
		  </m:apply>
		</m:apply>
	      </m:apply>
	      <m:apply>
		<m:times/>
		<m:apply>
		  <m:divide/>
		  <m:cn>1</m:cn>
		  <m:ci>T</m:ci>
		</m:apply>
		<m:apply>
		  <m:scalarproduct/>
		  <m:ci>f</m:ci>
		  <m:apply>
		    <m:exp/>
		    <m:apply>
		      <m:times/>
		      <m:imaginaryi/>
		      <m:ci><m:msub>
			  <m:mi>ω</m:mi>
			  <m:mn>0</m:mn>
			</m:msub></m:ci>
		      <m:ci>n</m:ci>
		      <m:ci>t</m:ci>
		    </m:apply>
		  </m:apply>
		</m:apply>
	      </m:apply>
	    </m:apply>	    
	  </m:math>
	</equation>

	where 
	<m:math>
	  <m:ci><m:msub>
	      <m:mi>c</m:mi>
	      <m:mi>n</m:mi>
	    </m:msub></m:ci>
	</m:math>
	tells us the amount of frequency
	<m:math>
	  <m:apply>
	    <m:times/>
	    <m:ci><m:msub>
		<m:mi>ω</m:mi>
		<m:mn>0</m:mn>
	      </m:msub></m:ci>
	    <m:ci>n</m:ci>
	  </m:apply>
	</m:math>
	in
	<m:math>
	  <m:apply>
	    <m:ci type="fn">f</m:ci>
	    <m:ci>t</m:ci>
	  </m:apply>
	</m:math>.
      </para>   

      <para id="p2_int">
	In this module, we will derive a similar expansion for
	discrete-time, periodic functions.  In doing so, we will
	derive the <term>Discrete Time Fourier Series</term> (DTFS),
	or the <cnxn strength="7" document="m10249">Discrete Fourier   
        Transform</cnxn> (DFT).
      </para>
    </section>


    <section id="sec2">
      <name>Derivation of DTFS</name>
      <para id="p1_sec2">
	Much like a periodic, continuous-time function can be thought
	of as a function on the interval
	<m:math>
	  <m:interval>
	    <m:cn>0</m:cn>
	    <m:ci>T</m:ci>
	  </m:interval>
	</m:math>
      </para>
      
      <figure orient="horizontal" id="fanal_figs">
	<subfigure id="subf1">
	  <media type="image/png" src="fanal1.png"/>
	  <caption>
	    Periodic Function
	  </caption>
	</subfigure>
	<subfigure id="subf2">
	  <media type="image/png" src="fanal2.png"/>
	  <caption>
	    Function on the interval 
	    <m:math>
	      <m:interval>
		<m:cn>0</m:cn>
		<m:ci>T</m:ci>
	      </m:interval>
	    </m:math>
	  </caption>
	</subfigure>
	<caption>
	  We will just consider one interval of the periodic function
	  throughout this section. 
	</caption>
      </figure>

      <para id="p2_sec2">
	A periodic, discrete-time signal (with period
	<m:math><m:ci>N</m:ci></m:math>) can be thought of as a
	<emphasis>finite</emphasis> set of numbers.  For example, say
	we have the following set of numbers that describe a periodic,
	discrete-time signal, where
	<m:math>
	  <m:apply>
	    <m:eq/>
	    <m:ci>N</m:ci>
	    <m:cn>4</m:cn>
	  </m:apply>
	</m:math>:

	<m:math display="block">
	  <m:set>
	    <m:ci>…</m:ci>
	    <m:cn>3</m:cn>
	    <m:cn>2</m:cn>
	    <m:cn>-2</m:cn>
	    <m:cn>1</m:cn>
	    <m:cn>3</m:cn>
	    <m:ci>…</m:ci>
	  </m:set>
	</m:math>
	
	We can represent this signal as either a periodic signal or as
	just a single interval as follows:
      </para>

      <figure orient="horizontal" id="fanal_dis">
	<subfigure id="subf1_dis">
	  <media type="image/png" src="fanal3.png"/>
	  <caption>
	    Periodic Function
	  </caption>
	</subfigure>
	<subfigure id="subf2_dis">
	  <media type="image/png" src="fanal4.png"/>
	  <caption>
	    Function on the interval 
	    <m:math>
	      <m:interval>
		<m:cn>0</m:cn>
		<m:ci>T</m:ci>
	      </m:interval>
	    </m:math>
	  </caption>
	</subfigure>
	<caption>
	  Here we can look at just one period of the signal that has a
	  vector length of four and is contained in 
	  <m:math>
	    <m:apply>
	      <m:power/>
	      <m:complexes/>
	      <m:cn>4</m:cn>
	    </m:apply>
	  </m:math>.		 
	</caption>
      </figure>
      
      <para id="p3_sec2">
	<note type="note">
	  The set of discrete time signals with period
	  <m:math><m:ci>N</m:ci></m:math> equal 
	   <m:math>
	    <m:apply>
	      <m:power/>
	      <m:complexes/>
	      <m:ci>N</m:ci>
	    </m:apply>
	  </m:math>.
	</note>
      
	Just like the continuous case, we are going to form a basis
	using <term>harmonic sinusoids</term>.  Before we look into
	this, it will be worth our time to look at the discrete-time,
	complex sinusoids in a little more detail.
      </para>
      
      <section id="sub1_s2">
	<name>Complex Sinusoids</name>
	<para id="p1_s1s2">
	  If you are familiar with the basic <cnxn document="m0004" strength="8">sinusoid signal</cnxn> and with <cnxn document="m10060" strength="8">complex exponentials</cnxn>
	  then you should not have any problem understanding this
	  section.  In most texts, you will see the the discrete-time,
	  complex sinusoid noted as:

	  <m:math display="block">
	    <m:apply>
	      <m:exp/>
	      <m:apply>
		<m:times/>
		<m:imaginaryi/>
		<m:ci>ω</m:ci>
		<m:ci>n</m:ci>
	      </m:apply>
	    </m:apply>
	  </m:math>
	</para>


	<example id="eg1_cmplxsin">	  
	  <figure id="fig1">
	    <media type="image/png" src="csin1.png"/>
	    <caption>
	      Complex sinusoid with frequency 
	      <m:math>
		<m:apply>
		  <m:eq/>
		  <m:ci>ω</m:ci>
		  <m:cn>0</m:cn>
		</m:apply>
	      </m:math>
	    </caption>
	  </figure>
	</example>


	<example id="eg2_cmplxsin">	  
	  <figure id="fig2">
	    <media type="image/png" src="csin2.png"/>
	    <caption>
	      Complex sinusoid with frequency 
	      <m:math>
		<m:apply>
		  <m:eq/>
		  <m:ci>ω</m:ci>
		  <m:apply>
		    <m:divide/>
		    <m:pi/>
		    <m:cn>4</m:cn>
		  </m:apply>		  
		</m:apply>
	      </m:math>
	    </caption>
	  </figure>
	</example>

	
	<section id="ssub1">
	  <name>In the Complex Plane</name>
	  <para id="p1_ssub1">
	    The complex sinusoid can be directly mapped onto our <cnxn document="m10596" strength="8">complex plane</cnxn>, which
	    allows us to easily visualize changes to the complex
	    sinusoid and extract certain properties.  The absolute
	    value of our complex sinusoid has the following
	    characteristic:

	    <equation id="eq3">
	      <m:math>
		<m:apply>
		  <m:forall/>
		  <m:bvar>
		    <m:ci>n</m:ci>
		  </m:bvar>
		  <m:condition>
		    <m:apply>
		      <m:in/>
		      <m:ci>n</m:ci>
		      <m:reals/>
		    </m:apply>
		  </m:condition>
		  <m:apply>
		    <m:eq/>
		    <m:apply>
		      <m:abs/>
		      <m:apply>
			<m:exp/>
			<m:apply>
			  <m:times/>
			  <m:imaginaryi/>
			  <m:ci>ω</m:ci>
			  <m:ci>n</m:ci>
			</m:apply>
		      </m:apply>
		    </m:apply>
		    <m:cn>1</m:cn>
		  </m:apply>
		</m:apply>
	      </m:math>
	    </equation>
	    
	    which tells that our complex sinusoid only takes values on
	    the unit circle.  As for the angle, the following
	    statement holds true:

	    <equation id="eq4">
	      <m:math>
		<m:apply>
		  <m:eq/>
		  <m:apply>
		    <m:ci><m:mo>∠</m:mo></m:ci>
		    <m:apply>
		      <m:exp/>
		      <m:apply>
			<m:times/>
			<m:imaginaryi/>
			<m:ci>ω</m:ci>
			<m:ci>n</m:ci>
		      </m:apply>
		    </m:apply>
		  </m:apply>
		  <m:apply>
		    <m:times/>
		    <m:ci>w</m:ci>
		    <m:ci>n</m:ci>
		  </m:apply>
		</m:apply>
	      </m:math>
	    </equation>
	  </para>
	  
	
	  <para id="p2_ssub1">
	    As <m:math><m:ci>n</m:ci></m:math> increases, we can
	    picture
	    <m:math display="inline">
	      <m:apply>
		<m:exp/>
		<m:apply>
		  <m:times/>
		  <m:imaginaryi/>
		  <m:ci>ω</m:ci>
		  <m:ci>n</m:ci>
		</m:apply>
	      </m:apply>
	    </m:math> equaling the values we get moving
	    counterclockwise around the unit circle.  See <cnxn target="cir_series"/> for an illustration:
	  </para>


	  <figure orient="horizontal" id="cir_series">
	    <subfigure id="cirsubf1">
	      <media type="image/png" src="fanalcir2.png"/>
	      <caption>
		<m:math>
		  <m:apply>
		    <m:eq/>
		    <m:ci>n</m:ci>
		    <m:cn>0</m:cn>
		  </m:apply>
		</m:math>
	      </caption>
	    </subfigure>
	    <subfigure id="cirsubf2">
	      <media type="image/png" src="fanalcir3.png"/>
	      <caption>
		<m:math>
		  <m:apply>
		    <m:eq/>
		    <m:ci>n</m:ci>
		    <m:cn>1</m:cn>
		  </m:apply>
		</m:math>
	      </caption>
	    </subfigure>
	    <subfigure id="cirsubf3">
	      <media type="image/png" src="fanalcir4.png"/>
	      <caption>
		<m:math>
		  <m:apply>
		    <m:eq/>
		    <m:ci>n</m:ci>
		    <m:cn>2</m:cn>
		  </m:apply>
		</m:math>
	      </caption>
	    </subfigure>
	    <caption>
	      These images show that as <m:math><m:ci>n</m:ci>
	      </m:math> increases, the value of 
	      <m:math display="inline">
		<m:apply>
		  <m:exp/>
		  <m:apply>
		    <m:times/>
		    <m:imaginaryi/>
		    <m:ci>ω</m:ci>
		    <m:ci>n</m:ci>
		  </m:apply>
		</m:apply>
	      </m:math> 
	      moves around the unit circle counterclockwise.	      
	    </caption>
	  </figure>

	  <para id="p3_ssub1">
	    <note type="note">
	      For 
	      <m:math display="inline">
		<m:apply>
		  <m:exp/>
		  <m:apply>
		    <m:times/>
		    <m:imaginaryi/>
		    <m:ci>ω</m:ci>
		    <m:ci>n</m:ci>
		  </m:apply>
		</m:apply>
	      </m:math> 
	      to be <cnxn document="m10744" strength="8">periodic</cnxn>, we need
	      <m:math display="inline">
		<m:apply>
		  <m:eq/>
		  <m:apply>
		    <m:exp/>
		    <m:apply>
		      <m:times/>
		      <m:imaginaryi/>
		      <m:ci>ω</m:ci>
		      <m:ci>N</m:ci>
		    </m:apply>
		  </m:apply>
		  <m:cn>1</m:cn>
		</m:apply>
	      </m:math> 
	      for some <m:math><m:ci>N</m:ci></m:math>.
	    </note>
	  </para>

	  <example id="eg3">
	    <para id="p1_eg3">
	      For our first example let us look at a periodic signal
	      where
	      <m:math>
		<m:apply>
		  <m:eq/>
		  <m:ci>ω</m:ci>		
		  <m:apply>
		    <m:divide/>
		    <m:apply>
		      <m:times/>
		      <m:cn>2</m:cn>
		      <m:pi/>
		    </m:apply>
		    <m:cn>7</m:cn>
		  </m:apply>
		</m:apply>
	      </m:math>
	      and 
	      <m:math>
		<m:apply>
		  <m:eq/>
		  <m:ci>N</m:ci>
		  <m:cn>7</m:cn>
		</m:apply>
	      </m:math>.
	    </para>
		
	    <figure orient="horizontal" id="fcir_examples">
	      <subfigure id="subegf1">
		<media type="image/png" src="fcirN1.png"/>
		<caption>
		  <m:math>
		    <m:apply>
		      <m:eq/>
		      <m:ci>N</m:ci>
		      <m:cn>7</m:cn>
		    </m:apply>
		  </m:math>
		</caption>
	      </subfigure>	      
	      <subfigure id="subegf2">
		<media type="image/png" src="fplot1.png"/>
		<caption>
		  Here we have a plot of 
		  <m:math>
		    <m:apply>
		      <m:real/>
		      <m:apply>
			<m:exp/>
			<m:apply>
			  <m:times/>
			  <m:imaginaryi/>
			  <m:apply>
			    <m:divide/>
			    <m:apply>
			      <m:times/>
			      <m:cn>2</m:cn>
			      <m:pi/>
			    </m:apply>
			    <m:cn>7</m:cn>
			  </m:apply>
			  <m:ci>n</m:ci>
			</m:apply>
		      </m:apply>
		    </m:apply>
		  </m:math>.
		</caption>
	      </subfigure>
	    </figure>	    
	  </example>


	  <example id="eg4">
	    <para id="p1_eg4">
	      Now let us look at the results of plotting a
	      non-periodic signal where
	      <m:math>
		<m:apply>
		  <m:eq/>
		  <m:ci>ω</m:ci>		
		  <m:cn>1</m:cn>
		</m:apply>
	      </m:math>
	      and 
	      <m:math>
		<m:apply>
		  <m:eq/>
		  <m:ci>N</m:ci>
		  <m:cn>7</m:cn>
		</m:apply>
	      </m:math>.
	    </para>
		
	    <figure orient="horizontal" id="fcir_examples2">
	      <subfigure id="subeg2f1">
		<media type="image/png" src="fcirN2.png"/>
		<caption>
		  <m:math>
		    <m:apply>
		      <m:eq/>
		      <m:ci>N</m:ci>
		      <m:cn>7</m:cn>
		    </m:apply>
		  </m:math>
		</caption>
	      </subfigure>	      
	      <subfigure id="subeg2f2">
		<media type="image/png" src="fplot2.png"/>
		<caption>
		  Here we have a plot of 
		  <m:math>
		    <m:apply>
		      <m:real/>
		      <m:apply>
			<m:exp/>
			<m:apply>
			  <m:times/>
			  <m:imaginaryi/>
			  <m:ci>n</m:ci>
			</m:apply>
		      </m:apply>
		    </m:apply>
		  </m:math>.
		</caption>
	      </subfigure>
	    </figure>
	  </example>
	</section>


	<section id="ssub2">
	  <name>Aliasing</name>
	  <para id="p1_ssub2">
	    Our complex sinusoids have the following property:

	    <equation id="eq5">
	      <m:math>
		<m:apply>
		  <m:eq/>
		  <m:apply>
		    <m:exp/>
		    <m:apply>
		      <m:times/>
		      <m:imaginaryi/>
		      <m:ci>ω</m:ci>
		      <m:ci>n</m:ci>
		    </m:apply>
		  </m:apply>
		  <m:apply>
		    <m:exp/>
		    <m:apply>
		      <m:times/>
		      <m:imaginaryi/>
		      <m:apply>
			<m:plus/>
			<m:ci>ω</m:ci>
			<m:apply>
			  <m:times/>
			  <m:cn>2</m:cn>
			  <m:pi/>
			</m:apply>
		      </m:apply>
		      <m:ci>n</m:ci>
		    </m:apply>
		  </m:apply>
		</m:apply>
	      </m:math>
	    </equation>

	    Given this property, if we have a sinusoid with frequency
	    <m:math>
	      <m:apply>
		<m:plus/>
		<m:ci>ω</m:ci>
		<m:apply>
		  <m:times/>
		  <m:cn>2</m:cn>
		  <m:pi/>
		</m:apply>
	      </m:apply>
	    </m:math>, then this signal "aliases" to a sinusoid with
	    frequency <m:math><m:ci>ω</m:ci></m:math>.

	    <note type="note">
	      Each 
	      <m:math>
		<m:apply>
		  <m:exp/>
		  <m:apply>
		    <m:times/>
		    <m:imaginaryi/>
		    <m:ci>ω</m:ci>
		    <m:ci>n</m:ci>
		  </m:apply>
		</m:apply>
	      </m:math>
	      is unique for 
	      <m:math display="inline">
		<m:apply>
		  <m:in/>
		  <m:ci>ω</m:ci>
		  <m:apply>
		    <m:interval closure="closed-open">
		      <m:cn>0</m:cn>
		      <m:apply>
			<m:times/>
			<m:cn>2</m:cn>
			<m:pi/>
		      </m:apply>
		    </m:interval>
		  </m:apply>
		</m:apply>
	      </m:math>
	    </note>
	  </para>
	</section>

	<section id="ssub3">
	  <name>"Negative" Frequencies</name>
	  <para id="p1_ss3">
	    If we are given a signal with frequency
	    <m:math display="inline">
	      <m:apply>
		<m:lt/>
		<m:apply>
		  <m:lt/>
		  <m:pi/>
		  <m:ci>ω</m:ci>
		</m:apply>
		<m:apply>
		  <m:times/>
		  <m:cn>2</m:cn>
		  <m:pi/>
		</m:apply>
	      </m:apply>
	    </m:math>, then this signal will be represented on our
	    complex plane as:
	  </para>

	  <figure orient="horizontal" id="fig8">
	    <subfigure id="sfig8_1">
	      <media type="image/png" src="fanal_neg1.png"/>
	    </subfigure>
	    <subfigure id="sfig8_2">
	      <media type="image/png" src="fanal_neg2.png"/>
	    </subfigure>
	    <caption>
	      Plot of our complex sinusoid with a frequency greater
	      than <m:math><m:pi/></m:math>.
	    </caption>
	  </figure>

	  <para id="p2_ss3">
	    From the above images, the value of our complex sinusoid
	    on the complex plane may be more easily interpreted as
	    cycling "backwards" (clockwise) around the unit circle
	    with frequency
	    <m:math>
	      <m:apply>
		<m:minus/>
		<m:apply>
		  <m:times/>
		  <m:cn>2</m:cn>
		  <m:pi/>
		</m:apply>
		<m:ci>ω</m:ci>
	      </m:apply>
	    </m:math>.  Rotating counterclockwise by
	    <m:math><m:ci>w</m:ci></m:math> is the same as rotating
	    clockwise by 
	     <m:math>
	      <m:apply>
		<m:minus/>
		<m:apply>
		  <m:times/>
		  <m:cn>2</m:cn>
		  <m:pi/>
		</m:apply>
		<m:ci>ω</m:ci>
	      </m:apply>
	    </m:math>.
	  </para>
	  
	  <example id="eg5">
	    <para id="p1_eg5">
	      Let us plot our complex sinusoid, 
	      <m:math display="inline">
		<m:apply>
		  <m:exp/>
		  <m:apply>
		    <m:times/>
		    <m:imaginaryi/>
		    <m:ci>ω</m:ci>
		    <m:ci>n</m:ci>
		  </m:apply>
		</m:apply>
	      </m:math>, where we have
	      <m:math>
		<m:apply>
		  <m:eq/>
		  <m:ci>ω</m:ci>
		  <m:apply>
		    <m:divide/>
		    <m:apply>
		      <m:times/>
		      <m:cn>5</m:cn>
		      <m:pi/>
		    </m:apply>
		    <m:cn>4</m:cn>
		  </m:apply>
		</m:apply>
	      </m:math> and 
	      <m:math>
		<m:apply>
		  <m:eq/>
		  <m:ci>n</m:ci>
		  <m:cn>1</m:cn>
		</m:apply>
	      </m:math>.
	    </para>

	    <figure id="fig9">
	      <media type="image/png" src="fanal_neg3.png"/>
	      <caption>
		The above plot of our given frequency is identical to
		that of one where 
		<m:math>
		  <m:apply>
		    <m:eq/>
		    <m:ci>ω</m:ci>
		    <m:apply>
		      <m:minus/>
		      <m:apply>
			<m:divide/>
			<m:apply>
			  <m:times/>
			  <m:cn>3</m:cn>
			  <m:pi/>
			</m:apply>
			<m:cn>4</m:cn>
		      </m:apply>
		    </m:apply>
		  </m:apply>
		</m:math>.
	      </caption>
	    </figure>

	    <para id="p2_eg5">
	      This plot is the same as a sinusoid with "negative"
	      frequency 
	      <m:math>
		<m:apply>
		  <m:minus/>
		  <m:apply>
		    <m:divide/>
		    <m:apply>
		      <m:times/>
		      <m:cn>3</m:cn>
		      <m:pi/>
		    </m:apply>
		    <m:cn>4</m:cn>
		  </m:apply>
		</m:apply>
	      </m:math>.
	 
	      <note type="point">
		It makes more physical sense to chose 
		<m:math>
		  <m:apply>
		    <m:interval closure="closed-open">
		      <m:apply>
			<m:minus/>
			<m:pi/>
		      </m:apply>
		      <m:pi/>
		    </m:interval>
		  </m:apply>
		</m:math> 
		as the interval for <m:math><m:ci>ω</m:ci>
		</m:math>.
	      </note>
	      
	    </para>
	  </example>
	  
	  <para id="p3_ssub3">
	    Remember that 
	    <m:math>
	      <m:apply>
		<m:exp/>
		<m:apply>
		  <m:times/>
		  <m:imaginaryi/>
		  <m:ci>ω</m:ci>
		  <m:ci>n</m:ci>
		</m:apply>
	      </m:apply>
	    </m:math> and
	    <m:math>
	      <m:apply>
		<m:exp/>
		<m:apply>
		  <m:minus/>
		  <m:apply>
		    <m:times/>
		    <m:imaginaryi/>
		    <m:ci>ω</m:ci>
		    <m:ci>n</m:ci>
		  </m:apply>
		</m:apply>
	      </m:apply>
	    </m:math>
	    are <term>conjugates</term>.  This gives us the following
	    notation and property:

	    <equation id="eq6">
	      <m:math>
		<m:apply>
		  <m:eq/>
		  <m:apply>
		    <m:conjugate/>
		    <m:apply>
		      <m:exp/>
		      <m:apply>
			<m:times/>
			<m:imaginaryi/>
			<m:ci>ω</m:ci>
			<m:ci>n</m:ci>
		      </m:apply>
		    </m:apply>
		  </m:apply>
		  <m:apply>
		    <m:exp/>
		    <m:apply>
		      <m:minus/>
		      <m:apply>
			<m:times/>
			<m:imaginaryi/>
			<m:ci>ω</m:ci>
			<m:ci>n</m:ci>
		      </m:apply>
		    </m:apply>
		  </m:apply>
		</m:apply>
	      </m:math>
	    </equation>

	    The real parts of of both exponentials in the above
	    equation are the same; the imaginary parts are negative of
	    one another.  This idea is the basic definition of a
	    conjugate.	    
	  </para>
	</section>
      </section>

      <para id="p4_sec2">
	Now that we have looked over the concepts of complex
	sinusoids, let us turn our attention back to finding a basis
	for discrete-time, periodic signals.  After looking at all the
	complex sinusoids, we must answer the question of which
	discrete-time sinusoids do we need to represent periodic
	sequences with a period <m:math><m:ci>N</m:ci></m:math>.
	
	<note type="Equivalent Question">
	  Find a set of vectors 
	  <m:math>
	    <m:apply>
	      <m:forall/>
	      <m:bvar>
		<m:ci>n</m:ci>
	      </m:bvar>
	      <m:condition>
		<m:apply>
		  <m:eq/>
		  <m:ci>n</m:ci>
		  <m:set>
		    <m:cn>0</m:cn>
		    <m:ci>…</m:ci>
		    <m:apply>
		      <m:minus/>
		      <m:ci>N</m:ci>
		      <m:cn>1</m:cn>
		    </m:apply>
		  </m:set>
		</m:apply>
	      </m:condition>
	      <m:apply>
		<m:eq/>
		<m:ci type="vector">
		  <m:msub>
		    <m:mi>b</m:mi>
		    <m:mi>k</m:mi>
		  </m:msub>
		</m:ci>
		<m:apply>
		  <m:exp/>
		  <m:apply>
		    <m:times/>
		    <m:imaginaryi/>
		    <m:ci><m:msub>
			<m:mi>ω</m:mi>
			<m:mi>k</m:mi>
		      </m:msub></m:ci>
		    <m:ci>n</m:ci>
		  </m:apply>
		</m:apply>
	      </m:apply>
	    </m:apply>
	  </m:math>

	  such that
	  <m:math>
	    <m:set>
	      <m:ci type="vector">
		<m:msub>
		  <m:mi>b</m:mi>
		  <m:mi>k</m:mi>
		</m:msub>
	      </m:ci>
	    </m:set>
	  </m:math>
	  are a <term>basis</term> for 
	  <m:math>
	    <m:ci><m:msup>
		<m:mi>ℂ</m:mi>
		<m:mi>n</m:mi>
	      </m:msup></m:ci>
	  </m:math>
	</note>

	In answer to the above question, let us try the "harmonic"
	sinusoids with a fundamental frequency 
	<m:math display="inline">
	  <m:apply>
	    <m:eq/>
	    <m:ci> <m:msub>
		<m:mi>ω</m:mi>
		<m:mn>0</m:mn>
	      </m:msub></m:ci>
	    <m:apply>
	      <m:divide/>
	      <m:apply>
		<m:times/>
		<m:cn>2</m:cn>
		<m:pi/>
	      </m:apply>
	      <m:ci>N</m:ci>
	    </m:apply>
	  </m:apply>
	</m:math>:

	<equation id="eq7">
	  <name>Harmonic Sinusoid</name>
	  <m:math>
	    <m:apply>
	      <m:exp/>
	      <m:apply>
		<m:times/>
		<m:imaginaryi/>
		<m:apply>
		  <m:divide/>
		  <m:apply>
		    <m:times/>
		    <m:cn>2</m:cn>
		    <m:pi/>
		  </m:apply>
		  <m:ci>N</m:ci>
		</m:apply>
		<m:ci>k</m:ci>
		<m:ci>n</m:ci>
	      </m:apply>
	    </m:apply>
	  </m:math>
	</equation>
      </para>

      <figure orient="horizontal" id="harsin_figs">
	<subfigure id="hs_subf1">
	  <media type="image/png" src="hsin1.png"/>
	  <caption>
	    Harmonic sinusoid with 
	    <m:math>
	      <m:apply>
		<m:eq/>
		<m:ci>k</m:ci>
		<m:cn>0</m:cn>
	      </m:apply>
	    </m:math>
	  </caption>
	</subfigure>
	<subfigure id="hs_subf2">
	  <media type="image/png" src="hsin2.png"/>
	  <caption>
	    Imaginary part of sinusoid, 
	    <m:math>
	      <m:apply>
		<m:imaginary/>
		<m:apply>
		  <m:exp/>
		  <m:apply>
		    <m:times/>
		    <m:imaginaryi/>
		    <m:apply>
		      <m:divide/>
		      <m:apply>
			<m:times/>
			<m:cn>2</m:cn>
			<m:pi/>
		      </m:apply>
		      <m:ci>N</m:ci>
		    </m:apply>
		    <m:cn>1</m:cn>
		    <m:ci>n</m:ci>
		  </m:apply>
		</m:apply>
	      </m:apply>
	    </m:math>, with
	    <m:math>
	      <m:apply>
		<m:eq/>
		<m:ci>k</m:ci>
		<m:cn>1</m:cn>
	      </m:apply>
	    </m:math>
	  </caption>
	</subfigure>
	<subfigure id="hs_subf3">
	  <media type="image/png" src="hsin3.png"/>
	  <caption>
	    Imaginary part of sinusoid, 
	    <m:math>
	      <m:apply>
		<m:imaginary/>
		<m:apply>
		  <m:exp/>
		  <m:apply>
		    <m:times/>
		    <m:imaginaryi/>
		    <m:apply>
		      <m:divide/>
		      <m:apply>
			<m:times/>
			<m:cn>2</m:cn>
			<m:pi/>
		      </m:apply>
		      <m:ci>N</m:ci>
		    </m:apply>
		    <m:cn>2</m:cn>
		    <m:ci>n</m:ci>
		  </m:apply>
		</m:apply>
	      </m:apply>
	    </m:math>, with
	    <m:math>
	      <m:apply>
		<m:eq/>
		<m:ci>k</m:ci>
		<m:cn>2</m:cn>
	      </m:apply>
	    </m:math>
	  </caption>
	</subfigure>
	<caption>
	  Examples of our Harmonic Sinusoids
	</caption>
      </figure>
      
      <para id="p5_sec2">
	<m:math display="inline">
	  <m:apply>
	    <m:exp/>
	    <m:apply>
	      <m:times/>
	      <m:imaginaryi/>
	      <m:apply>
		<m:divide/>
		<m:apply>
		  <m:times/>
		  <m:cn>2</m:cn>
		  <m:pi/>
		</m:apply>
		<m:ci>N</m:ci>
	      </m:apply>
	      <m:ci>k</m:ci>
	      <m:ci>n</m:ci>
	    </m:apply>
	  </m:apply>
	</m:math> is periodic with period <m:math><m:ci>N</m:ci>
	</m:math> and has <m:math><m:ci>k</m:ci></m:math> "cycles"
	between 
	<m:math display="inline">
	  <m:apply>
	    <m:eq/>
	    <m:ci>n</m:ci>
	    <m:cn>0</m:cn>
	  </m:apply>
	</m:math> and 
	<m:math display="inline">
	  <m:apply>
	    <m:eq/>
	    <m:ci>n</m:ci>
	    <m:apply>
	      <m:minus/>
	      <m:ci>N</m:ci>
	      <m:cn>1</m:cn>
	    </m:apply>
	  </m:apply>
	</m:math>.
	
	<rule type="theorem" id="harmonic_sin">
	  <statement>
	    <para id="p1_state">
	      If we let
	      <m:math display="block">
		<m:apply>
		  <m:forall/>
		  <m:bvar>
		    <m:ci>n</m:ci>
		  </m:bvar>
		  <m:condition>
		    <m:apply>
		      <m:eq/>
		      <m:ci>n</m:ci>
		      <m:set>
			<m:cn>0</m:cn>
			<m:ci>…</m:ci>
			<m:apply>
			  <m:minus/>
			  <m:ci>N</m:ci>
			  <m:cn>1</m:cn>
			</m:apply>
		      </m:set>
		    </m:apply>
		  </m:condition>
		  <m:apply>
		    <m:eq/>
		    <m:apply>
		      <m:ci type="fn" class="discrete">
			<m:msub>
			  <m:mi>b</m:mi>
			  <m:mi>k</m:mi>
			</m:msub>
		      </m:ci>
		      <m:ci>n</m:ci>
		    </m:apply>
		    <m:apply>
		      <m:times/>
		      <m:apply>
			<m:divide/>
			<m:cn>1</m:cn>
			<m:apply>
			  <m:root/>
			  <m:ci>N</m:ci>
			</m:apply>
		      </m:apply>
		      <m:apply>
			<m:exp/>
			<m:apply>
			  <m:times/>
			  <m:imaginaryi/>
			  <m:apply>
			    <m:divide/>
			    <m:apply>
			      <m:times/>
			      <m:cn>2</m:cn>
			      <m:pi/>
			    </m:apply>
			    <m:ci>N</m:ci>
			  </m:apply>
			  <m:ci>k</m:ci>
			  <m:ci>n</m:ci>
			</m:apply>
		      </m:apply>
		    </m:apply>
		  </m:apply>
		</m:apply>
	      </m:math>
	      
	      where the exponential term is a vector in 
	      <m:math>
		<m:apply>
		  <m:power/>
		  <m:complexes/>
		  <m:ci>N</m:ci>
		</m:apply>
	      </m:math>, then 
	      <m:math>
		<m:apply>
		  <m:csymbol definitionURL="http://cnx.rice.edu/cd/cnxmath.ocd#evaluateat"/>
		  <m:condition>
		    <m:apply>
		      <m:eq/>
		      <m:ci>k</m:ci>
		      <m:set>
			<m:cn>0</m:cn>
			<m:ci>…</m:ci>
			<m:apply>
			  <m:minus/>
			  <m:ci>N</m:ci>
			  <m:cn>1</m:cn>
			</m:apply>
		      </m:set>
		    </m:apply>
		  </m:condition>
		  <m:apply>
		    <m:set>
		      <m:ci><m:msub>
			  <m:mi>b</m:mi>
			  <m:mi>k</m:mi>
			</m:msub></m:ci>
		    </m:set>
		  </m:apply>
		</m:apply>
	      </m:math>

	      is an <term><cnxn document="m10772" target="orthon_b" strength="8">orthonormal basis</cnxn></term> for 
	      <m:math>
		<m:apply>
		  <m:power/>
		  <m:complexes/>
		  <m:ci>N</m:ci>
		</m:apply>
	      </m:math>.

	    </para>
	  </statement>
	  
	  <proof>
	    <para id="p1_prf">
	      First of all, we must show 
	      <m:math>
		<m:apply>
		  <m:set>
		    <m:ci><m:msub>
			<m:mi>b</m:mi>
			<m:mi>k</m:mi>
		      </m:msub></m:ci>
		  </m:set>
		</m:apply>
	      </m:math> is orthonormal, <foreign>i.e.</foreign> 
  <m:math>
    <m:apply>
      <m:eq/>
      <m:apply>
	<m:scalarproduct/>
	<m:ci><m:msub>
	    <m:mi>b</m:mi>
	    <m:mi>k</m:mi>
	  </m:msub></m:ci>
	<m:ci><m:msub>
	    <m:mi>b</m:mi>
	    <m:mi>l</m:mi>
	  </m:msub></m:ci>
		  </m:apply>
      <m:ci><m:msub>
	  <m:mi>δ</m:mi>
	  <m:mrow>
	    <m:mi>k</m:mi>
	    <m:mi>l</m:mi>
	  </m:mrow>
	</m:msub></m:ci>
    </m:apply>
  </m:math>

	      <m:math display="block">
		<m:apply>
		  <m:eq/>
		  <m:apply>
		    <m:scalarproduct/>
		    <m:ci><m:msub>
		      <m:mi>b</m:mi>
		      <m:mi>k</m:mi>
		    </m:msub></m:ci>
		    <m:ci><m:msub>
		      <m:mi>b</m:mi>
		      <m:mi>l</m:mi>
		    </m:msub></m:ci>
		  </m:apply>
		  <m:apply>
		    <m:sum/>
		    <m:bvar>
		      <m:ci>n</m:ci>
		    </m:bvar>
		    <m:uplimit>
		      <m:apply>
			<m:minus/>
			<m:ci>N</m:ci>
			<m:cn>1</m:cn>
		      </m:apply>
		    </m:uplimit>
		    <m:lowlimit>
		      <m:cn>0</m:cn>
		    </m:lowlimit>
		    <m:apply>
		      <m:times/>
		      <m:apply>
			<m:ci type="fn" class="discrete">
			  <m:msub>
			    <m:mi>b</m:mi>
			    <m:mi>k</m:mi>
			  </m:msub>
			</m:ci>
			<m:ci>n</m:ci>
		      </m:apply>
		      <m:apply>
			<m:conjugate/>
			<m:apply>
			  <m:ci type="fn" class="discrete">
			    <m:msub>
			      <m:mi>b</m:mi>
			      <m:mi>l</m:mi>
			    </m:msub>
			  </m:ci>
			  <m:ci>n</m:ci>
			</m:apply>
		      </m:apply>
		    </m:apply>
		  </m:apply>
		  <m:apply>
		    <m:times/>
		    <m:apply>
		      <m:divide/>
		      <m:cn>1</m:cn>
		      <m:ci>N</m:ci>
		    </m:apply>
		    <m:apply>
		      <m:sum/>
		      <m:bvar>
			<m:ci>n</m:ci>
		      </m:bvar>
		      <m:uplimit>
			<m:apply>
			  <m:minus/>
			  <m:ci>N</m:ci>
			  <m:cn>1</m:cn>
			</m:apply>
		      </m:uplimit>
		      <m:lowlimit>
			<m:cn>0</m:cn>
		      </m:lowlimit>
		      <m:apply>
			<m:times/>
			<m:apply>
			  <m:exp/>
			  <m:apply>
			    <m:times/>
			    <m:imaginaryi/>
			    <m:apply>
			      <m:divide/>
			      <m:apply>
				<m:times/>
				<m:cn>2</m:cn>
				<m:pi/>
			      </m:apply>
			      <m:ci>N</m:ci>
			    </m:apply>
			    <m:ci>k</m:ci>
			    <m:ci>n</m:ci>
			  </m:apply>
			</m:apply>
			<m:apply>
			  <m:exp/>
			  <m:apply>
			    <m:minus/>
			    <m:apply>
			      <m:times/>
			      <m:imaginaryi/>
			      <m:apply>
				<m:divide/>
				<m:apply>
				  <m:times/>
				  <m:cn>2</m:cn>
				  <m:pi/>
				</m:apply>
				<m:ci>N</m:ci>
			      </m:apply>
			      <m:ci>l</m:ci>
			      <m:ci>n</m:ci>
			    </m:apply>
			  </m:apply>
			</m:apply>
		      </m:apply>
		    </m:apply>
		  </m:apply>		  
		</m:apply>
	      </m:math>

	      <equation id="eq8">
		<m:math display="block">
		  <m:apply>
		    <m:eq/>
		    <m:apply>
		      <m:scalarproduct/>
		      <m:ci><m:msub>
			<m:mi>b</m:mi>
			<m:mi>k</m:mi>
		      </m:msub></m:ci>
		      <m:ci><m:msub>
			<m:mi>b</m:mi>
			<m:mi>l</m:mi>
		      </m:msub></m:ci>
		    </m:apply>
		    <m:apply>
		      <m:times/>
		      <m:apply>
			<m:divide/>
			<m:cn>1</m:cn>
			<m:ci>N</m:ci>
		      </m:apply>
		      <m:apply>
			<m:sum/>
			<m:bvar>
			  <m:ci>n</m:ci>
			</m:bvar>
			<m:uplimit>
			  <m:apply>
			    <m:minus/>
			    <m:ci>N</m:ci>
			    <m:cn>1</m:cn>
			  </m:apply>
			</m:uplimit>
			<m:lowlimit>
			  <m:cn>0</m:cn>
			</m:lowlimit>
			<m:apply>
			  <m:exp/>
			  <m:apply>
			    <m:times/>
			    <m:imaginaryi/>
			    <m:apply>
			      <m:divide/>
			      <m:apply>
				<m:times/>
				<m:cn>2</m:cn>
				<m:pi/>
			      </m:apply>
			      <m:ci>N</m:ci>
			    </m:apply>
			    <m:apply>
			      <m:minus/>
			      <m:ci>l</m:ci>
			      <m:ci>k</m:ci>
			    </m:apply>
			    <m:ci>n</m:ci>
			  </m:apply>
			</m:apply>
		      </m:apply>
		    </m:apply>
		  </m:apply>
		</m:math>
	      </equation>

	      If 
	      <m:math>
		<m:apply>
		  <m:eq/>
		  <m:ci>l</m:ci>
		  <m:ci>k</m:ci>
		</m:apply>
	      </m:math>, 
	      then
	      
	      <equation id="eq9">
		<m:math display="block">
		  <m:apply>
		    <m:eq/>
		    <m:apply>
		      <m:scalarproduct/>
		      <m:ci><m:msub>
			<m:mi>b</m:mi>
			<m:mi>k</m:mi>
		      </m:msub></m:ci>
		      <m:ci><m:msub>
			<m:mi>b</m:mi>
			<m:mi>l</m:mi>
		      </m:msub></m:ci>
		    </m:apply>
		    <m:apply>
		      <m:times/>
		      <m:apply>
			<m:divide/>
			<m:cn>1</m:cn>
			<m:ci>N</m:ci>
		      </m:apply>
		      <m:apply>
			<m:sum/>
			<m:bvar>
			  <m:ci>n</m:ci>
			</m:bvar>
			<m:uplimit>
			  <m:apply>
			    <m:minus/>
			    <m:ci>N</m:ci>
			    <m:cn>1</m:cn>
			  </m:apply>
			</m:uplimit>
			<m:lowlimit>
			  <m:cn>0</m:cn>
			</m:lowlimit>
			<m:apply>
			  <m:cn>1</m:cn>
			</m:apply>
		      </m:apply>
		    </m:apply>
		    <m:cn>1</m:cn>
		  </m:apply>
		</m:math>
	      </equation>
		
	      If 
	      <m:math>
		<m:apply>
		  <m:neq/>
		  <m:ci>l</m:ci>
		  <m:ci>k</m:ci>
		</m:apply>
	      </m:math>, 
	      then we must use the "partial summation formula" shown
	      below:

	      <m:math display="block">
		<m:apply>
		  <m:eq/>
		  <m:apply>
		    <m:sum/>
		    <m:bvar>
		      <m:ci>n</m:ci>
		    </m:bvar>
		    <m:uplimit>
		      <m:apply>
			<m:minus/>
			<m:ci>N</m:ci>
			<m:cn>1</m:cn>
		      </m:apply>
		    </m:uplimit>
		    <m:lowlimit>
		      <m:cn>0</m:cn>
		    </m:lowlimit>
		    <m:apply>
		      <m:power/>
		      <m:ci>α</m:ci>
		      <m:ci>n</m:ci>
		    </m:apply>
		  </m:apply>
		  <m:apply>
		    <m:minus/>
		    <m:apply>
		      <m:sum/>
		      <m:bvar>
			<m:ci>n</m:ci>
		      </m:bvar>
		      <m:uplimit>
			<m:infinity/>
		      </m:uplimit>
		      <m:lowlimit>
			<m:cn>0</m:cn>
		      </m:lowlimit>
		      <m:apply>
			<m:power/>
			<m:ci>α</m:ci>
			<m:ci>n</m:ci>
		      </m:apply>
		    </m:apply>
		    <m:apply>
		      <m:sum/>
		      <m:bvar>
			<m:ci>n</m:ci>
		      </m:bvar>
		      <m:uplimit>
			<m:infinity/>
		      </m:uplimit>
		      <m:lowlimit>
			<m:ci>N</m:ci>
		      </m:lowlimit>
		      <m:apply>
			<m:power/>
			<m:ci>α</m:ci>
			<m:ci>n</m:ci>
		      </m:apply>
		    </m:apply>
		  </m:apply>
		  <m:apply>
		    <m:minus/>
		    <m:apply>
		      <m:divide/>
		      <m:cn>1</m:cn>
		      <m:apply>
			<m:minus/>
			<m:cn>1</m:cn>
			<m:ci>α</m:ci>
		      </m:apply>
		    </m:apply>
		    <m:apply>
		      <m:divide/>
		      <m:apply>
			<m:power/>
			<m:ci>α</m:ci>
			<m:ci>N</m:ci>
		      </m:apply>
		      <m:apply>
			<m:minus/>
			<m:cn>1</m:cn>
			<m:ci>α</m:ci>
		      </m:apply>
		    </m:apply>
		  </m:apply>
		  <m:apply>
		    <m:divide/>
		    <m:apply>
		      <m:minus/>
		      <m:cn>1</m:cn>
		      <m:apply>
			<m:power/>
			<m:ci>α</m:ci>
			<m:ci>N</m:ci>
		      </m:apply>
		    </m:apply>
		    <m:apply>
		      <m:minus/>
		      <m:cn>1</m:cn>
		      <m:ci>α</m:ci>
		    </m:apply>
		  </m:apply>
		</m:apply>
	      </m:math>

<!--  FOLLOWING NOT REALLY NEEDED
	    
	      Now we use the above property in <cnxn target='eq8'
	      strength='8'/> when 
	      <m:math>
		<m:apply>
		  <m:neq/>
		  <m:ci>l</m:ci>
		  <m:ci>k</m:ci>
		</m:apply>
	      </m:math>:
-->

	      <m:math display="block">
		<m:apply>
		  <m:eq/>
		  <m:apply>
		    <m:scalarproduct/>
		    <m:ci><m:msub>
		      <m:mi>b</m:mi>
		      <m:mi>k</m:mi>
		    </m:msub></m:ci>
		    <m:ci><m:msub>
		      <m:mi>b</m:mi>
		      <m:mi>l</m:mi>
		    </m:msub></m:ci>
		  </m:apply>
		  <m:apply>
		    <m:times/>
		    <m:apply>
		      <m:divide/>
		      <m:cn>1</m:cn>
		      <m:ci>N</m:ci>
		    </m:apply>
		    <m:apply>
		      <m:sum/>
		      <m:bvar>
			<m:ci>n</m:ci>
		      </m:bvar>
		      <m:uplimit>
			<m:apply>
			  <m:minus/>
			  <m:ci>N</m:ci>
			  <m:cn>1</m:cn>
			</m:apply>
		      </m:uplimit>
		      <m:lowlimit>
			<m:cn>0</m:cn>
		      </m:lowlimit>
		      <m:apply>
			<m:exp/>
			<m:apply>
			  <m:times/>
			  <m:imaginaryi/>
			  <m:apply>
			    <m:divide/>
			    <m:apply>
			      <m:times/>
			      <m:cn>2</m:cn>
			      <m:pi/>
			    </m:apply>
			    <m:ci>N</m:ci>
			  </m:apply>
			  <m:apply>
			    <m:minus/>
			    <m:ci>l</m:ci>
			    <m:ci>k</m:ci>
			  </m:apply>
			  <m:ci>n</m:ci>
			</m:apply>
		      </m:apply>
		    </m:apply>
		  </m:apply>
		</m:apply>
	      </m:math>

	      where in the above equation we can say that 
	      <m:math>
		<m:apply>
		  <m:eq/>
		  <m:ci>α</m:ci>
		  <m:apply>
		    <m:exp/>
		    <m:apply>
		      <m:times/>
		      <m:imaginaryi/>
		      <m:apply>
			<m:divide/>
			<m:apply>
			  <m:times/>
			  <m:cn>2</m:cn>
			  <m:pi/>
			</m:apply>
			<m:ci>N</m:ci>
		      </m:apply>
		      <m:apply>
			<m:minus/>
			<m:ci>l</m:ci>
			<m:ci>k</m:ci>
		      </m:apply>
		    </m:apply>
		  </m:apply>
		</m:apply>
	      </m:math>, and thus we can see how this is in the form
	      needed to utilize our partial summation formula.  

	      <m:math display="block">
		<m:apply>
		  <m:eq/>
		  <m:apply>
		    <m:scalarproduct/>
		    <m:ci><m:msub>
		      <m:mi>b</m:mi>
		      <m:mi>k</m:mi>
		    </m:msub></m:ci>
		    <m:ci><m:msub>
		      <m:mi>b</m:mi>
		      <m:mi>l</m:mi>
		    </m:msub></m:ci>
		  </m:apply>
		  <m:apply>
		    <m:times/>
		    <m:apply>
		      <m:divide/>
		      <m:cn>1</m:cn>
		      <m:ci>N</m:ci>
		    </m:apply>
		    <m:apply>
		      <m:apply>
			<m:divide/>
			<m:apply>
			  <m:minus/>
			  <m:cn>1</m:cn>
			  <m:apply>
			    <m:exp/>
			    <m:apply>
			      <m:times/>
			      <m:imaginaryi/>
			      <m:apply>
				<m:divide/>
				<m:apply>
				  <m:times/>
				  <m:cn>2</m:cn>
				  <m:pi/>
				</m:apply>
				<m:ci>N</m:ci>
			      </m:apply>
			      <m:apply>
				<m:minus/>
				<m:ci>l</m:ci>
				<m:ci>k</m:ci>
			      </m:apply>
			      <m:ci>N</m:ci>
			    </m:apply>
			  </m:apply>
			</m:apply>
			<m:apply>
			  <m:minus/>
			  <m:cn>1</m:cn>
			  <m:apply>
			    <m:exp/>
			    <m:apply>
			      <m:times/>
			      <m:imaginaryi/>
			      <m:apply>
				<m:divide/>
				<m:apply>
				  <m:times/>
				  <m:cn>2</m:cn>
				  <m:pi/>
				</m:apply>
				<m:ci>N</m:ci>
			      </m:apply>
			      <m:apply>
				<m:minus/>
				<m:ci>l</m:ci>
				<m:ci>k</m:ci>
			      </m:apply>
			    </m:apply>
			  </m:apply>
			</m:apply>
		      </m:apply>
		    </m:apply>
		  </m:apply>
		  <m:apply>
		    <m:times/>
		    <m:apply>
		      <m:divide/>
		      <m:cn>1</m:cn>
		      <m:ci>N</m:ci>
		    </m:apply>
		    <m:apply>
		      <m:apply>
			<m:divide/>
			<m:apply>
			  <m:minus/>
			  <m:cn>1</m:cn>
			  <m:cn>1</m:cn>
			</m:apply>
			<m:apply>
			  <m:minus/>
			  <m:cn>1</m:cn>
			  <m:apply>
			    <m:exp/>
			    <m:apply>
			      <m:times/>
			      <m:imaginaryi/>
			      <m:apply>
				<m:divide/>
				<m:apply>
				  <m:times/>
				  <m:cn>2</m:cn>
				  <m:pi/>
				</m:apply>
				<m:ci>N</m:ci>
			      </m:apply>
			      <m:apply>
				<m:minus/>
				<m:ci>l</m:ci>
				<m:ci>k</m:ci>
			      </m:apply>
			    </m:apply>
			  </m:apply>
			</m:apply>
		      </m:apply>
		    </m:apply>
		  </m:apply>
		  <m:cn>0</m:cn>
		</m:apply>
	      </m:math>

	      So,
	      
	      <equation id="eq10">
		<m:math>
		  <m:apply>
		    <m:eq/>
		    <m:apply>
		      <m:scalarproduct/>
		      <m:ci><m:msub>
			<m:mi>b</m:mi>
			<m:mi>k</m:mi>
		      </m:msub></m:ci>
		      <m:ci><m:msub>
			<m:mi>b</m:mi>
			<m:mi>l</m:mi>
		      </m:msub></m:ci>
		    </m:apply>
		    <m:apply>
		      <m:piecewise>
			<m:piece>
			  <m:cn>1</m:cn>
			  <m:apply>
			    <m:eq/>
			    <m:ci>k</m:ci>
			    <m:ci>l</m:ci>
			  </m:apply>
			</m:piece>
			<m:piece>
			  <m:cn>0</m:cn>
			  <m:apply>
			    <m:neq/>
			    <m:ci>k</m:ci>
			    <m:ci>l</m:ci>
			  </m:apply>
			</m:piece>
		      </m:piecewise>
		    </m:apply>
		  </m:apply>
		</m:math>
	      </equation>
			    
	      Therefore: 
	      <m:math>
		<m:set>
		  <m:ci><m:msub>
		    <m:mi>b</m:mi>
		    <m:mi>k</m:mi>
		  </m:msub></m:ci>
		</m:set>
	      </m:math> is an orthonormal set.  
	      <m:math>
		<m:set>
		  <m:ci><m:msub>
		    <m:mi>b</m:mi>
		    <m:mi>k</m:mi>
		  </m:msub></m:ci>
		</m:set>
	      </m:math> is also a <cnxn document="m10734" target="sec_bas" strength="8">basis</cnxn>, since there
	      are <m:math><m:ci>N</m:ci></m:math> vectors which are
	      <cnxn document="m10734" target="lin_ind" strength="8">linearly independent</cnxn> (orthogonality
	      implies linear independence).
	    </para>

	    <para id="p2_prf">
	      And finally, we have shown that the harmonic sinusoids 
	      <m:math>
		<m:set>
		  <m:apply>
		    <m:times/>
		    <m:apply>
		      <m:divide/>
		      <m:cn>1</m:cn>
		      <m:apply>
			<m:root/>
			<m:ci>N</m:ci>
		      </m:apply>
		    </m:apply>
		    <m:apply>
		      <m:exp/>
		      <m:apply>
			<m:times/>
			<m:imaginaryi/>
			<m:apply>
			  <m:divide/>
			  <m:apply>
			    <m:times/>
			    <m:cn>2</m:cn>
			    <m:pi/>
			  </m:apply>
			  <m:ci>N</m:ci>
			</m:apply>
			<m:ci>k</m:ci>
			<m:ci>n</m:ci>
		      </m:apply>
		    </m:apply>
		  </m:apply>
		</m:set>
	      </m:math> form an orthonormal basis for 
	      <m:math>
		<m:ci><m:msup>
		  <m:mi>ℂ</m:mi>
		  <m:mi>n</m:mi>
		</m:msup></m:ci>
	      </m:math>
	    </para>
	  </proof>	  
	</rule>
      </para>

      <section id="dtfs">
	<name>Discrete-Time Fourier Series (DTFS)</name>
	<para id="p1_dtfs">
	  Using the steps shown above in the derivation and our
	  previous understanding of <cnxn document="m10755" strength="8">Hilbert Spaces</cnxn> and <cnxn document="m10760" strength="8">Orthogonal Expansions</cnxn>, the rest of the
	  derivation is automatic.  Given a discrete-time, periodic
	  signal (vector in 
	   <m:math>
	    <m:ci><m:msup>
	      <m:mi>ℂ</m:mi>
	      <m:mi>n</m:mi>
	    </m:msup></m:ci>
	  </m:math>)  
	  <m:math>
	    <m:apply>
	      <m:ci type="fn" class="discrete">f</m:ci>
	      <m:ci>n</m:ci>
	    </m:apply>
	  </m:math>, we can write:

	  <equation id="eq11">
	    <m:math>
	      <m:apply>
		<m:eq/>
		<m:apply>
		  <m:ci type="fn" class="discrete">f</m:ci>
		  <m:ci>n</m:ci>
		</m:apply>
		<m:apply>
		  <m:times/>
		  <m:apply>
		    <m:divide/>
		    <m:cn>1</m:cn>
		    <m:apply>
		      <m:root/>
		      <m:ci>N</m:ci>
		    </m:apply>
		  </m:apply>
		  <m:apply>
		    <m:sum/>
		    <m:bvar>
		      <m:ci>k</m:ci>
		    </m:bvar>
		    <m:uplimit>
		      <m:apply>
			<m:minus/>
			<m:ci>N</m:ci>
			<m:cn>1</m:cn>
		      </m:apply>
		    </m:uplimit>
		    <m:lowlimit>
		      <m:cn>0</m:cn>
		    </m:lowlimit>
		    <m:apply>
		      <m:times/>
		      <m:msub>
			<m:mi>c</m:mi>
			<m:mi>k</m:mi>
		      </m:msub>
		      <m:apply>
			<m:exp/>
			<m:apply>
			  <m:times/>
			  <m:imaginaryi/>
			  <m:apply>
			    <m:divide/>
			    <m:apply>
			      <m:times/>
			      <m:cn>2</m:cn>
			      <m:pi/>
			    </m:apply>
			    <m:ci>N</m:ci>
			  </m:apply>
			  <m:ci>k</m:ci>
			  <m:ci>n</m:ci>
			</m:apply>
		      </m:apply>
		    </m:apply>
		  </m:apply>
		</m:apply>
	      </m:apply>
	    </m:math>
	  </equation>
		      

	  <equation id="eq12">
	    <m:math>
	      <m:apply>
		<m:eq/>
		<m:ci><m:msub>
		  <m:mi>c</m:mi>
		  <m:mi>k</m:mi>
		</m:msub></m:ci>
		<m:apply>
		  <m:times/>
		  <m:apply>
		    <m:divide/>
		    <m:cn>1</m:cn>
		    <m:apply>
		      <m:root/>
		      <m:ci>N</m:ci>
		    </m:apply>
		  </m:apply>
		  <m:apply>
		    <m:sum/>
		    <m:bvar>
		      <m:ci>n</m:ci>
		    </m:bvar>
		    <m:uplimit>
		      <m:apply>
			<m:minus/>
			<m:ci>N</m:ci>
			<m:cn>1</m:cn>
		      </m:apply>
		    </m:uplimit>
		    <m:lowlimit>
		      <m:cn>0</m:cn>
		    </m:lowlimit>
		    <m:apply>
		      <m:times/>
		      <m:apply>
			<m:ci type="fn" class="discrete">f</m:ci>
			<m:ci>n</m:ci>
		      </m:apply>
		      <m:apply>
			<m:exp/>
			<m:apply>
			  <m:minus/>
			  <m:apply>
			    <m:times/>
			    <m:imaginaryi/>
			    <m:apply>
			      <m:divide/>
			      <m:apply>
				<m:times/>
				<m:cn>2</m:cn>
				<m:pi/>
			      </m:apply>
			      <m:ci>N</m:ci>
			    </m:apply>
			    <m:ci>k</m:ci>
			    <m:ci>n</m:ci>
			  </m:apply>
			</m:apply>
		      </m:apply>
		    </m:apply>
		  </m:apply>
		</m:apply>
	      </m:apply>
	    </m:math>
	  </equation>

	  Note: Most people collect both the 
	  <m:math>
	    <m:apply>
	      <m:divide/>
	      <m:cn>1</m:cn>
	      <m:apply>
		<m:root/>
		<m:ci>N</m:ci>
	      </m:apply>
	    </m:apply>
	  </m:math> terms into the expression for
	  <m:math>
	    <m:ci><m:msub>
	      <m:mi>c</m:mi>
	      <m:mi>k</m:mi>
	    </m:msub></m:ci>
	  </m:math>.  

	  <note type="Discrete Time Fourier Series">
	    Here is the common form of the DTFS with the above note
	    taken into account:
	    
	    <m:math display="block">
	      <m:apply>
		<m:eq/>
		<m:apply>
		  <m:ci type="fn" class="discrete">f</m:ci>
		  <m:ci>n</m:ci>
		</m:apply>
		<m:apply>
		  <m:sum/>
		  <m:bvar>
		    <m:ci>k</m:ci>
		  </m:bvar>
		  <m:uplimit>
		    <m:apply>
		      <m:minus/>
		      <m:ci>N</m:ci>
		      <m:cn>1</m:cn>
		    </m:apply>
		  </m:uplimit>
		  <m:lowlimit>
		    <m:cn>0</m:cn>
		  </m:lowlimit>
		  <m:apply>
		    <m:times/>
		    <m:ci><m:msub>
		      <m:mi>c</m:mi>
		      <m:mi>k</m:mi>
		    </m:msub></m:ci>
		    <m:apply>
		      <m:exp/>
		      <m:apply>
			<m:times/>
			<m:imaginaryi/>
			<m:apply>
			  <m:divide/>
			  <m:apply>
			    <m:times/>
			    <m:cn>2</m:cn>
			    <m:pi/>
			  </m:apply>
			  <m:ci>N</m:ci>
			</m:apply>
			<m:ci>k</m:ci>
			<m:ci>n</m:ci>
		      </m:apply>
		    </m:apply>
		  </m:apply>
		</m:apply>
	      </m:apply>
	    </m:math>
	    
	    <m:math display="block">
	      <m:apply>
		<m:eq/>
		<m:ci><m:msub>
		  <m:mi>c</m:mi>
		  <m:mi>k</m:mi>
		</m:msub></m:ci>
		<m:apply>
		  <m:times/>
		  <m:apply>
		    <m:divide/>
		    <m:cn>1</m:cn>
		    <m:ci>N</m:ci>
		  </m:apply>
		  <m:apply>
		    <m:sum/>
		    <m:bvar>
		      <m:ci>n</m:ci>
		    </m:bvar>
		    <m:uplimit>
		      <m:apply>
			<m:minus/>
			<m:ci>N</m:ci>
			<m:cn>1</m:cn>
		      </m:apply>
		    </m:uplimit>
		    <m:lowlimit>
		      <m:cn>0</m:cn>
		    </m:lowlimit>
		    <m:apply>
		      <m:times/>
		      <m:apply>
			<m:ci type="fn" class="discrete">f</m:ci>
			<m:ci>n</m:ci>
		      </m:apply>
		      <m:apply>
			<m:exp/>
			<m:apply>
			  <m:minus/>
			  <m:apply>
			    <m:times/>
			    <m:imaginaryi/>
			    <m:apply>
			      <m:divide/>
			      <m:apply>
				<m:times/>
				<m:cn>2</m:cn>
				<m:pi/>
			      </m:apply>
			      <m:ci>N</m:ci>
			    </m:apply>
			    <m:ci>k</m:ci>
			    <m:ci>n</m:ci>
			  </m:apply>
			</m:apply>
		      </m:apply>
		    </m:apply>
		  </m:apply>
		</m:apply>
	      </m:apply>
	    </m:math>

	    This what the <code>fft</code> command in MATLAB does.
	  </note>
	 
	</para>
      </section>
    </section>

  </content>
</document>
