<?xml version="1.0" encoding="utf-8" standalone="no"?>
<!DOCTYPE document PUBLIC "-//CNX//DTD CNXML 0.5 plus MathML//EN" "http://cnx.rice.edu/cnxml/0.5/DTD/cnxml_mathml.dtd">
<document xmlns="http://cnx.rice.edu/cnxml" xmlns:md="http://cnx.rice.edu/mdml/0.4" xmlns:m="http://www.w3.org/1998/Math/MathML" xmlns:bib="http://bibtexml.sf.net/" id="new0">
  <name>Signal Representation</name>
  <metadata>
  <md:version>2.0</md:version>
  <md:created>2003/05/09</md:created>
  <md:revised>2003/05/09</md:revised>
  <md:authorlist>
      <md:author id="feng">
      <md:firstname>Feng</md:firstname>
      
      <md:surname>Qiao</md:surname>
      <md:email>fqiao@rice.edu</md:email>
    </md:author>
      <md:author id="rmilam">
      <md:firstname>Rachael</md:firstname>
      
      <md:surname>Milam</md:surname>
      <md:email>rmilam@rice.edu</md:email>
    </md:author>
  </md:authorlist>

  <md:maintainerlist>
    <md:maintainer id="charlet">
      <md:firstname>Charlet</md:firstname>
      
      <md:surname>Reedstrom</md:surname>
      <md:email>charlet@rice.edu</md:email>
    </md:maintainer>
    <md:maintainer id="rmilam">
      <md:firstname>Rachael</md:firstname>
      
      <md:surname>Milam</md:surname>
      <md:email>rmilam@rice.edu</md:email>
    </md:maintainer>
    <md:maintainer id="feng">
      <md:firstname>Feng</md:firstname>
      
      <md:surname>Qiao</md:surname>
      <md:email>fqiao@rice.edu</md:email>
    </md:maintainer>
  </md:maintainerlist>
  
  <md:keywordlist>
    <md:keyword>signal</md:keyword>
  </md:keywordlist>

  <md:abstract/>
</metadata>



  <content>
    <para id="para1">
      The idea of signal representation is to decompose a general
      signal into a linear combination of a fixed set of vectors.
    </para>

    <example id="ex1">
      <para id="para2">
	For any 
	<m:math>
	  <m:apply>
	    <m:in/>
	    <m:ci type="vector">v</m:ci>
	    <m:apply>
	      <m:power/>
	      <m:reals/>
	      <m:cn>2</m:cn>
	    </m:apply>
	  </m:apply>
	</m:math>, we have 
	<m:math>
	  <m:apply>
	    <m:eq/>
	    <m:ci type="vector">v</m:ci>
	    <m:apply>
	      <m:plus/>
	      <m:apply>
		<m:times/>
		<m:ci>x</m:ci>
		<m:vector>
		  <m:cn>1</m:cn>
		  <m:cn>0</m:cn>
		</m:vector>
	      </m:apply>
	      <m:apply>
		<m:times/>
		<m:ci>y</m:ci>
		<m:vector>
		  <m:cn>0</m:cn>
		  <m:cn>1</m:cn>
		</m:vector>
	      </m:apply>
	    </m:apply>
	  </m:apply>
	</m:math>
      </para>
    </example>

    <example id="ex2">
      <para id="para3">
	Suppose we have an orthonormal set of vectors 
	<m:math>
	  <m:set>
	    <m:apply>
	      <m:ci type="fn"><m:msub>
		  <m:mi>v</m:mi>
		  <m:mi>k</m:mi>
		</m:msub></m:ci>
	      <m:ci>t</m:ci>
	    </m:apply>
	  </m:set>
	</m:math> which spans a subspace
	<m:math><m:ci>V</m:ci></m:math> of 
	<m:math>
	  <m:apply>
	    <m:apply>
	      <m:power/>
	      <m:ci type="fn">L</m:ci>
	      <m:cn>2</m:cn>
	    </m:apply>
	    <m:reals/>
	  </m:apply>
	</m:math>, then 
	<m:math>
	  <m:apply>
	    <m:forall/>
	    <m:condition>
	      <m:apply>
		<m:in/>
		<m:apply>
		  <m:ci type="fn">f</m:ci>
		  <m:ci>t</m:ci>
		</m:apply>
		<m:ci>V</m:ci>
	      </m:apply>
	    </m:condition>
	  </m:apply>
	</m:math>, we have 

	<equation id="eqn1">
	  <m:math display="block">
	    <m:apply>
	    <m:eq/>
	      <m:apply>
		<m:ci type="fn">f</m:ci>
		<m:ci>t</m:ci>
	      </m:apply>
	      <m:apply>
		<m:sum/>
		<m:bvar><m:ci>k</m:ci></m:bvar>
		<m:domainofapplication>
		  <m:ci>k</m:ci>
		</m:domainofapplication>
		<m:apply>
		  <m:times/>
		  <m:apply>
		    <m:scalarproduct/>
		    <m:apply>
		      <m:ci type="fn">f</m:ci>
		      <m:ci>t</m:ci>
		    </m:apply>
		    <m:apply>
		      <m:ci type="fn"><m:msub>
			  <m:mi>v</m:mi>
			  <m:mi>k</m:mi>
			</m:msub></m:ci>
		      <m:ci>t</m:ci>
		    </m:apply>
		  </m:apply>
		  <m:apply>
		    <m:ci type="fn"><m:msub>
			<m:mi>v</m:mi>
			<m:mi>k</m:mi>
		      </m:msub></m:ci>
		    <m:ci>t</m:ci>
		  </m:apply>
		</m:apply>
	      </m:apply>
	    </m:apply>
	  </m:math>
	</equation>
      </para>
    </example>

    <para id="para4">
      In practical applications, signals are generally smooth or at
      least piecewise smooth (e.g., sound waves, image intensities).
      Such signals can be well approximated by using piecewise
      polynomials.
    </para>

    <para id="para5">
      A function is piecewise polynomial with 
      <m:math>
	<m:apply>
	  <m:plus/>
	  <m:ci>K</m:ci>
	  <m:cn>1</m:cn>
	</m:apply>
      </m:math> pieces if 

      <equation id="eqn2">
	<m:math>
	  <m:apply>
	    <m:eq/>
	    <m:apply>
	      <m:ci type="fn">p</m:ci>
	      <m:ci>t</m:ci>
	    </m:apply>
	    <m:apply>
	      <m:sum/>
	      <m:bvar><m:ci>i</m:ci></m:bvar>
	      <m:lowlimit><m:cn>0</m:cn></m:lowlimit>
	      <m:uplimit><m:ci>K</m:ci></m:uplimit>
	      <m:apply>
		<m:times/>
		<m:apply>
		  <m:ci type="fn"><m:msub>
		      <m:mi>p</m:mi>
		      <m:mi>i</m:mi>
		    </m:msub></m:ci>
		  <m:ci>t</m:ci>
		</m:apply>
		<m:apply>
		  <m:ci type="fn">w</m:ci>
		  <m:ci>t</m:ci>
		</m:apply>
	      </m:apply>
	    </m:apply>
	  </m:apply>
	</m:math>
      </equation>

      <m:math display="block">
	<m:apply>
	  <m:eq/>
	  <m:apply>
	    <m:ci type="fn">w</m:ci>
	    <m:ci>t</m:ci>
	  </m:apply>
	  <m:piecewise>
	    <m:piece>
	      <m:cn>1</m:cn>
	      <m:apply>
		<m:leq/>
		<m:ci><m:msub>
		    <m:mi>t</m:mi>
		    <m:mi>i</m:mi>
		  </m:msub></m:ci>
		<m:apply>
		  <m:lt/>
		  <m:ci>t</m:ci>
		  <m:ci><m:msub>
		      <m:mi>t</m:mi>
		      <m:mrow>
			<m:mi>i</m:mi>
			<m:mo>+</m:mo>
			<m:mn>1</m:mn>
		      </m:mrow>
		    </m:msub></m:ci>
		</m:apply>
	      </m:apply>
	    </m:piece>
	    <m:otherwise>
	      <m:cn>0</m:cn>
	    </m:otherwise>
	  </m:piecewise>
	</m:apply>
      </m:math>
      where 
      <m:math>
	<m:apply>
	  <m:eq/>
	  <m:ci><m:msub>
	      <m:mi>t</m:mi>
	      <m:mn>0</m:mn>
	    </m:msub></m:ci>
	  <m:cn>0</m:cn>
	</m:apply>
      </m:math> and 
      <m:math>
	<m:apply>
	  <m:eq/>
	  <m:ci><m:msub>
	      <m:mi>t</m:mi>
	      <m:mrow>
		<m:mi>K</m:mi>
		<m:mo>+</m:mo>
		<m:mn>1</m:mn>
	      </m:mrow>
	    </m:msub></m:ci>
	  <m:ci>T</m:ci>
	</m:apply>
      </m:math> and 

      <m:math>
	<m:apply>
	  <m:eq/>
	  <m:apply>
	    <m:ci type="fn"><m:msub>
		<m:mi>p</m:mi>
		<m:mi>i</m:mi>
	      </m:msub></m:ci>
	    <m:ci>t</m:ci>
	  </m:apply>
	  <m:apply>
	    <m:sum/>
	    <m:bvar><m:ci>d</m:ci></m:bvar>
	    <m:lowlimit><m:cn>0</m:cn></m:lowlimit>
	    <m:uplimit><m:ci>D</m:ci></m:uplimit>
	    <m:apply>
	      <m:times/>
	      <m:ci><m:msub>
		  <m:mi>a</m:mi>
		  <m:mrow>
		    <m:mi>i</m:mi>
		    <m:mo>,</m:mo>
		    <m:mi>d</m:mi>
		  </m:mrow>
		</m:msub></m:ci>
	      <m:apply>
		<m:power/>
		<m:ci>t</m:ci>
		<m:ci>d</m:ci>
	      </m:apply>
	    </m:apply>
	  </m:apply>
	</m:apply>
      </m:math>
      are polynomials of max degree <m:math><m:ci>D</m:ci></m:math>.
    </para>

    <para id="para6">
      So when we try to project a polynomial signal 
      <m:math>
	<m:apply>
	  <m:eq/>
	  <m:apply>
	    <m:ci type="fn">f</m:ci>
	    <m:ci>t</m:ci>
	  </m:apply>
	  <m:apply>
	    <m:power/>
	    <m:ci>t</m:ci>
	    <m:ci>n</m:ci>
	  </m:apply>
	</m:apply>
      </m:math> to a subspace spanned by 
      <m:math>
	<m:set>
	  <m:apply>
	    <m:ci type="fn"><m:msub>
		<m:mi>v</m:mi>
		<m:mi>k</m:mi>
	      </m:msub></m:ci>
	    <m:ci>t</m:ci>
	  </m:apply>
	</m:set>
      </m:math>, we will get 
      <equation id="eqn3">
	<m:math>
	  <m:apply>
	    <m:eq/>
	    <m:apply>
	      <m:ci type="fn"><m:mover>
		  <m:mi>f</m:mi>
		  <m:mo>^</m:mo>
		</m:mover></m:ci>
	      <m:ci>t</m:ci>
	    </m:apply>
	    <m:apply>
	      <m:sum/>
	      <m:bvar><m:ci>k</m:ci></m:bvar>
	      <m:domainofapplication>
		<m:ci>k</m:ci>
	      </m:domainofapplication>
	      <m:apply>
		<m:times/>
		<m:apply>
		  <m:scalarproduct/>
		  <m:apply>
		    <m:power/>
		    <m:ci>t</m:ci>
		    <m:ci>n</m:ci>
		  </m:apply>
		  <m:apply>
		    <m:ci type="fn"><m:msub>
			<m:mi>v</m:mi>
			<m:mi>k</m:mi>
		      </m:msub></m:ci>
		    <m:ci>t</m:ci>
		  </m:apply>
		</m:apply>
		<m:apply>
		  <m:ci type="fn"><m:msub>
		      <m:mi>v</m:mi>
		      <m:mi>k</m:mi>
		    </m:msub></m:ci>
		  <m:ci>t</m:ci>
		</m:apply>
	      </m:apply>
	    </m:apply>
	  </m:apply>
	</m:math>
      </equation>
      The term 
      <m:math>
	<m:apply>
	  <m:eq/>
	  <m:apply>
	    <m:scalarproduct/>
	    <m:apply>
	      <m:power/>
	      <m:ci>t</m:ci>
	      <m:ci>n</m:ci>
	    </m:apply>
	    <m:apply>
	      <m:ci type="fn"><m:msub>
		  <m:mi>v</m:mi>
		  <m:mi>k</m:mi>
		</m:msub></m:ci>
	      <m:ci>t</m:ci>
	    </m:apply>
	  </m:apply>
	  <m:apply>
	    <m:int/>
	    <m:bvar><m:ci>t</m:ci></m:bvar>
	    <m:apply>
	      <m:times/>
	      <m:apply>
		<m:power/>
		<m:ci>t</m:ci>
		<m:ci>n</m:ci>
	      </m:apply>
	      <m:apply>
		<m:ci type="fn"><m:msub>
		    <m:mi>v</m:mi>
		    <m:mi>k</m:mi>
		  </m:msub></m:ci>
		<m:ci>t</m:ci>
	      </m:apply>
	    </m:apply>
	  </m:apply>
	</m:apply>
      </m:math> is called the 
      <m:math>
	<m:apply>
	  <m:power/>
	  <m:ci>n</m:ci>
	  <m:ci>th</m:ci>
	</m:apply>
      </m:math> moment of 
      <m:math>
	<m:apply>
	  <m:ci type="fn"><m:msub>
	      <m:mi>v</m:mi>
	      <m:mi>k</m:mi>
	    </m:msub></m:ci>
	  <m:ci>t</m:ci>
	</m:apply>
      </m:math>.  In many cases we would like a "parsimonious"
      representation of the signal (e.g., compression of the signal).
      That is, we would like most of the coefficients to be zero.  In
      the problem of polynomial signal representation, that is to say,
      we want the moments of the basis vector to be zero.  This is
      called <term>vanishing moments</term> of 
      <m:math>
	<m:apply>
	  <m:ci type="fn"><m:msub>
	      <m:mi>v</m:mi>
	      <m:mi>k</m:mi>
	    </m:msub></m:ci>
	  <m:ci>t</m:ci>
	</m:apply>
      </m:math>.

      <note type="question">
	How to choose 
	<m:math>
	  <m:set>
	    <m:apply>
	      <m:ci type="fn"><m:msub>
		  <m:mi>v</m:mi>
		  <m:mi>k</m:mi>
		</m:msub></m:ci>
	      <m:ci>t</m:ci>
	    </m:apply>
	  </m:set>
	</m:math> wisely so that we have as many vanishing moments as
	possible?</note>
    </para>

  </content>
</document>
