<?xml version="1.0" encoding="utf-8" standalone="no"?>
<!DOCTYPE document PUBLIC "-//CNX//DTD CNXML 0.5 plus MathML//EN" "http://cnx.rice.edu/cnxml/0.5/DTD/cnxml_mathml.dtd">
<document xmlns="http://cnx.rice.edu/cnxml" xmlns:md="http://cnx.rice.edu/mdml/0.4" xmlns:m="http://www.w3.org/1998/Math/MathML" xmlns:bib="http://bibtexml.sf.net/" id="new3">
  <name>Expected Values of Probability Functions</name>
  <metadata>
  <md:version>1.4</md:version>
  <md:created>2003/05/13</md:created>
  <md:revised>2003/08/08 12:31:12.457 GMT-5</md:revised>
  <md:authorlist>
    <md:author id="dhj">
      <md:firstname>Don</md:firstname>
      
      <md:surname>Johnson</md:surname>
      <md:email>dhj@rice.edu</md:email>
    </md:author>
  </md:authorlist>

  <md:maintainerlist>
    <md:maintainer id="dhj">
      <md:firstname>Don</md:firstname>
      
      <md:surname>Johnson</md:surname>
      <md:email>dhj@rice.edu</md:email>
    </md:maintainer>
    <md:maintainer id="erkrause">
      <md:firstname>Eileen</md:firstname>
      
      <md:surname>Krause</md:surname>
      <md:email>erkrause@rice.edu</md:email>
    </md:maintainer>
    <md:maintainer id="kclarks">
      <md:firstname>Kyle</md:firstname>
      
      <md:surname>Clarkson</md:surname>
      <md:email>kclarks@rice.edu</md:email>
    </md:maintainer>
    <md:maintainer id="lizzardg">
      <md:firstname>Elizabeth</md:firstname>
      
      <md:surname>Gregory</md:surname>
      <md:email>lizzardg@rice.edu</md:email>
    </md:maintainer>
    <md:maintainer id="kevinduh">
      <md:firstname>Kevin</md:firstname>
      
      <md:surname>Duh</md:surname>
      <md:email>kevinduh@rice.edu</md:email>
    </md:maintainer>
    <md:maintainer id="mariyah">
      <md:firstname>Mariyah</md:firstname>
      
      <md:surname>Poonawala</md:surname>
      <md:email>mariyah@rice.edu</md:email>
    </md:maintainer>
    <md:maintainer id="mjeanes">
      <md:firstname>Matthew</md:firstname>
      
      <md:surname>Jeanes</md:surname>
      <md:email>mjeanes@rice.edu</md:email>
    </md:maintainer>
    <md:maintainer id="jsilv">
      <md:firstname>Jeffrey</md:firstname>
      
      <md:surname>Silverman</md:surname>
      <md:email>jsilv@rice.edu</md:email>
    </md:maintainer>
  </md:maintainerlist>
  
  

  <md:abstract/>
</metadata>

  <content>
    <para id="para1">
      The <term>expected value</term> of a function <m:math>
	<m:apply>
	  <m:ci type="fn">f</m:ci>
	  <m:ci>·</m:ci>
	</m:apply>
      </m:math> of a random variable <m:math><m:ci>X</m:ci></m:math>
      is defined to be
      <equation id="eqn1">
	<m:math>
	  <m:apply>
	    <m:eq/>
	    <m:apply>
	      <m:csymbol definitionURL="http://cnx.rice.edu/cd/cnxmath.ocd#expectedvalue"/>
	      <m:apply>
		<m:ci type="fn">f</m:ci>
		<m:ci>X</m:ci>
	      </m:apply>
	    </m:apply>
	    <m:apply>
	      <m:int/>
	      <m:bvar><m:ci>x</m:ci></m:bvar>
	      <m:lowlimit>
		<m:apply>
		  <m:minus/>
		  <m:infinity/>
		</m:apply>
	      </m:lowlimit>
	      <m:uplimit>
		<m:infinity/>
	      </m:uplimit>
	      <m:apply>
		<m:times/>
		<m:apply>
		  <m:ci type="fn">f</m:ci>
		  <m:ci>x</m:ci>
		</m:apply>
		<m:apply>
		  <m:csymbol definitionURL="http://cnx.rice.edu/cd/cnxmath.ocd#pdf">p</m:csymbol>
		  <m:bvar>
		    <m:ci>X</m:ci>
		  </m:bvar>
		  <m:ci>x</m:ci>
		</m:apply>
	      </m:apply>
	    </m:apply>
	  </m:apply>
	</m:math>
      </equation>
      Several important quantities are expected values, with specific
      forms for the function <m:math>
	<m:apply>
	  <m:ci type="fn">f</m:ci>
	  <m:ci>·</m:ci>
	</m:apply>
      </m:math>.
      <list id="list1" type="bulleted">
	<item><m:math>
	    <m:apply>
	      <m:eq/>
	      <m:apply>
		<m:ci type="fn">f</m:ci>
		<m:ci>X</m:ci>
	      </m:apply>
	      <m:ci>X</m:ci>
	    </m:apply>
	  </m:math>.  The expected value or <term>mean</term> of a
	  random variable is the center-of-mass of the probability
	  density function.  We shall often denote the expected value
	  by <m:math> <m:ci><m:msub> <m:mi>m</m:mi> <m:mi>X</m:mi>
	      </m:msub></m:ci> </m:math> or just
	  <m:math><m:ci>m</m:ci></m:math> when the meaning is clear.
	  Note that the expected value can be a number never assumed
	  by the random variable (
	  <m:math>
	    <m:apply>
	      <m:csymbol definitionURL="http://cnx.rice.edu/cd/cnxmath.ocd#pdf">p</m:csymbol>
	      <m:bvar>
		<m:ci>X</m:ci>
	      </m:bvar>
	      <m:ci>m</m:ci>
	    </m:apply>
	  </m:math> can be zero).  An important property of the
	  expected value of a random variable is
	  <term>linearity</term>:
	  <m:math>
	    <m:apply>
	      <m:eq/>
	      <m:apply>
		<m:csymbol definitionURL="http://cnx.rice.edu/cd/cnxmath.ocd#expectedvalue"/>
		<m:apply>
		  <m:times/>
		  <m:ci>a</m:ci>
		  <m:ci>X</m:ci>
		</m:apply>
	      </m:apply>
	      <m:apply>
		<m:times/>
		<m:ci>a</m:ci>
		<m:apply>
		  <m:csymbol definitionURL="http://cnx.rice.edu/cd/cnxmath.ocd#expectedvalue"/>
		  <m:ci>X</m:ci>
		</m:apply>
	      </m:apply>
	    </m:apply>
	  </m:math>, <m:math><m:ci>a</m:ci></m:math> being a scalar.
	</item>
	<item><m:math>
	    <m:apply>
	      <m:eq/>
	      <m:apply>
		<m:ci type="fn">f</m:ci>
		<m:ci>X</m:ci>
	      </m:apply>
	      <m:apply>
		<m:power/>
		<m:ci>X</m:ci>
		<m:cn>2</m:cn>
	      </m:apply>
	    </m:apply>
	  </m:math>.  
	  <m:math>
	    <m:apply>
	      <m:csymbol definitionURL="http://cnx.rice.edu/cd/cnxmath.ocd#expectedvalue"/>
	      <m:apply>
		<m:power/>
		<m:ci>X</m:ci>
		<m:cn>2</m:cn>
	      </m:apply>
	    </m:apply>
	  </m:math> is known as the <term>mean squared value</term> of
	  <m:math><m:ci>X</m:ci></m:math> and represents the "power"
	  in the random variable.
	</item>
	<item><m:math>
	    <m:apply>
	      <m:eq/>
	      <m:apply>
		<m:ci type="fn">f</m:ci>
		<m:ci>X</m:ci>
	      </m:apply>
	      <m:apply>
		<m:power/>
		<m:apply>
		  <m:minus/>
		  <m:ci>X</m:ci>
		  <m:ci><m:msub>
		      <m:mi>m</m:mi>
		      <m:mi>X</m:mi>
		    </m:msub></m:ci>
		</m:apply>
		<m:cn>2</m:cn>
	      </m:apply>
	    </m:apply>
	  </m:math>. The so-called second central difference of a
	  random variable is its <term>variance</term>, usually
	  denoted by 
	  <m:math>
	    <m:ci><m:msubsup>
		<m:mi>σ</m:mi>
		<m:mi>X</m:mi>
		<m:mn>2</m:mn>
	      </m:msubsup></m:ci>
	  </m:math>.  This expression for the variance simplifies to 
	  <m:math>
	    <m:apply>
	      <m:eq/>
	      <m:ci><m:msubsup>
		  <m:mi>σ</m:mi>
		  <m:mi>X</m:mi>
		  <m:mn>2</m:mn>
		</m:msubsup></m:ci>
	      <m:apply>
		<m:minus/>
		<m:apply>
		  <m:csymbol definitionURL="http://cnx.rice.edu/cd/cnxmath.ocd#expectedvalue"/>
		  <m:apply>
		    <m:power/>
		    <m:ci>X</m:ci>
		    <m:cn>2</m:cn>
		  </m:apply>
		</m:apply>
		<m:apply>
		  <m:power/>
		  <m:apply>
		    <m:csymbol definitionURL="http://cnx.rice.edu/cd/cnxmath.ocd#expectedvalue"/>
		    <m:ci>X</m:ci>
		  </m:apply>
		  <m:cn>2</m:cn>
		</m:apply>
	      </m:apply>
	    </m:apply>
	  </m:math>, which expresses the variance operator 
	  <m:math>
	    <m:apply>
	      <m:variance/>
	      <m:ci>·</m:ci>
	    </m:apply>
	  </m:math>. The square root of the variance <m:math>
	    <m:ci><m:msub> <m:mi>σ</m:mi> <m:mi>X</m:mi>
	      </m:msub></m:ci> </m:math> is the <term>standard
	    deviation</term> and measures the spread of the distribution
	  of <m:math><m:ci>X</m:ci></m:math>.  Among all possible
	  second differences 
	  <m:math>
	    <m:apply>
	      <m:power/>
	      <m:apply>
		<m:minus/>
		<m:ci>X</m:ci>
		<m:ci>c</m:ci>
	      </m:apply>
	      <m:cn>2</m:cn>
	    </m:apply>
	  </m:math>, the minimum value occurs when 
	  <m:math>
	    <m:apply>
	      <m:eq/>
	      <m:ci>c</m:ci>
	      <m:ci><m:msub>
		  <m:mi>m</m:mi>
		  <m:mi>X</m:mi>
		</m:msub></m:ci>
	    </m:apply>
	  </m:math> (simply evaluate the derivative with respect to
	  <m:math><m:ci>c</m:ci></m:math> and equate it to
	  zero).
	</item>
	<item><m:math>
	    <m:apply>
	      <m:eq/>
	      <m:apply>
		<m:ci type="fn">f</m:ci>
		<m:ci>X</m:ci>
	      </m:apply>
	      <m:apply>
		<m:power/>
		<m:ci>X</m:ci>
		<m:ci>n</m:ci>
	      </m:apply>
	    </m:apply>
	  </m:math>.  
	  <m:math>
	    <m:apply>
	      <m:csymbol definitionURL="http://cnx.rice.edu/cd/cnxmath.ocd#expectedvalue"/>
	      <m:apply>
		<m:power/>
		<m:ci>X</m:ci>
		<m:ci>n</m:ci>
	      </m:apply>
	    </m:apply>
	  </m:math> is the <term><m:math> <m:ci><m:msup>
		  <m:mi>n</m:mi> <m:mi>th</m:mi> </m:msup></m:ci> </m:math>
	    moment</term> of the random variable and <m:math>
	    <m:apply>
	      <m:csymbol definitionURL="http://cnx.rice.edu/cd/cnxmath.ocd#expectedvalue"/>
	      <m:apply>
		<m:power/>
		<m:apply>
		  <m:minus/>
		  <m:ci>X</m:ci>
		  <m:ci><m:msub>
		      <m:mi>m</m:mi>
		      <m:mi>X</m:mi>
		    </m:msub></m:ci>
		</m:apply>
		<m:ci>n</m:ci>
	      </m:apply>
	    </m:apply>
	  </m:math> the <m:math>
	    <m:ci><m:msup>
		<m:mi>n</m:mi>
		<m:mi>th</m:mi>
	      </m:msup></m:ci>
	  </m:math> central moment.
	</item>
	<item><m:math>
	    <m:apply>
	      <m:eq/>
	      <m:apply>
		<m:ci type="fn">f</m:ci>
		<m:ci>X</m:ci>
	      </m:apply>
	      <m:apply>
		<m:exp/>
		<m:apply>
		  <m:times/>
		  <m:imaginaryi/>
		  <m:ci>u</m:ci>
		  <m:ci>X</m:ci>
		</m:apply>
	      </m:apply>
	    </m:apply>
	  </m:math>.  The <term>characteristic function</term> of a
	  random variable is essentially the Fourier Transform of the
	  probability density function.
	  <equation id="eqn2">
	    <m:math>
	      <m:apply>
		<m:eq/>
		<m:apply>
		  <m:equivalent/>
		  <m:apply>
		    <m:csymbol definitionURL="http://cnx.rice.edu/cd/cnxmath.ocd#expectedvalue"/>
		    <m:apply>
		      <m:exp/>
		      <m:apply>
			<m:times/>
			<m:imaginaryi/>
			<m:ci>u</m:ci>
			<m:ci>X</m:ci>
		      </m:apply>
		    </m:apply>
		  </m:apply>
		  <m:apply>
		    <m:ci type="fn"><m:msub>
			<m:mi>Φ</m:mi>
			<m:mi>X</m:mi>
		      </m:msub></m:ci>
		    <m:apply>
		      <m:times/>
		      <m:imaginaryi/>
		      <m:ci>u</m:ci>
		    </m:apply>
		  </m:apply>
		</m:apply>
		<m:apply>
		  <m:int/>
		  <m:bvar><m:ci>x</m:ci></m:bvar>
		  <m:lowlimit>
		    <m:apply>
		      <m:minus/>
		      <m:infinity/>
		    </m:apply>
		  </m:lowlimit>
		  <m:uplimit>
		    <m:infinity/>
		  </m:uplimit>
		  <m:apply>
		    <m:times/>
		    <m:apply>
		      <m:csymbol definitionURL="http://cnx.rice.edu/cd/cnxmath.ocd#pdf">p</m:csymbol>
		      <m:bvar>
			<m:ci>X</m:ci>
		      </m:bvar>
		      <m:ci>x</m:ci>
		    </m:apply>
		    <m:apply>
		      <m:exp/>
		      <m:apply>
			<m:times/>
			<m:imaginaryi/>
			<m:ci>u</m:ci>
			<m:ci>x</m:ci>
		      </m:apply>
		    </m:apply>
		  </m:apply>
		</m:apply>
	      </m:apply>
	    </m:math>
	  </equation>
	  The moments of a random variable can be calculated from the
	  derivatives of the characteristic function evaluated at the
	  origin.
	  <equation id="eqn3">
	    <m:math>
	      <m:apply>
		<m:eq/>
		<m:apply>
		  <m:csymbol definitionURL="http://cnx.rice.edu/cd/cnxmath.ocd#expectedvalue"/>
		  <m:apply>
		    <m:power/>
		    <m:ci>X</m:ci>
		    <m:ci>n</m:ci>
		  </m:apply>
		</m:apply>
		<m:apply>
		  <m:times/>
		  <m:apply>
		    <m:power/>
		    <m:imaginaryi/>
		    <m:apply>
		      <m:minus/>
		      <m:ci>n</m:ci>
		    </m:apply>
		  </m:apply>
		  <m:apply>
		    <m:csymbol definitionURL="http://cnx.rice.edu/cd/cnxmath.ocd#evaluateat"/>
		    <m:bvar><m:ci>u</m:ci></m:bvar>
		    <m:condition>
		      <m:cn>0</m:cn>
		    </m:condition>
		    <m:apply>
		      <m:diff/>
		      <m:bvar>
			<m:ci>u</m:ci>
			<m:degree><m:ci>n</m:ci></m:degree>
		      </m:bvar>
		      <m:degree><m:ci>n</m:ci></m:degree>
		      <m:apply>
			<m:ci type="fn"><m:msub>
			    <m:mi>Φ</m:mi>
			    <m:mi>X</m:mi>
			  </m:msub></m:ci>
			<m:apply>
			  <m:times/>
			  <m:imaginaryi/>
			  <m:ci>u</m:ci>
			</m:apply>
		      </m:apply>
		    </m:apply>
		  </m:apply>
		</m:apply>
	      </m:apply>
	    </m:math>
	  </equation>
	</item>
      </list>

    </para>
  </content> 
</document>
