Skip to content Skip to navigation

Connexions

You are here: Home » Content » Statistical terminology

Navigation

Recently Viewed

This feature requires Javascript to be enabled.
 

Statistical terminology

Module by: Christopher Curran. E-mail the author

Summary: This module contains a set of definitions from statistics that might be useful for advanced undergraduates.

Important definitions in statistics

It is not unusual for students to forget important concepts learned in an earlier course. This set of definitions is intended to stir memories of those wonderful times when you were learning statistics and econometrics. It is not intended to replace a statistics course but to provide you with a handy guide to the denfinition of some important terms in the statistical tools used by economists.

Random variables

Random experiment

A random experiment is an experiment whose outcome is uncertain.

Outcome space

The outcome space (also sometimes referred to as the sample space) is the list of all possible outcomes of a random experiment.

Example 1: Single toss of a coin.

Consider the toss of a coin. Since the outcome is uncertain, tossing the coin is an example of a random experiment. The outcome space consists of a heads and a tails. If we let X be 0 if the outcome is a heads and let X equal 1 if the outcome is a tails, then X is a random variable. Since X only can take on integer values (0 or 1), it is a discrete random variable.

Random variable

A random variable is a number that can be assigned to an outcome of a random experiment. A discrete random variable has a finite number of possible values while a continuous random variable has an infinite number of potential values.

Non-stochastic variable

A non-stochastic variable is any variable that is not a random variable; i.e., does not represent the outcome of a random experiment.

Example 2: Multiple tosses of a coin.

Let x equal the number of heads that occur when a coin is tossed n times. The tossing of the coin n times is a random experiment. The outcome space of this random experiment is an integar between 0 and n. Since the value x is equal represents the outcome of a random experiment, it is a random variable.

Random sample

A random sample of size n out of a population of size N has the characteristic that every member of the population is equally likely to be chosen.

Example 3: Height of college age women.

Consider a random sample of the population of college age women. The height, x, of any woman chosen from this population is a random variable with a value somewhere in the outcome space, where the outcome space is a number between (say) 24 and 96 inches. Since in theory we can have as accurate a measurement as we might like, x can be thought of as being a continuous random variable.

Probability

General terms

Probability distribution for a discrete random variable.

Consider a discrete random variable x i x i MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaaiaadIhadaWgaaWcbaGaamyAaaqabaaaaa@3800@ that represents an outcome of the n potential outcomes of a random experiment—that is, the set of potential outcomes is represented by X=( x 1 ,, x n ). X=( x 1 ,, x n ). MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaaiaahIfacqGH9aqpdaqadaqaaiaadIhadaWgaaWcbaGaaGymaaqabaGccaGGSaGaeSOjGSKaaiilaiaadIhadaWgaaWcbaGaamOBaaqabaaakiaawIcacaGLPaaacaGGUaaaaa@40A1@ Pr( x i ) Pr( x i ) MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaaiGaccfacaGGYbWaaeWaaeaacaWG4bWaaSbaaSqaaiaadMgaaeqaaaGccaGLOaGaayzkaaaaaa@3B5F@ Any function is a probability if and only if (1) Pr( x i )0 for all i=1,,n, Pr( x i )0 for all i=1,,n, MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaaiGaccfacaGGYbWaaeWaaeaacaWG4bWaaSbaaSqaaiaadMgaaeqaaaGccaGLOaGaayzkaaGaeyyzImRaaGimaiaabccacaqGMbGaae4BaiaabkhacaqGGaGaaeyyaiaabYgacaqGSbGaaeiiaiaadMgacqGH9aqpcaaIXaGaaiilaiablAciljaacYcacaWGUbGaaiilaaaa@4C2E@ (2) Pr( x i x j )=Pr( x i )+Pr( x j ) Pr( x i x j )=Pr( x i )+Pr( x j ) MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaaiGaccfacaGGYbWaaeWaaeaacaWG4bWaaSbaaSqaaiaadMgaaeqaaOGaeyOkIGSaamiEamaaBaaaleaacaWGQbaabeaaaOGaayjkaiaawMcaaiabg2da9iGaccfacaGGYbWaaeWaaeaacaWG4bWaaSbaaSqaaiaadMgaaeqaaaGccaGLOaGaayzkaaGaey4kaSIaciiuaiaackhadaqadaqaaiaadIhadaWgaaWcbaGaamOAaaqabaaakiaawIcacaGLPaaaaaa@4BF6@ for all i and j, and (3) i=1 n Pr( x i ) =1. i=1 n Pr( x i ) =1. MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaamaaqahabaGaciiuaiaackhadaqadaqaaiaadIhadaWgaaWcbaGaamyAaaqabaaakiaawIcacaGLPaaaaSqaaiaadMgacqGH9aqpcaaIXaaabaGaamOBaaqdcqGHris5aOGaeyypa0JaaGymaiaac6caaaa@43C0@ An example of a discrete distribution is in Example 4.

Example 4

Discrete distribution.

Figure 1 illustrates a discrete probability distribution where x i x i MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaaiaadIhadaWgaaWcbaGaamyAaaqabaaaaa@3800@ goes from 1 to 8. The areas in the shaded rectangles sum to 1.

Figure 1: The areas of the rectangles sum to 1.
A discrete probability function
Graph of a discrete probability function.

Probability density function.

If x i x i MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaaiaadIhadaWgaaWcbaGaamyAaaqabaaaaa@3800@ is a continuous random variable, the concept of a probability distribution is replaced by a probility density function (pdf). A function, f( x ), f( x ), MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaaiaadAgadaqadaqaaiaadIhaaiaawIcacaGLPaaacaGGSaaaaa@3A0A@ is a pdf for the continuous random variable x if and only if (1) f( x )0 f( x )0 MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaaiaadAgadaqadaqaaiaadIhaaiaawIcacaGLPaaacqGHLjYScaaIWaaaaa@3BDA@ for -<x<; -<x<; MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaaiaac2cacqGHEisPcqGH8aapcaWG4bGaeyipaWJaeyOhIuQaai4oaaaa@3D40@ (2) f( x )dx =1; f( x )dx =1; MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaamaapehabaGaamOzamaabmaabaGaamiEaaGaayjkaiaawMcaaiaadsgacaWG4baaleaacqGHsislcqGHEisPaeaacqGHEisPa0Gaey4kIipakiabg2da9iaaigdacaGG7aaaaa@4402@ and (3) f( x ) f( x ) MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaaiaadAgadaqadaqaaiaadIhaaiaawIcacaGLPaaaaaa@395A@ has a finite number of discontinuities. By definition Pr( axb )= a b f( x )dx . Pr( axb )= a b f( x )dx . MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaaiGaccfacaGGYbWaaeWaaeaacaWGHbGaeyizImQaamiEaiabgsMiJkaadkgaaiaawIcacaGLPaaacqGH9aqpdaWdXbqaaiaadAgadaqadaqaaiaadIhaaiaawIcacaGLPaaacaWGKbGaamiEaaWcbaGaamyyaaqaaiaadkgaa0Gaey4kIipakiaac6caaaa@4AC1@ Example 5 offers an example of a pfd.

Example 5: Probability distribution function for a continuous random variable.

Figure 2: The red line is the pdf for the random variable x. The shaded in area under the pdf is equal to the probability that x falls between a and b. The total area under the pdf is equal to 1.
Graph of a pdf.

Cumulative distribution function (cdf).

The cumulative distribution function is given by F( x )=Pr( Xx ). F( x )=Pr( Xx ). MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaaiaadAeadaqadaqaaiaadIhaaiaawIcacaGLPaaacqGH9aqpciGGqbGaaiOCamaabmaabaGaamiwaiabgsMiJkaadIhaaiaawIcacaGLPaaacaGGUaaaaa@41D6@ For a discrete variable the cdf is F( x w )= i=1 w f( x i ) . F( x w )= i=1 w f( x i ) . MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaaiaadAeadaqadaqaaiaadIhadaWgaaWcbaGaam4DaaqabaaakiaawIcacaGLPaaacqGH9aqpdaaeWbqaaiaadAgadaqadaqaaiaadIhadaWgaaWcbaGaamyAaaqabaaakiaawIcacaGLPaaaaSqaaiaadMgacqGH9aqpcaaIXaaabaGaam4DaaqdcqGHris5aOGaaiOlaaaa@46B0@ For a continuous distribution, the cdf is F( x )= x f( w )dw. F( x )= x f( w )dw. MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaaiaadAeadaqadaqaaiaadIhaaiaawIcacaGLPaaacqGH9aqpdaWdXbqaaiaadAgadaqadaqaaiaadEhaaiaawIcacaGLPaaacaWGKbGaam4Daiaac6caaSqaaiabgkHiTiabg6HiLcqaaiaadIhaa0Gaey4kIipaaaa@460B@ Example 6 illustrates the calculation of the cumulative distribution function for a continuous random variable.

Example 6: The cumulative distributon function.

Let f( x )= x 2 f( x )= x 2 MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaaiaadAgadaqadaqaaiaadIhaaiaawIcacaGLPaaacqGH9aqpcaWG4bWaaWbaaSqabeaacaaIYaaaaaaa@3C46@ be the pdf for the random variable x defined between 0 and 1. The cumulative distribution function for any a is F( a )= 0 a x 2 dx = 1 3 x 3 | 0 a = a 3 3 . F( a )= 0 a x 2 dx = 1 3 x 3 | 0 a = a 3 3 . MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaaiaadAeadaqadaqaaiaadggaaiaawIcacaGLPaaacqGH9aqpdaWdXbqaaiaadIhadaahaaWcbeqaaiaaikdaaaGccaWGKbGaamiEaaWcbaGaaGimaaqaaiaadggaa0Gaey4kIipakiabg2da9maalaaabaGaaGymaaqaaiaaiodaaaWaaqGaaeaacaWG4bWaaWbaaSqabeaacaaIZaaaaaGccaGLiWoadaqhaaWcbaGaaGimaaqaaiaadggaaaGccqGH9aqpdaWcaaqaaiaadggadaahaaWcbeqaaiaaiodaaaaakeaacaaIZaaaaiaac6caaaa@4E5D@

Mathematical expectation

Mathematical expectation for a function.

The mathematical expectation of the function g( x ) g( x ) MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaaiaadEgadaqadaqaaiaadIhaaiaawIcacaGLPaaaaaa@395B@ is E( g( x ) )= x g( x )f( x )dx E( g( x ) )= x g( x )f( x )dx MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaaiaadweadaqadaqaaiaadEgadaqadaqaaiaadIhaaiaawIcacaGLPaaaaiaawIcacaGLPaaacqGH9aqpdaWdrbqaaiaadEgadaqadaqaaiaadIhaaiaawIcacaGLPaaacaWGMbWaaeWaaeaacaWG4baacaGLOaGaayzkaaGaamizaiaadIhaaSqaaiaadIhaaeqaniabgUIiYdaaaa@48C4@ where x is a random variable. Example 7 shows the calculation of the expected value of a function.

Example 7: Expected value calculation.

Let f( x )= x a f( x )= x a MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaaiaadAgadaqadaqaaiaadIhaaiaawIcacaGLPaaacqGH9aqpcaWG4bWaaWbaaSqabeaacaWGHbaaaaaa@3C70@ be a pdf for 0x1 0x1 MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaaiaaicdacqGHKjYOcaWG4bGaeyizImQaaGymaaaa@3BC5@ and a>0. a>0. MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaaiaadggacqGH+aGpcaaIWaGaaiOlaaaa@3943@ Let g( x )= x 3 . g( x )= x 3 . MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaaiaadEgadaqadaqaaiaadIhaaiaawIcacaGLPaaacqGH9aqpcaWG4bWaaWbaaSqabeaacaaIZaaaaOGaaiOlaaaa@3D04@ We can calculate E[ g( x ) ]= 0 1 ( x 3 ) x a dx = 0 1 x a+3 dx = 1 a+4 x a+4 | 0 1 = 1 a+4 . E[ g( x ) ]= 0 1 ( x 3 ) x a dx = 0 1 x a+3 dx = 1 a+4 x a+4 | 0 1 = 1 a+4 . MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaaiaadweadaWadaqaaiaadEgadaqadaqaaiaadIhaaiaawIcacaGLPaaaaiaawUfacaGLDbaacqGH9aqpdaWdXbqaamaabmaabaGaamiEamaaCaaaleqabaGaaG4maaaaaOGaayjkaiaawMcaaiaadIhadaahaaWcbeqaaiaadggaaaGccaWGKbGaamiEaaWcbaGaaGimaaqaaiaaigdaa0Gaey4kIipakiabg2da9maapehabaGaamiEamaaCaaaleqabaGaamyyaiabgUcaRiaaiodaaaGccaWGKbGaamiEaaWcbaGaaGimaaqaaiaaigdaa0Gaey4kIipakiabg2da9maalaaabaGaaGymaaqaaiaadggacqGHRaWkcaaI0aaaamaaeiaabaGaamiEamaaCaaaleqabaGaamyyaiabgUcaRiaaisdaaaaakiaawIa7amaaDaaaleaacaaIWaaabaGaaGymaaaakiabg2da9maalaaabaGaaGymaaqaaiaadggacqGHRaWkcaaI0aaaaiaac6caaaa@6368@

The mean of a distribution.

The population mean, μ, μ, MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaaiabeY7aTjaacYcaaaa@384F@ of a random variable, x, with a pdf of f( x ) f( x ) MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaaiaadAgadaqadaqaaiaadIhaaiaawIcacaGLPaaaaaa@395A@ is defined to be the expected value of x: μ=E( x )= xf( x )dx. μ=E( x )= xf( x )dx. MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaaiabeY7aTjabg2da9iaadweadaqadaqaaiaadIhaaiaawIcacaGLPaaacqGH9aqpdaWdbaqaaiaadIhacaWGMbWaaeWaaeaacaWG4baacaGLOaGaayzkaaGaamizaiaadIhacaGGUaaaleqabeqdcqGHRiI8aaaa@45FC@ Example 8 illustrates the calculation of the population mean.

Example 8: Calculation of the population mean.

Assume we have the same pdf used in Example 7. The population mean for this distribution is μ=E[ x ]= 0 1 ( x ) x a dx = 0 1 x a+1 dx = 1 a+2 x a+2 | 0 1 = 1 a+2 . μ=E[ x ]= 0 1 ( x ) x a dx = 0 1 x a+1 dx = 1 a+2 x a+2 | 0 1 = 1 a+2 . MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaaiabeY7aTjabg2da9iaadweadaWadaqaaiaadIhaaiaawUfacaGLDbaacqGH9aqpdaWdXbqaamaabmaabaGaamiEaaGaayjkaiaawMcaaiaadIhadaahaaWcbeqaaiaadggaaaGccaWGKbGaamiEaaWcbaGaaGimaaqaaiaaigdaa0Gaey4kIipakiabg2da9maapehabaGaamiEamaaCaaaleqabaGaamyyaiabgUcaRiaaigdaaaGccaWGKbGaamiEaaWcbaGaaGimaaqaaiaaigdaa0Gaey4kIipakiabg2da9maalaaabaGaaGymaaqaaiaadggacqGHRaWkcaaIYaaaamaaeiaabaGaamiEamaaCaaaleqabaGaamyyaiabgUcaRiaaikdaaaaakiaawIa7amaaDaaaleaacaaIWaaabaGaaGymaaaakiabg2da9maalaaabaGaaGymaaqaaiaadggacqGHRaWkcaaIYaaaaiaac6caaaa@62B3@

The variance of a distribution.

The population variance, σ 2 , σ 2 , MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaaiabeo8aZnaaCaaaleqabaGaaGOmaaaakiaacYcaaaa@394F@ of a distribution is σ 2 =E[ ( xμ ) 2 ]. σ 2 =E[ ( xμ ) 2 ]. MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaaiabeo8aZnaaCaaaleqabaGaaGOmaaaakiabg2da9iaadweadaWadaqaamaabmaabaGaamiEaiabgkHiTiabeY7aTbGaayjkaiaawMcaamaaCaaaleqabaGaaGOmaaaaaOGaay5waiaaw2faaiaac6caaaa@432F@ Example 9 shows a shortcut way to calculate the population variance.

Example 9: Calculation of the population variance using the expected value operator.

Define the variance operator, V, to be:

V( x )=E[ ( xμ ) 2 ]. V( x )=E[ ( xμ ) 2 ]. MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaaiaadAfadaqadaqaaiaadIhaaiaawIcacaGLPaaacqGH9aqpcaWGfbWaamWaaeaadaqadaqaaiaadIhacqGHsislcqaH8oqBaiaawIcacaGLPaaadaahaaWcbeqaaiaaikdaaaaakiaawUfacaGLDbaacaGGUaaaaa@43DA@

Then,

E[ ( xμ ) 2 ]= ( xμ ) 2 f( x )dx . E[ ( xμ ) 2 ]= ( xμ ) 2 f( x )dx . MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaaiaadweadaWadaqaamaabmaabaGaamiEaiabgkHiTiabeY7aTbGaayjkaiaawMcaamaaCaaaleqabaGaaGOmaaaaaOGaay5waiaaw2faaiabg2da9maapeaabaWaaeWaaeaacaWG4bGaeyOeI0IaeqiVd0gacaGLOaGaayzkaaWaaWbaaSqabeaacaaIYaaaaOGaamOzamaabmaabaGaamiEaaGaayjkaiaawMcaaiaadsgacaWG4baaleqabeqdcqGHRiI8aOGaaiOlaaaa@4DF1@

Squaring the term in the integral gives: ( x 2 2μx+ μ 2 )f( x )dx =E( x 2 2μx+ μ 2 ). ( x 2 2μx+ μ 2 )f( x )dx =E( x 2 2μx+ μ 2 ). MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaamaapeaabaWaaeWaaeaacaWG4bWaaWbaaSqabeaacaaIYaaaaOGaeyOeI0IaaGOmaiabeY7aTjaadIhacqGHRaWkcqaH8oqBdaahaaWcbeqaaiaaikdaaaaakiaawIcacaGLPaaacaWGMbWaaeWaaeaacaWG4baacaGLOaGaayzkaaGaamizaiaadIhaaSqabeqaniabgUIiYdGccqGH9aqpcaWGfbWaaeWaaeaacaWG4bWaaWbaaSqabeaacaaIYaaaaOGaeyOeI0IaaGOmaiabeY7aTjaadIhacqGHRaWkcqaH8oqBdaahaaWcbeqaaiaaikdaaaaakiaawIcacaGLPaaacaGGUaaaaa@5687@

Expand of the left-hand-side of this equality:

x 2 f( x )dx 2μxf( x )dx+ μ 2 f( x )dx =E( x 2 )E( 2μx )+E( μ 2 ). x 2 f( x )dx 2μxf( x )dx+ μ 2 f( x )dx =E( x 2 )E( 2μx )+E( μ 2 ). MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaamaapeaabaGaamiEamaaCaaaleqabaGaaGOmaaaakiaadAgadaqadaqaaiaadIhaaiaawIcacaGLPaaacaWGKbGaamiEaaWcbeqab0Gaey4kIipakiabgkHiTmaapeaabaGaaGOmaiabeY7aTjaadIhacaWGMbWaaeWaaeaacaWG4baacaGLOaGaayzkaaGaamizaiaadIhacqGHRaWkaSqabeqaniabgUIiYdGcdaWdbaqaaiabeY7aTnaaCaaaleqabaGaaGOmaaaakiaadAgadaqadaqaaiaadIhaaiaawIcacaGLPaaacaWGKbGaamiEaaWcbeqab0Gaey4kIipakiabg2da9iaadweadaqadaqaaiaadIhadaahaaWcbeqaaiaaikdaaaaakiaawIcacaGLPaaacqGHsislcaWGfbWaaeWaaeaacaaIYaGaeqiVd0MaamiEaaGaayjkaiaawMcaaiabgUcaRiaadweadaqadaqaaiabeY7aTnaaCaaaleqabaGaaGOmaaaaaOGaayjkaiaawMcaaiaac6caaaa@685C@

Thus, we have established that:

E[ ( xμ ) 2 ]=E( x 2 )E( 2μx )+E( μ 2 ). E[ ( xμ ) 2 ]=E( x 2 )E( 2μx )+E( μ 2 ). MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaaiaadweadaWadaqaamaabmaabaGaamiEaiabgkHiTiabeY7aTbGaayjkaiaawMcaamaaCaaaleqabaGaaGOmaaaaaOGaay5waiaaw2faaiabg2da9iaadweadaqadaqaaiaadIhadaahaaWcbeqaaiaaikdaaaaakiaawIcacaGLPaaacqGHsislcaWGfbWaaeWaaeaacaaIYaGaeqiVd0MaamiEaaGaayjkaiaawMcaaiabgUcaRiaadweadaqadaqaaiabeY7aTnaaCaaaleqabaGaaGOmaaaaaOGaayjkaiaawMcaaiaac6caaaa@5149@

Evaluating the last two terms gives

E( 2μx )= 2μxf( x )dx =2μ x dx=2 μ 2 E( 2μx )= 2μxf( x )dx =2μ x dx=2 μ 2 MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaaiaadweadaqadaqaaiaaikdacqaH8oqBcaWG4baacaGLOaGaayzkaaGaeyypa0Zaa8qaaeaacaaIYaGaeqiVd0MaamiEaiaadAgadaqadaqaaiaadIhaaiaawIcacaGLPaaacaWGKbGaamiEaaWcbeqab0Gaey4kIipakiabg2da9iaaikdacqaH8oqBdaWdbaqaaiaadIhaaSqabeqaniabgUIiYdGccaWGKbGaamiEaiabg2da9iaaikdacqaH8oqBdaahaaWcbeqaaiaaikdaaaaaaa@543D@

and

E( μ 2 )= μ 2 f( x )dx E( μ 2 )= μ 2 f( x )dx MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaaiaadweadaqadaqaaiabeY7aTnaaCaaaleqabaGaaGOmaaaaaOGaayjkaiaawMcaaiabg2da9maapeaabaGaeqiVd02aaWbaaSqabeaacaaIYaaaaOGaamOzamaabmaabaGaamiEaaGaayjkaiaawMcaaiaadsgacaWG4baaleqabeqdcqGHRiI8aaaa@45E6@

or, since f( x )dx =1, f( x )dx =1, MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaamaapeaabaGaamOzamaabmaabaGaamiEaaGaayjkaiaawMcaaiaadsgacaWG4baaleqabeqdcqGHRiI8aOGaeyypa0JaaGymaiaacYcaaaa@3FB6@ that E( μ 2 )= μ 2 . E( μ 2 )= μ 2 . MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaaiaadweadaqadaqaaiabeY7aTnaaCaaaleqabaGaaGOmaaaaaOGaayjkaiaawMcaaiabg2da9iabeY7aTnaaCaaaleqabaGaaGOmaaaakiaac6caaaa@3F46@ Thus, E[ ( xμ ) 2 ]=E( x 2 )2 μ 2 + μ 2 E[ ( xμ ) 2 ]=E( x 2 )2 μ 2 + μ 2 MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaaiaadweadaWadaqaamaabmaabaGaamiEaiabgkHiTiabeY7aTbGaayjkaiaawMcaamaaCaaaleqabaGaaGOmaaaaaOGaay5waiaaw2faaiabg2da9iaadweadaqadaqaaiaadIhadaahaaWcbeqaaiaaikdaaaaakiaawIcacaGLPaaacqGHsislcaaIYaGaeqiVd02aaWbaaSqabeaacaaIYaaaaOGaey4kaSIaeqiVd02aaWbaaSqabeaacaaIYaaaaaaa@4BDD@ or

E[ ( xμ ) 2 ]=E( x 2 ) μ 2 . E[ ( xμ ) 2 ]=E( x 2 ) μ 2 . MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaaiaadweadaWadaqaamaabmaabaGaamiEaiabgkHiTiabeY7aTbGaayjkaiaawMcaamaaCaaaleqabaGaaGOmaaaaaOGaay5waiaaw2faaiabg2da9iaadweadaqadaqaaiaadIhadaahaaWcbeqaaiaaikdaaaaakiaawIcacaGLPaaacqGHsislcqaH8oqBdaahaaWcbeqaaiaaikdaaaGccaGGUaaaaa@4852@

For example, in Example 8 we found that μ= 1 a+2 . μ= 1 a+2 . MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaaiabeY7aTjabg2da9maalaaabaGaaGymaaqaaiaadggacqGHRaWkcaaIYaaaaiaac6caaaa@3CA6@ The expected value of x 2 x 2 MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaaiaadIhadaahaaWcbeqaaiaaikdaaaaaaa@37CF@ is

E[ x 2 ]= 0 1 ( x 2 ) x a dx = 0 1 x a+2 dx = 1 a+3 x a+3 | 0 1 = 1 a+3 . E[ x 2 ]= 0 1 ( x 2 ) x a dx = 0 1 x a+2 dx = 1 a+3 x a+3 | 0 1 = 1 a+3 . MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaaiaadweadaWadaqaaiaadIhadaahaaWcbeqaaiaaikdaaaaakiaawUfacaGLDbaacqGH9aqpdaWdXbqaamaabmaabaGaamiEamaaCaaaleqabaGaaGOmaaaaaOGaayjkaiaawMcaaiaadIhadaahaaWcbeqaaiaadggaaaGccaWGKbGaamiEaaWcbaGaaGimaaqaaiaaigdaa0Gaey4kIipakiabg2da9maapehabaGaamiEamaaCaaaleqabaGaamyyaiabgUcaRiaaikdaaaGccaWGKbGaamiEaaWcbaGaaGimaaqaaiaaigdaa0Gaey4kIipakiabg2da9maalaaabaGaaGymaaqaaiaadggacqGHRaWkcaaIZaaaamaaeiaabaGaamiEamaaCaaaleqabaGaamyyaiabgUcaRiaaiodaaaaakiaawIa7amaaDaaaleaacaaIWaaabaGaaGymaaaakiabg2da9maalaaabaGaaGymaaqaaiaadggacqGHRaWkcaaIZaaaaiaac6caaaa@61E1@

Thus, the variance of the distribution is

V( x )= 1 a+3 ( 1 a+2 ) 2 V( x )= 1 a+3 ( 1 a+2 ) 2 MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaaiaadAfadaqadaqaaiaadIhaaiaawIcacaGLPaaacqGH9aqpdaWcaaqaaiaaigdaaeaacaWGHbGaey4kaSIaaG4maaaacqGHsisldaqadaqaamaalaaabaGaaGymaaqaaiaadggacqGHRaWkcaaIYaaaaaGaayjkaiaawMcaamaaCaaaleqabaGaaGOmaaaaaaa@444E@

or V( x )= ( a+2 ) 2 ( a+3 ) ( a+3 ) ( a+2 ) 2 = a 2 +3a+1 ( a+3 ) ( a+2 ) 2 . V( x )= ( a+2 ) 2 ( a+3 ) ( a+3 ) ( a+2 ) 2 = a 2 +3a+1 ( a+3 ) ( a+2 ) 2 . MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaaiaadAfadaqadaqaaiaadIhaaiaawIcacaGLPaaacqGH9aqpdaWcaaqaamaabmaabaGaamyyaiabgUcaRiaaikdaaiaawIcacaGLPaaadaahaaWcbeqaaiaaikdaaaGccqGHsisldaqadaqaaiaadggacqGHRaWkcaaIZaaacaGLOaGaayzkaaaabaWaaeWaaeaacaWGHbGaey4kaSIaaG4maaGaayjkaiaawMcaamaabmaabaGaamyyaiabgUcaRiaaikdaaiaawIcacaGLPaaadaahaaWcbeqaaiaaikdaaaaaaOGaeyypa0ZaaSaaaeaacaWGHbWaaWbaaSqabeaacaaIYaaaaOGaey4kaSIaaG4maiaadggacqGHRaWkcaaIXaaabaWaaeWaaeaacaWGHbGaey4kaSIaaG4maaGaayjkaiaawMcaamaabmaabaGaamyyaiabgUcaRiaaikdaaiaawIcacaGLPaaadaahaaWcbeqaaiaaikdaaaaaaOGaaiOlaaaa@5E3A@

Expected value operation rules.

As shown in Example 9, the expected value operation allows several linear operations. Let a and b be a non-stochastic variables and x be a random variable. Then we have

  1. E( a )=a, E( a )=a, MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaaiaadweadaqadaqaaiaadggaaiaawIcacaGLPaaacqGH9aqpcaWGHbGaaiilaaaa@3BBE@
  2. E( a x 2 +bx+c )=aE( x 2 )+bμ+c. E( a x 2 +bx+c )=aE( x 2 )+bμ+c. MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaaiaadweadaqadaqaaiaadggacaWG4bWaaWbaaSqabeaacaaIYaaaaOGaey4kaSIaamOyaiaadIhacqGHRaWkcaWGJbaacaGLOaGaayzkaaGaeyypa0JaamyyaiaadweadaqadaqaaiaadIhadaahaaWcbeqaaiaaikdaaaaakiaawIcacaGLPaaacqGHRaWkcaWGIbGaeqiVd0Maey4kaSIaam4yaiaac6caaaa@4BCC@
  3. E( ax+b )=aμ+b, E( ax+b )=aμ+b, MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaaiaadweadaqadaqaaiaadggacaWG4bGaey4kaSIaamOyaaGaayjkaiaawMcaaiabg2da9iaadggacqaH8oqBcqGHRaWkcaWGIbGaaiilaaaa@4203@

These rules work both for discrete and continuous random variables.

Joint distributions

The joint pdf for two random variables.

Any function, f( x,y ), f( x,y ), MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaaiaadAgadaqadaqaaiaadIhacaGGSaGaamyEaaGaayjkaiaawMcaaiaacYcaaaa@3BB8@ that has the characteristics

  1. f( x,y )0 f( x,y )0 MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaaiaadAgadaqadaqaaiaadIhacaGGSaGaamyEaaGaayjkaiaawMcaaiabgwMiZkaaicdaaaa@3D88@ for all x and y and
  2. y x f( x,y )dx dy =1 y x f( x,y )dx dy =1 MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaamaapefabaWaa8quaeaacaWGMbWaaeWaaeaacaWG4bGaaiilaiaadMhaaiaawIcacaGLPaaacaWGKbGaamiEaaWcbaGaamiEaaqab0Gaey4kIipakiaadsgacaWG5baaleaacaWG5baabeqdcqGHRiI8aOGaeyypa0JaaGymaaaa@4739@

is a joint pdf. This definition can be extended easily to include more than two random variables.

Covariance between two random variables.

If x and y are random variables, then the covariance between the two variables, Cov( x,y ) Cov( x,y ) MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaaiaadoeacaWGVbGaamODamaabmaabaGaamiEaiaacYcacaWG5baacaGLOaGaayzkaaaaaa@3CD4@ or σ xy , σ xy , MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaaiabeo8aZnaaBaaaleaacaWG4bGaamyEaaqabaGccaGGSaaaaa@3A8D@ is defined to be Cov( x,y )=E[ ( x μ x )( y μ y ) ]. Cov( x,y )=E[ ( x μ x )( y μ y ) ]. MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaaiaadoeacaWGVbGaamODamaabmaabaGaamiEaiaacYcacaWG5baacaGLOaGaayzkaaGaeyypa0JaamyramaadmaabaWaaeWaaeaacaWG4bGaeyOeI0IaeqiVd02aaSbaaSqaaiaadIhaaeqaaaGccaGLOaGaayzkaaWaaeWaaeaacaWG5bGaeyOeI0IaeqiVd02aaSbaaSqaaiaadMhaaeqaaaGccaGLOaGaayzkaaaacaGLBbGaayzxaaGaaiOlaaaa@4E02@ Expansion gives the alternative definition that σ xy =E( xy ) μ x μ y . σ xy =E( xy ) μ x μ y . MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaaiabeo8aZnaaBaaaleaacaWG4bGaamyEaaqabaGccqGH9aqpcaWGfbWaaeWaaeaacaWG4bGaamyEaaGaayjkaiaawMcaaiabgkHiTiabeY7aTnaaBaaaleaacaWG4baabeaakiabeY7aTnaaBaaaleaacaWG5baabeaakiaac6caaaa@46A3@

Stochastic independence.

The random variables x and y are stochastically independent if and only if σ xy =0. σ xy =0. MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaaiabeo8aZnaaBaaaleaacaWG4bGaamyEaaqabaGccqGH9aqpcaaIWaGaaiOlaaaa@3C4F@ An equivalent definition of independence is that x and y are stochastically independent if and only if f( x,y )=f( x )f( y ), f( x,y )=f( x )f( y ), MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaaiaadAgadaqadaqaaiaadIhacaGGSaGaamyEaaGaayjkaiaawMcaaiabg2da9iaadAgadaqadaqaaiaadIhaaiaawIcacaGLPaaacaWGMbWaaeWaaeaacaWG5baacaGLOaGaayzkaaGaaiilaaaa@43A1@ or, in words, if the joint pdf of the two random variables is equal to the product of the pdf of each random variable. From the definition of covariance it is easy to see that if two random variables are stochastically independent then E( xy )= μ x μ y . E( xy )= μ x μ y . MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaaiaadweadaqadaqaaiaadIhacaWG5baacaGLOaGaayzkaaGaeyypa0JaeqiVd02aaSbaaSqaaiaadIhaaeqaaOGaeqiVd02aaSbaaSqaaiaadMhaaeqaaOGaaiOlaaaa@41C2@

Correlation coefficient.

The correlation coefficient, ρ, ρ, MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaaiabeg8aYjaacYcaaaa@3859@ is defined to be ρ xy = σ xy σ x σ y . ρ xy = σ xy σ x σ y . MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaaiabeg8aYnaaBaaaleaacaWG4bGaamyEaaqabaGccqGH9aqpdaWcaaqaaiabeo8aZnaaBaaaleaacaWG4bGaamyEaaqabaaakeaacqaHdpWCdaWgaaWcbaGaamiEaaqabaGccqaHdpWCdaWgaaWcbaGaamyEaaqabaaaaOGaaiOlaaaa@4583@ The correlation coefficient is a unitless number that varies between -1 and +1. Clearly, two random variables are stochastically independent if and only if ρ xy =0. ρ xy =0. MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaaiabeg8aYnaaBaaaleaacaWG4bGaamyEaaqabaGccqGH9aqpcaaIWaGaaiOlaaaa@3C4C@

Discrete distributions

Binomial distribution.

The discrete random variable x has a binomial distribution if f( x )={ ( n x ) p x ( 1p ) nx ,  x=0,1,,n 0  elsewhere f( x )={ ( n x ) p x ( 1p ) nx ,  x=0,1,,n 0  elsewhere MathType@MTEF@5@5@+=feaagyart1ev2aaatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaaiaadAgadaqadaqaaiaadIhaaiaawIcacaGLPaaacqGH9aqpdaGabaabaeqabaWaaeWaaqaabeqaaiaad6gaaeaacaWG4baaaiaawIcacaGLPaaacaWGWbWaaWbaaSqabeaacaWG4baaaOWaaeWaaeaacaaIXaGaeyOeI0IaamiCaaGaayjkaiaawMcaamaaCaaaleqabaGaamOBaiabgkHiTiaadIhaaaGccaGGSaGaaeiiaiaabccacaWG4bGaeyypa0JaaGimaiaacYcacaaIXaGaaiilaiablAciljaacYcacaWGUbaabaGaaGimaiaabccacaqGGaGaaeyzaiaabYgacaqGZbGaaeyzaiaabEhacaqGObGaaeyzaiaabkhacaqGLbaaaiaawUhaaaaa@5C55@ where ( n x )= n! x!( nx ) . ( n x )= n! x!( nx ) . MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaamaabmaaeaqabeaacaWGUbaabaGaamiEaaaacaGLOaGaayzkaaGaeyypa0ZaaSaaaeaacaWGUbGaaiyiaaqaaiaadIhacaGGHaWaaeWaaeaacaWGUbGaeyOeI0IaamiEaaGaayjkaiaawMcaaaaacaGGUaaaaa@42D1@ For the binomial distribution, μ=np μ=np MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaaiabeY7aTjabg2da9iaad6gacaWGWbaaaa@3A8D@ and σ 2 =np( 1p ). σ 2 =np( 1p ). MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaaiabeo8aZnaaCaaaleqabaGaaGOmaaaakiabg2da9iaad6gacaWGWbWaaeWaaeaacaaIXaGaeyOeI0IaamiCaaGaayjkaiaawMcaaiaac6caaaa@4065@

Uniform distribution.

The discrete random variable x has a uniform distribution if f( x )={ 1 ba  if axb 0  elsewhere }. f( x )={ 1 ba  if axb 0  elsewhere }. MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaaiaadAgadaqadaqaaiaadIhaaiaawIcacaGLPaaacqGH9aqpdaGadaabaeqabaWaaSaaaeaacaaIXaaabaGaamOyaiabgkHiTiaadggaaaGaaeiiaiaabMgacaqGMbGaaeiiaiaadggacqGHKjYOcaWG4bGaeyizImQaamOyaaqaaiaaicdacaqGGaGaaeiiaiaabwgacaqGSbGaae4CaiaabwgacaqG3bGaaeiAaiaabwgacaqGYbGaaeyzaaaacaGL7bGaayzFaaGaaiOlaaaa@547D@ The mean and variance of the uniform distribution are μ= a+b 2 μ= a+b 2 MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaaiabeY7aTjabg2da9maalaaabaGaamyyaiabgUcaRiaadkgaaeaacaaIYaaaaaaa@3C20@ and σ 2 = ( ba ) 2 12 . σ 2 = ( ba ) 2 12 . MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaaiabeo8aZnaaCaaaleqabaGaaGOmaaaakiabg2da9maalaaabaWaaeWaaeaacaWGIbGaeyOeI0IaamyyaaGaayjkaiaawMcaamaaCaaaleqabaGaaGOmaaaaaOqaaiaaigdacaaIYaaaaiaac6caaaa@4114@

Poisson distribution.

The discrete random variable x has a Poisson distribution if f( x )={ m x e m x! ,  x=0,1, 0  elsewhere f( x )={ m x e m x! ,  x=0,1, 0  elsewhere MathType@MTEF@5@5@+=feaagyart1ev2aaatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaaiaadAgadaqadaqaaiaadIhaaiaawIcacaGLPaaacqGH9aqpdaGabaabaeqabaWaaSaaaeaacaWGTbWaaWbaaSqabeaacaWG4baaaOGaamyzamaaCaaaleqabaGaeyOeI0IaamyBaaaaaOqaaiaadIhacaGGHaaaaiaacYcacaqGGaGaaeiiaiaadIhacqGH9aqpcaaIWaGaaiilaiaaigdacaGGSaGaeSOjGSeabaGaaGimaiaabccacaqGGaGaaeyzaiaabYgacaqGZbGaaeyzaiaabEhacaqGObGaaeyzaiaabkhacaqGLbaaaiaawUhaaaaa@54A7@ For the Poisson distribution μ= σ 2 =m. μ= σ 2 =m. MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaaiabeY7aTjabg2da9iabeo8aZnaaCaaaleqabaGaaGOmaaaakiabg2da9iaad2gacaGGUaaaaa@3E05@ The Poisson distribution is used quite often in queuing theory to, among other things, describe the arrival of customers at a cashier's station.

Continuous distributions

Expotential distribution.

The continuous random variable x has an exponential distribution if f( x )={ λ e λx , for x0   0   for x<0 }. f( x )={ λ e λx , for x0   0   for x<0 }. MathType@MTEF@5@5@+=feaagyart1ev2aaatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaaiaadAgadaqadaqaaiaadIhaaiaawIcacaGLPaaacqGH9aqpdaGadaabaeqabaGaeq4UdWMaamyzamaaCaaaleqabaGaeyOeI0Iaeq4UdWMaamiEaaaakiaacYcacaqGGaGaaeOzaiaab+gacaqGYbGaaeiiaiaadIhacqGHLjYScaaIWaGaaeiiaiaabccaaeaacaqGWaGaaeiiaiaabccacaqGGaGaaeOzaiaab+gacaqGYbGaaeiiaiaadIhacqGH8aapcaaIWaaaaiaawUhacaGL9baacaGGUaaaaa@560F@ The cumulative exponential distribution is given by F( x )=1 e λx , F( x )=1 e λx , MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaaiaadAeadaqadaqaaiaadIhaaiaawIcacaGLPaaacqGH9aqpcaaIXaGaeyOeI0IaamyzamaaCaaaleqabaGaeyOeI0Iaeq4UdWMaamiEaaaakiaacYcaaaa@4157@ for x0. x0. MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaaiaadIhacqGHLjYScaaIWaGaaiOlaaaa@3A18@ The exponential distribution describes the times between events that occur continuously and independently at a constant rate (as in a Poisson process). The mean and variance of an exponential distribution are μ= λ 1 μ= λ 1 MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaaiabeY7aTjabg2da9iabeU7aSnaaCaaaleqabaGaeyOeI0IaaGymaaaaaaa@3C2E@ and σ 2 = λ 2 . σ 2 = λ 2 . MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaaiabeo8aZnaaCaaaleqabaGaaGOmaaaakiabg2da9iabeU7aSnaaCaaaleqabaGaeyOeI0IaaGOmaaaakiaac6caaaa@3DEB@

Cauchy distribution.

A random variable x, where <x<, <x<, MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaaiabgkHiTiabg6HiLkabgYda8iaadIhacqGH8aapcqGHEisPcaGGSaaaaa@3D6D@ has a Cauchy (or Cauchy-Lorentz) distribution if its pdf is f( x )= 1 π [ γ ( x x 0 ) 2 + γ 2 ]. f( x )= 1 π [ γ ( x x 0 ) 2 + γ 2 ]. MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaaiaadAgadaqadaqaaiaadIhaaiaawIcacaGLPaaacqGH9aqpdaWcaaqaaiaaigdaaeaacqaHapaCaaWaamWaaeaadaWcaaqaaiabeo7aNbqaamaabmaabaGaamiEaiabgkHiTiaadIhadaWgaaWcbaGaaGimaaqabaaakiaawIcacaGLPaaadaahaaWcbeqaaiaaikdaaaGccqGHRaWkcqaHZoWzdaahaaWcbeqaaiaaikdaaaaaaaGccaGLBbGaayzxaaGaaiOlaaaa@4B12@ The parameter x 0 x 0 MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaaiaadIhadaWgaaWcbaGaaGimaaqabaaaaa@37CC@ locates the peak of the pdf while γ specifies the half-width of the pdf at the half maximum. Figure 3 shows the pdf and cumulative function for two values of these two parameters.

Figure 3: The two panels represent the Cauchy distribution for two sets of values of x0 and γ.
The Cauchy distribution.
Graph of the Cauchy distribution for two values of the parameters.

Normal distribution.

The continuous random variable x has a normal distribution with a mean of μ μ MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaaiabeY7aTbaa@379F@ and a variance of σ 2 σ 2 MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaaiabeo8aZnaaCaaaleqabaGaaGOmaaaaaaa@3895@ if its pdf is f( x )= 1 σ 2π e ( xμ ) 2 2 σ 2 f( x )= 1 σ 2π e ( xμ ) 2 2 σ 2 MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaaiaadAgadaqadaqaaiaadIhaaiaawIcacaGLPaaacqGH9aqpdaWcaaqaaiaaigdaaeaacqaHdpWCdaGcaaqaaiaaikdacqaHapaCaSqabaaaaOGaamyzamaaCaaaleqabaGaeyOeI0YaaSaaaeaadaqadaqaaiaadIhacqGHsislcqaH8oqBaiaawIcacaGLPaaadaahaaadbeqaaiaaikdaaaaaleaacaaIYaGaeq4Wdm3aaWbaaWqabeaacaaIYaaaaaaaaaaaaa@4B27@ for x. x. MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaaiabgkHiTiabg6HiLkabgsMiJkaadIhacqGHKjYOcqGHEisPcaGGUaaaaa@3ED1@ The distribution is symmetric around the mean.

Log normal distribution.

The continuous random variable x has log normal distribution if y has a normal distribution and x= e y . x= e y . MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaaiaadIhacqGH9aqpcaWGLbWaaWbaaSqabeaacaWG5baaaOGaaiOlaaaa@3ABD@ Thus, if yN( μ, σ 2 ), yN( μ, σ 2 ), MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaaiaadMhacqWI8iIocaWGobWaaeWaaeaacqaH8oqBcaGGSaGaeq4Wdm3aaWbaaSqabeaacaaIYaaaaaGccaGLOaGaayzkaaGaaiilaaaa@4038@ then the pdf of a log normal distribution is f( x )={ 1 xσ 2π e ( ln( x )μ ) 2 2 σ 2 ,  for x>0 0    otherwise }. f( x )={ 1 xσ 2π e ( ln( x )μ ) 2 2 σ 2 ,  for x>0 0    otherwise }. MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaaiaadAgadaqadaqaaiaadIhaaiaawIcacaGLPaaacqGH9aqpdaGadaabaeqabaWaaSaaaeaacaaIXaaabaGaamiEaiabeo8aZnaakaaabaGaaGOmaiabec8aWbWcbeaaaaGccaWGLbWaaWbaaSqabeaacqGHsisldaWcaaqaamaabmaabaGaciiBaiaac6gadaqadaqaaiaadIhaaiaawIcacaGLPaaacqGHsislcqaH8oqBaiaawIcacaGLPaaadaahaaadbeqaaiaaikdaaaaaleaacaaIYaGaeq4Wdm3aaWbaaWqabeaacaaIYaaaaaaaaaGccaqGSaGaaeiiaiaabccacaqGMbGaae4BaiaabkhacaqGGaGaamiEaiabg6da+iaaicdaaeaacaaIWaGaaeiiaiaabccacaqGGaGaaeiiaiaab+gacaqG0bGaaeiAaiaabwgacaqGYbGaae4DaiaabMgacaqGZbGaaeyzaaaacaGL7bGaayzFaaGaaiOlaaaa@6667@ The mean and variance of x are μ x = e μ+ σ 2 2 μ x = e μ+ σ 2 2 MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaaiabeY7aTnaaBaaaleaacaWG4baabeaakiabg2da9iaadwgadaahaaWcbeqaaiabeY7aTjabgUcaRmaaleaameaacqaHdpWCdaahaaqabeaacaaIYaaaaaqaaiaaikdaaaaaaaaa@4101@ and σ x 2 =( e σ 2 1 ) e 2μ+ σ 2 . σ x 2 =( e σ 2 1 ) e 2μ+ σ 2 . MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaaiabeo8aZnaaDaaaleaacaWG4baabaGaaGOmaaaakiabg2da9maabmaabaGaamyzamaaCaaaleqabaGaeq4Wdm3aaWbaaWqabeaacaaIYaaaaaaakiabgkHiTiaaigdaaiaawIcacaGLPaaacaWGLbWaaWbaaSqabeaacaaIYaGaeqiVd0Maey4kaSIaeq4Wdm3aaWbaaWqabeaacaaIYaaaaaaakiaac6caaaa@4975@ Because the distribution is skewed downward for variances over 1, the log normal distribution is sometimes used to describe income distributions (where there are relatively few very wealthy people and incomes generally are positive. Figure 4 shows the graphs of the pdf and cumulative functions for the log normal distributions for two values of σ.

Figure 4: The two panels illustrate the log-normal distribution for two values of σ..
The log-normal distribution.
Graph of the log-normal distribution for two values of σ.

Gamma distribution.

A positive random variable x has a gamma distribution if its pdf is f( x )= 1 Γ( α ) β α x α1 e x β f( x )= 1 Γ( α ) β α x α1 e x β MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaaiaadAgadaqadaqaaiaadIhaaiaawIcacaGLPaaacqGH9aqpdaWcaaqaaiaaigdaaeaacqqHtoWrdaqadaqaaiabeg7aHbGaayjkaiaawMcaaiabek7aInaaCaaaleqabaGaeqySdegaaaaakiaadIhadaahaaWcbeqaaiabeg7aHjabgkHiTiaaigdaaaGccaWGLbWaaWbaaSqabeaacqGHsisldaWcbaadbaGaamiEaaqaaiabek7aIbaaaaaaaa@4C6C@ for x>0 x>0 MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaaiaadIhacqGH+aGpcaaIWaaaaa@38A8@ and 0 elsewhere. Γ( α ) Γ( α ) MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaaiabfo5ahnaabmaabaGaeqySdegacaGLOaGaayzkaaaaaa@3A79@ is known as the gamma function and is defined to be Γ( α )= 0 y α1 e y dy =( α1 )!. Γ( α )= 0 y α1 e y dy =( α1 )!. MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaaiabfo5ahnaabmaabaGaeqySdegacaGLOaGaayzkaaGaeyypa0Zaa8qmaeaacaWG5bWaaWbaaSqabeaacqaHXoqycqGHsislcaaIXaaaaOGaamyzamaaCaaaleqabaGaeyOeI0IaamyEaaaakiaadsgacaWG5baaleaacaaIWaaabaGaeyOhIukaniabgUIiYdGccqGH9aqpdaqadaqaaiabeg7aHjabgkHiTiaaigdaaiaawIcacaGLPaaacaGGHaGaaiOlaaaa@5079@ The gamma function is often used to model waiting times like waiting for death. Its mean and variance are given by μ=αβ μ=αβ MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaaiabeY7aTjabg2da9iabeg7aHjabek7aIbaa@3BE5@ and σ 2 =α β 2 . σ 2 =α β 2 . MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaaiabeo8aZnaaCaaaleqabaGaaGOmaaaakiabg2da9iabeg7aHjabek7aInaaCaaaleqabaGaaGOmaaaakiaac6caaaa@3E8A@

Chi-square distribution.

A chi-square distribution ( χ 2 ( k) χ 2 ( k)MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaaiabeE8aJnaaCaaaleqabaGaaGOmaaaakmaabmaabaGaam4AaaGaayjkaiaawMcaaiaac6caaaa@3BBE@ ) is the sum of k independent standard normal random variables and is a special case of the gamma distribution (with α= k 2 α= k 2 MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaaiabeg7aHjabg2da9maalaaabaGaam4Aaaqaaiaaikdaaaaaaa@3A4A@ and β=2 β=2 MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaaiabek7aIjabg2da9iaaikdaaaa@394C@ ). The pdf of a chi-square distribution with k degrees of freedom is f( x )= 1 2 k 2 Γ( k 2 ) x k 2 1 e x 2 f( x )= 1 2 k 2 Γ( k 2 ) x k 2 1 e x 2 MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaaiaadAgadaqadaqaaiaadIhaaiaawIcacaGLPaaacqGH9aqpdaWcaaqaaiaaigdaaeaacaaIYaWaaWbaaSqabeaadaWcdaadbaGaam4AaaqaaiaaikdaaaaaaOGaeu4KdC0aaeWaaeaadaWcbaWcbaGaam4AaaqaaiaaikdaaaaakiaawIcacaGLPaaaaaGaamiEamaaCaaaleqabaWaaSqaaWqaaiaadUgaaeaacaaIYaaaaSGaeyOeI0IaaGymaaaakiaadwgadaahaaWcbeqaaiabgkHiTmaaleaameaacaWG4baabaGaaGOmaaaaaaaaaa@4B36@ where x > 0. Its mean and variance are μ=k μ=k MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaaiabeY7aTjabg2da9iaadUgaaaa@3995@ and σ 2 =2k. σ 2 =2k. MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaaiabeo8aZnaaCaaaleqabaGaaGOmaaaakiabg2da9iaaikdacaWGRbGaaiOlaaaa@3C03@ If y= i=1 k x i 2 y= i=1 k x i 2 MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaaiaadMhacqGH9aqpdaaeWbqaaiaadIhadaqhaaWcbaGaamyAaaqaaiaaikdaaaaabaGaamyAaiabg2da9iaaigdaaeaacaWGRbaaniabggHiLdaaaa@4097@ where the xi's are independently drawn from the standard normal distribution (N(1, 0)), then y i χ 2 ( k ). y i χ 2 ( k ). MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaaiaadMhadaWgaaWcbaGaamyAaaqabaGccqWI8iIocqaHhpWydaahaaWcbeqaaiaaikdaaaGcdaqadaqaaiaadUgaaiaawIcacaGLPaaacaGGUaaaaa@3F09@

Student's t-distribution.

Consider two random variables, x and v. Assume that xN( 0,1 ) xN( 0,1 ) MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaaiaadIhacqWI8iIocaWGobWaaeWaaeaacaaIWaGaaiilaiaaigdaaiaawIcacaGLPaaaaaa@3C90@ and v χ 2 ( r ) v χ 2 ( r ) MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaaiaadAhacqWI8iIocqaHhpWydaahaaWcbeqaaiaaikdaaaGcdaqadaqaaiaadkhaaiaawIcacaGLPaaaaaa@3D37@ and are stochastically independent. Then the random variable t= w v r t= w v r MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaaiaadshacqGH9aqpdaWcaaqaaiaadEhaaeaadaGcaaqaamaalaaabaGaamODaaqaaiaadkhaaaaaleqaaaaaaaa@3B11@ has the t-distribution with rdegrees of freedom. The pdf and cumulative function of t are f( t )= Γ( r+1 2 ) rπ Γ( r 2 ) ( 1+ t 2 r ) ( r+1 2 ) f( t )= Γ( r+1 2 ) rπ Γ( r 2 ) ( 1+ t 2 r ) ( r+1 2 ) MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaaiaadAgadaqadaqaaiaadshaaiaawIcacaGLPaaacqGH9aqpdaWcaaqaaiabfo5ahnaabmaabaWaaSaaaeaacaWGYbGaey4kaSIaaGymaaqaaiaaikdaaaaacaGLOaGaayzkaaaabaWaaOaaaeaacaWGYbGaeqiWdahaleqaaOGaeu4KdC0aaeWaaeaadaWcaaqaaiaadkhaaeaacaaIYaaaaaGaayjkaiaawMcaaaaadaqadaqaaiaaigdacqGHRaWkdaWcaaqaaiaadshadaahaaWcbeqaaiaaikdaaaaakeaacaWGYbaaaaGaayjkaiaawMcaamaaCaaaleqabaGaeyOeI0YaaeWaaeaadaWcaaqaaiaadkhacqGHRaWkcaaIXaaabaGaaGOmaaaaaiaawIcacaGLPaaaaaaaaa@5466@ and F( t )= 1 2 +tΓ( t 2 ). F( t )= 1 2 +tΓ( t 2 ). MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaaiaadAeadaqadaqaaiaadshaaiaawIcacaGLPaaacqGH9aqpdaWcaaqaaiaaigdaaeaacaaIYaaaaiabgUcaRiaadshacqqHtoWrdaqadaqaamaalaaabaGaamiDaaqaaiaaikdaaaaacaGLOaGaayzkaaGaaiOlaaaa@4306@ The mean and variance of the distribution are 0 for r>1 r>1 MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaaiaadkhacqGH+aGpcaaIXaaaaa@38A3@ and r r2 r r2 MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaamaalaaabaGaamOCaaqaaiaadkhacqGHsislcaaIYaaaaaaa@3990@ for t>2, t>2, MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaaiaadshacqGH+aGpcaaIYaGaaiilaaaa@3956@ respectively.1 The t-distribution plays a prominent role in hypothesis testing that is well-known to all undergraduate economics majors.

F distribution.

Consider two stochastically independent chi-square random variable such that u χ 2 ( r 1 ) u χ 2 ( r 1 ) MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaaiaadwhacqWI8iIocaqGhpWaaWbaaSqabeaacaaIYaaaaOWaaeWaaeaacaWGYbWaaSbaaSqaaiaaigdaaeqaaaGccaGLOaGaayzkaaaaaa@3DBD@ and v χ 2 ( r 2 ) v χ 2 ( r 2 ) MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaaiaadAhacqWI8iIocaqGhpWaaWbaaSqabeaacaaIYaaaaOWaaeWaaeaacaWGYbWaaSbaaSqaaiaaikdaaeqaaaGccaGLOaGaayzkaaaaaa@3DBF@ and u,v>0. u,v>0. MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaaiaadwhacaGGSaGaamODaiabg6da+iaaicdacaGGUaaaaa@3B02@ The new random variable f= u r 1 v r 2 f= u r 1 v r 2 MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaaiaadAgacqGH9aqpdaWcaaqaamaaliaabaGaamyDaaqaaiaadkhadaWgaaWcbaGaaGymaaqabaaaaaGcbaWaaSGaaeaacaWG2baabaGaamOCamaaBaaaleaacaaIYaaabeaaaaaaaaaa@3DCA@ has a F-distribution with r 1 r 1 MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaaiaadkhadaWgaaWcbaGaaGymaaqabaaaaa@37C7@ and r 2 r 2 MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaaiaadkhadaWgaaWcbaGaaGOmaaqabaaaaa@37C8@ degrees of freedom. The pdf for the F-distribution is g( f )= Γ( r 1 + r 2 2 )( r 1 r 2 ) Γ( r 1 2 )Γ( r 2 2 ) f r 1 2 1 ( 1+ r 1 f r 2 ) r 1 + r 2 2 . g( f )= Γ( r 1 + r 2 2 )( r 1 r 2 ) Γ( r 1 2 )Γ( r 2 2 ) f r 1 2 1 ( 1+ r 1 f r 2 ) r 1 + r 2 2 . MathType@MTEF@5@5@+=feaagyart1ev2aaatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaaiaadEgadaqadaqaaiaadAgaaiaawIcacaGLPaaacqGH9aqpdaWcaaqaaiabfo5ahnaabmaabaWaaSaaaeaacaWGYbWaaSbaaSqaaiaaigdaaeqaaOGaey4kaSIaamOCamaaBaaaleaacaaIYaaabeaaaOqaaiaaikdaaaaacaGLOaGaayzkaaWaaeWaaeaadaWcaaqaaiaadkhadaWgaaWcbaGaaGymaaqabaaakeaacaWGYbWaaSbaaSqaaiaaikdaaeqaaaaaaOGaayjkaiaawMcaaaqaaiabfo5ahnaabmaabaWaaSaaaeaacaWGYbWaaSbaaSqaaiaaigdaaeqaaaGcbaGaaGOmaaaaaiaawIcacaGLPaaacqqHtoWrdaqadaqaamaalaaabaGaamOCamaaBaaaleaacaaIYaaabeaaaOqaaiaaikdaaaaacaGLOaGaayzkaaaaamaalaaabaGaamOzamaaCaaaleqabaWaaSaaaeaacaWGYbWaaSbaaWqaaiaaigdaaeqaaaWcbaGaaGOmaaaacqGHsislcaaIXaaaaaGcbaWaaeWaaeaacaaIXaGaey4kaSYaaSaaaeaacaWGYbWaaSbaaSqaaiaaigdaaeqaaOGaamOzaaqaaiaadkhadaWgaaWcbaGaaGOmaaqabaaaaaGccaGLOaGaayzkaaWaaWbaaSqabeaadaWcaaqaaiaadkhadaWgaaadbaGaaGymaaqabaWccqGHRaWkcaWGYbWaaSbaaWqaaiaaikdaaeqaaaWcbaGaaGOmaaaaaaaaaOGaaiOlaaaa@6771@ The F-distribution is used in testing if population variances are equal and in performing likelihood ratio tests.

Multinomial distribution.

Consider the n random variables x 1 , x 2 ,, x n x 1 , x 2 ,, x n MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaaiaadIhadaWgaaWcbaGaaGymaaqabaGccaGGSaGaamiEamaaBaaaleaacaaIYaaabeaakiaacYcacqWIVlctcaGGSaGaamiEamaaBaaaleaacaWGUbaabeaaaaa@3FE0@ where each variable has a normal distribution—that is, x i N( μ i , σ i 2 ) x i N( μ i , σ i 2 ) MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaaiaadIhadaWgaaWcbaGaamyAaaqabaGccqWI8iIocaWGobWaaeWaaeaacqaH8oqBdaWgaaWcbaGaamyAaaqabaGccaGGSaGaeq4Wdm3aa0baaSqaaiaadMgaaeaacaaIYaaaaaGccaGLOaGaayzkaaaaaa@42BD@ and the covariance between of the variables is σ ij =E[ ( x i μ i )( x j μ j . ) ] σ ij =E[ ( x i μ i )( x j μ j . ) ] MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaaiabeo8aZnaaBaaaleaacaWGPbGaamOAaaqabaGccqGH9aqpcaWGfbWaamWaaeaadaqadaqaaiaadIhadaWgaaWcbaGaamyAaaqabaGccqGHsislcqaH8oqBdaWgaaWcbaGaamyAaaqabaaakiaawIcacaGLPaaadaqadaqaaiaadIhadaWgaaWcbaGaamOAaaqabaGccqGHsislcqaH8oqBdaWgaaWcbaGaamOAaaqabaaakiaawIcacaGLPaaaaiaawUfacaGLDbaaaaa@4C65@ We can arrange the variances and covariances into a n-by-n matrix where Σ=[ σ 1 2 σ 12 σ 1n σ 21 σ 2 2 σ 2n σ n1 σ n2 σ n 2 ] Σ=[ σ 1 2 σ 12 σ 1n σ 21 σ 2 2 σ 2n σ n1 σ n2 σ n 2 ] MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaaiabfo6atjabg2da9maadmaabaqbaeqabqabaaaaaeaacqaHdpWCdaqhaaWcbaGaaGymaaqaaiaaikdaaaaakeaacqaHdpWCdaWgaaWcbaGaaGymaiaaikdaaeqaaaGcbaGaeS47IWeabaGaeq4Wdm3aaSbaaSqaaiaaigdacaWGUbaabeaaaOqaaiabeo8aZnaaBaaaleaacaaIYaGaaGymaaqabaaakeaacqaHdpWCdaqhaaWcbaGaaGOmaaqaaiaaikdaaaaakeaacqWIVlctaeaacqaHdpWCdaWgaaWcbaGaaGOmaiaad6gaaeqaaaGcbaGaeSO7I0eabaGaeSO7I0eabaGaeSy8I8eabaGaeSO7I0eabaGaeq4Wdm3aaSbaaSqaaiaad6gacaaIXaaabeaaaOqaaiabeo8aZnaaBaaaleaacaWGUbGaaGOmaaqabaaakeaacqWIVlctaeaacqaHdpWCdaqhaaWcbaGaamOBaaqaaiaaikdaaaaaaaGccaGLBbGaayzxaaaaaa@6816@ that is known as the variance-covariance matrix. Define the vector ( xμ )=( x 1 μ 1 x n μ n ) ( xμ )=( x 1 μ 1 x n μ n ) MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaamaabmaabaGaaCiEaiabgkHiTiaahY7aaiaawIcacaGLPaaacqGH9aqpdaqadaqaauaabeqadeaaaeaacaWG4bWaaSbaaSqaaiaaigdaaeqaaOGaeyOeI0IaeqiVd02aaSbaaSqaaiaaigdaaeqaaaGcbaGaeSO7I0eabaGaamiEamaaBaaaleaacaWGUbaabeaakiabgkHiTiabeY7aTnaaBaaaleaacaWGUbaabeaaaaaakiaawIcacaGLPaaaaaa@4AA8@ and ( xμ ) ( xμ ) MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaamaabmaabaGaaCiEaiabgkHiTiaahY7aaiaawIcacaGLPaaadaahaaWcbeqaaOGamai4gkdiIcaaaaa@3DC7@ as its transpose. Then, ( xμ ) Σ( xμ )= i=1 n j=1 n ( x i μ i )( x j μ j ) σ ij , ( xμ ) Σ( xμ )= i=1 n j=1 n ( x i μ i )( x j μ j ) σ ij , MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaamaabmaabaGaaCiEaiabgkHiTiaahY7aaiaawIcacaGLPaaadaahaaWcbeqaaOGamai4gkdiIcaacaWHJoWaaeWaaeaacaWH4bGaeyOeI0IaaCiVdaGaayjkaiaawMcaaiabg2da9maaqahabaWaaabCaeaadaqadaqaaiaadIhadaWgaaWcbaGaamyAaaqabaGccqGHsislcqaH8oqBdaWgaaWcbaGaamyAaaqabaaakiaawIcacaGLPaaadaqadaqaaiaadIhadaWgaaWcbaGaamOAaaqabaGccqGHsislcqaH8oqBdaWgaaWcbaGaamOAaaqabaaakiaawIcacaGLPaaacqaHdpWCdaWgaaWcbaGaamyAaiaadQgaaeqaaaqaaiaadQgacqGH9aqpcaaIXaaabaGaamOBaaqdcqGHris5aaWcbaGaamyAaiabg2da9iaaigdaaeaacaWGUbaaniabggHiLdGccaGGSaaaaa@63E3@ where σ ii = σ i 2 . σ ii = σ i 2 . MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaaiabeo8aZnaaBaaaleaacaWGPbGaamyAaaqabaGccqGH9aqpcqaHdpWCdaqhaaWcbaGaamyAaaqaaiaaikdaaaaaaa@3E5E@ If | Σ | | Σ | MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaamaaemaabaGaaC4OdaGaay5bSlaawIa7aaaa@3A3A@ is the determinant of the variance-covariance matrix, then the pdf for the joint distribution of these random variables is f( x 1 , x 2 ,, x n )= 1 ( 2π ) n/2 | Σ | 1 2 e 1 2 ( xμ ) Σ( xμ ) . f( x 1 , x 2 ,, x n )= 1 ( 2π ) n/2 | Σ | 1 2 e 1 2 ( xμ ) Σ( xμ ) . MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaaiaadAgadaqadaqaaiaadIhadaWgaaWcbaGaaGymaaqabaGccaGGSaGaamiEamaaBaaaleaacaaIYaaabeaakiaacYcacqWIMaYscaGGSaGaamiEamaaBaaaleaacaWGUbaabeaaaOGaayjkaiaawMcaaiabg2da9maalaaabaGaaGymaaqaamaabmaabaGaaGOmaiabec8aWbGaayjkaiaawMcaamaaCaaaleqabaGaamOBaiaac+cacaaIYaaaaOWaaqWaaeaacaWHJoaacaGLhWUaayjcSdWaaWbaaSqabeaadaWccaqaaiaaigdaaeaacaaIYaaaaaaaaaGccaWGLbWaaWbaaSqabeaacqGHsisldaWcaaqaaiaaigdaaeaacaaIYaaaamaabmaabaGaaCiEaiabgkHiTiaahY7aaiaawIcacaGLPaaadaahaaadbeqaaSGamaiUgkdiIcaacaWHJoWaaeWaaeaacaWH4bGaeyOeI0IaaCiVdaGaayjkaiaawMcaaaaakiaac6caaaa@61FC@ If the random variables are stochastically independent the covariances are equal to 0 and the pdf becomes f( x 1 , x 2 ,, x n )= 1 ( 2π ) n/2 ( i=1 n σ 1 2 ) 1 2 e 1 2 i=1 n ( x i μ i ) 2 σ i 2 . f( x 1 , x 2 ,, x n )= 1 ( 2π ) n/2 ( i=1 n σ 1 2 ) 1 2 e 1 2 i=1 n ( x i μ i ) 2 σ i 2 . MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaaiaadAgadaqadaqaaiaadIhadaWgaaWcbaGaaGymaaqabaGccaGGSaGaamiEamaaBaaaleaacaaIYaaabeaakiaacYcacqWIMaYscaGGSaGaamiEamaaBaaaleaacaWGUbaabeaaaOGaayjkaiaawMcaaiabg2da9maalaaabaGaaGymaaqaamaabmaabaGaaGOmaiabec8aWbGaayjkaiaawMcaamaaCaaaleqabaGaamOBaiaac+cacaaIYaaaaOWaaeWaaeaadaqeWbqaaiabeo8aZnaaDaaaleaacaaIXaaabaGaaGOmaaaaaeaacaWGPbGaeyypa0JaaGymaaqaaiaad6gaa0Gaey4dIunaaOGaayjkaiaawMcaamaaCaaaleqabaWaaSGaaeaacaaIXaaabaGaaGOmaaaaaaaaaOGaamyzamaaCaaaleqabaGaeyOeI0YaaSaaaeaacaaIXaaabaGaaGOmaaaadaaeWbqaamaalaaabaWaaeWaaeaacaWG4bWaaSbaaWqaaiaadMgaaeqaaSGaeyOeI0IaeqiVd02aaSbaaWqaaiaadMgaaeqaaaWccaGLOaGaayzkaaWaaWbaaWqabeaacaaIYaaaaaWcbaGaeq4Wdm3aa0baaWqaaiaadMgaaeaacaaIYaaaaaaaaeaacaWGPbGaeyypa0JaaGymaaqaaiaad6gaa4GaeyyeIuoaaaGccaGGUaaaaa@6CB6@ If the n random variables are all drawn from the same normal distribution with a mean of μ and a variance of σ 2 , σ 2 , MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaaiabeo8aZnaaCaaaleqabaGaaGOmaaaakiaacYcaaaa@394F@ then the pdf simplifies to f( x 1 , x 2 ,, x n )= 1 ( 2π σ 2 ) n/2 e 1 2 σ 2 i=1 n ( x i μ ) 2 . f( x 1 , x 2 ,, x n )= 1 ( 2π σ 2 ) n/2 e 1 2 σ 2 i=1 n ( x i μ ) 2 . MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaaiaadAgadaqadaqaaiaadIhadaWgaaWcbaGaaGymaaqabaGccaGGSaGaamiEamaaBaaaleaacaaIYaaabeaakiaacYcacqWIMaYscaGGSaGaamiEamaaBaaaleaacaWGUbaabeaaaOGaayjkaiaawMcaaiabg2da9maalaaabaGaaGymaaqaamaabmaabaGaaGOmaiabec8aWjabeo8aZnaaCaaaleqabaGaaGOmaaaaaOGaayjkaiaawMcaamaaCaaaleqabaGaamOBaiaac+cacaaIYaaaaaaakiaadwgadaahaaWcbeqaaiabgkHiTmaalaaabaGaaGymaaqaaiaaikdacqaHdpWCdaahaaadbeqaaiaaikdaaaaaaSWaaabCaeaadaqadaqaaiaadIhadaWgaaadbaGaamyAaaqabaWccqGHsislcqaH8oqBaiaawIcacaGLPaaadaahaaadbeqaaiaaikdaaaaabaGaamyAaiabg2da9iaaigdaaeaacaWGUbaaoiabggHiLdaaaOGaaiOlaaaa@60C6@

Characteristics of an estimator of a population parameter θ

Finite estimators

Bias.

The bias of an estimator is defined to be B( θ ^ )=E( θ ^ )θ. B( θ ^ )=E( θ ^ )θ. MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaaiaadkeadaqadaqaaiqbeI7aXzaajaaacaGLOaGaayzkaaGaeyypa0JaamyramaabmaabaGafqiUdeNbaKaaaiaawIcacaGLPaaacqGHsislcqaH4oqCcaGGUaaaaa@4273@ An estimator is unbiased if and only if B( θ ^ )=0. B( θ ^ )=0. MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaaiaadkeadaqadaqaaiqbeI7aXzaajaaacaGLOaGaayzkaaGaeyypa0JaaGimaiaac6caaaa@3C71@

Mean square error.

The mean square error (MSE) of an estimator is defined to be MSE( θ ^ )=E[ ( θ ^ θ ) 2 ]. MSE( θ ^ )=E[ ( θ ^ θ ) 2 ]. MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaaiaad2eacaWGtbGaamyramaabmaabaGafqiUdeNbaKaaaiaawIcacaGLPaaacqGH9aqpcaWGfbWaamWaaeaadaqadaqaaiqbeI7aXzaajaGaeyOeI0IaeqiUdehacaGLOaGaayzkaaWaaWbaaSqabeaacaaIYaaaaaGccaGLBbGaayzxaaGaaiOlaaaa@4705@ It is relatively easy to show that MSE( θ ^ )=V( θ ^ )+ ( B( θ ^ ) ) 2 . MSE( θ ^ )=V( θ ^ )+ ( B( θ ^ ) ) 2 . MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaaiaad2eacaWGtbGaamyramaabmaabaGafqiUdeNbaKaaaiaawIcacaGLPaaacqGH9aqpcaWGwbWaaeWaaeaacuaH4oqCgaqcaaGaayjkaiaawMcaaiabgUcaRmaabmaabaGaamOqamaabmaabaGafqiUdeNbaKaaaiaawIcacaGLPaaaaiaawIcacaGLPaaadaahaaWcbeqaaiaaikdaaaGccaGGUaaaaa@4902@ Often a biased estimator with a smaller MSE may be preferred to an unbiased estimator with a relatively larger MSE.

Efficiency.

An estimator θ ^ θ ^ MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaaiqbeI7aXzaajaaaaa@37AF@ is relatively more efficient than θ ˜ θ ˜ MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaaiqbeI7aXzaaiaaaaa@37AE@ if and only if V( θ ^ )<V( θ ˜ ). V( θ ^ )<V( θ ˜ ). MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaaiaadAfadaqadaqaaiqbeI7aXzaajaaacaGLOaGaayzkaaGaeyipaWJaamOvamaabmaabaGafqiUdeNbaGaaaiaawIcacaGLPaaacaGGUaaaaa@3FF2@ Generally, we would prefer to use the most efficient estimator available (if it is unbiased).

Asymtoptic estimators

plim.

x n x n MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaaiaadIhadaWgaaWcbaGaamOBaaqabaaaaa@3805@ converges to a constant, c, if lim n Pr( | x n c |>ε )=0 lim n Pr( | x n c |>ε )=0 MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaaiGacYgacaGGPbGaaiyBamaaBaaaleaacaWGUbGaeyOKH4QaeyOhIukabeaakiGaccfacaGGYbWaaeWaaeaadaabdaqaaiaadIhadaWgaaWcbaGaamOBaaqabaGccqGHsislcaWGJbaacaGLhWUaayjcSdGaeyOpa4JaeqyTdugacaGLOaGaayzkaaGaeyypa0JaaGimaaaa@4C21@ for any positive ε. ε. MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaaiabew7aLjaac6caaaa@3842@ We can write this relationship as plim x n =c. plim x n =c. MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaaiaadchaciGGSbGaaiyAaiaac2gacaWG4bWaaSbaaSqaaiaad6gaaeqaaOGaeyypa0Jaam4yaiaac6caaaa@3E74@

Example 10

Greene2 offers this example of plim: Suppose x n x n MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaaiaadIhadaWgaaWcbaGaamOBaaqabaaaaa@3805@ equals 0 with probability 1( 1 n ) 1( 1 n ) MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaaiaaigdacqGHsisldaqadaqaamaalaaabaGaaGymaaqaaiaad6gaaaaacaGLOaGaayzkaaaaaa@3AD8@ and n with probability ( 1 n ). ( 1 n ). MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaamaabmaabaWaaSaaaeaacaaIXaaabaGaamOBaaaaaiaawIcacaGLPaaacaGGUaaaaa@39E2@ As n increases, the second point becomes more remote from the first point. However, at the same time the probability of observing the second point becomes more and more unlikely. This effect is shown in Figure 5 where as n increases the probability distribution concentrates more and more on 1.

Figure 5: The probability x = 1 is the area of the gray box centered on 1 for n = 5; the gray area plus the blue area for n = 10; and the sum of the gray, blue, and red areas for n = 20; the probability x = n is the area of the box centered on n.
Example of plim.
This is an illustration of the concept of plim.

Consistency.

The estimator θ ^ θ ^ MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaaiqbeI7aXzaajaaaaa@37AF@ is a consistent estimator of θ if and only if plim θ ^ =θ. plim θ ^ =θ. MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaaiaadchaciGGSbGaaiyAaiaac2gacuaH4oqCgaqcaiabg2da9iabeI7aXjaac6caaaa@3EE2@

Asymmtotically unbiased.

An estimator θ ^ θ ^ MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaaiqbeI7aXzaajaaaaa@37AF@ is an asymtotically unbiased estimator of θ if lim n E[ θ ^ ]=θ. lim n E[ θ ^ ]=θ. MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaaiGacYgacaGGPbGaaiyBamaaBaaaleaacaWGUbGaeyOKH4QaeyOhIukabeaakiaadweadaWadaqaaiqbeI7aXzaajaaacaGLBbGaayzxaaGaeyypa0JaeqiUdeNaaiOlaaaa@4530@

Footnotes

  1. The mean of the t-distribution is undefined for t1. t1. MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaaiaadshacqGHKjYOcaaIXaGaaiOlaaaa@3A04@ The variance of the distribution is MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaaiabg6HiLcaa@375A@ for 1<r2 1<r2 MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaaiaaigdacqGH8aapcaWGYbGaeyizImQaaGOmaaaa@3B10@ and undefined for r1. r1. MathType@MTEF@5@5@+=feaagyart1ev2aqatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLnhiov2DGi1BTfMBaeXatLxBI9gBaerbd9wDYLwzYbItLDharqqtubsr4rNCHbGeaGqiVCI8FfYJH8YrFfeuY=Hhbbf9v8qqaqFr0xc9pk0xbba9q8WqFfeaY=biLkVcLq=JHqpepeea0=as0Fb9pgeaYRXxe9vr0=vr0=vqpWqaaeaabiGaciaacaqabeaadaqaaqaaaOqaaiaadkhacqGHKjYOcaaIXaGaaiOlaaaa@3A02@
  2. Greene, William H. (1990). Econometric Analysis (New York: Macmillan Publishing Company): 103.

Content actions

Download module as:

PDF | EPUB (?)

What is an EPUB file?

EPUB is an electronic book format that can be read on a variety of mobile devices.

Downloading to a reading device

For detailed instructions on how to download this content's EPUB to your specific device, click the "(?)" link.

| More downloads ...

Add module to:

My Favorites (?)

'My Favorites' is a special kind of lens which you can use to bookmark modules and collections. 'My Favorites' can only be seen by you, and collections saved in 'My Favorites' can remember the last module you were on. You need an account to use 'My Favorites'.

| A lens I own (?)

Definition of a lens

Lenses

A lens is a custom view of the content in the repository. You can think of it as a fancy kind of list that will let you see content through the eyes of organizations and people you trust.

What is in a lens?

Lens makers point to materials (modules and collections), creating a guide that includes their own comments and descriptive tags about the content.

Who can create a lens?

Any individual member, a community, or a respected organization.

What are tags? tag icon

Tags are descriptors added by lens makers to help label content, attaching a vocabulary that is meaningful in the context of the lens.

| External bookmarks