Connexions

Sections
You are here: Home » Content » Markov Chains

About: Markov Chains

Module by: Bart Sinclair. E-mail the author

View content

Metadata

Name: Markov Chains
ID: m10861
Language: English (en)
Summary: Introduction to continuous and discrete Markov chains, including the "birth and death" process.
Subject: Science and Technology
Keywords: continuous-state, continuous-time, discrete-state, discrete-time, exponential distribution, Markov chain, Markov process, Markov property, memory-less distribution, random process, stochastic process
Document Type: -//CNX//DTD CNXML 0.5 plus MathML//EN
License: Creative Commons Attribution License CC-BY 1.0
Authors: Bart Sinclair (bs@rice.edu)
Copyright Holders: Bart Sinclair (bs@rice.edu)
Maintainers: Jacob Grabczewski (jgrab@owlnet.rice.edu), Bart Sinclair (bs@rice.edu), Charlet Reedstrom (charlet@rice.edu)
Latest version: 2.3 (history)
First publication date: Sep 22, 2002 12:00 am GMT-5
Last revision to module: Jun 9, 2005 10:43 am GMT-5
Module XML: m10861_2.3.cnxml

Version History

Version: 2.3 Jun 9, 2005 10:43 am GMT-5 by Elizabeth Gregory
Changes: 
Updated from CNXML 0.4 to CNXML 0.5
Version: 2.2 Nov 8, 2002 12:00 am US/Central by (Unknown)
Changes: 
changed markup of probability to csymbol, fixed typos, removed/changed content inside of presentation, changed j to i where needed, added type=fn where needed
Version: 2.1 Oct 28, 2002 12:00 am US/Central by (Unknown)
Changes: 
Stat functions need to be updated.  One equal sign equation 5 needs to be adjusted to inline.
Version: 2.0 Sep 22, 2002 12:00 am GMT-5 by (Unknown)
Changes: 
Added initial template for new module m10861

How to Reuse and Attribute This Content

If you derive a copy of this content using a Connexions account and publish your version, proper attribution of the original work will be automatically done for you.

If you reuse this work elsewhere, in order to comply with the attribution requirements of the license (CC-BY 1.0), you must include

  • the authors' names: Bart Sinclair
  • the title of the work: Markov Chains
  • the Connexions URL where the work can be found: http://cnx.org/content/m10861/2.3/

See the citation section below for examples you can copy.

How to Cite and Attribute This Content

The following citation styles comply with the attribution requirements for the license (CC-BY 1.0) of this work:

American Chemical Society (ACS) Style Guide:

Sinclair, B. Markov Chains, Connexions Web site. http://cnx.org/content/m10861/2.3/, Jun 9, 2005.

American Medical Assocation (AMA) Manual of Style:

Sinclair B. Markov Chains [Connexions Web site]. June 9, 2005. Available at: http://cnx.org/content/m10861/2.3/.

American Psychological Assocation (APA) Publication Manual:

Sinclair, B. (2005, June 9). Markov Chains. Retrieved from the Connexions Web site: http://cnx.org/content/m10861/2.3/

Chicago Manual of Style (Bibliography):

Sinclair, Bart. "Markov Chains." Connexions. June 9, 2005. http://cnx.org/content/m10861/2.3/.

Chicago Manual of Style (Note):

Bart Sinclair, "Markov Chains," Connexions, June 9, 2005, http://cnx.org/content/m10861/2.3/.

Chicago Manual of Style (Reference, in Author-Date style):

Sinclair, B. 2005. Markov Chains. Connexions, June 9, 2005. http://cnx.org/content/m10861/2.3/.

Modern Languages Association (MLA) Style Manual:

Sinclair, Bart. Markov Chains. Connexions. 9 June 2005 <http://cnx.org/content/m10861/2.3/>.