OpenStax CNX

You are here: Home » Content » Markov Chains

About: Markov Chains

Module by: Rupinder Sekhon. E-mail the author

View the content: Markov Chains


Name: Markov Chains
ID: m18909
Language: English (en)
Summary: This chapter covers principles of Markov Chains. After completing this chapter students should be able to: write transition matrices for Markov Chain problems; find the long term trend for a Regular Markov Chain; Solve and interpret Absorbing Markov Chains.
Subject: Mathematics and Statistics
Keywords: Absorbing Markov Chains, Markov Chains, matrices, Regular Markov Chains, trends
License: Creative Commons Attribution License CC-BY 3.0

Authors: Rupinder Sekhon (
Copyright Holders: Rupinder Sekhon (
Maintainers: Judy Baker (, UniqU, LLC (, Connexions (

Latest version: 1.2 (history)
First publication date: Dec 12, 2008 2:44 pm -0600
Last revision to module: Jul 15, 2011 11:18 pm -0500


PDF: m18909_1.2.pdf PDF file, for viewing content offline and printing. Learn more.
XML: m18909_1.2.cnxml XML that defines the structure and contents of the module, minus any included media files. Can be reimported in the editing interface. Learn more.

Version History

Version: 1.2 Jul 15, 2011 11:18 pm -0500 by Collins Williamson
initial Connexionized Publication

Version: 1.1 Dec 12, 2008 5:32 pm -0600 by Judy Baker

How to Reuse and Attribute This Content

If you derive a copy of this content using a OpenStax-CNX account and publish your version, proper attribution of the original work will be automatically done for you.

If you reuse this work elsewhere, in order to comply with the attribution requirements of the license (CC-BY 3.0), you must include

  • the authors' names: Rupinder Sekhon
  • the title of the work: Markov Chains
  • the OpenStax-CNX URL where the work can be found:

See the citation section below for examples you can copy.

How to Cite and Attribute This Content

The following citation styles comply with the attribution requirements for the license (CC-BY 3.0) of this work:

American Chemical Society (ACS) Style Guide:

Sekhon, R. Markov Chains, OpenStax-CNX Web site., Jul 15, 2011.

American Medical Assocation (AMA) Manual of Style:

Sekhon R. Markov Chains [OpenStax-CNX Web site]. July 15, 2011. Available at:

American Psychological Assocation (APA) Publication Manual:

Sekhon, R. (2011, July 15). Markov Chains. Retrieved from the OpenStax-CNX Web site:

Chicago Manual of Style (Bibliography):

Sekhon, Rupinder. "Markov Chains." OpenStax-CNX. July 15, 2011.

Chicago Manual of Style (Note):

Rupinder Sekhon, "Markov Chains," OpenStax-CNX, July 15, 2011,

Chicago Manual of Style (Reference, in Author-Date style):

Sekhon, R. 2011. Markov Chains. OpenStax-CNX, July 15, 2011.

Modern Languages Association (MLA) Style Manual:

Sekhon, Rupinder. Markov Chains. OpenStax-CNX. 15 July 2011 <>.