OpenStax CNX

You are here: Home » Content » Source Coding

About: Source Coding

Module by: Behnaam Aazhang. E-mail the author

View the content: Source Coding


Name: Source Coding
ID: m10175
Language: English (en)
Summary: An introduction to the concept of typical sequences, which lie at the heart of source coding. The idea of typical sequences leads to Shannon's source-coding Theorem.
Subject: Science and Technology
Keywords: entropy, information, information theory, source coding, typical sequence
Document Type: -//CNX//DTD CNXML 0.5 plus MathML//EN
License: Creative Commons Attribution License CC-BY 1.0

Authors: Behnaam Aazhang (
Copyright Holders: Behnaam Aazhang (
Maintainers: Dinesh Rajan (, Mohammad Borran (, Roy Ha (, Shawn Stewart (, Behnaam Aazhang (

Latest version: 2.10 (history)
First publication date: Jul 10, 2001 12:00 am +0000
Last revision to module: Oct 3, 2005 1:45 pm +0000


PDF: m10175_2.10.pdf PDF file, for viewing content offline and printing. Learn more.
XML: m10175_2.10.cnxml XML that defines the structure and contents of the module, minus any included media files. Can be reimported in the editing interface. Learn more.

Version History

Version: 2.10 Oct 3, 2005 1:45 pm +0000 by Elizabeth Gregory
Added the name to the theorem.

Version: 2.9 Sep 13, 2004 8:44 pm +0000 by Charlet Reedstrom
updated module to cnxml-0.5, removed hardcoded numbers in name tags, added math tags around inline variables 

Version: 2.8 Jan 7, 2004 10:13 am +0000 by Adan Galvan
added maintainer

Version: 2.7 Aug 12, 2002 12:00 am +0000 by (Unknown)
Content changes as requested by author

Version: 2.6 Feb 9, 2002 12:00 am +0000 by (Unknown)
Authors updated

Version: 2.5 Dec 7, 2001 12:00 am +0000 by (Unknown)
changed blank= to get module to print

Version: 2.4 Jul 19, 2001 12:00 am +0000 by (Unknown)
Added graphics

Version: 2.3 Jul 11, 2001 12:00 am +0000 by (Unknown)
Added content on Lempel/Ziv

Version: 2.2 Jul 11, 2001 12:00 am +0000 by (Unknown)
Added links to other modules

Version: 2.1 Jul 10, 2001 12:00 am +0000 by (Unknown)
First draft of module

Version: 2.0 Jul 10, 2001 12:00 am +0000 by (Unknown)
Added initial template for new module m10175

How to Reuse and Attribute This Content

If you derive a copy of this content using a OpenStax-CNX account and publish your version, proper attribution of the original work will be automatically done for you.

If you reuse this work elsewhere, in order to comply with the attribution requirements of the license (CC-BY 1.0), you must include

  • the authors' names: Behnaam Aazhang
  • the title of the work: Source Coding
  • the OpenStax-CNX URL where the work can be found:

See the citation section below for examples you can copy.

How to Cite and Attribute This Content

The following citation styles comply with the attribution requirements for the license (CC-BY 1.0) of this work:

American Chemical Society (ACS) Style Guide:

Aazhang, B. Source Coding, OpenStax-CNX Web site., Oct 3, 2005.

American Medical Assocation (AMA) Manual of Style:

Aazhang B. Source Coding [OpenStax-CNX Web site]. October 3, 2005. Available at:

American Psychological Assocation (APA) Publication Manual:

Aazhang, B. (2005, October 3). Source Coding. Retrieved from the OpenStax-CNX Web site:

Chicago Manual of Style (Bibliography):

Aazhang, Behnaam. "Source Coding." OpenStax-CNX. October 3, 2005.

Chicago Manual of Style (Note):

Behnaam Aazhang, "Source Coding," OpenStax-CNX, October 3, 2005,

Chicago Manual of Style (Reference, in Author-Date style):

Aazhang, B. 2005. Source Coding. OpenStax-CNX, October 3, 2005.

Modern Languages Association (MLA) Style Manual:

Aazhang, Behnaam. Source Coding. OpenStax-CNX. 3 Oct. 2005 <>.