Connexions

Sections
You are here: Home » Content » Source Coding Theorem

About: Source Coding Theorem

Module by: Don Johnson. E-mail the author

View content

Metadata

Name: Source Coding Theorem
ID: m0091
Language: English (en)
Summary: The Source Coding Theorem states that the entropy of an alphabet of symbols specifies to within one bit how many bits on the average need to be used to send the alphabet.
Subject: Science and Technology
Keywords: bits, codebook, compression, digital communication, digital sources, entropy, information communication, Shannon, source coding theorem
Document Type: -//CNX//DTD CNXML 0.5 plus MathML//EN
License: Creative Commons Attribution License CC-BY 1.0
Authors: Don Johnson (dhj@rice.edu)
Copyright Holders: Don Johnson (dhj@rice.edu)
Maintainers: Don Johnson (dhj@rice.edu), John Cottrell (jac3@rice.edu)
Latest version: 2.13 (history)
First publication date: Jul 27, 2000 12:00 am GMT-5
Last revision to module: Jun 3, 2007 5:30 pm GMT-5
Module XML: m0091_2.13.cnxml

Version History

Version: 2.13 Jun 3, 2007 5:30 pm GMT-5 by Don Johnson
Changes: 
Fixed a notation problem.
Version: 2.12 Apr 25, 2005 7:40 pm GMT-5 by Charlet Reedstrom
Changes: 
update to cnxml-0.5, update mathml csymbol and mo
Version: 2.11 Aug 18, 2004 12:10 pm GMT-5 by Adan Galvan
Changes: 
 changed subscipts
Version: 2.10 Aug 17, 2002 12:00 am GMT-5 by (Unknown)
Changes: 
Fixed a minor typo.
Version: 2.9 Aug 17, 2002 12:00 am GMT-5 by (Unknown)
Changes: 
Fixed a math display error.
Version: 2.8 Aug 13, 2002 12:00 am GMT-5 by (Unknown)
Changes: 
Upgraded to 0.4.
Version: 2.7 Apr 22, 2002 12:00 am GMT-5 by (Unknown)
Changes: 
changed mover to mean, where units were displayed, how a couple eqns were marked up,
Version: 2.6 Sep 11, 2001 12:00 am GMT-5 by Brent Hendricks
Changes: 
Converted to CNXML 0.3.5
Version: 2.5 Aug 23, 2001 12:00 am GMT-5 by (Unknown)
Changes: 
fixed blanks
Version: 2.4 Aug 23, 2001 12:00 am GMT-5 by (Unknown)
Changes: 
- Use overbarred B as a function, not the mean of B(.)
Version: 2.3 Jul 17, 2001 12:00 am GMT-5 by (Unknown)
Changes: 
added keywords
fixed minor errors
Version: 2.2 Jun 6, 2001 12:00 am GMT-5 by (Unknown)
Changes: 
abstract and keywords added to textfields of database.
Version: 2.1 Jun 4, 2001 12:00 am GMT-5 by (Unknown)
Changes: 
brought up to cnxml 0.3
added keywords and abstract
equations redone in content mathml

note: the mathml has a few unwanted spacings in the way it presents, but the content i correct i believe, so ill leave that for the style sheet people.
Version: 2.0 Jul 27, 2000 12:00 am GMT-5 by Brent Hendricks
Changes: 
Bumped version to 2.0

How to Reuse and Attribute This Content

If you derive a copy of this content using a Connexions account and publish your version, proper attribution of the original work will be automatically done for you.

If you reuse this work elsewhere, in order to comply with the attribution requirements of the license (CC-BY 1.0), you must include

  • the authors' names: Don Johnson
  • the title of the work: Source Coding Theorem
  • the Connexions URL where the work can be found: http://cnx.org/content/m0091/2.13/

See the citation section below for examples you can copy.

How to Cite and Attribute This Content

The following citation styles comply with the attribution requirements for the license (CC-BY 1.0) of this work:

American Chemical Society (ACS) Style Guide:

Johnson, D. Source Coding Theorem, Connexions Web site. http://cnx.org/content/m0091/2.13/, Jun 3, 2007.

American Medical Assocation (AMA) Manual of Style:

Johnson D. Source Coding Theorem [Connexions Web site]. June 3, 2007. Available at: http://cnx.org/content/m0091/2.13/.

American Psychological Assocation (APA) Publication Manual:

Johnson, D. (2007, June 3). Source Coding Theorem. Retrieved from the Connexions Web site: http://cnx.org/content/m0091/2.13/

Chicago Manual of Style (Bibliography):

Johnson, Don. "Source Coding Theorem." Connexions. June 3, 2007. http://cnx.org/content/m0091/2.13/.

Chicago Manual of Style (Note):

Don Johnson, "Source Coding Theorem," Connexions, June 3, 2007, http://cnx.org/content/m0091/2.13/.

Chicago Manual of Style (Reference, in Author-Date style):

Johnson, D. 2007. Source Coding Theorem. Connexions, June 3, 2007. http://cnx.org/content/m0091/2.13/.

Modern Languages Association (MLA) Style Manual:

Johnson, Don. Source Coding Theorem. Connexions. 3 June 2007 <http://cnx.org/content/m0091/2.13/>.