Connexions

Sections
You are here: Home » Content » Source Coding Theorem

About: Source Coding Theorem

Module by: Don Johnson. E-mail the author

View the content: Source Coding Theorem

Metadata

Name: Source Coding Theorem
ID: m0091
Language: English (en)
Summary: The Source Coding Theorem states that the entropy of an alphabet of symbols specifies to within one bit how many bits on the average need to be used to send the alphabet.
Subject: Science and Technology
Keywords: bits, codebook, compression, digital communication, digital sources, entropy, information communication, Shannon, source coding theorem
License: Creative Commons Attribution License CC-BY 1.0
Authors: Don Johnson (dhj@rice.edu)
Copyright Holders: Don Johnson (dhj@rice.edu)
Maintainers: Don Johnson (dhj@rice.edu), John Cottrell (jac3@rice.edu)
Latest version: 2.14 (history)
First publication date: Jul 27, 2000 12:00 am -0500
Last revision to module: Jun 27, 2010 5:45 pm -0500

Downloads

PDF: m0091_2.14.pdf PDF file, for viewing content offline and printing. Learn more.
XML: m0091_2.14.cnxml XML that defines the structure and contents of the module, minus any included media files. Can be reimported in the editing interface. Learn more.

Version History

Version: 2.15 May 18, 2013 6:27 pm -0500 by Don Johnson
Changes: 
Fixed a typo.
Version: 2.14 Jun 27, 2010 5:45 pm -0500 by Don Johnson Currently viewing this version.
Changes: 
Improved layout of inline equation.
Version: 2.13 Jun 3, 2007 5:30 pm -0500 by Don Johnson
Changes: 
Fixed a notation problem.
Version: 2.12 Apr 25, 2005 7:40 pm -0500 by Charlet Reedstrom
Changes: 
update to cnxml-0.5, update mathml csymbol and mo
Version: 2.11 Aug 18, 2004 12:10 pm -0500 by Adan Galvan
Changes: 
 changed subscipts
Version: 2.10 Aug 17, 2002 12:00 am -0500 by (Unknown)
Changes: 
Fixed a minor typo.
Version: 2.9 Aug 17, 2002 12:00 am -0500 by (Unknown)
Changes: 
Fixed a math display error.
Version: 2.8 Aug 13, 2002 12:00 am -0500 by (Unknown)
Changes: 
Upgraded to 0.4.
Version: 2.7 Apr 22, 2002 12:00 am -0500 by (Unknown)
Changes: 
changed mover to mean, where units were displayed, how a couple eqns were marked up,
Version: 2.6 Sep 11, 2001 12:00 am -0500 by Brent Hendricks
Changes: 
Converted to CNXML 0.3.5
Version: 2.5 Aug 23, 2001 12:00 am -0500 by (Unknown)
Changes: 
fixed blanks
Version: 2.4 Aug 23, 2001 12:00 am -0500 by (Unknown)
Changes: 
- Use overbarred B as a function, not the mean of B(.)
Version: 2.3 Jul 17, 2001 12:00 am -0500 by (Unknown)
Changes: 
added keywords
fixed minor errors
Version: 2.2 Jun 6, 2001 12:00 am -0500 by (Unknown)
Changes: 
abstract and keywords added to textfields of database.
Version: 2.1 Jun 4, 2001 12:00 am -0500 by (Unknown)
Changes: 
brought up to cnxml 0.3
added keywords and abstract
equations redone in content mathml

note: the mathml has a few unwanted spacings in the way it presents, but the content i correct i believe, so ill leave that for the style sheet people.
Version: 2.0 Jul 27, 2000 12:00 am -0500 by Brent Hendricks
Changes: 
Bumped version to 2.0

How to Reuse and Attribute This Content

If you derive a copy of this content using a Connexions account and publish your version, proper attribution of the original work will be automatically done for you.

If you reuse this work elsewhere, in order to comply with the attribution requirements of the license (CC-BY 1.0), you must include

  • the authors' names: Don Johnson
  • the title of the work: Source Coding Theorem
  • the Connexions URL where the work can be found: http://cnx.org/content/m0091/2.14/

See the citation section below for examples you can copy.

How to Cite and Attribute This Content

The following citation styles comply with the attribution requirements for the license (CC-BY 1.0) of this work:

American Chemical Society (ACS) Style Guide:

Johnson, D. Source Coding Theorem, Connexions Web site. http://cnx.org/content/m0091/2.14/, Jun 27, 2010.

American Medical Assocation (AMA) Manual of Style:

Johnson D. Source Coding Theorem [Connexions Web site]. June 27, 2010. Available at: http://cnx.org/content/m0091/2.14/.

American Psychological Assocation (APA) Publication Manual:

Johnson, D. (2010, June 27). Source Coding Theorem. Retrieved from the Connexions Web site: http://cnx.org/content/m0091/2.14/

Chicago Manual of Style (Bibliography):

Johnson, Don. "Source Coding Theorem." Connexions. June 27, 2010. http://cnx.org/content/m0091/2.14/.

Chicago Manual of Style (Note):

Don Johnson, "Source Coding Theorem," Connexions, June 27, 2010, http://cnx.org/content/m0091/2.14/.

Chicago Manual of Style (Reference, in Author-Date style):

Johnson, D. 2010. Source Coding Theorem. Connexions, June 27, 2010. http://cnx.org/content/m0091/2.14/.

Modern Languages Association (MLA) Style Manual:

Johnson, Don. Source Coding Theorem. Connexions. 27 June 2010 <http://cnx.org/content/m0091/2.14/>.