| Name: | Source Coding Theorem |
| ID: | m0091 |
| Language: | English (en) |
| Summary: | The Source Coding Theorem states that the entropy of an alphabet of symbols specifies to within one bit how many bits on the average need to be used to send the alphabet. |
| Subject: | Science and Technology |
| Keywords: | bits, codebook, compression, digital communication, digital sources, entropy, information communication, Shannon, source coding theorem |
| Document Type: | -//CNX//DTD CNXML 0.5 plus MathML//EN |
| License: | Creative Commons Attribution License CC-BY 1.0 |
|
|
|
| Authors: | Don Johnson (dhj@rice.edu) |
| Copyright Holders: | Don Johnson (dhj@rice.edu) |
| Maintainers: | Don Johnson (dhj@rice.edu), John Cottrell (jac3@rice.edu) |
|
|
|
| Version: | 2.13 (history) |
| Created: | Jul 27, 2000 12:00 am GMT-5 |
| Revised: | Jun 3, 2007 5:30 pm GMT-5 |
| Version: | 2.13 Jun 3, 2007 5:30 pm GMT-5 by Don Johnson |
| Changes: | Fixed a notation problem. |
|
|
|
| Version: | 2.12 Apr 25, 2005 7:40 pm GMT-5 by Charlet Reedstrom |
| Changes: | update to cnxml-0.5, update mathml csymbol and mo |
|
|
|
| Version: | 2.11 Aug 18, 2004 12:10 pm GMT-5 by Adan Galvan |
| Changes: | changed subscipts |
|
|
|
| Version: | 2.10 Aug 17, 2002 12:00 am GMT-5 by (Unknown) |
| Changes: | Fixed a minor typo. |
|
|
|
| Version: | 2.9 Aug 17, 2002 12:00 am GMT-5 by (Unknown) |
| Changes: | Fixed a math display error. |
|
|
|
| Version: | 2.8 Aug 13, 2002 12:00 am GMT-5 by (Unknown) |
| Changes: | Upgraded to 0.4. |
|
|
|
| Version: | 2.7 Apr 22, 2002 12:00 am GMT-5 by (Unknown) |
| Changes: | changed mover to mean, where units were displayed, how a couple eqns were marked up, |
|
|
|
| Version: | 2.6 Sep 11, 2001 12:00 am GMT-5 by Brent Hendricks |
| Changes: | Converted to CNXML 0.3.5 |
|
|
|
| Version: | 2.5 Aug 23, 2001 12:00 am GMT-5 by (Unknown) |
| Changes: | fixed blanks |
|
|
|
| Version: | 2.4 Aug 23, 2001 12:00 am GMT-5 by (Unknown) |
| Changes: | - Use overbarred B as a function, not the mean of B(.) |
|
|
|
| Version: | 2.3 Jul 17, 2001 12:00 am GMT-5 by (Unknown) |
| Changes: | added keywords fixed minor errors |
|
|
|
| Version: | 2.2 Jun 6, 2001 12:00 am GMT-5 by (Unknown) |
| Changes: | abstract and keywords added to textfields of database. |
|
|
|
| Version: | 2.1 Jun 4, 2001 12:00 am GMT-5 by (Unknown) |
| Changes: | brought up to cnxml 0.3 added keywords and abstract equations redone in content mathml note: the mathml has a few unwanted spacings in the way it presents, but the content i correct i believe, so ill leave that for the style sheet people. |
|
|
|
| Version: | 2.0 Jul 27, 2000 12:00 am GMT-5 by Brent Hendricks |
| Changes: | Bumped version to 2.0 |
If you derive a copy of this content using a Connexions account and publish your version, proper attribution of the original work will be automatically done for you.
If you reuse this work elsewhere, in order to comply with the attribution requirements of the license (CC-BY 1.0), you must include
See the citation section below for examples you can copy.
The following citation styles comply with the attribution requirements for the license (CC-BY 1.0) of this work:
Johnson, D. Source Coding Theorem, Connexions Web site. http://cnx.org/content/m0091/2.13/, Jun 3, 2007.
Johnson D. Source Coding Theorem [Connexions Web site]. June 3, 2007. Available at: http://cnx.org/content/m0091/2.13/.
Johnson, D. (2007, June 3). Source Coding Theorem. Retrieved from the Connexions Web site: http://cnx.org/content/m0091/2.13/
Johnson, Don. "Source Coding Theorem." Connexions. June 3, 2007. http://cnx.org/content/m0091/2.13/.
Don Johnson, "Source Coding Theorem," Connexions, June 3, 2007, http://cnx.org/content/m0091/2.13/.
Johnson, D. 2007. Source Coding Theorem. Connexions, June 3, 2007. http://cnx.org/content/m0091/2.13/.
Johnson, Don. Source Coding Theorem. Connexions. 3 June 2007 <http://cnx.org/content/m0091/2.13/>.