Connexions

Sections
You are here: Home » Content » Entropy

About: Entropy

Module by: Don Johnson

View content

Metadata

Name: Entropy
ID: m0070
Language: English (en)
Summary: Shannon showed the power of probabilistic models for symbolic-valued signals. The dey quantity that characterizes such a signal is the entropy of its alphabet.
Subject: Science and Technology
Keywords: communication theory, compression, digital communication, digital sources, entropy, information communication, Shannon
Document Type: -//CNX//DTD CNXML 0.5 plus MathML//EN
License: Creative Commons Attribution License (CC-BY 1.0)

Authors: Don Johnson (dhj@rice.edu)
Copyright Holders: Don Johnson (dhj@rice.edu)
Maintainers: Indra Datta (kashent@alumni.rice.edu), CJ Ganier (seejaie@rice.edu), Don Johnson (dhj@rice.edu), John Cottrell (jac3@rice.edu)

Version: 2.13 (history)
Created: Jul 27, 2000 12:00 am GMT-5
Revised: Apr 15, 2005 11:36 am GMT-5

Version History

Version: 2.13 Apr 15, 2005 11:36 am GMT-5 by Charlet Reedstrom
Changes:
update to cnxml-0.5, update Pr csymbol, add equation tag

Version: 2.12 Aug 18, 2004 12:06 pm GMT-5 by Adan Galvan
Changes:
 changed subscripts

Version: 2.11 Nov 30, 2003 9:15 pm US/Central by Don Johnson
Changes:
Fixed a math markup error in solution to exercise.

Version: 2.10 Aug 17, 2002 12:00 am GMT-5 by (Unknown)
Changes:
Fixed important math display errors.

Version: 2.9 Aug 13, 2002 12:00 am GMT-5 by (Unknown)
Changes:
Upgraded to 0.4.

Version: 2.8 Aug 5, 2002 12:00 am GMT-5 by (Unknown)
Changes:
Fixed minor math error.

Version: 2.7 Apr 29, 2002 12:00 am GMT-5 by (Unknown)
Changes:
fixed summation markup on problem solution, wrapped msub in ci, changed mi tag surrounding numbers to mn tag

Version: 2.6 Sep 11, 2001 12:00 am GMT-5 by Brent Hendricks
Changes:
Converted to CNXML 0.3.5

Version: 2.5 Aug 23, 2001 12:00 am GMT-5 by (Unknown)
Changes:
- Revert wide equation change

Version: 2.4 Aug 23, 2001 12:00 am GMT-5 by (Unknown)
Changes:
The equation in the example is too wide, so change it.

Version: 2.3 Aug 22, 2001 12:00 am GMT-5 by (Unknown)
Changes:
correct a minor error in equation.

Version: 2.2 Jul 17, 2001 12:00 am GMT-5 by (Unknown)
Changes:
added keywords
made John Cottrell a maintainer
fixed minor errors

Version: 2.1 Jun 5, 2001 12:00 am GMT-5 by (Unknown)
Changes:
Updated from .2 to .3 CNXML and to content MathML

Version: 2.0 Jul 27, 2000 12:00 am GMT-5 by Brent Hendricks
Changes:
Bumped version to 2.0

How to Reuse and Attribute This Content

If you derive a copy of this content using a Connexions account and publish your version, proper attribution of the original work will be automatically done for you.

If you reuse this work elsewhere, in order to comply with the attribution requirements of the license (CC-BY 1.0), you must include

  • the authors' names: Don Johnson
  • the title of the work: Entropy
  • the Connexions URL where the work can be found: http://cnx.org/content/m0070/2.13/

See the citation section below for examples you can copy.

How to Cite and Attribute This Content

The following citation styles comply with the attribution requirements for the license (CC-BY 1.0) of this work:

American Chemical Society (ACS) Style Guide:

Johnson, D. Entropy, Connexions Web site. http://cnx.org/content/m0070/2.13/, Apr 15, 2005.

American Medical Assocation (AMA) Manual of Style:

Johnson D. Entropy [Connexions Web site]. April 15, 2005. Available at: http://cnx.org/content/m0070/2.13/.

American Psychological Assocation (APA) Publication Manual:

Johnson, D. (2005, April 15). Entropy. Retrieved from the Connexions Web site: http://cnx.org/content/m0070/2.13/

Chicago Manual of Style (Bibliography):

Johnson, Don. "Entropy." Connexions. April 15, 2005. http://cnx.org/content/m0070/2.13/.

Chicago Manual of Style (Note):

Don Johnson, "Entropy," Connexions, April 15, 2005, http://cnx.org/content/m0070/2.13/.

Chicago Manual of Style (Reference, in Author-Date style):

Johnson, D. 2005. Entropy. Connexions, April 15, 2005. http://cnx.org/content/m0070/2.13/.

Modern Languages Association (MLA) Style Manual:

Johnson, Don. Entropy. Connexions. 15 Apr. 2005 <http://cnx.org/content/m0070/2.13/>.