About: Entropy
Metadata
| Name: | Entropy |
| ID: | m0070 |
| Language: | English (en) |
| Summary: | Shannon showed the power of probabilistic models for symbolic-valued signals. The dey quantity that characterizes such a signal is the entropy of its alphabet. |
| Subject: | Science and Technology |
| Keywords: | communication theory, compression, digital communication, digital sources, entropy, information communication, Shannon |
| Document Type: | -//CNX//DTD CNXML 0.5 plus MathML//EN |
| License: | Creative Commons Attribution License CC-BY 1.0 |
|
|
|
| Authors: | Don Johnson (dhj@rice.edu) |
| Copyright Holders: | Don Johnson (dhj@rice.edu) |
| Maintainers: | Indra Datta (kashent@alumni.rice.edu), CJ Ganier (seejaie@rice.edu), Don Johnson (dhj@rice.edu), John Cottrell (jac3@rice.edu) |
|
|
|
| Version: | 2.13 (history) |
| Created: | Jul 27, 2000 12:00 am GMT-5 |
| Revised: | Apr 15, 2005 11:36 am GMT-5 |
Version History
| Version: | 2.13 Apr 15, 2005 11:36 am GMT-5 by Charlet Reedstrom |
| Changes: | update to cnxml-0.5, update Pr csymbol, add equation tag |
|
|
|
| Version: | 2.12 Aug 18, 2004 12:06 pm GMT-5 by Adan Galvan |
| Changes: | changed subscripts |
|
|
|
| Version: | 2.11 Nov 30, 2003 9:15 pm US/Central by Don Johnson |
| Changes: | Fixed a math markup error in solution to exercise. |
|
|
|
| Version: | 2.10 Aug 17, 2002 12:00 am GMT-5 by (Unknown) |
| Changes: | Fixed important math display errors. |
|
|
|
| Version: | 2.9 Aug 13, 2002 12:00 am GMT-5 by (Unknown) |
| Changes: | Upgraded to 0.4. |
|
|
|
| Version: | 2.8 Aug 5, 2002 12:00 am GMT-5 by (Unknown) |
| Changes: | Fixed minor math error. |
|
|
|
| Version: | 2.7 Apr 29, 2002 12:00 am GMT-5 by (Unknown) |
| Changes: | fixed summation markup on problem solution, wrapped msub in ci, changed mi tag surrounding numbers to mn tag |
|
|
|
| Version: | 2.6 Sep 11, 2001 12:00 am GMT-5 by Brent Hendricks |
| Changes: | Converted to CNXML 0.3.5 |
|
|
|
| Version: | 2.5 Aug 23, 2001 12:00 am GMT-5 by (Unknown) |
| Changes: | - Revert wide equation change |
|
|
|
| Version: | 2.4 Aug 23, 2001 12:00 am GMT-5 by (Unknown) |
| Changes: | The equation in the example is too wide, so change it. |
|
|
|
| Version: | 2.3 Aug 22, 2001 12:00 am GMT-5 by (Unknown) |
| Changes: | correct a minor error in equation. |
|
|
|
| Version: | 2.2 Jul 17, 2001 12:00 am GMT-5 by (Unknown) |
| Changes: | added keywords made John Cottrell a maintainer fixed minor errors |
|
|
|
| Version: | 2.1 Jun 5, 2001 12:00 am GMT-5 by (Unknown) |
| Changes: | Updated from .2 to .3 CNXML and to content MathML |
|
|
|
| Version: | 2.0 Jul 27, 2000 12:00 am GMT-5 by Brent Hendricks |
| Changes: | Bumped version to 2.0 |
How to Reuse and Attribute This Content
If you derive a copy of this content using a Connexions account and publish your version, proper attribution of the original work will be automatically done for you.
If you reuse this work elsewhere, in order to comply with the attribution requirements of the license (CC-BY 1.0), you must include
- the authors' names: Don Johnson
- the title of the work: Entropy
- the Connexions URL where the work can be found: http://cnx.org/content/m0070/2.13/
See the citation section below for examples you can copy.
How to Cite and Attribute This Content
The following citation styles comply with the attribution requirements for the license (CC-BY 1.0) of this work:
American Chemical Society (ACS) Style Guide:
Johnson, D. Entropy, Connexions Web site. http://cnx.org/content/m0070/2.13/, Apr 15, 2005.
American Medical Assocation (AMA) Manual of Style:
Johnson D. Entropy [Connexions Web site]. April 15, 2005. Available at: http://cnx.org/content/m0070/2.13/.
American Psychological Assocation (APA) Publication Manual:
Johnson, D. (2005, April 15). Entropy. Retrieved from the Connexions Web site: http://cnx.org/content/m0070/2.13/
Chicago Manual of Style (Bibliography):
Johnson, Don. "Entropy." Connexions. April 15, 2005. http://cnx.org/content/m0070/2.13/.
Chicago Manual of Style (Note):
Don Johnson, "Entropy," Connexions, April 15, 2005, http://cnx.org/content/m0070/2.13/.
Chicago Manual of Style (Reference, in Author-Date style):
Johnson, D. 2005. Entropy. Connexions, April 15, 2005. http://cnx.org/content/m0070/2.13/.
Modern Languages Association (MLA) Style Manual:
Johnson, Don. Entropy. Connexions. 15 Apr. 2005 <http://cnx.org/content/m0070/2.13/>.
Footer
More about this content: Metadata | Version History
This work is licensed by Don Johnson under a Creative Commons Attribution License (CC-BY 1.0), and is an Open Educational Resource.
Last edited by Charlet Reedstrom on Apr 15, 2005 11:36 am GMT-5.