About: Entropy
Metadata
| Name: | Entropy |
| ID: | m10164 |
| Language: | English (en) |
| Summary: | This module presents a quantification of information by the use of entropy. Entropy, or average self-information, measures the uncertainty of a source and hence provides a measure of the information it could reveal. |
| Subject: | Science and Technology |
| Keywords: | conditional entropy, entropy, entropy rate, information, joint entropy |
| Document Type: | -//CNX//DTD CNXML 0.5 plus MathML//EN |
| License: | Creative Commons Attribution License CC-BY 1.0 |
|
|
|
| Authors: | Behnaam Aazhang (aaz@ece.rice.edu) |
| Copyright Holders: | Behnaam Aazhang (aaz@ece.rice.edu) |
| Maintainers: | Dinesh Rajan (dinesh@ece.rice.edu), Mohammad Borran (mohammad@ece.rice.edu), Roy Ha (rha@alumni.rice.edu), Shawn Stewart (mrshawn@alumni.rice.edu), Behnaam Aazhang (aaz@ece.rice.edu) |
|
|
|
| Version: | 2.16 (history) |
| Created: | Jul 3, 2001 12:00 am GMT-5 |
| Revised: | Oct 24, 2005 2:52 pm GMT-5 |
Version History
| Version: | 2.16 Oct 24, 2005 2:52 pm GMT-5 by Charlet Reedstrom |
| Changes: | fixed a couple more typos, made eqn1 look like the notes, added pdf csymbol in a few places |
|
|
|
| Version: | 2.15 Oct 3, 2005 1:29 pm GMT-5 by Elizabeth Gregory |
| Changes: | Corrected the follow set of omissions and typos: 1) Entered a missing phrase before the list; 2) Deleted the second term of a list in the first item of the first list; 3) Added a cnxn pointing to the first figure to the third item of the list; 4) In Example 2, switched x=0 and x=1 in the second sentence; 5) In Example 5, in the equation, corrected the second line. |
|
|
|
| Version: | 2.14 Oct 13, 2004 2:43 pm GMT-5 by Charlet Reedstrom |
| Changes: | updated module to cnxml-0.5, fixed some presentation mathml, added foreign tags |
|
|
|
| Version: | 2.13 Jan 7, 2004 9:56 am US/Central by Adan Galvan |
| Changes: | added maintainer |
|
|
|
| Version: | 2.12 Oct 3, 2003 1:28 pm GMT-5 by Charlet Reedstrom |
| Changes: | removed hardcoded numbers in example names, changed markup of multiple subscripts in places, added markup of variable inline in places, changed condition to domainofapplication |
|
|
|
| Version: | 2.11 Aug 12, 2002 12:00 am GMT-5 by (Unknown) |
| Changes: | Content changes as requested by author |
|
|
|
| Version: | 2.10 Feb 9, 2002 12:00 am US/Central by (Unknown) |
| Changes: | Authors updated |
|
|
|
| Version: | 2.9 Dec 19, 2001 12:00 am US/Central by (Unknown) |
| Changes: | Sample text |
|
|
|
| Version: | 2.8 Dec 7, 2001 12:00 am US/Central by (Unknown) |
| Changes: | changed blank= to get module to print |
|
|
|
| Version: | 2.7 Jul 23, 2001 12:00 am GMT-5 by (Unknown) |
| Changes: | Added link to elec 241 entropy module |
|
|
|
| Version: | 2.5 Jul 19, 2001 12:00 am GMT-5 by (Unknown) |
| Changes: | Added graphics |
|
|
|
| Version: | 2.4 Jul 11, 2001 12:00 am GMT-5 by (Unknown) |
| Changes: | Added links to other modules |
|
|
|
| Version: | 2.3 Jul 11, 2001 12:00 am GMT-5 by (Unknown) |
| Changes: | Edited Title |
|
|
|
| Version: | 2.2 Jul 10, 2001 12:00 am GMT-5 by (Unknown) |
| Changes: | Modulariztion of material. Added keywords and abstract. |
|
|
|
| Version: | 2.1 Jul 5, 2001 12:00 am GMT-5 by (Unknown) |
| Changes: | First draft of module |
|
|
|
| Version: | 2.0 Jul 3, 2001 12:00 am GMT-5 by (Unknown) |
| Changes: | Added initial template for new module m10164 |
How to Reuse and Attribute This Content
If you derive a copy of this content using a Connexions account and publish your version, proper attribution of the original work will be automatically done for you.
If you reuse this work elsewhere, in order to comply with the attribution requirements of the license (CC-BY 1.0), you must include
- the authors' names: Behnaam Aazhang
- the title of the work: Entropy
- the Connexions URL where the work can be found: http://cnx.org/content/m10164/2.16/
See the citation section below for examples you can copy.
How to Cite and Attribute This Content
The following citation styles comply with the attribution requirements for the license (CC-BY 1.0) of this work:
American Chemical Society (ACS) Style Guide:
Aazhang, B. Entropy, Connexions Web site. http://cnx.org/content/m10164/2.16/, Oct 24, 2005.
American Medical Assocation (AMA) Manual of Style:
Aazhang B. Entropy [Connexions Web site]. October 24, 2005. Available at: http://cnx.org/content/m10164/2.16/.
American Psychological Assocation (APA) Publication Manual:
Aazhang, B. (2005, October 24). Entropy. Retrieved from the Connexions Web site: http://cnx.org/content/m10164/2.16/
Chicago Manual of Style (Bibliography):
Aazhang, Behnaam. "Entropy." Connexions. October 24, 2005. http://cnx.org/content/m10164/2.16/.
Chicago Manual of Style (Note):
Behnaam Aazhang, "Entropy," Connexions, October 24, 2005, http://cnx.org/content/m10164/2.16/.
Chicago Manual of Style (Reference, in Author-Date style):
Aazhang, B. 2005. Entropy. Connexions, October 24, 2005. http://cnx.org/content/m10164/2.16/.
Modern Languages Association (MLA) Style Manual:
Aazhang, Behnaam. Entropy. Connexions. 24 Oct. 2005 <http://cnx.org/content/m10164/2.16/>.
Footer
More about this content: Metadata | Version History
This work is licensed by Behnaam Aazhang under a Creative Commons Attribution License (CC-BY 1.0), and is an Open Educational Resource.
Last edited by Charlet Reedstrom on Oct 24, 2005 2:52 pm GMT-5.