Hostname: page-component-7b7567c8c-z4zkx Total loading time: 0 Render date: 2026-11-16T03:27:43.258Z Has data issue: false hasContentIssue false

Why the Shannon and Hartley entropies are ‘natural’

Published online by Cambridge University Press:  01 July 2016

J. Aczél
Affiliation:
University of Waterloo, Ontario
B. Forte
Affiliation:
University of Waterloo, Ontario
C. T. Ng
Affiliation:
University of Waterloo, Ontario

Abstract

The following properties of entropies, as measures of expected information, seem natural. The amount of information expected from an experiment does not change if we add outcomes of zero probability (expansibility). The expected information is symmetric in the (probabilities of the) outcomes. The information expected from a combination of two experiments is less than or equal to the sum of the informations expected from the single experiments (subadditivity); equality holds here if the two experiments are independent (additivity).

In this paper it is shown that linear combinations of the Shannon and Hartley entropies and only these have the above properties. The Shannon and the Hartley entropies are also individually characterized.

Information

Type
Research Article
Copyright
Copyright © Applied Probability Trust 1974 

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

Article purchase

Temporarily unavailable