New Foundations for Information Theory: Logical Entropy and Shannon Entropy
- ISBN-10
- 3030865525
- ISBN-13
- 9783030865528
- Category
- Philosophy
- Pages
- 121
- Language
- English
- Published
- 2021-10-30
- Publisher
- Springer Nature
- Author
- David Ellerman
Description
This monograph offers a new foundation for information theory that is based on the notion of information-as-distinctions, being directly measured by logical entropy, and on the re-quantification as Shannon entropy, which is the fundamental concept for the theory of coding and communications. Information is based on distinctions, differences, distinguishability, and diversity. Information sets are defined that express the distinctions made by a partition, e.g., the inverse-image of a random variable so they represent the pre-probability notion of information. Then logical entropy is a probability measure on the information sets, the probability that on two independent trials, a distinction or “dit” of the partition will be obtained. The formula for logical entropy is a new derivation of an old formula that goes back to the early twentieth century and has been re-derived many times in different contexts. As a probability measure, all the compound notions of joint, conditional, and mutual logical entropy are immediate. The Shannon entropy (which is not defined as a measure in the sense of measure theory) and its compound notions are then derived from a non-linear dit-to-bit transform that re-quantifies the distinctions of a random variable in terms of bits—so the Shannon entropy is the average number of binary distinctions or bits necessary to make all the distinctions of the random variable. And, using a linearization method, all the set concepts in this logical information theory naturally extend to vector spaces in general—and to Hilbert spaces in particular—for quantum logical information theory which provides the natural measure of the distinctions made in quantum measurement. Relatively short but dense in content, this work can be a reference to researchers and graduate students doing investigations in information theory, maximum entropy methods in physics, engineering, and statistics, and to all those with a special interest in a new approach to quantum information theory.
Get the book
Similar books
-
Ecofeminist Philosophy: A Western Perspective on what it is and why it Matters
By Karen WarrenWijkman and Timberlake , Natural Disasters , 27 . 32. Wijkman and Timberlake , Natural Disasters , 49 . 33. Seager , New State of the Earth Atlas , 121 .
-
Each Day a Renewed Beginning: Meditations for a Peaceful Journey
By Karen Casey7. Sometimes the things that frighten you the most can be the biggest sources of strength. —Iris Timberlake or Most of us learn as we mature that strength.
-
Emerging Trends in Continental Philosophy
By Todd May28 It is therefore not difficult to reconcile Badiou«s references to historical ... On the one hand, Badiou«s major essays on Rancière all deal with the ...
-
Pierre Bayle's Cartesian Metaphysics: Rediscovering Early Modern Philosophy
By Todd RyanBayle offers a similar assessment in a letter to Minutoli: There has just been ... touchant la tran[s]substantiation, et leur conformité avec le calvinisme.
-
Negotiating a Settlement in Northern Ireland, 1969-2019
By John Coakley, Jennifer ToddHowever, acceptance of the deal was driven in part by threats of worse to come should agreement ... see Northern Ireland (St Andrews Agreement) Act 2006, s.
-
The Philosopher's Way
By Pearson Education, Pearson Education Staff, Inc.Several versions of Pearson's MyLab & Mastering products exist for each title, including customized versions for individual schools, and registrations are not transferable.
-
Swimmer in a Dark Sea
By Pierce TimberlakeTake a tour through the mind of America's undiscovered philosopher: Pierce Timberlake. Swimmer in a Dark Sea is a dizzying ride through a dazzling array of profound concepts.
-
Bringing Peace Home: Feminism, Violence, and Nature
By Karen Warren, Duane L. Cady"This collection of works is ambitious, well documented, thoroughly—though not turgidly—referenced, and comprehensively indexed.
-
Ecological Feminism
By Karen Warren, Barbara Wells-HoweThe essays in this volume deal with a wide variety of subjects - the essential distinction between the "ecofeminist" and the "ecofeminine," the link between violence and environmental exploitation, feminism's relationship to animal rights ...
-
Catharine Macaulay's Republican Enlightenment
By Karen Green6 Davies, Catharine Macaulay and Mercy Otis Warren, 228; Franklin Bowditch Dexter (ed.), The Literary Diary of Ezra Stiles (New York: C. Scribner's Sons, ...