The Mathematical Theory of Information

The Mathematical Theory of Information
ISBN-10
1402070640
ISBN-13
9781402070648
Category
Technology & Engineering
Pages
528
Language
English
Published
2002-06-30
Publisher
Springer Science & Business Media
Author
Jan Kåhre

Description

The general concept of information is here, for the first time, defined mathematically by adding one single axiom to the probability theory. This Mathematical Theory of Information is explored in fourteen chapters: 1. Information can be measured in different units, in anything from bits to dollars. We will here argue that any measure is acceptable if it does not violate the Law of Diminishing Information. This law is supported by two independent arguments: one derived from the Bar-Hillel ideal receiver, the other is based on Shannon's noisy channel. The entropy in the 'classical information theory' is one of the measures conforming to the Law of Diminishing Information, but it has, however, properties such as being symmetric, which makes it unsuitable for some applications. The measure reliability is found to be a universal information measure. 2. For discrete and finite signals, the Law of Diminishing Information is defined mathematically, using probability theory and matrix algebra. 3. The Law of Diminishing Information is used as an axiom to derive essential properties of information. Byron's law: there is more information in a lie than in gibberish. Preservation: no information is lost in a reversible channel. Etc. The Mathematical Theory of Information supports colligation, i. e. the property to bind facts together making 'two plus two greater than four'. Colligation is a must when the information carries knowledge, or is a base for decisions. In such cases, reliability is always a useful information measure. Entropy does not allow colligation.

Other editions

Similar books

  • Animal Sciences: The Biology, Care, and Production of Domestic Animals, Fourth Edition
    By John R. Campbell, M. Douglas Kenealy, Karen L. Campbell

    Timberlake claimed in 1980 that a fundamental problem with Singer's work is the lack of an adequate definition of suffering ...

  • Resilient Agriculture: Cultivating Food Systems for a Changing Climate
    By Laura Lengnick

    3. D. Layne. 2013. Tree Fruit: Protecting Your Investment. American/Western Fruit Grower, September/October. 4. R. Snyder and J. Melu-Abreu. 2005. Frost ...

  • Biodesign: The Process of Innovating Medical Technologies
    By Stefanos Zenios, Josh Makower, Paul Yock

    At that time, these were in the low $10s of millions. ... be a good partner going forward, even though it takes longer to get the deal done," offered Chess.

  • Advanced Signal Processing: A Concise Guide
    By Amir-Homayoon Najmi, Todd Moon

    [ 59 ] S. Kotz , T. J. Kozubowski , and K. Podgorski , The Laplace ... valued signal processing : The proper way to deal with impropriety , ” IEEE Trans .

  • Resources for Technical Communication
    By Pearson Education, Pearson Education Staff, David P Pearson Education

    Some documents are annotated; some are left without annotations to provide more flexibility for instructors. This booklet can be packaged at no additional cost with any Longman title in technical communication.

  • Chemistry: An Introduction to General, Organic, and Biological Chemistry; Chemistry Study Pack Version 2.0 CD-ROM; The Chemistry of Life CD-ROM;...
    By Karen C. Timberlake

    Chemistry: An Introduction to General, Organic, and Biological Chemistry; Chemistry Study Pack Version 2.0 CD-ROM; The Chemistry of Life CD-ROM;...

  • Poultry Science: Fifth Edition
    By Colin G. Scanes, Karen D. Christensen

    The emission rates for ammonia (Casey et al., 2006): • Layers: 116 g NH3 per AU (AU or animal unit or 500 kg). • Broilers: 135 g NH3 per AU (AU or animal unit or 500 kg). Emission rates in different reports vary from less than either 10 ...

  • Solid State Materials Chemistry
    By Patrick M. Woodward, Pavel Karen, John S. O. Evans

    [45] B.F. Hoskins, R. Robson, “Design and construction of a new class of scaffolding-like materials comprising infinite polymeric frameworks of 3D-linked molecular rods. A reappraisal of the zinc cyanide and cadmium cyanide structures ...

  • Abbreviations Dictionary
    By Dean A. Stahl, Karen Landen

    ... Tallest Mountain Mount Robson—12,972 feet or 3,954 meters—in the Canadian Rockies Canada's Westernmost City Dawson, Yukon Canada's Westernmost Point in Yukon Territory just east of Alaska's Demarcation Point Canary Islands' Largest ...

  • Agriculture: A Very Short Introduction
    By Paul Brassley, Richard Soffe

    ACCOUNTING Christopher Nobes ADVERTISING Winston Fletcher AFRICAN AMERICAN RELIGION Eddie S. Glaude Jr AFRICAN HISTORY ... Hugh Bowden ALGEBRA Peter M. Higgins AMERICAN HISTORY Paul S. Boyer AMERICAN IMMIGRATION David A. Gerber AMERICAN ...