Information Theory, Inference and Learning Algorithms
- ISBN-10
- 0521644445
- ISBN-13
- 9780521644440
- Category
- Computers
- Pages
- 640
- Language
- English
- Published
- 2003
- Publisher
- Cambridge University Press
- Author
- David J. C. MacKay
Description
Information theory and inference, often taught separately, are here united in one entertaining textbook. These topics lie at the heart of many exciting areas of contemporary science and engineering - communication, signal processing, data mining, machine learning, pattern recognition, computational neuroscience, bioinformatics, and cryptography. This textbook introduces theory in tandem with applications. Information theory is taught alongside practical communication systems, such as arithmetic coding for data compression and sparse-graph codes for error-correction. A toolbox of inference techniques, including message-passing algorithms, Monte Carlo methods, and variational approximations, are developed alongside applications of these tools to clustering, convolutional codes, independent component analysis, and neural networks. The final part of the book describes the state of the art in error-correcting codes, including low-density parity-check codes, turbo codes, and digital fountain codes -- the twenty-first century standards for satellite communications, disk drives, and data broadcast. Richly illustrated, filled with worked examples and over 400 exercises, some with detailed solutions, David MacKay's groundbreaking book is ideal for self-learning and for undergraduate or graduate courses. Interludes on crosswords, evolution, and sex provide entertainment along the way. In sum, this is a textbook on information, communication, and coding for a new generation of students, and an unparalleled entry point into these subjects for professionals in areas as diverse as computational biology, financial engineering, and machine learning.
Get the book
Other editions
-
- 2003-09-25
- 628 pages
- Paperback
- Cambridge University Press
Similar books
-
Family History Digital Libraries
By William Sims BainbridgeOne named Sara and Timberlake had 11 male workers, 1 female worker, and 4 children workers, so it might have employed the Minor family.
-
Foundation Dreamweaver MX
By Craig Grannell, Jerome Turner, Matt StephensSo here's what we need to do to arrive at our layout: s Create the main table to hold all the page elements. s Deal with the navigation area which is ...
-
Cisco CCNA Certification, 2 Volume Set: Exam 200-301
By Todd LammleThis inclusive, two-book set provides what you need to know to succeed on the new CCNA exam. The set includes Understanding Cisco Networking Technologies: Volume 1 and the CCNA Certification Study Guide: Volume 2.
-
CompTIA Network+ Study Guide: Exam N10-006
By Todd Lammle... you can use: –a –A –c –n –r –R –S –s All nbtstat switches are case sensitive. Generally speaking, lowercase switches deal with NetBIOS names of hosts, ...
-
CompTIA Network+ Study Guide with Online Labs: N10-007 Exam
By Todd Lammle, Jon Buhagiar... you can use: –a –A –c –n –r –R –S –s All nbtstat switches are case sensitive. Generally speaking, lowercase switches deal with NetBIOS names of hosts, ...
-
CCNA: Cisco Certified Network Associate FastPass
By Todd LammleS The S reference point defines the point between the customer router and an ... with the letter E deal with using ISDN on the existing telephone network.
-
Stranger in the Chat Room
By Todd Hafer, Jedd HaferA sequel to In the Chat Room With God finds a group of teens contacted by a mysterious and increasingly malevolent character who claims to know about their encounters with the Almighty and challenges their beliefs. Original.
-
Error Correction Coding: Mathematical Methods and Algorithms
By Todd K. MoonM M−1∑ k=0 −∞ ∞ k=0 The average energy per signal E s ∫ can be related to the ... we will deal primarily with additive white Gaussian noise (AWGN), ...
-
Security+ Training Guide
By Todd King... to deal with most , but unfortunately not all , of these potential threats . ... The S / MIME standard implements encryption for message content using ...
-
CCDA: Cisco Certified Design Associate Study Guide: Exam 640-861
By Todd Lammle, Andy BarklS reference point The S reference point defines the reference point between ... with the letter E deal with using ISDN on the existing telephone network.