An Introduction to Information Theory

An Introduction to Information Theory Symbols, Signals & Noise

Behind the familiar surfaces of the telephone, radio, and television lies a sophisticated and intriguing body of knowledge known as information theory. This is the theory that has permeated the rapid development of all sorts of communication, from color television to the clear transmission of photographs from the vicinity of Jupiter. Even more revolutionary progress is expected in the future. To give a solid introduction to this burgeoning field, J. R. Pierce has revised his well-received 1961 study of information theory for an up-to-date second edition. Beginning with the origins of the field, Dr. Pierce follows the brilliant formulations of Claude Shannon and describes such aspects of the subject as encoding and binary digits, entropy. language and meaning, efficient encoding , and the noisy channel. He then goes beyond the strict confines of the topic to explore the ways in which information theory relates to physics, cybernetics, psychology, and art. Mathematical formulas are introduced at the appropriate points for the benefit of serious students. A glossary of terms and an appendix on mathematical notation are provided to help the less mathematically sophisticated. J. R. Pierce worked for many years at the Bell Telephone Laboratories, where he became Director of Research in Communications Principles. He is currently affiliated with the engineering department of the California Institute of Technology. While his background is impeccable, Dr. Pierce also possesses an engaging writing style that makes his book all the more welcome. An Introduction to Information Theory continues to be the most impressive non-technical account available and a fascinating introduction to the subject for laymen. "An uncommonly good study. . . . Pierce's volume presents the most satisfying discussion to be found."? Scientific American.
Sign up to use

Reviews

Photo of robert preswick
robert preswick@prez
5 stars
Sep 21, 2023

The author describes the history of information theory (before it was coined) starting with Alexander Bell, Morse, Binary / Boolean. He explains in a very straight forward and retail manner, concepts such as ergodicity and the units of measurement known as bits and the mathematics behind calculating bits per message. Information theory is a hammer that allows almost any discipline and topic to be a nail. In the 50+ years since this book was written, information theory has been applied to economics, evolution, medicine, and remains the backbone of computing. Some argue it is the most robust unifying theory we know. Great introduction for those wanting to learn about this very important concept.

Photo of Mundy Otto Reimer
Mundy Otto Reimer@mundyreimer
5 stars
Aug 16, 2022
Photo of Chris Aldrich
Chris Aldrich@chrisaldrich
4 stars
Dec 26, 2021