The latest edition of this classic is updated with new problem sets and material
The Second Edition of this fundamental textbook maintains the book's tradition of clear, thought-provoking instruction. Readers are provided once again with an instructive mix of mathematics, physics, statistics, and information theory.
All the essential topics in information theory are covered i...
The latest edition of this classic is updated with new problem sets and material
The Second Edition of this fundamental textbook maintains the book's tradition of clear, thought-provoking instruction. Readers are provided once again with an instructive mix of mathematics, physics, statistics, and information theory.
All the essential topics in information theory are covered in detail, including entropy, data compression, channel capacity, rate distortion, network information theory, and hypothesis testing. The authors provide readers with a solid understanding of the underlying theory and applications. Problem sets and a telegraphic summary at the end of each chapter further assist readers. The historical notes that follow each chapter recap the main points.
The Second Edition features:
* Chapters reorganized to improve teaching
* 200 new problems
* New material on source coding, portfolio theory, and feedback capacity
* Updated references
Now current and enhanced, the Second Edition of Elements of Information Theory remains the ideal textbook for upper-level undergraduate and graduate courses in electrical engineering, statistics, and telecommunications. An Instructor's Manual presenting detailed solutions to all the problems in the book is available from the Wiley editorial department.
原文摘录
· · · · · ·
The initial questions treated by information theory lay in the areas of data compression and transmission. The answers are quantities such as entropy and mutual information, which are functions of the probability distributions that underlie the process of communication.
The Kol-mogorov complexity of a binary string is defined as the length of the
shortest computer program that prints out the string.
Entropy is the uncertainty of a single random variable.
A communication channel is a system in which the output depends probabilistically on its input.
The entropy H of a random variable is a lower bound on the average length of the shortest description of the random variable. (查看原文)
Wiley Series in Telecommunications and Signal Processing(共15册)，
这套丛书还有
《Principles of Broadband Switching and Networking (Wiley Series in Telecommunications and Signal Processing)》《Fundamentals of Telecommunication Networks》《Optical Communications》《Vector Space Projections》《Robust Adaptive Beamforming (Wiley Series in Telecommunications and Signal Processing)》
等
。
喜欢读"Elements of Information Theory"的人也喜欢
· · · · · ·
读这本书的时候看见一个知乎的帖子，问 “信息论值不值得研究？” 想了一下，有些理论还是很重要的，比如信息熵，字节跳动 2021 年 ACL 的 Best Paper Award 就用到了，我还非常有幸和论文第一作者交流了一下学术。 信息论看来可能对于通讯领域更加重要吧。很难想象在几十年前...
(展开)
jake
机械工业出版社2005版
lx271
钢的门
机械工业出版社2008版
橡皮人
机械工业出版社2008版
Hao
水上漂
机械工业出版社2005版
7 有用 卖乐色的人贩子 2019-07-26 23:33:43
主要读了从Kolmogorov复杂性到金融的三章，其实后面各章之间没太大逻辑连贯性，都是不同的主题，所以批评这本书内容散乱完全是搞错了阅读方法，这书本来就不是一章一章读下去的，而是挑自己需要的章节读。
0 有用 Creasy 2013-02-28 04:40:53
Great book!
11 有用 Bayesian 2012-04-08 14:08:40
经典。但若是为了研究统计推断而学习信息论，我更推荐MacKay的Information Theory, Inference and Learning Algorithms。
0 有用 谁家的鸡 2019-12-26 14:21:13
写得真好！信息论用到的数学是如此简单，但是结论又这么优雅，Shannon 真的厉害。
0 有用 Hao 2022-02-02 16:39:04
大约在 8 年前我就有学习信息论的计划