转一下自己在 stats.stackexchange 上的问题和回答。
The book perfectly fulfills the three requirements:
- Emphasizes connections and unifying principles (I checked this question and the links posted therein, but didn't find an introduction textbook)
- Concisely presents the solid basics of core techniques and concepts, like: linear regression, MLE, hypothesis test, confidence interval, unbiasedness, consistency, sufficiency, etc. (pretty much like the point 2 & 3 here, but I am not a mathematician)
- At a level between a first and a second course (or a first course for an honors class?)
- After a brief description of what is statistical inference in plain English (Chapter 1), it introduces the decision theoretic framework of statistical inference (Chapter 2&3), along with many insightful remarks. Chapter 4 is amazing. It presents most of the principles of statistics: Bayes, Minimax, Admissibility, Unbiasedness, Maximum Likelihood, Method of Moments, along with criticisms and connections.
- Afterwards, it goes into Linear Regression (Chapter 5), Point Estimation (Chapter 7), Hypothesis Testing (Chapter 8), and Confidence Intervals (Chapter 9). Sufficiency (Chapter 6) and Asymptotics (Section 7.6) are also covered. All these are packed concisely within about 300 pages.
- The prerequisites are only Calculus and Linear Algebra, the latter is optional if you omit '5.4 Analysis of the General Linear Model'. Also, it avoids formalization whenever possible. That said, the mathematical maturity required to follow the (often informal) reasoning is actually more than most of introductions to statistics I've tried (e.g. Casella & Berger, which is usually considered as advanced undergraduate or graduate level). You need to devote many thoughts into nuances of statistical ideas that are rarely found in books of this level.
An additional advantage is the good exercises. They are not simple repetitions of the examples, but rather like exam problems. They are broken into several sub-problems to guide the readers, and there are also hints. A unique feature is the the author's suggestions of which problems you should do as a minimum.
- Although the exercises are well-designed and you can solve most of them independently, it would be better if there are solutions.
- Since the book was written in the 70's, the notation is a bit weird and it takes some time to get used to.
Finally, maybe this should not be count as a problem of the book itself, but as mentioned in my another question, I think it is a big plus if one can get to know some computational techniques and tools from the very beginning of learning Statistics.
I would be very happy to know other books (or supplements) that address the mentioned problems, at the same time preserve the advantages of Kiefer's.