Back in March I started to review the latest book authored by Bradley Efron and Trevor Hastie, Computer Age Statistical Inference. Since then I found that there are far better reviews than the one I could write right now, and it is probably time to close this post or just let it go.
Statistics is the science of learning from experience, particularly experience that arrives a little bit at a time.
Together with the Elements of Statistical Learning or an Introduction to Statistical Learning, this is another great reference for applied researchers. The present book shares a similar spirit in that it offers a deep review of modern techniques of statistical inference, especially in Part 2, but it also covers more “classical” techniques like generalized linear and time to event models. Note that the book has also been made available in PDF format for free.
As I said above, there are many good reviews of this book on the internet, including one by Joseph Rickert and another one by William J. Satzer on the MAA. So I will let the interested reader go through these reviews and read the whole book. For what is worth, chapters 4, 7, 10, 17 and 20 are my preferred ones, although I learned a lot from the last chapter which is all about the empirical Bayes learning process.
From the very beginning of the book, the authors want to pinpoint and exploit the distinction that one can establish “between the algorithmic and inferential aspects of statistical analysis.” For example, while averaging a series of observed numbers is an algorithm, computing the standard error of this estimate allows to make an inference for the accuracy of this algorithm. I like the idea of the interplay between statistical algorithm and learning because it sums up the situation of computational statistics very well. Nowadays, there are so many schools of thought to focus on (machine learning vs. statistics, data scientists vs. statisticians) that such pragmatic distinction should help to (somewhat) decide where to put one’s effort.
While editing this draft post, I found the following link at the end of the post. I don’t remember why I put this when I was in draft mode, but in case someone find it useful, I will leave it there but don’t ask me why: Do Statistical Methods Have an Expiration Date?
John Cale • Fragments of a Rainy Season