Skip to main content

Information Theory: a tutorial introduction - James V. Stone ***

Information theory is central to the technology that we use every day - apart from anything else, in the technology that brings you this review (though ironically not in the book being reviewed as it doesn't appear to have an ebook version). As in his Bayes' Rule, James Stone sets out to walk a fine line between a title for the general reader and a textbook. And like that companion title the outcome is mixed, though here the textbook side largely wins.

The opening chapter 'What is information?' walks the line very well. It gradually builds up the basics that will be required to understand information theory and though it would work better if it had a little more context (for example, more about Claude Shannon as a person) to anchor it, the general reader will, with perhaps a few pages that needs re-reading, find it approachable and providing more depth than a popular science title usually would. I like the way that Stone uses variants of a photograph, for instance, to demonstrate what is happening with different mechanisms for compressing data. Unfortunately, though, this is pretty much where that general reader gets off, until we get to chapter 9.

The main bulk of the book, pages 21 to 184, cross that line and plonk solidly into textbook territory - they may cover the topic rather more lightly than a traditional textbook, but they simply don't work to inform without requiring the kind of investment of mind and mathematics that a textbook does - and, with a few brief exceptions, the writing style feels no different from the better textbooks I have from university. At chapter 9, the subject is brought round to information in nature, and there we get enough application and context to make what we learn seem more approachable again, though not to the same level as the equivalent part of Bayes' Rule. It's also a shame that (unless I missed it) there is no mention of Omega, Greg Chaitin's remarkable non-computable number.

So where Bayes' Rule is suited to popular science readers who want to stretch themselves and put in some extra effort, Information Theory can only really be regarded as a readable introductory textbook - it doesn't work in a popular science context. (Why then am I reviewing it? The author kindly provided the title for review in the hope that it would work for popular science readers.) If you are about to take a university course encompassing information theory - or are contemplating doing so - I can, however, heartily recommend this title as an introduction. 



Paperback 


Buy direct from the author here.
Review by Brian Clegg

Comments

Popular posts from this blog

The AI Delusion - Gary Smith *****

This is a very important little book ('little' isn't derogatory - it's just quite short and in a small format) - it gets to the heart of the problem with applying artificial intelligence techniques to large amounts of data and thinking that somehow this will result in wisdom.

Gary Smith as an economics professor who teaches statistics, understands numbers and, despite being a self-confessed computer addict, is well aware of the limitations of computer algorithms and big data. What he makes clear here is that we forget at our peril that computers do not understand the data that they process, and as a result are very susceptible to GIGO - garbage in, garbage out. Yet we are increasingly dependent on computer-made decisions coming out of black box algorithms which mine vast quantities of data to find correlations and use these to make predictions. What's wrong with this? We don't know how the algorithms are making their predictions - and the algorithms don't kn…

Five Photons - James Geach ****

It is generally acknowledged that Stephen Hawking's A Brief History of Time is one of the most common books to be bought but not read beyond the first few pages. If you are the kind of popular science reader who found Hawking hard going, you can stop now - Five Photons is not for you. If, on the other hand, you found A Brief History of Time a piece of cake and wished you could get into more depth without resorting to heavy mathematics or a tedious textbook style, Five Photons could be just up your street.

Astrophysicist James Geach starts of fairly gently with a chapter on the nature of light that mostly sets aside quantum physics, leading up to the observation that light is our vehicle for for stripping back the history of the universe to its earliest times (or, at least, the point where the universe became transparent). From here on, the five photons of the title take us on different journeys, from the oldest surviving light of the cosmic microwave background radiation to that fr…

Mercury - William Sheehan ****

Driving to work one morning several years ago, I spotted a tiny white dot close to the rising sun. ‘That’s Venus,’ I said to myself. Almost immediately I saw another, much brighter dot a few degrees away. ‘No, that’s Venus – the first one must be, um ... Mercury.’ Even with a lifelong interest in astronomy, I always manage to forget Mercury.

With eight planets in the Solar System, one of them has to be the least interesting – and Mercury got the short straw. That’s a relative statement, though, and a diligent author could still dig up enough fascinating facts about that tiny dot by the Sun to fill a short book. William Sheehan has done a brilliant job of doing just that.

One of the reasons Mercury is so easy to forget is that it’s almost impossible to get a good view of it from Earth. Even after the invention of the telescope, which turned planets like Mars and Jupiter into explorable worlds, Mercury remained a mystery – and the subject of some pretty wild speculations. In 1686, for exa…