Skip to main content

Information Theory: a tutorial introduction - James V. Stone ***

Information theory is central to the technology that we use every day - apart from anything else, in the technology that brings you this review (though ironically not in the book being reviewed as it doesn't appear to have an ebook version). As in his Bayes' Rule, James Stone sets out to walk a fine line between a title for the general reader and a textbook. And like that companion title the outcome is mixed, though here the textbook side largely wins.

The opening chapter 'What is information?' walks the line very well. It gradually builds up the basics that will be required to understand information theory and though it would work better if it had a little more context (for example, more about Claude Shannon as a person) to anchor it, the general reader will, with perhaps a few pages that needs re-reading, find it approachable and providing more depth than a popular science title usually would. I like the way that Stone uses variants of a photograph, for instance, to demonstrate what is happening with different mechanisms for compressing data. Unfortunately, though, this is pretty much where that general reader gets off, until we get to chapter 9.

The main bulk of the book, pages 21 to 184, cross that line and plonk solidly into textbook territory - they may cover the topic rather more lightly than a traditional textbook, but they simply don't work to inform without requiring the kind of investment of mind and mathematics that a textbook does - and, with a few brief exceptions, the writing style feels no different from the better textbooks I have from university. At chapter 9, the subject is brought round to information in nature, and there we get enough application and context to make what we learn seem more approachable again, though not to the same level as the equivalent part of Bayes' Rule. It's also a shame that (unless I missed it) there is no mention of Omega, Greg Chaitin's remarkable non-computable number.

So where Bayes' Rule is suited to popular science readers who want to stretch themselves and put in some extra effort, Information Theory can only really be regarded as a readable introductory textbook - it doesn't work in a popular science context. (Why then am I reviewing it? The author kindly provided the title for review in the hope that it would work for popular science readers.) If you are about to take a university course encompassing information theory - or are contemplating doing so - I can, however, heartily recommend this title as an introduction. 



Paperback 
Using these links earns us commission at no cost to you

Buy direct from the author here.
Review by Brian Clegg

Comments

Popular posts from this blog

The God Game (SF) - Danny Tobey *****

Wow. I'm not sure I've ever read a book that was quite such an adrenaline rush - certainly it has been a long time since I've read a science fiction title which has kept me wanting to get back to it and read more so fiercely. 

In some ways, what we have here is a cyber-SF equivalent of Stephen King's It. A bunch of misfit American high school students face a remarkably powerful evil adversary - though in this case, at the beginning, their foe appears to be able to transform their worlds for the better.

Rather than a supernatural evil, the students take on a rogue AI computer game that thinks it is a god - and has the powers to back its belief. Playing the game is a mix of a virtual reality adventure like Pokemon Go and a real world treasure hunt. Players can get rewards for carrying out tasks - delivering a parcel, for example, which can be used to buy favours, abilities in the game and real objects. But once you are in the game, it doesn't want to let you go and is …

Uncertainty - Kostas Kampourakis and Kevin McCain ***

This is intended as a follow-on to Stuart Firestein's two books, the excellent Ignorance and its sequel, Failure, which cut through some of the myths about the nature of science and how it's not so much about facts as about what we don't know and how we search for explanations. The authors of Uncertainty do pretty much what they set out to do in explaining the significance of uncertainty and why it can make it difficult to present scientific findings to the public, who expect black-and-white facts, not grey probabilities, which can seem to some like dithering.

However, I didn't get on awfully well with the book. A minor issue was the size - it was just too physically small to hold comfortably, which was irritating. More significantly, it felt like a magazine article that was inflated to make a book. There really was only one essential point made over and over again, with a handful of repeated examples. I want something more from a book - more context and depth - that …

The Art of Statistics - David Spiegelhalter *****

Statistics have a huge impact on us - we are bombarded with them in the news, they are essential to medical trials, fundamental science, some court cases and far more. Yet statistics is also a subject than many struggle to deal with (especially when the coupled subject of probability rears its head). Most of us just aren't equipped to understand what we're being told, or to question it when the statistics are dodgy. What David Spiegelhalter does here is provide a very thorough introductory grounding in statistics without making use of mathematical formulae*. And it's remarkable.

What will probably surprise some who have some training in statistics, particularly if (like mine) it's on the old side, is that probability doesn't come into the book until page 205. Spiegelhalter argues that as probability is the hardest aspect for us to get an intuitive feel for, this makes a lot of sense - and I think he's right. That doesn't mean that he doesn't cover all …