Skip to main content

Information Theory: a tutorial introduction - James V. Stone ***

Information theory is central to the technology that we use every day - apart from anything else, in the technology that brings you this review (though ironically not in the book being reviewed as it doesn't appear to have an ebook version). As in his Bayes' Rule, James Stone sets out to walk a fine line between a title for the general reader and a textbook. And like that companion title the outcome is mixed, though here the textbook side largely wins.

The opening chapter 'What is information?' walks the line very well. It gradually builds up the basics that will be required to understand information theory and though it would work better if it had a little more context (for example, more about Claude Shannon as a person) to anchor it, the general reader will, with perhaps a few pages that needs re-reading, find it approachable and providing more depth than a popular science title usually would. I like the way that Stone uses variants of a photograph, for instance, to demonstrate what is happening with different mechanisms for compressing data. Unfortunately, though, this is pretty much where that general reader gets off, until we get to chapter 9.

The main bulk of the book, pages 21 to 184, cross that line and plonk solidly into textbook territory - they may cover the topic rather more lightly than a traditional textbook, but they simply don't work to inform without requiring the kind of investment of mind and mathematics that a textbook does - and, with a few brief exceptions, the writing style feels no different from the better textbooks I have from university. At chapter 9, the subject is brought round to information in nature, and there we get enough application and context to make what we learn seem more approachable again, though not to the same level as the equivalent part of Bayes' Rule. It's also a shame that (unless I missed it) there is no mention of Omega, Greg Chaitin's remarkable non-computable number.

So where Bayes' Rule is suited to popular science readers who want to stretch themselves and put in some extra effort, Information Theory can only really be regarded as a readable introductory textbook - it doesn't work in a popular science context. (Why then am I reviewing it? The author kindly provided the title for review in the hope that it would work for popular science readers.) If you are about to take a university course encompassing information theory - or are contemplating doing so - I can, however, heartily recommend this title as an introduction. 



Paperback 


Buy direct from the author here.
Review by Brian Clegg

Comments

Popular posts from this blog

The Art of Statistics - David Spiegelhalter *****

Statistics have a huge impact on us - we are bombarded with them in the news, they are essential to medical trials, fundamental science, some court cases and far more. Yet statistics is also a subject than many struggle to deal with (especially when the coupled subject of probability rears its head). Most of us just aren't equipped to understand what we're being told, or to question it when the statistics are dodgy. What David Spiegelhalter does here is provide a very thorough introductory grounding in statistics without making use of mathematical formulae*. And it's remarkable.

What will probably surprise some who have some training in statistics, particularly if (like mine) it's on the old side, is that probability doesn't come into the book until page 205. Spiegelhalter argues that as probability is the hardest aspect for us to get an intuitive feel for, this makes a lot of sense - and I think he's right. That doesn't mean that he doesn't cover all …

The Case Against Reality - Donald Hoffman ***

It's not exactly news that our perception of the world around us can be a misleading confection of the brain, rather than a precise picture of reality - everything from optical illusions to the apparent motion of video confirms this - but professor of cognitive science Donald Hoffman goes far beyond this. He wants us to believe that spacetime and the objects in it are not real: that they only exist when we perceive them. It's not that he believes everything to be totally illusory, but suggests that the whole framework of the physical world is a construction of our minds.

To ease us into this viewpoint, Hoffman gives the example of the Necker cube - the clever two-dimensional drawing apparently of a cube which can be seen in two totally different orientations. Calling these orientations 'Cube A and Cube B' he remarks that our changing perceptions suggest that 'neither Cube A nor Cube B is there when no one looks, and there is no objective cube that exists unobserve…

The Body - Bill Bryson ****

I am a huge fan of Bill Bryson's travel books - he is a superb storyteller, and in the best parts of his science writing, this ability to provide fascinating facts and intriguing tales shines through.

After taking on the whole of science in his first book, here he focuses in on the physiology, anatomy and diseases of the human body. Bryson does so with his usual light, approachable style, peppering the plethora of facts (and 'don't know's - it's amazing how much we still don't know about the workings of the body) with the little nuggets you can't help but share and stories of some of the odd and, frankly, horrifying goings on in the history of medicine.

So, for example, Bryson throws in 'The chin is unique to humans and no one knows why we have one.' He speculates that it might be just that we 'find a good chin dashing' and quotes a Harvard professor as saying 'Testing this last hypothesis is especially difficult, but the reader is encoura…