Skip to main content

Information Theory: a tutorial introduction - James V. Stone ***

Information theory is central to the technology that we use every day - apart from anything else, in the technology that brings you this review (though ironically not in the book being reviewed as it doesn't appear to have an ebook version). As in his Bayes' Rule, James Stone sets out to walk a fine line between a title for the general reader and a textbook. And like that companion title the outcome is mixed, though here the textbook side largely wins.

The opening chapter 'What is information?' walks the line very well. It gradually builds up the basics that will be required to understand information theory and though it would work better if it had a little more context (for example, more about Claude Shannon as a person) to anchor it, the general reader will, with perhaps a few pages that needs re-reading, find it approachable and providing more depth than a popular science title usually would. I like the way that Stone uses variants of a photograph, for instance, to demonstrate what is happening with different mechanisms for compressing data. Unfortunately, though, this is pretty much where that general reader gets off, until we get to chapter 9.

The main bulk of the book, pages 21 to 184, cross that line and plonk solidly into textbook territory - they may cover the topic rather more lightly than a traditional textbook, but they simply don't work to inform without requiring the kind of investment of mind and mathematics that a textbook does - and, with a few brief exceptions, the writing style feels no different from the better textbooks I have from university. At chapter 9, the subject is brought round to information in nature, and there we get enough application and context to make what we learn seem more approachable again, though not to the same level as the equivalent part of Bayes' Rule. It's also a shame that (unless I missed it) there is no mention of Omega, Greg Chaitin's remarkable non-computable number.

So where Bayes' Rule is suited to popular science readers who want to stretch themselves and put in some extra effort, Information Theory can only really be regarded as a readable introductory textbook - it doesn't work in a popular science context. (Why then am I reviewing it? The author kindly provided the title for review in the hope that it would work for popular science readers.) If you are about to take a university course encompassing information theory - or are contemplating doing so - I can, however, heartily recommend this title as an introduction. 


Paperback:  

Buy direct from the author here.
Review by Brian Clegg

Comments

Popular posts from this blog

I, Mammal - Liam Drew *****

It's rare that a straightforward biology book (with a fair amount of palaeontology thrown in) really grabs my attention, but this one did. Liam Drew really piles in the surprising facts (often surprising to him too) and draws us a wonderful picture of the various aspects of mammals that make them different from other animals. 

More on this in a moment, but I ought to mention the introduction, as you have to get past it to get to the rest, and it might put you off. I'm not sure why many books have an introduction - they often just get in the way of the writing, and this one seemed to go on for ever. So bear with it before you get to the good stuff, starting with the strange puzzle of why some mammals have external testes.

It seems bizarre to have such an important thing for passing on the genes so precariously posed - and it's not that they have to be, as it's not the case with all mammals. Drew mixes his own attempts to think through this intriguing issue with the histor…

Foolproof - Brian Hayes *****

The last time I enjoyed a popular maths book as much as this one was reading Martin Gardner’s Mathematical Puzzles and Diversions as a teenager. The trouble with a lot of ‘fun’ maths books is that they cover material that mathematicians consider fascinating, such as pairs of primes that are only two apart, which fail to raise much excitement in normal human beings. 

Here, all the articles have something a little more to them. So, even though Brian Hayes may be dealing with something fairly abstruse-sounding like the ratio of the volume of an n-dimensional hypersphere to the smallest hypercube that contains it, the article always has an interesting edge - in this case that although the ‘volume’ of the hypersphere grows up to the fifth dimension it gets smaller and smaller thereafter, becoming an almost undetectable part of the hypercube.

If that doesn’t grab you, many articles in this collection aren’t as abstruse, covering everything from random walks to a strange betting game. What'…

A Galaxy of Her Own - Libby Jackson ****

This is an interesting book, even if it probably tries to be too many things to too many people. I wondered from the cover design whether it was a children's book, but the publisher's website (and the back of the book) resolutely refuse to categorise it as such. The back copy doesn't help by saying that it will 'inspire trailblazers and pioneers of all ages.' As I belong to the set 'all ages' I thought I'd give it a go.

Inside are featured the 'stories of fifty inspirational women who have been fundamental to the story of humans in space.' So, in some ways, A Galaxy of Her Own presents the other side of the coin to Angela Saini's excellent Inferior. But, inevitably, given the format, it can hardly provide the same level of discourse.

Despite that 'all ages' comment and the lack of children's book labelling we get a bit of a hint when we get to a bookplate page in the form of a Galaxy Pioneers security pass (with the rather worrying…