Skip to main content

Information Theory: a tutorial introduction - James V. Stone ***

Information theory is central to the technology that we use every day - apart from anything else, in the technology that brings you this review (though ironically not in the book being reviewed as it doesn't appear to have an ebook version). As in his Bayes' Rule, James Stone sets out to walk a fine line between a title for the general reader and a textbook. And like that companion title the outcome is mixed, though here the textbook side largely wins.

The opening chapter 'What is information?' walks the line very well. It gradually builds up the basics that will be required to understand information theory and though it would work better if it had a little more context (for example, more about Claude Shannon as a person) to anchor it, the general reader will, with perhaps a few pages that needs re-reading, find it approachable and providing more depth than a popular science title usually would. I like the way that Stone uses variants of a photograph, for instance, to demonstrate what is happening with different mechanisms for compressing data. Unfortunately, though, this is pretty much where that general reader gets off, until we get to chapter 9.

The main bulk of the book, pages 21 to 184, cross that line and plonk solidly into textbook territory - they may cover the topic rather more lightly than a traditional textbook, but they simply don't work to inform without requiring the kind of investment of mind and mathematics that a textbook does - and, with a few brief exceptions, the writing style feels no different from the better textbooks I have from university. At chapter 9, the subject is brought round to information in nature, and there we get enough application and context to make what we learn seem more approachable again, though not to the same level as the equivalent part of Bayes' Rule. It's also a shame that (unless I missed it) there is no mention of Omega, Greg Chaitin's remarkable non-computable number.

So where Bayes' Rule is suited to popular science readers who want to stretch themselves and put in some extra effort, Information Theory can only really be regarded as a readable introductory textbook - it doesn't work in a popular science context. (Why then am I reviewing it? The author kindly provided the title for review in the hope that it would work for popular science readers.) If you are about to take a university course encompassing information theory - or are contemplating doing so - I can, however, heartily recommend this title as an introduction. 


Buy direct from the author here.
Review by Brian Clegg


Popular posts from this blog

The Feed (SF) - Nick Clark Windo ****

Ever since The War of the Worlds, the post-apocalyptic disaster novel has been a firm fixture in the Science Fiction universe. What's more, such books are often among the few SF titles that are shown any interest by the literati, probably because many future disaster novels feature very little science. With a few exceptions, though (I'm thinking, for instance, The Chrysalids) they can make for pretty miserable reading unless you enjoy a diet of page after page of literary agonising.

The Feed is a real mixture. Large chunks of it are exactly that - page after page of self-examining misery with an occasional bit of action thrown in. But, there are parts where the writing really comes alive and shows its quality. This happens when we get the references back to pre-disaster, when we discover the Feed, which takes The Circle's premise to a whole new level with a mega-connected society where all human interaction is through directly-wired connections… until the whole thing fails …

Everything You Know About Space Is Wrong - Matt Brown ****

What we have here is a feast of assertions some people make about space that are satisfyingly incorrect, with pithy, entertaining explanations of what the true picture is. Matt Brown admits in his introduction that a lot of these incorrect facts are nitpicking - more on that in a moment - but it doesn't stop them being delightful. I particularly enjoyed the ones about animals in space and about the Moon.

Along the way, we take in space exploration, the Earth's place in space, the Moon, the solar system, the universe and a collection of random oddities, such as the fact that Mozart didn't write Twinkle, Twinkle Little Star. Sometimes the wrongness comes from a frequent misunderstanding. So, for example, Brown corrects the idea that Copernicus was the first to say that the Earth moves around the Sun. Sometimes there's some very careful wording. This is used when Brown challenges the idea that the Russian dog Laika was the first animal in space. What we discover is that, i…

Dark Matter and the Dinosaurs - Lisa Randall ****

I did my PhD in galactic dynamics - which is an awkward subject when people want to know what its relevance to the 'real world' is. So I was excited when Clube and Napier's book The Cosmic Serpent came out, around the same time, because it provided me with a ready-made answer. It argued that the comets which occasionally crash into Earth with disastrous results - such as the extinction of the dinosaurs - are perturbed from their normal orbits by interactions with the large-scale structure of the galaxy.

I was reminded of this idea a few years ago when there was a flurry of media interest in Lisa Randall's "dark matter and the dinosaurs" conjecture. I was sufficiently enthusiastic about it to write an article on the subject for Fortean Times - though my enthusiasm didn't quite extend to purchasing her hardback book at the time. However, now that it's out in paperback I've remedied the situation - and I'm glad I did.

Dark matter is believed to exi…