Skip to main content

Information Theory: a tutorial introduction - James V. Stone ***

Information theory is central to the technology that we use every day - apart from anything else, in the technology that brings you this review (though ironically not in the book being reviewed as it doesn't appear to have an ebook version). As in his Bayes' Rule, James Stone sets out to walk a fine line between a title for the general reader and a textbook. And like that companion title the outcome is mixed, though here the textbook side largely wins.

The opening chapter 'What is information?' walks the line very well. It gradually builds up the basics that will be required to understand information theory and though it would work better if it had a little more context (for example, more about Claude Shannon as a person) to anchor it, the general reader will, with perhaps a few pages that needs re-reading, find it approachable and providing more depth than a popular science title usually would. I like the way that Stone uses variants of a photograph, for instance, to demonstrate what is happening with different mechanisms for compressing data. Unfortunately, though, this is pretty much where that general reader gets off, until we get to chapter 9.

The main bulk of the book, pages 21 to 184, cross that line and plonk solidly into textbook territory - they may cover the topic rather more lightly than a traditional textbook, but they simply don't work to inform without requiring the kind of investment of mind and mathematics that a textbook does - and, with a few brief exceptions, the writing style feels no different from the better textbooks I have from university. At chapter 9, the subject is brought round to information in nature, and there we get enough application and context to make what we learn seem more approachable again, though not to the same level as the equivalent part of Bayes' Rule. It's also a shame that (unless I missed it) there is no mention of Omega, Greg Chaitin's remarkable non-computable number.

So where Bayes' Rule is suited to popular science readers who want to stretch themselves and put in some extra effort, Information Theory can only really be regarded as a readable introductory textbook - it doesn't work in a popular science context. (Why then am I reviewing it? The author kindly provided the title for review in the hope that it would work for popular science readers.) If you are about to take a university course encompassing information theory - or are contemplating doing so - I can, however, heartily recommend this title as an introduction. 



Paperback 


Buy direct from the author here.
Review by Brian Clegg

Comments

Popular posts from this blog

Where are the chemistry popular science books?

by Brian Clegg
There has never been more emphasis on the importance of public engagement. We need both to encourage a deeper interest in science and to counter anti-scientific views that seem to go hand-in-hand with some types of politics. Getting the public interested in science both helps recruit new scientists of the future and spreads an understanding of why an area of scientific research deserves funding. Yet it is possible that chemistry lags behind the other sciences in outreach. As a science writer, and editor of this website, I believe that chemistry is under-represented in popular science. I'd like to establish if this is the case, if so why it is happening - and what can be done to change things. 


An easy straw poll is provided by the topic tags on the site. At the time of writing, there are 22 books under 'chemistry' as opposed to 97 maths, 126 biology and 182 physics. The distribution is inevitably influenced by editorial bias - but as the editor, I can confirm …

Artificial Intelligence - Yorick Wilks ****

Artificial intelligence is one of those topics where it's very easy to spin off into speculation, whether it's about machine conciousness or AI taking over the world (and don't get me onto the relatively rare connection to robots - cover designer please note). All the experience of AI to date has been that it has been made feasible far slower than originally predicted, and that it faces dramatic limitations. So, for example, self-driving cars may be okay in limited circumstances, but are nowhere near ready for the commute home. Similarly, despite all the moves forward in AI technology, computers are so-so at recognising objects after learning from thousands of examples - sometimes fooled by apparently trivial surface patterning - where humans can recognise items from a handful of examples.

Even so, we can't deny that AI is having an influence on our lives and Yorick Wilks, emeritus professor of AI at the University of Sheffield, is ideally placed to give us a picture …

Apollo 11 - David Whitehouse *****

The problem with doing a book about the Apollo programme is that it's hard to find something that hasn't been said before - but with the 50th anniversary of the first moon landing just weeks away, the publication of this elegant book is extremely timely, and science-reporting veteran David Whitehouse manages to make the story feel fresh, even if you're one of the just 20 per cent of the world population who were alive on the remarkable day in 1969.

Although he has worked a lot with New Scientist, Whitehouse was for many years a TV journalist, and that comes through in his impressively engaging prose as he takes us back to the origins of the US/USSR space race that would lead to the moon landing. He passes through the wartime aspects relatively quickly, but once the two superpowers are flexing their space technology muscles, Whitehouse achieves a near perfect balance between the far less-heard USSR side of the story and the US. This is probably the best bit of the whole bo…