Information Theory: a tutorial introduction

Information Theory: a tutorial introduction - James V. Stone ***

Information theory is central to the technology that we use every day - apart from anything else, in the technology that brings you this review (though ironically not in the book being reviewed as it doesn't appear to have an ebook version). As in his Bayes' Rule, James Stone sets out to walk a fine line between a title for the general reader and a textbook. And like that companion title the outcome is mixed, though here the textbook side largely wins.

The opening chapter 'What is information?' walks the line very well. It gradually builds up the basics that will be required to understand information theory and though it would work better if it had a little more context (for example, more about Claude Shannon as a person) to anchor it, the general reader will, with perhaps a few pages that needs re-reading, find it approachable and providing more depth than a popular science title usually would. I like the way that Stone uses variants of a photograph, for instance, to demonstrate what is happening with different mechanisms for compressing data. Unfortunately, though, this is pretty much where that general reader gets off, until we get to chapter 9.

The main bulk of the book, pages 21 to 184, cross that line and plonk solidly into textbook territory - they may cover the topic rather more lightly than a traditional textbook, but they simply don't work to inform without requiring the kind of investment of mind and mathematics that a textbook does - and, with a few brief exceptions, the writing style feels no different from the better textbooks I have from university. At chapter 9, the subject is brought round to information in nature, and there we get enough application and context to make what we learn seem more approachable again, though not to the same level as the equivalent part of Bayes' Rule. It's also a shame that (unless I missed it) there is no mention of Omega, Greg Chaitin's remarkable non-computable number.

So where Bayes' Rule is suited to popular science readers who want to stretch themselves and put in some extra effort, Information Theory can only really be regarded as a readable introductory textbook - it doesn't work in a popular science context. (Why then am I reviewing it? The author kindly provided the title for review in the hope that it would work for popular science readers.) If you are about to take a university course encompassing information theory - or are contemplating doing so - I can, however, heartily recommend this title as an introduction.

Paperback:

Using these links earns us commission at no cost to you

Buy direct from the author here.

Review by Brian Clegg

Comments

The Infinite Book – John D. Barrow ****

Authors are often asked to review books on a topic they’ve written on themselves. The reasoning is sensible – they ought to know something about the subject – but there’s always that uneasy suspicion that there’s going to be a bit of bias creeping in. So I think it’s only fair to admit up front that I have written a book on infinity (of which more later). Infinity is a wonderful subject, because it’s intimately mind-bending (if the combination sounds paradoxical, that’s what infinity is all about) and gives you the chance to pull in all sorts of different concepts and assocations along the way, something Barrow does with great gusto. There’s a surprisingly large amount of coverage here for God, and for the universe, and the book jumps around from Aristotle to Hilbert’s Infinite Hotel (explained at great length), from the paradoxes of infinite sets to the paradoxes of time travel. Overall it’s an enjoyable journey that gives plenty of opportunity to be amazed and surprised. The...

Adventures of a Computational Explorer - Stephen Wolfram ***

Stephen Wolfram, the man behind the scientist's mathematical tool of choice, Mathematica, plus a whole host of other software products, including the uncanny Wolfram Alpha knowledge engine, is undoubtedly a genius of the first order. In this book, we get an uncensored excursion into the mind of genius - which is, without doubt, a fascinating prospect. The book consists of a collection of essays and speeches that Wolfram has produced over the last ten to fifteen years, covering an eclectic range of topics. Like all such collections, the result is something that lacks the coherence of a book with a narrative that runs through it, inevitably introducing a degree of repetition and a mix of interesting and not-so-interesting topics - but there's likely to be something to catch the attention anyone who is into computing or mathematics. One of the most interesting pieces is the opening one, where Wolfram describes being a consultant on the SF movie Arrival. He seems to hav...

The Random Universe - Andrew Jaffe *****

This is an absolutely fascinating book for anyone interested in the way that science really works, bearing in mind the difficulties of having to base our models and theories on induction. Andrew Jaffe introduces the difficulties we face when trying to take a scientific view because largely we are dependent on induction: predicting the future from what has previously been observed. He explores what probability is, the two key ways of looking at it (frequentist and Bayesian) and how scientists use (or misuse it) to work out the implications of their experiments for hypotheses. This is then expanded into looking at the nature of scientific models and the philosophy of science before heading out to entropy, quantum randomness and attempting to achieve meaningful cosmology with its potential dearth of evidence. The topic might sound a little dry, but in fact Jaffe does it with good humour and a very readable style. For example, he uses measuring his daughter's height by making marks on...

Search This Blog