Skip to main content

Information Theory: a tutorial introduction - James V. Stone ***

Information theory is central to the technology that we use every day - apart from anything else, in the technology that brings you this review (though ironically not in the book being reviewed as it doesn't appear to have an ebook version). As in his Bayes' Rule, James Stone sets out to walk a fine line between a title for the general reader and a textbook. And like that companion title the outcome is mixed, though here the textbook side largely wins.

The opening chapter 'What is information?' walks the line very well. It gradually builds up the basics that will be required to understand information theory and though it would work better if it had a little more context (for example, more about Claude Shannon as a person) to anchor it, the general reader will, with perhaps a few pages that needs re-reading, find it approachable and providing more depth than a popular science title usually would. I like the way that Stone uses variants of a photograph, for instance, to demonstrate what is happening with different mechanisms for compressing data. Unfortunately, though, this is pretty much where that general reader gets off, until we get to chapter 9.

The main bulk of the book, pages 21 to 184, cross that line and plonk solidly into textbook territory - they may cover the topic rather more lightly than a traditional textbook, but they simply don't work to inform without requiring the kind of investment of mind and mathematics that a textbook does - and, with a few brief exceptions, the writing style feels no different from the better textbooks I have from university. At chapter 9, the subject is brought round to information in nature, and there we get enough application and context to make what we learn seem more approachable again, though not to the same level as the equivalent part of Bayes' Rule. It's also a shame that (unless I missed it) there is no mention of Omega, Greg Chaitin's remarkable non-computable number.

So where Bayes' Rule is suited to popular science readers who want to stretch themselves and put in some extra effort, Information Theory can only really be regarded as a readable introductory textbook - it doesn't work in a popular science context. (Why then am I reviewing it? The author kindly provided the title for review in the hope that it would work for popular science readers.) If you are about to take a university course encompassing information theory - or are contemplating doing so - I can, however, heartily recommend this title as an introduction. 



Paperback 


Buy direct from the author here.
Review by Brian Clegg

Comments

Popular posts from this blog

The Art of Logic - Eugenia Cheng ***

This is an important book, though I'm not sure Eugenia Cheng would agree with my logic in saying so. 

Going on the marketing, what we have here is a counter to fake news and dodgy argumentation in the form of mathematical logic. The back cover tells us 'Newspaper headlines and social media use emotions to warp the facts. Politicians and companies master rhetoric to mislead us. What one book could help us make sense of it all?' Admittedly they don't answer their rhetorical question, but I assume the answer is intended to be The Art of Logic. (Did the company behind this book realise it was using rhetoric, though presumably not to mislead us?) 

What we actually have is a combination of a lucid and interesting explanation of the basics of logic with the mathematical equivalent of those books such as Algorithms to Live By that were so popular a couple of years ago. They used the logic of algorithms (differently worded, and, to me, easier to understand), the heart of computer…

Quantum Economics - David Orrell ****

David Orrell's earlier title Economyths is one of my favourite popular science books of all time. Or, perhaps, I should say popular non-science, as Orrell shows just how devastatingly traditional economics uses the tools of science without having a scientific basis. I was, therefore, really looking forward to reading Orrell's new book - until I saw the title. As anyone involved with physics can tell you, there's nothing more irritating than the business of sticking the word 'quantum' onto something to give a pseudo-scientific boost to waffle and woo. Was Orrell doing the same thing? Thankfully, his introduction put my fears aside.

Orrell, a mathematician with a physics background quickly makes it clear that the way he is using quantum theory is not just employing magic words, but involves making use of strong parallels between the nature of quantum objects and concepts like money (more on money in a moment). Yes, this is to some extent a metaphorical use of quantum …

The Ashtray - Errol Morris *****

Wow. When someone suggested I read a book called The Ashtray, written by a documentary film-maker, it didn't strike me that it would be a book that gave deep insights into the history and philosophy of science - while also being a remarkable reading experience. In fact, I almost didn't bother with it, but I'm glad that I did.

The titular ashtray was thrown at the author when he was a grad student - thrown by one of the two best known names in the philosophy of science, Thomas Kuhn, he of The Structure of Scientific Revolutions and the concept of paradigm shifts. Kuhn didn't like the young Errol Morris daring to challenge his ideas and reacted with what some would regard as a less than philosophical reply by hurling a heavy glass ashtray at him.

Part of the reason that reading The Ashtray is a remarkable experience is because it's a book that feels in some ways like watching a documentary. I have to confess I've never seen any of Morris's work, but he uses vis…