Skip to main content

Information Theory: a tutorial introduction - James V. Stone ***

Information theory is central to the technology that we use every day - apart from anything else, in the technology that brings you this review (though ironically not in the book being reviewed as it doesn't appear to have an ebook version). As in his Bayes' Rule, James Stone sets out to walk a fine line between a title for the general reader and a textbook. And like that companion title the outcome is mixed, though here the textbook side largely wins.

The opening chapter 'What is information?' walks the line very well. It gradually builds up the basics that will be required to understand information theory and though it would work better if it had a little more context (for example, more about Claude Shannon as a person) to anchor it, the general reader will, with perhaps a few pages that needs re-reading, find it approachable and providing more depth than a popular science title usually would. I like the way that Stone uses variants of a photograph, for instance, to demonstrate what is happening with different mechanisms for compressing data. Unfortunately, though, this is pretty much where that general reader gets off, until we get to chapter 9.

The main bulk of the book, pages 21 to 184, cross that line and plonk solidly into textbook territory - they may cover the topic rather more lightly than a traditional textbook, but they simply don't work to inform without requiring the kind of investment of mind and mathematics that a textbook does - and, with a few brief exceptions, the writing style feels no different from the better textbooks I have from university. At chapter 9, the subject is brought round to information in nature, and there we get enough application and context to make what we learn seem more approachable again, though not to the same level as the equivalent part of Bayes' Rule. It's also a shame that (unless I missed it) there is no mention of Omega, Greg Chaitin's remarkable non-computable number.

So where Bayes' Rule is suited to popular science readers who want to stretch themselves and put in some extra effort, Information Theory can only really be regarded as a readable introductory textbook - it doesn't work in a popular science context. (Why then am I reviewing it? The author kindly provided the title for review in the hope that it would work for popular science readers.) If you are about to take a university course encompassing information theory - or are contemplating doing so - I can, however, heartily recommend this title as an introduction. 



Paperback 
Using these links earns us commission at no cost to you

Buy direct from the author here.
Review by Brian Clegg

Comments

Popular posts from this blog

A (Very) Short History of Life on Earth - Henry Gee *****

In writing this book, Henry Gee had a lot to live up to. His earlier title  The Accidental Species was a superbly readable and fascinating description of the evolutionary process leading to Homo sapiens . It seemed hard to beat - but he has succeeded with what is inevitably going to be described as a tour-de-force. As is promised on the cover, we are taken through nearly 4.6 billion years of life on Earth (actually rather more, as I'll cover below). It's a mark of Gee's skill that what could have ended up feeling like an interminable list of different organisms comes across instead as something of a pager turner. This is helped by the structuring - within those promised twelve chapters everything is divided up into handy bite-sized chunks. And although there certainly are very many species mentioned as we pass through the years, rather than feeling overwhelming, Gee's friendly prose and careful timing made the approach come across as natural and organic.  There was a w

Michael D. Gordin - Four Way Interview

Michael D. Gordin is a historian of modern science and a professor at Princeton University, with particular interests in the physical sciences and in science in Russia and the Soviet Union. He is the author of six books, ranging from the periodic table to early nuclear weapons to the history of scientific languages. His most recent book is On the Fringe: Where Science Meets Pseudoscience (Oxford University Press). Why history of science? The history of science grabbed me long before I knew that there were actual historians of science out there. I entered college committed to becoming a physicist, drawn in by the deep intellectual puzzles of entropy, quantum theory, and relativity. When I started taking courses, I came to understand that what really interested me about those puzzles were not so much their solutions — still replete with paradoxes — but rather the rich debates and even the dead-ends that scientists had taken to trying to resolve them. At first, I thought this fell under

Regeneration - Paul Hawken **

This is a really big book. I don't mean big in the sense of important, but physically enormous for what it is - it's roughly the size of a children's annual, though a lot thicker. Interestingly, the format appears to be a Paul Hawken speciality - he did it with his previous title, Drawdown ,  though that was far less glossy. Paul Hawken's aim is to put forward a solution to climate change driven from humans rather than from the science. The tag line on the back of the book reads 'The climate crisis is not at science problem. It is a human problem.' And that itself is a problem. It's not that climate change isn't a human problem, but rather that it's both a human problem and a science problem - requiring human and science-based solutions. But the approach taken in this book is anything but scientific. It's a bit like saying the Covid-19 pandemic is a human problem, not a science problem. The pandemic is indeed a human problem, but if we'd tr