Skip to main content

Big Data - Brian Clegg ****

I first became involved with what we now term big data when providing some mathematical assistance to a major supermarket.  They wanted to know what products would suffer, or benefit, if another product were put on special offer – the victims and victors as they called them.  As an example, if fresh meat pies are put on buy one get one free, should the supermarket plan on stocking more fresh vegetables? That sort of thing.  The supermarket in question had a lot of data concerning historical sales, and what had previously been put on special offer, so it was just a case of designing a set of algorithms to analyse this data to provide the necessary forecast, and also to have the system learn through what we would now call reinforcement learning over time.  This was back in the mid 90s. One can imagine how things - in all camps - should have vastly improved since then.  That’s just one example of where Big Data transparently impacts our lives.

In Big Data, Clegg sets out an assortment of examples from the success of Netflix and the prediction of crime locations to algorithms that have lost people their jobs or caused stock market crashes, examining the mechanisms and implications of each.  Taking the supermarket example - although this is my example and not his - we might ask ourselves who really benefits here – who exactly are the victims and victors (or villains perhaps) in real life?

Big Data is here to stay - should we be afraid of it or embrace it?  As always, Clegg writes with an easy clarity that draws us in - no technical expertise required to understand his exploration of this essential subject - and throughout Big Data’s highly enjoyable pages, the spread and range of material is highly impressive – dizzying in fact.  I personally found entirely new perspectives on the subject that will keep me pondering for quite some time.  

I should add that, if I were still a statistics lecturer at Oxford, I would recommend the book to my students as bedside reading.

Paperback:  

Kindle:  
Using these links earns us commission at no cost to you
Review by Peet Morris
Please note, this title is written by the editor of the Popular Science website. Our review is still an honest opinion – and we could hardly omit the book – but do want to make the connection clear.

Comments

Popular posts from this blog

Why Nobody Understands Quantum Physics - Frank Verstraete and Céline Broeckaert **

It's with a heavy heart that I have to say that I could not get on with this book. The structure is all over the place, while the content veers from childish remarks to unexplained jargon. Frank Versraete is a highly regarded physicist and knows what he’s talking about - but unfortunately, physics professors are not always the best people to explain physics to a general audience and, possibly contributed to by this being a translation, I thought this book simply doesn’t work. A small issue is that there are few historical inaccuracies, but that’s often the case when scientists write history of science, and that’s not the main part of the book so I would have overlooked it. As an example, we are told that Newton's apple story originated with Voltaire. Yet Newton himself mentioned the apple story to William Stukeley in 1726. He may have made it up - but he certainly originated it, not Voltaire. We are also told that ‘Galileo discovered the counterintuitive law behind a swinging o...

How to Keep a Plane in the Sky - Alex Davies ****

If there's one big gap in the science writing sphere, it's popular engineering (you can quibble over whether engineering is science, but where else would you put popular engineering?). Alex Davies does the field a real service with this insightful introduction to the world of test engineering. The concept is simple. If we build something and sell it, we need to test it to make sure that it won't fail in a way that's dangerous to the consumer. The most obvious example is airliners, which feature at some length, but this applies to everything from cuddly toys to hair straighteners: someone needs to predict what could go wrong and to put the product through its paces to see if it will survive under any reasonable circumstances. When Davies is telling a story of test engineering in action, the book is a delight. He opens with the way that real bears are used to test if bears can get into coolers and trash cans - and the impressive ways these animals can  circumvent human in...

On the Equality of All Things - Carlo Rovelli ****

There is a wide gulf between the worldviews of physicists and philosophers. Many physicists present a rather sweetly naive, child-like view of the world, where philosophers bring a distinctly more adult, cynical tone. This being the case, it can be a little worrying when a physicist dips a toe into the philosophical mire. Infamously, in The Grand Design , Stephen Hawking and co-author Leonard Mlodinow told us that philosophy was now dead because science could deal with anything it had previously been needed for. Thankfully, Carlo Rovelli is not trying to do away with philosophy, though it has to be said that when he veers into the topic that physicist's naivety can make it feel like the philosophising of an earnest eighteen-year-old. Take the opening paragraph, which tells us 'electrons and minds, stones and laws, judgements and galaxies do not essentially differ in nature from one another. They are notions that illuminate each other'. I almost expected a Pink Floyd soundtr...