Big Data - Brian Clegg ****

I first became involved with what we now term big data when providing some mathematical assistance to a major supermarket. They wanted to know what products would suffer, or benefit, if another product were put on special offer – the victims and victors as they called them. As an example, if fresh meat pies are put on buy one get one free, should the supermarket plan on stocking more fresh vegetables? That sort of thing. The supermarket in question had a lot of data concerning historical sales, and what had previously been put on special offer, so it was just a case of designing a set of algorithms to analyse this data to provide the necessary forecast, and also to have the system learn through what we would now call reinforcement learning over time. This was back in the mid 90s. One can imagine how things - in all camps - should have vastly improved since then. That’s just one example of where Big Data transparently impacts our lives.

In Big Data, Clegg sets out an assortment of examples from the success of Netflix and the prediction of crime locations to algorithms that have lost people their jobs or caused stock market crashes, examining the mechanisms and implications of each. Taking the supermarket example - although this is my example and not his - we might ask ourselves who really benefits here – who exactly are the victims and victors (or villains perhaps) in real life?

Big Data is here to stay - should we be afraid of it or embrace it? As always, Clegg writes with an easy clarity that draws us in - no technical expertise required to understand his exploration of this essential subject - and throughout Big Data’s highly enjoyable pages, the spread and range of material is highly impressive – dizzying in fact. I personally found entirely new perspectives on the subject that will keep me pondering for quite some time.

I should add that, if I were still a statistics lecturer at Oxford, I would recommend the book to my students as bedside reading.

Paperback:

Kindle:

Using these links earns us commission at no cost to you

Review by Peet Morris
Please note, this title is written by the editor of the Popular Science website. Our review is still an honest opinion – and we could hardly omit the book – but do want to make the connection clear.

Comments

Rakhat-Bi Abdyssagin Five Way Interview

Rakhat-Bi Abdyssagin (born in 1999) is a distinguished composer, concert pianist, music theorist and researcher. Three of his piano CDs have been released in Germany. He started his undergraduate degree at the age of 13 in Kazakhstan, and having completed three musical doctorates in prominent Italian music institutions at the age of 20, he has mastered advanced composition techniques. In 2024 he completed a PhD in music at the University of St Andrews / Royal Conservatoire of Scotland (researching timbre-texture co-ordinate in avant- garde music), and was awarded The Silver Medal of The Worshipful Company of Musicians, London. He has held visiting affiliations at the Universities of Oxford, Cambridge and UCL, and has been lecturing and giving talks internationally since the age of 13. His latest book is Quantum Mechanics and Avant Garde Music . What links quantum physics and avant-garde music? The entire book is devoted to this question. To put it briefly, there are many different link...

The Bright Side - Sumit Paul-Choudhury ***

When I first saw The Bright Side (the subtitle doesn't help), I was worried it was a self-help manual, a format that rarely contains good science. In reality, Sumit Paul-Choudhury does not give us a checklist for becoming an optimist or anything similar - and there is a fair amount of science content. But to be honest, I didn't get on very well with this book. What Paul-Choudhury sets out to do is to both identify what optimism is and to assess its place in a world where we are beset with big problems such as climate change (which he goes into in some detail) that some activists position as an existential threat. This is all done in a friendly, approachable fashion. In that sense it's a classic pop-psychology title. For me, Paul-Choudhury certainly has it right about the lack of logic of extreme doom-mongers, such as Extinction Rebellion and teenage climate protestors, and his assessment of the nature of optimism seems very reasonable, if presented at a fairly overview leve...

Everything is Predictable - Tom Chivers *****

There's a stereotype of computer users: Mac users are creative and cool, while PC users are businesslike and unimaginative. Less well-known is that the world of statistics has an equivalent division. Bayesians are the Mac users of the stats world, where frequentists are the PC people. This book sets out to show why Bayesians are not just cool, but also mostly right. Tom Chivers does an excellent job of giving us some historical background, then dives into two key aspects of the use of statistics. These are in science, where the standard approach is frequentist and Bayes only creeps into a few specific applications, such as the accuracy of medical tests, and in decision theory where Bayes is dominant. If this all sounds very dry and unexciting, it's quite the reverse. I admit, I love probability and statistics, and I am something of a closet Bayesian*), but Chivers' light and entertaining style means that what could have been the mathematical equivalent of debating angels on...

Search This Blog