Big Data - Brian Clegg ****

I first became involved with what we now term big data when providing some mathematical assistance to a major supermarket. They wanted to know what products would suffer, or benefit, if another product were put on special offer – the victims and victors as they called them. As an example, if fresh meat pies are put on buy one get one free, should the supermarket plan on stocking more fresh vegetables? That sort of thing. The supermarket in question had a lot of data concerning historical sales, and what had previously been put on special offer, so it was just a case of designing a set of algorithms to analyse this data to provide the necessary forecast, and also to have the system learn through what we would now call reinforcement learning over time. This was back in the mid 90s. One can imagine how things - in all camps - should have vastly improved since then. That’s just one example of where Big Data transparently impacts our lives.

In Big Data, Clegg sets out an assortment of examples from the success of Netflix and the prediction of crime locations to algorithms that have lost people their jobs or caused stock market crashes, examining the mechanisms and implications of each. Taking the supermarket example - although this is my example and not his - we might ask ourselves who really benefits here – who exactly are the victims and victors (or villains perhaps) in real life?

Big Data is here to stay - should we be afraid of it or embrace it? As always, Clegg writes with an easy clarity that draws us in - no technical expertise required to understand his exploration of this essential subject - and throughout Big Data’s highly enjoyable pages, the spread and range of material is highly impressive – dizzying in fact. I personally found entirely new perspectives on the subject that will keep me pondering for quite some time.

I should add that, if I were still a statistics lecturer at Oxford, I would recommend the book to my students as bedside reading.

Paperback:

Kindle:

Using these links earns us commission at no cost to you

Review by Peet Morris
Please note, this title is written by the editor of the Popular Science website. Our review is still an honest opinion – and we could hardly omit the book – but do want to make the connection clear.

Comments

The Infinity Machine - Sebastian Mallaby ****

It's very quickly clear that Sebastian Mallaby is a huge Demis Hassabis fan - writing about the only child prodigy and teen genius ever who was also a nice, rounded personality. After a few chapters, though, things settle down (I'm reminded of Douglas Adams' description of the Hitchhiker's Guide to the Galaxy ) and we get a good, solid trip through the journey that gave us DeepMind, their AlphaGo and AlphaFold programs, the sudden explosion of competition on the AI front and thoughts on artificial general intelligence. Although Mallaby does occasionally still go into fan mode - reading this you would think that AlphaFold had successfully perfectly predicted the structure of every protein, where it is usually not sufficiently accurate for its results to have direct practical application - we get a real feel for the way this relatively unusual company was swiftly and successfully developed away from Silicon Valley. It's readable and gives an important understanding of...

In Seach of Sea Dragons - Matthew Myerscough ****

It's common advice to would-be authors of narrative non-fiction to open with something dramatic - Matthew Myerscough certainly does this with the story of his being trapped under an avalanche on Snowdon (while his girlfriend, also carried away remains on top of the snow unhurt). It certainly is dramatic, but seemed entirely disconnected from the reason I got the book, which was to read about fossil collecting. Luckily, though, in the second chapter we get into a more conventional 'how I got interested in fossils as a boy'. Having recently reviewed Patrick Moore's autobiography and noting that astronomy was one of the few sciences where amateurs can still make a contribution, it came to mind that palaeontology is another - Myerscough is a civil engineer by trade, but just as amateur astronomers can find new details in the skies, so amateur fossil hunters have been searching for these relics for centuries. When I give talks in junior schools, the two topics that guarant...

Robot-Proof - Vivienne Ming ****

As Vivienne Ming makes apparent, there seem largely to be two views of AI's pros and cons, both of which are almost certainly wrong. It's either doom-saying 'It'll destroy life as we know it' or Pollyanna-ish 'It'll do all the boring work and we can all be wonderfully creative and live lives of leisure.' Instead, Ming gives us a clear analysis of the likely trajectory for the workplace, particularly for the IT industry. She describes three 'equally flawed, intellectually lazy strategies' to deal with the impact of AI. The first is substitution and deprofessionalisation, using AI to allow cheaper 'AI-augmented technicians' to replace more expensive professionals, producing more low wage jobs and fewer mid-range. This does save money but leaves a company at risk of being easily outcompeted. The second is what Ming describes as the '"A-Player" Hunger Games', the approach favoured by Silicon Valley. This sees the growing rif...

Search This Blog