Skip to main content

Big Data - Brian Clegg ****

I first became involved with what we now term big data when providing some mathematical assistance to a major supermarket.  They wanted to know what products would suffer, or benefit, if another product were put on special offer – the victims and victors as they called them.  As an example, if fresh meat pies are put on buy one get one free, should the supermarket plan on stocking more fresh vegetables? That sort of thing.  The supermarket in question had a lot of data concerning historical sales, and what had previously been put on special offer, so it was just a case of designing a set of algorithms to analyse this data to provide the necessary forecast, and also to have the system learn through what we would now call reinforcement learning over time.  This was back in the mid 90s. One can imagine how things - in all camps - should have vastly improved since then.  That’s just one example of where Big Data transparently impacts our lives.

In Big Data, Clegg sets out an assortment of examples from the success of Netflix and the prediction of crime locations to algorithms that have lost people their jobs or caused stock market crashes, examining the mechanisms and implications of each.  Taking the supermarket example - although this is my example and not his - we might ask ourselves who really benefits here – who exactly are the victims and victors (or villains perhaps) in real life?

Big Data is here to stay - should we be afraid of it or embrace it?  As always, Clegg writes with an easy clarity that draws us in - no technical expertise required to understand his exploration of this essential subject - and throughout Big Data’s highly enjoyable pages, the spread and range of material is highly impressive – dizzying in fact.  I personally found entirely new perspectives on the subject that will keep me pondering for quite some time.  

I should add that, if I were still a statistics lecturer at Oxford, I would recommend the book to my students as bedside reading.

Paperback:  

Kindle:  

Review by Peet Morris
Please note, this title is written by the editor of the Popular Science website. Our review is still an honest opinion – and we could hardly omit the book – but do want to make the connection clear.

Comments

Popular posts from this blog

Superior - Angela Saini *****

It was always going to be difficult to follow Angela Saini's hugely popular Inferior, but with Superior she has pulled it off, not just in the content but by upping the quality of the writing to a whole new level. Where Inferior looked at the misuse of science in supporting sexism (and the existence of sexism in science), Superior examines the way that racism has been given a totally unfounded pseudo-scientific basis in the past - and how, remarkably, despite absolute evidence to the contrary, this still turns up today.

At the heart of the book is the scientific fact that 'race' simply does not exist biologically - it is nothing more than an outdated social label. As Saini points out, there are far larger genetic variations within a so-called race than there are between individuals supposedly of different races. She shows how, pre-genetics, racial prejudice was given a pseudo-scientific veneer by dreaming up fictitious physical differences over and above the tiny distinct…

Artificial Intelligence - Yorick Wilks ****

Artificial intelligence is one of those topics where it's very easy to spin off into speculation, whether it's about machine conciousness or AI taking over the world (and don't get me onto the relatively rare connection to robots - cover designer please note). All the experience of AI to date has been that it has been made feasible far slower than originally predicted, and that it faces dramatic limitations. So, for example, self-driving cars may be okay in limited circumstances, but are nowhere near ready for the commute home. Similarly, despite all the moves forward in AI technology, computers are so-so at recognising objects after learning from thousands of examples - sometimes fooled by apparently trivial surface patterning - where humans can recognise items from a handful of examples.

Even so, we can't deny that AI is having an influence on our lives and Yorick Wilks, emeritus professor of AI at the University of Sheffield, is ideally placed to give us a picture …

Where are the chemistry popular science books?

by Brian Clegg
There has never been more emphasis on the importance of public engagement. We need both to encourage a deeper interest in science and to counter anti-scientific views that seem to go hand-in-hand with some types of politics. Getting the public interested in science both helps recruit new scientists of the future and spreads an understanding of why an area of scientific research deserves funding. Yet it is possible that chemistry lags behind the other sciences in outreach. As a science writer, and editor of this website, I believe that chemistry is under-represented in popular science. I'd like to establish if this is the case, if so why it is happening - and what can be done to change things. 


An easy straw poll is provided by the topic tags on the site. At the time of writing, there are 22 books under 'chemistry' as opposed to 97 maths, 126 biology and 182 physics. The distribution is inevitably influenced by editorial bias - but as the editor, I can confirm …