Skip to main content

Fun with the Reverend Bayes

A recent review of Bayes' Rule by James V. Stone for review, has reminded me of the delightful case of the mathematician's coloured balls. (Mathematicians often have cases of coloured balls. Don't ask me why.)

This is a thought experiment that helps illustrate why we have problems dealing with uncertainty and probability.

Imagine I've got a jar with 50 white balls and 50 black balls in it. I take out a ball but don't look at it. What's the chance that this ball is black?

I hope you said 50% or 50:50 or 1/2 or 0.5 - all ways of saying that it has equal chances of being either white or black. With no further information that's the only sensible assumption.

Now keep that ball to one side, still not looking at it. You pull out another ball and you do look at this one. (Mathematicians know how to have a good time.) It's white.

Now what's the chance that the first ball was black?

You might be very sensibly drawn to suggest that it's still 50:50. After all, how could the probability change just because I took another ball out afterwards? But the branch of probability and statistics known as Bayesian tells us that probabilities are not set in stone or absolute - they are only as good as the information we have, and gaining extra information can change the probability.

Initially you had no information about the balls other than that there were 50 of each colour in the pot. Now, however, you also know that a ball drawn from the remainder was white. If that first ball had been black, you would be slightly more likely to draw a white ball next time. So drawing a white makes it's slightly more likely that the first ball was black than it was white - you've got extra information. Not a lot of information, it's true. Yet it does shift the probability, even though the information comes in after the first ball was drawn.

If you find that hard to believe, imagine taking the example to the extreme. I've got a similar pot with just two balls in, one black, one white. I draw one out but don't look at it. What's the chance that this ball is black? Again it's 50%. Now lets take another ball out of the pot and look at. It's white. Do you still think that looking at another ball doesn't change the chances of the other ball being black? If so let's place a bet - because I now know that the other ball is definitely black.

So even though it appears that there's a 0.5 chance of the ball being black initially, what is really the case is that 0.5 is our best bet given the information we had. It's not an absolute fact, it's our best guess given what we know. In reality the ball was either definitely white or definitely black, not it some quantum indeterminate state. But we didn't know which it was, so that 0.5 gave us a best guess.

One final example to show how information can change apparently fixed probabilities.

We'll go back to the first example to show another way that information can change probability. Again I've got a pot, then with 50 black and 50 white balls. I draw one out. What's the probability it's black? You very reasonably say 50%.  So far this is exactly the same situation as the first time round.

I, however, have extra information. I now share that information with you - and you change your mind and say that the probability is 100% black, even though nothing has changed about the actual pot or ball drawn. Why? Because I have told you that all the balls at the bottom of the pot are white and all the balls at the top are black. My extra information changes the probabilities.

Comments

Popular posts from this blog

De/Cipher - Mark Frary ****

I was a little doubtful when I first saw this book. Although it has the intriguing tagline 'The greatest codes ever invented and how to crack them' the combination of a small format hardback and gratuitous illustrations made me suspect it would be a lightweight, minimal content, Janet and John approach to codes and ciphers. Thankfully, in reality Mark Frary manages to pack a remarkable amount of content into De/Cipher's slim form.

Not only do we get some history on and instructions to use a whole range of ciphers, there are engaging little articles on historical codebreakers and useful guidance on techniques to break the simpler ciphers. The broadly historical structure takes the reader through basic alphabetic manipulation, keys, electronic cryptography, one time pads and so on, all the way up to modern public key encryption and a short section on quantum cryptography. 

We even get articles on some of the best known unsolved ciphers, such as the Dorabella and the Voynich ma…

Paul McAuley - Four Way Interview

Paul McAuley won the Philip K. Dick Award for his first novel and has gone on to win the Arthur C. Clarke, British Fantasy, Sidewise and John W. Campbell Awards. He gave up his position as a research biologist to write full-time. He lives in London. His latest novel is Austral.


Why science fiction?

For one thing, I fell in love with science fiction at an early age, and haven’t yet fallen out of love with it (although I have flirted with other genres). For another, we’re living in an increasingly science-fictional present. Every day brings headlines that could have been ripped from a science-fiction story. Giant robot battle: Who knew a duel between chainsaw-armed mech suits could be so boring? for instance. Or, Roy Orbison hologram to embark on UK tour in 2018. And looming above all this, like Hokusai’s famous wave, are the ongoing changes caused by global warming and climate change, which is just one consequence of human activity having become the dominant force of change on the planet…

Karl Drinkwater - Four Way Interview

Karl Drinkwater is originally from Manchester, but has lived in Wales half his life. He is a full-time author, edits fiction for other writers and was a professional librarian for over twenty-five years. He has degrees in English, Classics and Information Science. When he isn't writing, he loves exercise, guitars, computer and board games, the natural environment, animals, social justice, cake and zombies - not necessarily in that order. His latest novel is Lost Solace.

Why science fiction?

My favourite books have always been any form of speculative fiction. As a child I began with ghost stories, which were the first books to make me completely forget I was reading. By my teenage years I was obsessed with fantasy, science fiction, and horror. Although I read literary and contemporary books, non-fiction, historical works, classics and so on, it is speculative fiction that I return to when I want escape and wonder. When I read reviews of my last book, the fast-paced novella Harvest Fe…