The geometry of Bayes theorem

17 Jun, 2022 at 10:50 | Posted in Statistics & Econometrics | 1 Comment


An informative visualization of a theorem that shows how to update probabilities — calculating conditional probabilities — when new information/evidence becomes available.

But …

Although Bayes’ theorem is mathematically unquestionable, that doesn’t qualify it as indisputably applicable to scientific questions. Bayesian statistics is one thing, and Bayesian epistemology is something else. Science is not reducible to betting, and scientific inference is not a branch of probability theory. It always transcends mathematics. The unfulfilled dream of constructing an inductive logic of probabilism — the Bayesian Holy Grail — will always remain unfulfilled.

Bayesian probability calculus is far from the automatic inference engine that its protagonists maintain it is. That probabilities may work for expressing uncertainty when we pick balls from an urn, does not automatically make it relevant for making inferences in science. Where do the priors come from? Wouldn’t it be better in science if we did some scientific experimentation and observation if we are uncertain, rather than starting to make calculations based on often vague and subjective personal beliefs? People have a lot of beliefs, and when they are plainly wrong, we shall not do any calculations whatsoever on them. We simply reject them. Is it, from an epistemological point of view, really credible to think that the Bayesian probability calculus makes it possible to somehow fully assess people’s subjective beliefs? And are — as many Bayesians maintain — all scientific controversies and disagreements really possible to explain in terms of differences in prior probabilities? I strongly doubt it.

1 Comment »

RSS feed for comments on this post. TrackBack URI

  1. Not everything is about scientific evidence, especially in day-to-day life. You make a lot of decisions during a day, many of them subconsciously, and some of them are based on predictions. If you know how to improve your judgments, while receiving more and more information about the problem along your journey towards the final step to decide if you should go this direction or another, you are definitely to make better decisions. It is not about inferring whatsover at all. It’s about your learning and eliminating bias and noise out of your emotionally skewed brain. And that’s the reason why is good idea to utilize Bayesian thinking into your mental tool pocket. Even in scientific disputes you will find it useful, and I am betting your repution wouldn’t be harmed, rather the opposite. That’s my prior. 🙂

Leave a Reply

Fill in your details below or click an icon to log in: Logo

You are commenting using your account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s

Blog at
Entries and Comments feeds.