NOTICE: Citizendium is still being set up on its newer server, treat as a beta for now; please see here for more. |

Citizendium - a community developing a quality comprehensive compendium of knowledge, online and free. Click here to join and contribute—free |

CZ thanks our previous donors. Donate here. Treasurer's Financial Report -- Thanks to our content contributors. -- |

# Bayes Theorem

**Bayes' Theorem** is a theorem in probability theory named for Thomas Bayes (1702–1761).

It is used for updating probabilities by finding conditional probabilities given new data. This simplest case involves a situation in which probabilities have been assigned to each of several mutually exclusive alternatives *H*_{1}, ..., *H*_{n}, at least one of which may be true. New data *D* is observed. The conditional probability of *D* given each of the alternative hypotheses *H*_{1}, ..., *H*_{n} is known. What is needed is the conditional probability of each hypothesis *H*_{i} given *D*. Bayes' Theorem says

The use of Bayes' Theorem is sometimes described as follows. Start with the vector of "prior probabilities", i.e. the probabilities of the several hypotheses *before* the new data is observed:

Multiply these term-by-term by the "likelihood vector":

getting

The sum of these numbers is not (usually) 1. Multiply all of them by the "normalizing constant"

getting

The result is the "posterior probabilities", i.e. conditional probabilities given the new data:

In epidemiology, Bayes' Theorem is used to obtain the probability of disease in a group of people with some characteristic on the basis of the overall rate of that disease and of the probabilities of that characteristic in healthy and diseased individuals. In clinical decision analysis it is used for estimating the probability of a particular diagnosis given the base rate, and the appearance of some symptoms or test result.^{[1]}

## Bayes' Rule

Bayes theorem can be cast in the following memorable forms:

*posterior odds equals prior odds times likelihood ratio*, or

*posterior odds equals prior odds times Bayes factor*.

Consider any two hypotheses, not necessarily exhaustive or mutually exclusive, and .

Suppose that initially we assign these hypotheses probabilities and and then observe data .

The "prior odds" on the hypotheses and is the ratio .

The "likelihood ratio" or "Bayes factor" for these two hypotheses, given the data , is the ratio of the probabilities of the data under the two hypotheses, .

The "posterior odds" on the two hypotheses is the ratio of their probabilities given the data, .

And indeed, provided no divisions by zero are involved,

## Calculations

## References

- ↑ National Library of Medicine. Bayes Theorem. Retrieved on 2007-12-09.