Bayes' theorem

Bayes' theorem formula: P(A|B) = [P(B|A) * P(A)] / P(B)

Bayes' theorem provides a way to update the probability of a hypothesis as more evidence becomes available. It is expressed as P(A|B) = [P(B|A) * P(A)] / P(B), where P(A|B) is the probability of event A given that B is true, P(B|A) is the probability of event B given that A is true, P(A) is the prior probability of A, and P(B) is the prior probability of B.

Example

Suppose we want to find the probability that a patient has a disease (A) given that they tested positive (B). If the probability of testing positive given the disease is present (P(B|A)) is 0.98, the prior probability of having the disease (P(A)) is 0.01, and the probability of testing positive (P(B)) is 0.05, then using Bayes' theorem, P(A|B) = [0.98 * 0.01] / 0.05 = 0.196.

Bayes' theorem is crucial for making informed decisions based on new evidence, as it allows for the calculation of conditional probabilities in various fields such as medicine, finance, and machine learning.

Related concepts

Conditional probability

P(A|B) = P(A ∩ B) / P(B)

Expected value

Expected value formula: E[X] = Σ [x * P(x)]

Poisson distribution

Poisson distribution formula: P(k; λ) = (λ^k * e^(-λ)) / k!

Entropy (information theory)

H(X) = −∑x∈X p(x) log(p(x))

Minkowski spacetime

Minkowski distance formula: D = (Σ |x_i - y_i|^p)^(1/p)

Kullback–Leibler divergence

Kullback–Leibler divergence formula: D_KL(P||Q) = ∑_x∈X P(x) log(P(x)/Q(x))

One email a day: 5 concepts + the 5 stories that matter →

Swipe through 100 ML concepts daily

Open TickerNews