SJMathTube · Formula Library⌂ Home
SJMATHTUBE · PROBABILITY & STATISTICS

Probability Rules and Bayes’ Theorem Formula Sheet

Definitions, conditional probability, independence and Bayes’ theorem, with workbook practice.

Explore the digital workbook →

The language of events

Sample space and event

The sample space Ω contains all outcomes. An event A is a set of outcomes within Ω.

Probability and complement

\[\displaystyle 0\le P(A)\le1,\qquad P(A^c)=1-P(A)\]

Aᶜ is the event that A does not occur.

Equally likely outcomes

\[\displaystyle P(A)=\frac{|A|}{|\Omega|}\]

Use only when the finite outcomes in Ω are equally likely.

Mutually exclusive events

\[\displaystyle A\cap B=\varnothing\]

A and B cannot occur together.

Independent events

\[\displaystyle P(A\cap B)=P(A)P(B)\]

The occurrence of one event does not change the probability of the other, when the relevant conditional probabilities are defined.

Do not confuse the two

Two mutually exclusive events with positive probabilities cannot be independent.

The essential probability rules

Addition rule

\[\displaystyle P(A\cup B)=P(A)+P(B)-P(A\cap B)\]

For mutually exclusive events, the intersection term is zero.

Conditional probability

\[\displaystyle P(A\mid B)=\frac{P(A\cap B)}{P(B)},\qquad P(B)>0\]

Read this as “the probability of A given B”.

Multiplication rule

\[\displaystyle P(A\cap B)=P(B)\,P(A\mid B)\]

Equivalently use P(A)P(B | A) when P(A) is positive.

At least one of two events

\[\displaystyle P(A\cup B)=1-P(A^c\cap B^c)\]

The complement is neither event occurring.

Total probability

\[\displaystyle P(A)=\sum\limits_{j=1}^{k}P(A\mid B_j)P(B_j)\]

B₁, …, Bₖ form a mutually exclusive, exhaustive partition with positive probabilities.

Bayes’ theorem

\[\displaystyle P(B_i\mid A)=\frac{P(A\mid B_i)P(B_i)}{\displaystyle\sum\limits_{j=1}^{k}P(A\mid B_j)P(B_j)}\]

Use a valid partition and require P(A) > 0.

‹›
Formulae

Available Formula Sheets

⌂ Home
Latest
Latest Content Auto
Home