Axioms of probability

  1. Non-negativity. $Pr(A) \leq 0$
  2. Normalization: $Pr(A)=1$ when A is a tautology
  3. Finite additivity: $Pr( A \lor B) \eq Pr(A) + Pr(B)$ when A and B are incompatible.

Probability theory satisfies the axioms of set theory. Moreover, the three axioms of Kolmogorov together with axioms of set theory fully define probability calculus.

Explanation from Easwaran_Bayesianism_I.md :

Kolmogorov axioms are defined on sets of events. Have a function P defining assigning real numbers to all members of F, where F is a collection of subsets of the "field of probabilities" E.

Then we have the following axioms on P:

  1. values of P are non-negative
  2. P(E)=1: field of all probabilities describes all possible outcomes, and thus at least one of those outcomes must occur (my phrasing)
  3. If A and B have nothing in common, then $P(A \cup B) = P(A) + P(B)$.

Example of how you can deduce probability rules:

$\Omega = {1,2,3,4,5,6}$

$A \subseteq \Omega = {1,2,3}$

Then set theory states $B \ A = {4,5,6}$

Together with Kolmogorov's 2nd and 3rd it follows Pr(B)=1-Pr(A).