Axioms of probability
- Non-negativity. $Pr(A) \leq 0$
- Normalization: $Pr(A)=1$ when A is a tautology
- Finite additivity: $Pr( A \lor B) \eq Pr(A) + Pr(B)$ when A and B are incompatible.
Probability theory satisfies the axioms of set theory. Moreover, the three axioms of Kolmogorov together with axioms of set theory fully define probability calculus.
Explanation from Easwaran_Bayesianism_I.md :
Kolmogorov axioms are defined on sets of events. Have a function P defining assigning real numbers to all members of F, where F is a collection of subsets of the "field of probabilities" E.
Then we have the following axioms on P:
- values of P are non-negative
- P(E)=1: field of all probabilities describes all possible outcomes, and thus at least one of those outcomes must occur (my phrasing)
- If A and B have nothing in common, then $P(A \cup B) = P(A) + P(B)$.
Example of how you can deduce probability rules:
$\Omega = {1,2,3,4,5,6}$
$A \subseteq \Omega = {1,2,3}$
Then set theory states $B \ A = {4,5,6}$
Together with Kolmogorov's 2nd and 3rd it follows Pr(B)=1-Pr(A).