The basis of probability theory is a set of events - sample space - and a systematic set of numbers - probabilities - assigned to each event. The key aspect of the theory is the system of assigning probabilities. Formally, a sample space is the set ΩΩ of all possible outcomes ω i ω i of an experiment. An event is a collection of sample points ω i ω i determined by some set-algebraic rules governed by the laws of Boolean algebra. Letting AA and BB denote events, these laws are Union: A⋃B={ω|ω∈A∨ω∈B} Union: A B ω ω A ω B Intersection: A⋂B={ω|ω∈A∧ω∈B} Intersection: A B ω ω A ω B Complement: A′={ω|ω∉A} Complement: A ω ω A A⋃B′=A′⋂B′ A B A B The null set ∅ is the complement of ΩΩ. Events are said to be mutually exclusive if there is no element common to both events: A⋂B=∅ A B .

Associated with each event A i A i is a probability measure Pr A i A i , sometimes denoted by π i π i , that obeys the axioms of probability.

• Pr A i ≥0 A i 0
• PrΩ=1 Ω 1
• If A⋂B=∅ A B , then PrA⋃B=PrA+PrB A B A B .

The consistent set of probabilities Pr· · assigned to events are known as the a priori probabilities. From the axioms, probability assignments for Boolean expressions can be computed. For example, simple Boolean manipulations ( A⋃B=A⋃A′B A B A A B ) lead to

Suppose PrB≠0 B 0 . Suppose we know that the event BB has occurred; what is the probability that event AA has also occurred? This calculation is known as the conditional probability of AA given BB and is denoted by PrA|B B A . To evaluate conditional probabilities, consider BB to be the sample space rather than ΩΩ. To obtain a probability assignment under these circumstances consistent with the axioms of probability, we must have The event is said to be statistically independent of BB if PrA|B=PrA B A A : the occurrence of the event BB does not change the probability that AA occurred. When independent, the probability of their intersection PrA⋂B A B is given by the product of the a priori probabilities PrAPrB A B . This property is necessary and sufficient for the independence of the two events. As PrA|B=PrA⋂BPrB B A A B B and PrB|A=PrA⋂BPrA A B A B A , we obtain Bayes' Rule.