# Connexions

You are here: Home » Content » Signal and Information Processing for Sonar » Foundations of Probability Theory: Basic Definitions

### Recently Viewed

This feature requires Javascript to be enabled.

Inside Collection (Course):

Course by: Laurence Riddle. E-mail the author

# Foundations of Probability Theory: Basic Definitions

Module by: Don Johnson. E-mail the author

Summary: This module covers the basic ideas of Probability Theory. It reviews the laws of boolean algebra, describes how to compute a priori and conditional probabilities, and uses these properties to obtain Bayes' Rule.

## Basic Definitions

The basis of probability theory is a set of events - sample space - and a systematic set of numbers - probabilities - assigned to each event. The key aspect of the theory is the system of assigning probabilities. Formally, a sample space is the set ΩΩ of all possible outcomes ω i ω i of an experiment. An event is a collection of sample points ω i ω i determined by some set-algebraic rules governed by the laws of Boolean algebra. Letting AA and BB denote events, these laws are Union: AB=ω ωAωB Union: A B ω ω A ω B Intersection: AB=ω ωAωB Intersection: A B ω ω A ω B Complement: A=ω ωA Complement: A ω ω A AB=AB A B A B The null set is the complement of ΩΩ. Events are said to be mutually exclusive if there is no element common to both events: AB= A B .

Associated with each event A i A i is a probability measure Pr A i A i , sometimes denoted by π i π i , that obeys the axioms of probability.

• Pr A i 0 A i 0
• PrΩ=1 Ω 1
• If AB= A B , then PrAB=PrA+PrB A B A B .
The consistent set of probabilities Pr· · assigned to events are known as the a priori probabilities. From the axioms, probability assignments for Boolean expressions can be computed. For example, simple Boolean manipulations ( AB=AAB A B A A B ) lead to
PrAB=PrA+PrBPrAB A B A B A B
(1)

Suppose PrB0 B 0 . Suppose we know that the event BB has occurred; what is the probability that event AA has also occurred? This calculation is known as the conditional probability of AA given BB and is denoted by PrA| B B A . To evaluate conditional probabilities, consider BB to be the sample space rather than ΩΩ. To obtain a probability assignment under these circumstances consistent with the axioms of probability, we must have

PrA| B =PrABPrB B A A B B
(2)
The event is said to be statistically independent of BB if PrA| B =PrA B A A : the occurrence of the event BB does not change the probability that AA occurred. When independent, the probability of their intersection PrAB A B is given by the product of the a priori probabilities PrAPrB A B . This property is necessary and sufficient for the independence of the two events. As PrA| B =PrABPrB B A A B B and PrB| A =PrABPrA A B A B A , we obtain Bayes' Rule.
PrB| A =PrA| B PrBPrA A B B A B A
(3)

## Content actions

EPUB (?)

### What is an EPUB file?

EPUB is an electronic book format that can be read on a variety of mobile devices.

PDF | EPUB (?)

### What is an EPUB file?

EPUB is an electronic book format that can be read on a variety of mobile devices.

#### Collection to:

My Favorites (?)

'My Favorites' is a special kind of lens which you can use to bookmark modules and collections. 'My Favorites' can only be seen by you, and collections saved in 'My Favorites' can remember the last module you were on. You need an account to use 'My Favorites'.

| A lens I own (?)

#### Definition of a lens

##### Lenses

A lens is a custom view of the content in the repository. You can think of it as a fancy kind of list that will let you see content through the eyes of organizations and people you trust.

##### What is in a lens?

Lens makers point to materials (modules and collections), creating a guide that includes their own comments and descriptive tags about the content.

##### Who can create a lens?

Any individual member, a community, or a respected organization.

##### What are tags?

Tags are descriptors added by lens makers to help label content, attaching a vocabulary that is meaningful in the context of the lens.

| External bookmarks

#### Module to:

My Favorites (?)

'My Favorites' is a special kind of lens which you can use to bookmark modules and collections. 'My Favorites' can only be seen by you, and collections saved in 'My Favorites' can remember the last module you were on. You need an account to use 'My Favorites'.

| A lens I own (?)

#### Definition of a lens

##### Lenses

A lens is a custom view of the content in the repository. You can think of it as a fancy kind of list that will let you see content through the eyes of organizations and people you trust.

##### What is in a lens?

Lens makers point to materials (modules and collections), creating a guide that includes their own comments and descriptive tags about the content.

##### Who can create a lens?

Any individual member, a community, or a respected organization.

##### What are tags?

Tags are descriptors added by lens makers to help label content, attaching a vocabulary that is meaningful in the context of the lens.

| External bookmarks

### Reuse / Edit:

Reuse or edit collection (?)

#### Check out and edit

If you have permission to edit this content, using the "Reuse / Edit" action will allow you to check the content out into your Personal Workspace or a shared Workgroup and then make your edits.

#### Derive a copy

If you don't have permission to edit the content, you can still use "Reuse / Edit" to adapt the content by creating a derived copy of it and then editing and publishing the copy.

| Reuse or edit module (?)

#### Check out and edit

If you have permission to edit this content, using the "Reuse / Edit" action will allow you to check the content out into your Personal Workspace or a shared Workgroup and then make your edits.

#### Derive a copy

If you don't have permission to edit the content, you can still use "Reuse / Edit" to adapt the content by creating a derived copy of it and then editing and publishing the copy.