Home | Site Map | Anoca.org

# Probability theory

(probabilitytheory)

Probability theory is the mathematical study of probability .

Mathematicians think of probabilities as numbers in the interval from 0 to 1 assigned to "events" whose occurrence or failureto occur is random. Probabilities P(E) are assigned to events E according to the probabilityaxioms .

The probability that an event E occurs given the known occurrence of an eventF is the conditional probability of E givenF; its numerical value is (as long as P(F) is nonzero). If the conditional probabilityof E given F is the same as the ("unconditional")probability of E, then E and F are said to be independent events. That this relation between E andF is symmetric may be seen more readily by realizing that it is the same as saying.

Two crucial concepts in the theory of probability are those of a random variable and of the probability distribution of a random variable; see those articles for more information.

## A somewhat more abstract view of probability

"Pure" mathematicians usually take probability theory to be the study of probability spaces and random variables — anapproach introduced by Andrey NikolaevichKolmogorov in the 1930s . A probability space is a triple (Ω, F, P), where

• Ω is a non-empty set, sometimes called the "sample space", each of whose members is thought of as a potential outcome ofa random experiment. For example, if 100 voters are to be drawn randomly from among all voters in California and asked whom theywill vote for governor, then the set of all sequences of 100 Californian voters would be the sample space Ω.
• F is a sigma-algebra of subsets of Ω whose members arecalled "events". For example the set of all sequences of 100 Californian voters in which at least 60 will vote for Schwarzeneggeris identified with the "event" that at least 60 of the 100 chosen voters will so vote. To say that F is a sigma-algebranecessarily implies that the complement of any event is an event, and the union of any (finite or countably infinite) sequence ofevents is an event.
• P is a probability measure on F, i.e., a measure such that P(Ω) = 1.

It is important to note that P is defined on F and not on Ω. With Ω denumerable we can defineF := powerset(Ω) which is trivially a sigma-algebra and the biggest one we can create using Ω. In adiscrete space we can therefore omit F and just write (Ω, P) to define it. If on the other hand Ω isnon-denumerable and we use F = powerset(Ω) we get into trouble defining our probability measure P becauseF is too 'huge'. So we have to use a smaller sigma-algebra F (eg. the Borel algebra of Ω). We call this sort of probability space a continuous probability space and are ledto questions in measure theory when we try to define P.

A random variable is a measurable function on Ω. For example, the number of voters who will vote for Schwarzenegger inthe aforementioned sample of 100 is a random variable.

If X is any random variable, the notation P(X ≥ 60) is shorthand for P({ ω inΩ : X(ω) ≥ 60 }), so that "X ≥ 60" is an "event".

## Philosophy of application of probability

Some statisticians will assign probabilities only to events that they think of as random, according to their relativefrequencies of occurrence, or to subsets of populations as proportions of the whole; those are frequentists.Others assign probabilities to propositions that are uncertain according either to subjective degrees of belief in their truth, or to logically justifiable degrees of belief in theirtruth. Such persons are Bayesians . A Bayesian may assign aprobability to the proposition that there was life on Mars a billion years ago, since that is uncertain; a frequentist would notassign such a probability, since it is not a random event that has a long-run relative frequency of occurrence.