Expected value
The expected value (seldom and ambiguous mean ), which is often abbreviated with, is a basic concept of stochastics . The expected value of a random variable describes the number that the random variable assumes on average. For example, if the underlying experiment is repeated indefinitely, it is the average of the results. The law of large numbers describes the exact form in which the averages of the results tend towards the expected value as the number of experiments increases, or, in other words, how the sample means converge towards the expected value as the sample size increases .
It determines the localization (position) of the distribution of the random variables and is comparable to the empirical arithmetic mean of a frequency distribution in descriptive statistics. It is calculated as the probability-weighted mean of the values that the random variable assumes. However, it does not have to be one of these values itself. In particular, the expected value can assume the values .
Because the expected value only depends on the probability distribution , we speak of the expected value of a distribution without reference to a random variable. The expectation value of a random variable can be viewed as the center of gravity of the probability mass and is therefore referred to as its first moment .
motivation
The numbers on the dice can be viewed as different characteristics of a random variable . Because the (actually observed) relative frequencies, according to the law of large numbers, approach the theoretical probabilities of the individual numbers as the sample size increases , the mean value must strive towards the expected value of . To calculate it, the possible values are weighted with their theoretical probability.
Like the results of the die rolls, the mean value is random . In contrast to this, the expected value is a fixed indicator of the distribution of the random variables .
The definition of the expected value is analogous to the weighted mean of empirically observed numbers. For example, if a series of ten dice attempts returned the results 4, 2, 1, 3, 6, 3, 3, 1, 4, 5, the associated mean value can
alternatively can be calculated by first summarizing the same values and weighting them according to their relative frequency :
- .
In general, the mean of the numbers in throws can be like
write in which denotes the relative frequency of the number .
Concept and notation
The concept of the expected value goes back to Christiaan Huygens . In a treatise on games of chance from 1656, "Van rekeningh in spelen van geluck", Huygens describes the expected win of a game as "het is my soo veel weerdt". Frans van Schooten used the term expectatio in his translation of Huygens' text into Latin . Bernoulli adopted the term introduced by van Schooten in his Ars conjectandi in the form valor expectationis .
In the western world is used for the operator , especially in Anglophone literature .
The term can be found in Russian-language literature .
The designation emphasizes the property as a first moment that is not dependent on chance. The Bra-Ket notation is used in physics . In particular, instead of writing for the expected value of a quantity .
Definitions
If a random variable is discrete or has a density , the following formulas exist for the expected value.
Expected value of a discrete real random variable
In the real discrete case, the expected value is calculated as the sum of the products of the probabilities of each possible result of the experiment and the “values” of these results.
If a real discrete random variable that accepts the values with the respective probabilities (with as a countable index set ), the expected value in the case of existence is calculated with:
It should be noted that nothing is said about the order of the summation (see summable family ).
Is , then has a finite expectation if and only if the convergence condition
- is fulfilled, ie the series for the expected value is absolutely convergent .
The following property is often useful for nonnegative integer random variables
This property is proven in the section on the expectation of a non-negative random variable.
Expected value of a real random variable with a density function
If a real random variable has a probability density function , i.e. if the image measure has this density with respect to the Lebesgue measure , then the expected value in the case of existence is calculated as
- (1)
In many applications there is (generally improper ) Riemann integrability and the following applies:
- (2)
It is equivalent to this equation if the distribution function of is:
- (3)
(2) and (3) are equivalent under the common assumption ( is a density function and is a distribution function of ), which can be proven with school-based means.
For nonnegative random variables, the important relationship to the reliability function follows from this
general definition
The expected value is to correspond to the Lebesgue integral with respect to the probability measure defined: Is a measure of the relative integrated or quasi integrable random variable on a probability space with values in , wherein the Borel σ algebra over , it is defined as
- .
The random variable has an expected value precisely when it is quasi-integrable , i.e. the integrals
- and
are not both infinite, where and denote the positive as well as the negative part of . In this case, or can apply.
The expectation value is finite if and only if it is integrable, i.e. the above integrals over and both are finite. This is equivalent to
In this case, many authors write that the expected value exists or is a random variable with an existing expected value , and thus exclude the case or respectively .
Expected value of two random variables with a common density function
Have the integrable random variables and a joint probability density function , then the expectation value of a function calculated from and according to the set of Fubini to
The expectation of is only finite if the integral
is finite.
In particular:
The expected value is calculated from the edge density as in the case of univariate distributions:
The edge density is given by
Elementary properties
Linearity
The expectation value is linear , so it holds for any, not necessarily independent random variable that
is. There are special cases
- ,
and
- .
The linearity can also be extended to finite sums:
The linearity of the expected value follows from the linearity of the integral.
monotony
Is almost certain , and there are so true
- .
Probabilities as expected values
The probabilities of events can also be expressed using the expected value. For every event applies
- ,
where is the indicator function of .
This connection is often useful, for example to prove the Chebyshev inequality .
Triangle inequality
It applies
and
Examples
roll the dice
The experiment is a throw of the dice . We consider the number of points rolled as a random variable , with each of the numbers 1 to 6 being rolled with a probability of 1/6.
For example, if you roll the dice 1000 times, i.e. you repeat the random experiment 1000 times and add up the rolled numbers and divide by 1000, the result is with a high probability a value close to 3.5. However, it is impossible to get this value with a single roll of the dice.
Saint Petersburg Paradox
The Saint Petersburg Paradox describes a game of chance whose random win has an infinite expected value. According to classical decision theory, which is based on the expected value rule, one should risk an arbitrarily high stake. However, since the probability of losing the stake is 50%, this recommendation does not seem rational. One solution to the paradox is to use a logarithmic utility function .
Random variable with density
The real random variable is given with the density function
where denotes Euler's constant.
The expected value of is calculated as
general definition
Given is the probability space with , the power set of and for . The expected value of the random variable with and is
Since it is a discrete random variable with and , the expected value can alternatively be calculated as
Other properties
Expected value of a non-negative random variable
If is and is almost certainly non-negative, then according to Fubini-Tonelli's theorem (here the square brackets denote the predicate mapping )
So is
(The last equality is correct, there for almost everyone .)
The following known special case results for:
For integer, nonnegative random variables, the following applies because
the above formula:
Sigma additivity
If all random variables are almost certainly non-negative, the finite additivity can even be extended to -additivity:
Expected value of the product of n stochastically independent random variables
If the random variables are stochastically independent of one another and can be integrated, the following applies:
especially too
- For
Expected value of the product of non-stochastically independent random variables
If the random variables are independent and not stochastically, the following applies to their product:
It is the covariance between and .
Expected value of a composite random variable
Is a composite random variable, say are independent random variables and are identically distributed and is on defined, it can be represented as
- .
If the first moments of exist , then applies
- .
This statement is also known as the formula of Wald . She is z. B. used in insurance mathematics.
Monotonous convergence
If the non-negative random variables are almost certainly monotonically growing point by point and almost certainly converge to another random variable , then the following applies
- .
This is the theorem of monotonic convergence in the probabilistic formulation.
Calculation using the cumulant generating function
The cumulative generating function of a random variable is defined as
- .
If it is derived and evaluated at 0, the expected value is:
- .
The first cumulant is the expected value.
Calculation using the characteristic function
The characteristic function of a random variable is defined as . With their help, the expected value of the random variable can be determined by deriving:
- .
Calculation using the torque generating function
Similar to the characteristic function, the torque generating function is defined as
- .
Here, too, the expected value can easily be determined as
- .
This follows from the fact that the expected value is the first moment and the k-th derivatives of the moment-generating function at 0 are exactly the k-th moments.
Calculation using the probability generating function
If only natural numbers are accepted as values, the expected value for can also be determined with the help of the probability-generating function
- .
to calculate. It then applies
- ,
if the left-hand limit exists.
Best approximation
If a random variable is in a probability space , the best approximation describes an in the sense of minimizing , where a is a real constant. This follows from the best approximation theorem, da
for all constants , where denotes the standard normal scalar product . This view of the expected value makes the definition of the variance as the minimum mean square distance meaningful, see also the Fréchet principle .
Expected values of functions of random variables
If there is a random variable again, the expected value of can also be determined using the formula instead of using the definition:
In this case, too, the expected value only exists if
converges.
For a discrete random variable, a sum is used:
If the sum is not finite, then the series must converge absolutely in order for the expectation value to exist.
Related concepts and generalizations
Location parameters
If the expected value is understood as the center of gravity of the distribution of a random variable, then it is a situation parameter. This indicates where the main part of the distribution is located. Further location parameters are
- The mode : The mode indicates the point at which the distribution has a maximum, i.e. in the case of discrete random variables the characteristic with the greatest probability and in the case of continuous random variables the maximum positions of the density function. In contrast to the expected value, the mode always exists, but does not have to be unique. Examples of ambiguous modes are bimodal distributions .
- The median is another common location parameter. It indicates which value on the x-axis separates the probability density in such a way that half of the probability is found to the left and right of the median. The median also always exists, but does not have to be unique (depending on the definition).
Moments
If the expected value is understood as the first moment , it is closely related to the higher-order moments. Since these are in turn defined by the expected value in connection with a function , they are, as it were, a special case. Some of the familiar moments are:
- The variance : Centered second moment . Here is the expected value.
- The skewness : centered third moment, normalized to the third power of the standard deviation . It is .
- The curvature : Centered fourth moment, normalized to . It is .
Conditional expected value
The conditional expected value is a generalization of the expected value for the case that certain outcomes of the random experiment are already known. This allows conditional probabilities to be generalized and the conditional variance to be defined. The conditional expectation value plays an important role in the theory of stochastic processes .
Quantum mechanical expectation
If the wave function of a particle is in a certain state and is an operator, then is
the quantum mechanical expectation of in the state . is here the spatial space in which the particle moves, is the dimension of , and a superscript star stands for complex conjugation .
If it can be written as a formal power series (and this is often the case), the formula is used
The index on the expectation value bracket is not only abbreviated as here, but sometimes also omitted entirely.
- example
The expected value of the whereabouts in the location representation is
The expected value of the location in the momentum representation is
where we have identified the probability density function of quantum mechanics in space.
Expected value of matrices and vectors
Let be a stochastic - matrix , with the stochastic variables as elements, then the expected value of is defined as:
- .
If there is a - random vector :
.
See also
literature
- Krishna B. Athreya , Soumendra N. Lahiri : Measure Theory and Probability Theory (= Springer Texts in Statistics ). Springer Verlag , New York 2006, ISBN 0-387-32903-X ( MR2247694 ).
- Heinz Bauer : Probability Theory (= De Gruyter textbook ). 5th, revised and improved edition. de Gruyter , Berlin, New York 2002, ISBN 3-11-017236-4 ( MR1902050 ).
- Kai Lai Chung : A Course in Probability Theory . Academic Press, Inc. , San Diego (et al.) 2001, ISBN 0-12-174151-6 ( R1796326 ).
- Walter Greiner : Quantum Mechanics . 6. revised and exp. Edition. Publisher Harri Deutsch , Zurich [u. a.] 2005, ISBN 3-8171-1765-5 .
- Erich Härtter : Probability calculation for economists and natural scientists . 10th edition. Vandenhoeck & Ruprecht , Göttingen 1974, ISBN 3-525-03114-9 .
- Norbert Henze : Stochastics for beginners . 10th edition. Springer Spectrum , Wiesbaden 2013, ISBN 978-3-658-03076-6 , doi : 10.1007 / 978-3-658-03077-3 .
- Achim Klenke : Probability Theory . 3rd, revised and expanded edition. Springer Spectrum , Berlin, Heidelberg 2013, ISBN 978-3-642-36017-6 , doi : 10.1007 / 978-3-642-36018-6 .
- Norbert Kusolitsch : Measure and probability theory . An introduction (= Springer textbook ). 2nd, revised and expanded edition. Springer-Verlag, Berlin, Heidelberg 2014, ISBN 978-3-642-45386-1 .
- M. Loève : Probability Theory I (= Graduate Texts in Mathematics . Volume 45 ). 4th edition. Springer Verlag, Berlin, Heidelberg 1977, ISBN 3-540-90210-4 ( MR0651017 ).
- Vladimir Spokoiny , Thorsten Dickhaus : Basics of Modern Mathematical Statistics (= Springer Texts in Statistics ). Springer-Verlag, Heidelberg, New York, Dordrecht, London 2015, ISBN 978-3-642-39908-4 ( MR3289985 ).
Web links
Individual evidence
- ↑ Norbert Henze: Stochastics for beginners . Vieweg + Teubner, 2008. ISBN 978-3-8348-9465-6 . P. 79.
- ↑ See for example AN Širjaev: Probability 1988, p. 52 ff!
- ^ John Aldrich: Earliest Uses of Symbols in Probability and Statistics . on-line
- ↑ Ross, SM: Introduction to probability models , Academic Press, 2007, 9th edition, p. 143, ISBN 0-12-598062-0 .
- ↑ H. Wirths: The expectation value - sketches for the development of concepts from grade 8 to 13. In: Mathematik in der Schule 1995 / Heft 6, pp. 330–343.