This article covers the Green function in stochastics. For the auxiliary function for solving inhomogeneous linear partial differential equations see Green's function .
The Green function is a real-valued function in the mathematical branch of stochastics . It is a tool for studying Markov chains , a special class of stochastic processes . In particular, it can be used to examine whether and how often a Markov chain returns to its starting point ( recurrence ).
the number of visits to , including possible visits at time zero. Here is the characteristic function on the set .
Then is called
the green function of .
Here referred to the expected value if the Markov chain , ie with an initial distribution starts, so that is. In addition, describes the probability of being in at the start in according to time steps .
properties
The value of the Green function clearly corresponds to the expected number of visits to when starting in .
Looking at the probability of ever getting from to , formally
,
this is how you get the identity for the green function
as well as the alternative representation
.
However, since by definition the state is recurrent if is, a (non- absorbing state ) is recurrent if and only if holds.
Application example: recurrence of the simple random walk
The simple random walk with start at zero is given as an application example. It is given by the start distribution given by and the transition probabilities
described. Due to the periodicity, it is impossible to return to the zero point at odd times. At even points in time, a return is possible if the same number of steps has been taken to the left as to the right. In addition, since the individual transition probabilities of the Bernoulli distribution obey, and the sum thus the binomial distribution , applies
and thus for the green function
Using the identity
then follows the illustration for the Green function
.
Thus, the random walk is recurrent if and only if it is symmetrical, so it holds.
Hans-Otto Georgii: Stochastics . Introduction to probability theory and statistics. 4th edition. Walter de Gruyter, Berlin 2009, ISBN 978-3-11-021526-7 , p.187 , doi : 10.1515 / 9783110215274 .