Content: Stochastic processes in discrete and continuous time; Markov chains: Markov property, Chapman-Kolmogorov equation, classification of states, stationary distribution, examples of infinite ...

In this paper we discuss a counter system whose output is a stochastic point process such that the time intervals between pairs of successive events form a first order Markov chain. Such processes may ...

We establish global convergence results for stochastic fictitious play for four classes of games: games with an interior ESS, zero sum games, potential games, and supermodular games. We do so by ...

Combined with readily identifiable major environmental stressors this provides a tractable model system for determining the relative role of stochastic and deterministic drivers in community assembly.