Stochastic Process


Also found in: Dictionary, Thesaurus, Medical, Wikipedia.
Related to Stochastic Process: Markov chain

stochastic process

[stō′kas·tik ′prä·səs]
(mathematics)
A family of random variables, dependent upon a parameter which usually denotes time. Also known as random process.

Stochastic Process

 

(or random process), a process —that is, a change in the state of some system over time—whose course depends on chance and for which the probability of a particular course is defined. Brownian motion is a typical example of a stochastic process. Other examples of practical importance include turbulent flows of liquids and gases, the flow of current in an electric circuit where there occur random fluctuations in voltage and current strength (noise), and the propagation of radio waves with random fading of the radio signal as a result of changes in the propagation characteristics of the signal path. Also classified as stochastic processes are many industrial processes accompanied by random fluctuations and a number of processes encountered in geophysics (for example, changes in the earth’s magnetic field), physiology (for example, variations in the bioelectric potentials of the brain as recorded in an electroencephalogram), and economics.

In order to apply mathematical methods to the study of a stochastic process, it must be possible to represent schematically the instantaneous state of the system in the form of a point of some phase space, or state space, R. The stochastic process here is represented by a function X(t) of time t with values in R. The case where the points of R are specified by one or more numerical parameters (generalized coordinates of the system) has been best studied and is of great interest from the point of view of applications. In mathematical investigations, the term “stochastic process’ is often applied to a numerical-valued function X(t) that can assume different values depending on chance and for which a probability distribution is specified for its various possible values. Such a function is called a simple stochastic process. If the points of R are specified by several numerical-valued parameters, the corresponding stochastic process X(t) = {X1(t), X2(t), • • •, Xk(t)} is said to be multiple.

The mathematical theory of stochastic processes and of more general random functions of an arbitrary argument is an important branch of probability theory. The first steps in the development of the theory of stochastic processes were made by, for example, A. A. Markov (the elder). These early efforts dealt with cases where time t varies discretely and the system can have only a finite number of different states. In other words, the schemes used involved sequences of dependent trials. A number of mathematicians have contributed to the development of the theory of stochastic processes that are functions of continuously varying time. These mathematicians include the Soviets E. E. Slutskii, A. N. Kolmogorov, and A. Ia. Khinchin, the Americans N. Wiener, W. Feller, and J. Doob, the Frenchman P. Lévy, and the Swede H. Cramer. The best studied areas of the theory of stochastic processes are certain special classes of processes, particularly Markov processes and stationary stochastic processes. Intensive research has also been done on a number of subclasses and generalizations of these two classes—for example, Markov chains, branching processes, processes with independent increments, martingales, and processes with stationary increments.

REFERENCES

Markov, A. A. “Zamechatel’nyi sluchai ispytanii, sviazannykh ν tsep’.” In A. A. Markov, Ischislenie veroiatnostei, 4th ed. Moscow. 1924.
Slutskii, E. E. Izbrannye trudy. Moscow, 1960.
Kolmogorov, A. N. “Ob analiticheskikh metodakh ν teorii veroiatnostei.” Uspekhi matemalicheskikh nauk, 1938, issue 5, pp. 5–41.
Khinchin, A. Ia. “Teoriia korreliatsii statsionarnykh stokhasticheskikh protsessov.” Uspekhi matemalicheskikh nauk, 1938, issue 5, pp. 42–51.
Wiener, N. Nelineinye zadachi ν teorii sluchainykh protsessov. Moscow, 1961. (Translated from English.)
Doob, J. Veroiatnostnye protsessy. Moscow, 1956. (Translated from English.)
Lévy, P. Stokhasticheskie protsessy i brounovskoe dvizhenie. Moscow, 1972. (Translated from French.)
Chandrasekhar, S. Stokhasticheskie problemy v fizike i astronomii. Moscow, 1947. (Translated from English.)
Rozanov, lu. A. Sluchainye protsessy. Moscow, 1971.
Gikhman, I. I., and A. V. Skorokhod. Teoriia sluchainykh protsessy, vols. 1-2. Moscow, 1971–73.

A. M. IAGLOM

References in periodicals archive ?
Wu, "A new proof for comparison theorems for stochastic differential inequalities with respect to semi-martingales," Stochastic Processes and Their Applications, vol.
In this section we also offer a precise definition of M-stability for different spaces of stochastic processes. The central result of Section 3 describes relationship between stochastic Lyapunov stability and Mstability, where we relate specially defined spaces of stochastic processes to different kinds of stochastic Lyapunov stability.
Similarly, a stochastic process is said to be discrete-time if the set T is discrete and continuous-time if the set of times T is a (possibly unbounded) interval in R
Peng, "Problem of eigenvalues of stochastic Hamiltonian systems with boundary conditions," Stochastic Processes and their Applications, vol.
Let x : J x [OMEGA] [right arrow] [E.sup.d] be a fuzzy stochastic process. Then x is the solution of problem (8) if and only if x is a continuous fuzzy stochastic process and satisfy the following random impulsive fuzzy integral equation:
Based on the above evolutionary spectrum theory, a numerical simulation of a nonstationary stochastic process, y(t), was initially proposed by Shinozuka et al.
For G : I x J x [OMEGA] [right arrow] [K.sup.b.sub.c] ([R.sup.d]) being a predictable and [L.sup.2,d.sub.P] ([[mu].sub.M])-integrally bounded set-valued stochastic process, let
define [mathematical expression not reproducible] be a generalized stochastic process. If [lambda] [member of] [LAMBDA], then V([omega]) * [[phi].sub.[lambda]] is measurable with respect to [omega] [member of] [OMEGA] and smooth with respect to x [member of] [R.sup.d], hence jointly measurable.
For this reason, the stochastic processes are modeled with Markov processes, in which the next step depends only on the last value of the series, regardless of the trajectory of this hitherto.
Equation (6) can be applied to express moments of the voltage stochastic process across the resistor in the case of statistical dependence between the resistance R and the current stochastic process:
The former can be regarded as the SDE describing Ito stochastic processes, the other as its algebraic constraints.
Under the p-order model, it is easy to control the local and global fluctuations of the stochastic process X.

Full browser ?