Markov Chain
(redirected from Discrete-time Markov chain)

Also found in: Dictionary/thesaurus, Medical, Acronyms, Wikipedia

0.01 sec.

Markov chain [′mar‚kȯf ‚chān]

(mathematics)

A Markov process whose state space is finite or countably infinite.

(probability)

Markov chain - (Named after Andrei Markov) A model of sequences of events where the probability of an event occurring depends upon the fact that a preceding event occurred.

A Markov process is governed by a Markov chain.

In simulation, the principle of the Markov chain is applied to the selection of samples from a probability density function to be applied to the model. Simscript II.5 uses this approach for some modelling functions.

Markov Chain

a concept in probability theory that emerged from the works of the Russian mathematician A. A. Markov (the elder) that dealt with the study of sequences of dependent trials and sums of random variables associated with them. The development of the theory of Markov chains facilitated the creation of the general theory of Markov processes.

Want to thank TFD for its existence? Tell a friend about us, add a link to this page, add the site to iGoogle, or visit the webmaster's page for free fun content.

?Page tools

Printer friendly
Cite / link

Feedback

Mentioned in	?		References in periodicals archive	?		Encyclopedia browser	?		Full browser	?
No references found			2 Notation and definitions Let [MATHEMATICAL EXPRESSION NOT REPRODUCIBLE IN ASCII] be a discrete-time Markov chain with a discrete state space S and transition probabilities P(x, y) for x, y [member of] S, where [summation over (y)] [member of]S] P(x, y) = 1 for each x [member of] S. Concentration of measure and mixing for Markov chains by Luczak, Malwina J. / DMTCS Proceedings A sampling of the paper topics: the performace of D-redundant disk systems; X-ray--a tool for automatic measurement of hardware paramenters; workload propagation--overload in bursty servers; and optimal importance sampling for discrete-time Markov chains. Quantitative evaluation of systems; proceedings by SciTech Book News Critically acclaimed text for computer performance analysis-now in its second edition The Second Edition of this now-classic text provides a current and thorough treatment of queuing systems, queuing networks, continuous and discrete-time Markov chains, and simulation. The Second Edition of Queueing Networks and Markov Chains Provides a ... by Business Wire			discovery vein discovery well Discrediting of Authority discrete discrete address beacon system discrete comparator discrete component discrete cosine transform discrete Fourier transform discrete graphics discrete input selection discrete logic discrete manufacturing discrete mathematics discrete preorder discrete radio source discrete sampling discrete set discrete sound system discrete spectrum discrete system discrete topology discrete transfer function discrete variable discrete-film zone Discrete-time Markov chain discrete-time system discrete-word intelligibility Discreteness discretionary access control discretionary hyphen Discretionary Power discretization discretization error Discriminant discriminant function discriminated union Discrimination discrimination learning Discriminator discriminator transformer discursive discus discus throw discus throwing discussion group disdrometer Disease Disease ecology diseases of plants diseconomy			Discrete Value Group discrete variable discrete variable discrete variable discrete variable discrete variable Discrete Variable Representation-Ray Eigenvector Discrete Variables Discrete Variational Method Discrete Variational-Local Density Functional Discrete Variational-X Discrete Wavelet Frame Transform Discrete Wavelet Multi-Tone Discrete Wavelet Packet Transform Discrete wavelet transform Discrete Wavenumber Integration Method Discrete Wiring Board discrete x-rays Discrete-Event Dynamic Simulation Discrete-Event Simulation discrete-film zone Discrete-Time Batch Markovian Arrival Process Discrete-Time Cellular Neural Networks Discrete-time complex variable Discrete-Time Describing Function Discrete-Time Fourier Series Discrete-Time Gaussian Channel Discrete-Time Infinite Impulse Response Discrete-time Markov chain Discrete-Time Markovian Arrival Process Discrete-Time Markovian Model Discrete-Time Memoryless Channel Discrete-Time Optical Processing of Microwave Signals Discrete-Time Phase-Locked Loop Discrete-Time Poisson Channel Discrete-Time Process Algebra Discrete-Time Quantum Walk Discrete-Time Survival Analysis Discrete-time system Discrete-Time Uniform Theory of Diffraction Discrete-Time Wavelet Series Discrete-Valued Time Series discrete-word intelligibility DiscreteLogix discretely discretely discretely discretely Discretely Presented Component Unit discretely sampled data discreteness discreteness discreteness discreteness discretion discretion discretion discretion discretion

Encyclopedia

Free Tools:	For surfers: Free toolbar & extensions \| Word of the Day \| Help For webmasters: Free content \| Linking \| Lookup box \| Double-click lookup

Disclaimer
All content on this website, including dictionary, thesaurus, literature, geography, and other reference data is for informational purposes only. This information should not be considered complete, up to date, and is not intended to be used in place of a visit, consultation, or advice of a legal, medical, or any other professional.

Markov Chain (redirected from Discrete-time Markov chain)

Markov Chain
(redirected from Discrete-time Markov chain)