سلسلة ماركوف مونت كارلو (MCMC)
1953
- Nicholas Metropolis
- Arianna W. Rosenbluth
- Marshall N. Rosenbluth
- Augusta H. Teller
- Edward Teller
- W. Keith Hastings
Markov Chain مونت كارلو (MCMC) methods are a class of algorithms for sampling from a probability distribution. A Markov chain is constructed that has the desired distribution as its equilibrium or stationary distribution. The state of the chain after a large number of steps is then used as a sample from the desired distribution, enabling computation of integrals and expectations.
MCMC methods are essential when direct sampling from a complex, high-dimensional probability distribution [latex]P(x)[/latex] is intractable. Instead of generating independent samples, MCMC generates a sequence of correlated samples that form a Markov chain. A Markov chain is a stochastic process where the probability of transitioning to the next state depends only on the current state, not on the sequence of events that preceded it. The key is to design the transition probabilities of the chain such that its stationary distribution is the target distribution [latex]P(x)[/latex].
The process starts at an arbitrary state [latex]x_0[/latex]. At each step [latex]t[/latex], a new state [latex]x_{t+1}[/latex] is generated based on the current state [latex]x_t[/latex] using a specific algorithm (like Metropolis-Hastings). After an initial “burn-in” period, during which the chain converges from its starting point to the high-probability regions of the target distribution, the subsequent states [latex]x_t, x_{t+1}, …[/latex] can be considered as (correlated) samples from [latex]P(x)[/latex]. These samples can then be used to estimate expectations of functions [latex]f(x)[/latex] with respect to [latex]P(x)[/latex] by averaging [latex]f(x_t)[/latex] over the samples. This is particularly useful in Bayesian inference, where [latex]P(x)[/latex] is a posterior distribution of model parameters, and direct calculation is often impossible due to a complex denominator (the evidence or marginal likelihood).
علاوة على ذلك: MCMC differs from the basic Monte Carlo method in how it generates samples to estimate a desired distribution or integral. While Monte Carlo methods rely on drawing independent and identically distributed random samples directly from a target distribution or a proposal distribution, MCMC generates samples through a correlated sequence (a Markov chain) where each sample depends on the previous one. This dependency allows MCMC to efficiently explore complex, high-dimensional distributions that are difficult to sample from directly, by constructing a chain that converges to the target distribution over time. In contrast, traditional Monte Carlo methods may struggle with such problems due to inefficiencies in sampling or requiring explicit knowledge of the distribution’s form. Thus, MCMC extends Monte Carlo by harnessing dependence between samples to facilitate sampling in challenging statistical and computational settings.
UNESCO Nomenclature: 1209
- الإحصائيات
الاستخدام
الاستخدام الواسع النطاق
السلائف
- نظرية سلاسل ماركوف (أندريه ماركوف)
- أساسيات الإحصاءات البايزية (توماس بايز، بيير سيمون لابلاس)
- طريقة مونت كارلو الأصلية (أولام، فون نيومان)
- نظرية إرجوديك
التطبيقات
- الإحصاءات البايزية لتقدير المعاملات
- علم الأحياء الحسابي لاستنتاج الشجرة التطورية
- التعلم الآلي لتدريب النماذج الاحتمالية
- الفيزياء الحسابية لمحاكاة الأنظمة الجزيئية
- القياس الاقتصادي لنمذجة البيانات المالية المعقدة
أفكار ابتكارات محتملة
بسبب عمليات جمع البيانات من خلال برامج الروبوت، والتي تتجاوز حاليًا 40 ألفًا يوميًا، فإن هذا المحتوى مخصص لأعضاء المجتمع فقط.
> تسجيل الدخول < أو > سجل < (مجاني 100٪) للوصول إلى هذا، وكذلك جميع المحتويات والأدوات الأخرى المقيدة.
Related to: MCMC, Markov chain, Bayesian inference, statistics, sampling, stationary distribution, Metropolis-Hastings, Gibbs sampling, computational statistics, posterior distribution.