Logo image
A splitting method to reduce MCMC variance
Preprint   Open access

A splitting method to reduce MCMC variance

Robert J Webber, David Aristoff and Gideon Simpson
27 Nov 2020
url
https://doi.org/10.48550/arxiv.2011.13899View
Preprint (Author's original)arXiv.org - Non-exclusive license to distribute Open

Abstract

We explore whether splitting and killing methods can improve the accuracy of Markov chain Monte Carlo (MCMC) estimates of rare event probabilities, and we make three contributions. First, we prove that "weighted ensemble" is the only splitting and killing method that provides asymptotically consistent estimates when combined with MCMC. Second, we prove a lower bound on the asymptotic variance of weighted ensemble's estimates. Third, we give a constructive proof and numerical examples to show that weighted ensemble can approach this optimal variance bound, in many cases reducing the variance of MCMC estimates by multiple orders of magnitude.

Metrics

4 Record Views

Details

Logo image