Logo image
Kullback-Leibler Approximation for Probability Measures on Infinite Dimensional Spaces
Journal article   Open access   Peer reviewed

Kullback-Leibler Approximation for Probability Measures on Infinite Dimensional Spaces

Frank Pinski, Gideon Simpson, Andrew Stuart, Hendrik Weber and Warwick Univ., Coventry (United Kingdom)
SIAM Journal on Mathematical Analysis, v 47(6), pp 4091-4122
29 Oct 2013
url
https://doi.org/10.1137/140962802View
Published, Version of Record (VoR)CC BY V4.0 Open

Abstract

Mathematics - Probability
In a variety of applications it is important to extract information from a probability measure $\mu$ on an infinite dimensional space. Examples include the Bayesian approach to inverse problems and possibly conditioned) continuous time Markov processes. It may then be of interest to find a measure $\nu$, from within a simple class of measures, which approximates $\mu$. This problem is studied in the case where the Kullback-Leibler divergence is employed to measure the quality of the approximation. A calculus of variations viewpoint is adopted and the particular case where $\nu$ is chosen from the set of Gaussian measures is studied in detail. Basic existence and uniqueness theorems are established, together with properties of minimising sequences. Furthermore, parameterisation of the class of Gaussians through the mean and inverse covariance is introduced, the need for regularisation is explained, and a regularised minimisation is studied in detail. The calculus of variations framework resulting from this work provides the appropriate underpinning for computational algorithms.

Metrics

9 Record Views
43 citations in Scopus

Details

UN Sustainable Development Goals (SDGs)

This publication has contributed to the advancement of the following goals:

#11 Sustainable Cities and Communities

InCites Highlights

Data related to this publication, from InCites Benchmarking & Analytics tool:

Collaboration types
Domestic collaboration
International collaboration
Web of Science research areas
Mathematics, Applied
Logo image