Efficient stochastic simulation on discrete spaces

Using balancing functions to incorporate local target density information into Markov Chain Monte Carlo sampling schemes

Bachelor Thesis (2022)
Author(s)

B.S.P. Herben (TU Delft - Electrical Engineering, Mathematics and Computer Science)

Contributor(s)

Frank Van Der Meulen – Mentor (TU Delft - Statistics)

M. Moller – Graduation committee member (TU Delft - Numerical Analysis)

Jeroen Spandaw – Graduation committee member (TU Delft - Analysis)

Faculty
Electrical Engineering, Mathematics and Computer Science
Copyright
© 2022 Bjarne Herben
More Info
expand_more
Publication Year
2022
Language
English
Copyright
© 2022 Bjarne Herben
Graduation Date
12-07-2022
Awarding Institution
Delft University of Technology
Programme
['Applied Mathematics']
Faculty
Electrical Engineering, Mathematics and Computer Science
Reuse Rights

Other than for strictly personal use, it is not permitted to download, forward or distribute the text or part of it, without the consent of the author(s) and/or copyright holder(s), unless the work is under an open content license such as Creative Commons.

Abstract

The breadth of theoretical results on efficient Markov Chain Monte Carlo (MCMC) sampling schemes on discrete spaces is slim when compared to the available theory for MCMC sampling schemes on continuous spaces. Nonetheless, in [Zan17] a simple framework to design Metropolis-Hastings (MH) proposal kernels that incorporate local information about the target is presented. The class of functions for which the resulting MH kernels are Peskun optimal in high-dimensional regimes is characterized. We will refer to these functions as \textit{balancing functions} and to the class of resulting MH proposal kernels as \textit{pointwise informed proposals}. In [PG19], the class of balancing functions is used to construct Markov Jump Processes (MJP) on discrete state spaces. As a result, the Zanella process is constructed. In the absence of a theoretical result on the optimal balancing function to choose from the class of balancing functions, a heuristic approach is proposed using the Zanella process. To further encourage the mixing behaviour of the simulated chain, the algebraic structure of the state space is exploited to achieve non-reversible Markov chains on short to medium timescales. Simulations are performed for all the considered MCMC sampling schemes by studying the Bayesian record linkage problem.

Files

License info not available