English
Related papers

Related papers: Oracle-based Uniform Sampling from Convex Bodies

200 papers

We construct a new Markov chain Monte Carlo method on finite states with optimal choices of acceptance-rejection ratio functions. We prove that the constructed continuous time Markov jumping process has a global in-time convergence rate in…

Optimization and Control · Mathematics 2023-02-06 Wuchen Li , Linyuan Lu

Stochastic billiards can be used for approximate sampling from the boundary of a bounded convex set through the Markov Chain Monte Carlo (MCMC) paradigm. This paper studies how many steps of the underlying Markov chain are required to get…

Probability · Mathematics 2014-10-22 A. B. Dieker , Santosh Vempala

Monte Carlo methods are widely used to estimate observables in many-body quantum systems. However, conventional sampling schemes often require a large number of samples to achieve sufficient accuracy. In this work we propose the…

Quantum Physics · Physics 2026-01-29 Wenxuan Zhang , Dingzu Wang , Dario Poletti

The resolution of many large-scale inverse problems using MCMC methods requires a step of drawing samples from a high dimensional Gaussian distribution. While direct Gaussian sampling techniques, such as those based on Cholesky…

Methodology · Statistics 2015-06-22 Clément Gilavert , Saïd Moussaoui , Jérôme Idier

A method based on multicanonical Monte Carlo is applied to the calculation of large deviations in the largest eigenvalue of random matrices. The method is successfully tested with the Gaussian orthogonal ensemble (GOE), sparse random…

Statistical Mechanics · Physics 2013-05-29 Nen Saito , Yukito Iba , Koji Hukushima

Markov Chain Monte Carlo (MCMC) methods have a drawback when working with a target distribution or likelihood function that is computationally expensive to evaluate, specially when working with big data. This paper focuses on…

Machine Learning · Computer Science 2019-10-22 Asif J. Chowdhury , Gabriel Terejanu

We present a geometrically enhanced Markov chain Monte Carlo sampler for networks based on a discrete curvature measure defined on graphs. Specifically, we incorporate the concept of graph Forman curvature into sampling procedures on both…

Machine Learning · Statistics 2021-10-12 John Sigbeku , Emil Saucan , Anthea Monod

Group distributionally robust optimization (GDRO) aims to develop models that perform well across $m$ distributions simultaneously. Existing GDRO algorithms can only process a fixed number of samples per iteration, either 1 or $m$, and…

Machine Learning · Computer Science 2025-05-22 Haomin Bai , Dingzhi Yu , Shuai Li , Haipeng Luo , Lijun Zhang

The receiver operating characteristic curve is widely applied in measuring the performance of diagnostic tests. Many direct and indirect approaches have been proposed for modelling the ROC curve, and because of its tractability, the…

Methodology · Statistics 2017-10-09 Amay Cheam , Paul D. McNicholas

We study the problem of sampling from a distribution $\target$ using the Langevin Monte Carlo algorithm and provide rate of convergences for this algorithm in terms of Wasserstein distance of order $2$. Our result holds as long as the…

Computation · Statistics 2016-07-04 Thomas Bonis

We present a new approach to sample from generic binary distributions, based on an exact Hamiltonian Monte Carlo algorithm applied to a piecewise continuous augmentation of the binary distribution of interest. An extension of this idea to…

Computation · Statistics 2015-10-13 Ari Pakman , Liam Paninski

Monte Carlo methods are essential tools for Bayesian inference. Gibbs sampling is a well-known Markov chain Monte Carlo (MCMC) algorithm, extensively used in signal processing, machine learning, and statistics, employed to draw samples from…

Computation · Statistics 2017-12-21 Luca Martino , Victor Elvira , Gustau Camps-Valls

Projection-based algorithms for Constrained Online Convex Optimization (COCO) achieve optimal $\mathcal{O}(T^{1/2})$ regret guarantees but face scalability challenges due to the computational complexity of projections. To circumvent this,…

Machine Learning · Computer Science 2026-01-29 Yiyang Lu , Mohammad Pedramfar , Vaneet Aggarwal

In the field of global optimization, many existing algorithms face challenges posed by non-convex target functions and high computational complexity or unavailability of gradient information. These limitations, exacerbated by sensitivity to…

Optimization and Control · Mathematics 2023-10-16 Xinyu Zhang , Sujit Ghosh

We consider feasibility and constrained optimization problems defined over smooth and/or strongly convex sets. These notions mirror their popular function counterparts but are much less explored in the first-order optimization literature.…

Optimization and Control · Mathematics 2025-10-02 Ning Liu , Benjamin Grimmer

We consider the problem of sampling from constrained distributions, which has posed significant challenges to both non-asymptotic analysis and algorithmic design. We propose a unified framework, which is inspired by the classical mirror…

Machine Learning · Computer Science 2021-01-01 Ya-Ping Hsieh , Ali Kavis , Paul Rolland , Volkan Cevher

We propose a Markov chain Monte Carlo (MCMC) algorithm based on third-order Langevin dynamics for sampling from distributions with log-concave and smooth densities. The higher-order dynamics allow for more flexible discretization schemes,…

Machine Learning · Statistics 2020-05-27 Wenlong Mou , Yi-An Ma , Martin J. Wainwright , Peter L. Bartlett , Michael I. Jordan

Markov chain Monte Carlo algorithms are used to simulate from complex statistical distributions by way of a local exploration of these distributions. This local feature avoids heavy requests on understanding the nature of the target, but it…

Computation · Statistics 2018-04-12 Christian P. Robert , Victor Elvira , Nick Tawn , Changye Wu

Adaptive and interacting Markov chain Monte Carlo algorithms (MCMC) have been recently introduced in the literature. These novel simulation algorithms are designed to increase the simulation efficiency to sample complex distributions.…

Statistics Theory · Mathematics 2012-03-15 G. Fort , E. Moulines , P. Priouret

Bayesian methods and their implementations by means of sophisticated Monte Carlo techniques, such as Markov chain Monte Carlo (MCMC) and particle filters, have become very popular in signal processing over the last years. However, in many…

Computation · Statistics 2012-05-29 Luca Martino , Joaquin Miguez