English
Related papers

Related papers: Understanding and Improving the Wang-Landau Algori…

200 papers

We analyze the efficiency of the Wang-Landau algorithm to sample a multimodal distribution on a prototypical simple test case. We show that the exit time from a metastable state is much smaller for the Wang Landau dynamics than for the…

Numerical Analysis · Mathematics 2014-02-11 G. Fort , B. Jourdain , E. Kuhn , T Lelièvre , G. Stoltz

We present a distributional approach to theoretical analyses of reinforcement learning algorithms for constant step-sizes. We demonstrate its effectiveness by presenting simple and unified proofs of convergence for a variety of…

Machine Learning · Computer Science 2020-03-30 Philip Amortila , Doina Precup , Prakash Panangaden , Marc G. Bellemare

Given a large set $U$ where each item $a\in U$ has weight $w(a)$, we want to estimate the total weight $W=\sum_{a\in U} w(a)$ to within factor of $1\pm\varepsilon$ with some constant probability $>1/2$. Since $n=|U|$ is large, we want to do…

Data Structures and Algorithms · Computer Science 2021-10-29 Lorenzo Beretta , Jakub Tětek

In this paper we estimate the expected error of a stochastic approximation algorithm where the maximum of a function is found using finite differences of a stochastic representation of that function. An error estimate of $O(n^{-1/5})$ for…

Optimization and Control · Mathematics 2021-09-02 Miklos Rasonyi , Kinga Tikosi

We investigate the behavior of the deviation of the estimator for the density of states (DOS) with respect to the exact solution in the course of Wang-Landau and Stochastic Approximation Monte Carlo (SAMC) simulations of the two-dimensional…

Statistical Mechanics · Physics 2017-03-08 Simon Schneider , Marco Mueller , Wolfhard Janke

In this paper, we study the strong convergence of an algorithm to solve the variational inequality problem which extends(Thong et al, Numerical Algorithms. 78, 1045-1060 (2018)). We have reduced and refined some of their algorithm's…

Numerical Analysis · Mathematics 2021-05-11 Mostafa Ghadampour , Donal O'Regan , Ebrahim Soori , Ravi. p. Agarwal

Unfolding problems often arise in the context of statistical data analysis. Such problematics occur when the probability distribution of a physical quantity is to be measured, but it is randomized (smeared) by some well understood process,…

Applications · Statistics 2016-12-09 Andras Laszlo

Wang-Landau simulations offer the possibility to integrate explicitly over a collective coordinate and stochastically over the remainder of configuration space. We propose to choose the so-called "slow mode", which is responsible for large…

Statistical Mechanics · Physics 2022-11-30 Kurt Langfeld , Pavel Buividovich , P. E. L Rakow , James Roscoe

An algorithm is given for determining an optimal $b$-step approximation of weighted data, where the error is measured with respect to the $L_\infty$ norm. For data presorted by the independent variable the algorithm takes $\Theta(n + \log n…

Data Structures and Algorithms · Computer Science 2015-05-05 Quentin F. Stout

We establish the pointwise convergence of the iterative Lloyd algorithm, also known as $k$-means algorithm, when the quadratic quantization error of the starting grid (with size $N\ge 2$) is lower than the minimal quantization error with…

Probability · Mathematics 2014-01-03 Gilles Pagès , Jun Yu

The unadjusted Langevin algorithm is commonly used to sample probability distributions in extremely high-dimensional settings. However, existing analyses of the algorithm for strongly log-concave distributions suggest that, as the dimension…

Machine Learning · Statistics 2025-09-05 Yifan Chen , Xiaoou Cheng , Jonathan Niles-Weed , Jonathan Weare

We study the problem of sampling from a distribution $\target$ using the Langevin Monte Carlo algorithm and provide rate of convergences for this algorithm in terms of Wasserstein distance of order $2$. Our result holds as long as the…

Computation · Statistics 2016-07-04 Thomas Bonis

Frank-Wolfe (FW) algorithms have been often proposed over the last few years as efficient solvers for a variety of optimization problems arising in the field of Machine Learning. The ability to work with cheap projection-free iterations and…

Machine Learning · Statistics 2015-10-27 Emanuele Frandi , Ricardo Nanculef , Stefano Lodi , Claudio Sartori , Johan A. K. Suykens

Although data augmentation is a powerful technique for improving the performance of image classification tasks, it is difficult to identify the best augmentation policy. The optimal augmentation policy, which is the latent variable, cannot…

Computer Vision and Pattern Recognition · Computer Science 2023-05-05 Koichi Kuriyama

Metropolis algorithm has been extensively employed for simulating a canonical ensemble and estimating macroscopic properties of a closed system at any desired temperature. A mechanical property, like energy can be calculated by averaging…

Statistical Mechanics · Physics 2017-09-28 K. P. N. Murthy

PAGE, a stochastic algorithm introduced by Li et al. [2021], was designed to find stationary points of averages of smooth nonconvex functions. In this work, we study PAGE in the broad framework of $\tau$-weakly convex functions, which…

Optimization and Control · Mathematics 2025-09-23 Laurent Condat , Peter Richtárik

We present a time-optimal deterministic distributed algorithm for approximating a minimum weight vertex cover in hypergraphs of rank $f$. This problem is equivalent to the Minimum Weight Set Cover Problem in which the frequency of every…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-08-20 Ran Ben-Basat , Guy Even , Ken-ichi Kawarabayashi , Gregory Schwartzman

Flat histogram methods, such as Wang--Landau sampling, provide a means for high-throughput calculation of phase diagrams of atomistic/lattice model systems. Many parallelisation schemes with varying degrees of complexity have been proposed…

Computational Physics · Physics 2026-03-11 Hubert J. Naguszewski , Christopher D. Woodgate , David Quigley

We propose a simple method to estimate the central charge of the conformal field theory corresponding to a critical point of a two-dimensional lattice model from Monte Carlo simulations. The main idea is to use the Wang-Landau…

Statistical Mechanics · Physics 2017-06-19 P. A. Belov , A. A. Nazarov , A. O. Sorokin

This paper studies a distributed algorithm for constrained consensus optimization that is obtained by fusing the Arrow-Hurwicz-Uzawa primal-dual gradient method for centralized constrained optimization and the Wang-Elia method for…

Optimization and Control · Mathematics 2025-03-11 Xiaoxing Ren , Michelangelo Bin , Ivano Notarnicola , Thomas Parisini