English
Related papers

Related papers: Understanding and Improving the Wang-Landau Algori…

200 papers

This paper introduces a novel approach to enhance the performance of the stochastic gradient descent (SGD) algorithm by incorporating a modified decay step size based on $\frac{1}{\sqrt{t}}$. The proposed step size integrates a logarithmic…

Machine Learning · Computer Science 2023-09-06 M. Soheil Shamaee , S. Fathi Hafshejani

We develop a Frank-Wolfe algorithm with corrective steps, generalizing previous algorithms including blended conditional gradients, blended pairwise conditional gradients, and fully-corrective Frank-Wolfe. For this, we prove tight…

Optimization and Control · Mathematics 2026-05-21 Jannis Halbey , Seta Rakotomandimby , Mathieu Besançon , Sébastien Designolle , Sebastian Pokutta

The Self-Healing Umbrella Sampling (SHUS) algorithm is an adaptive biasing algorithm which has been proposed to efficiently sample a multimodal probability measure. We show that this method can be seen as a variant of the well-known…

Probability · Mathematics 2014-10-09 G. Fort , B. Jourdain , T. Lelievre , G. Stoltz

Combining traditional Wang-Landau sampling for multiple replica systems with an exchange of densities of states between replicas, we describe a general framework for simulations on massively parallel Petaflop supercomputers. The advantages…

Computational Physics · Physics 2014-03-13 Thomas Vogel , Ying Wai Li , Thomas Wüst , David P. Landau

We provide attainable analytical tools to estimate the error of flow-based generative models under the Wasserstein metric and to establish the optimal sampling iteration complexity bound with respect to dimension as $O(\sqrt{d})$. We show…

Machine Learning · Computer Science 2025-12-09 Xiangjun Meng , Zhongjian Wang

Randomized parallel algorithms for many fundamental problems achieve optimal linear work in expectation, but upgrading this guarantee to hold with high probability (whp) remains a recurring theoretical challenge. In this paper, we address…

Data Structures and Algorithms · Computer Science 2026-03-03 Chase Hutton , Adam Melrod

We consider a class of systems where $N$ identical particles with positions ${\bf q}_1,...,{\bf q}_N$ and momenta ${\bf p}_1,...,{\bf p}_N$ are enclosed in a box of size $L$, and exhibit the scaling $\mathcal{U}(L{\bf r}_1,...,L{\bf…

Statistical Mechanics · Physics 2019-02-22 Santosh Kumar , Girish Kumar , Rohit S. Chandramouli , Shashank Anand

In this paper, we consider several possible ways to set up Heterogeneous Multiscale Methods for the Landau-Lifshitz equation with a highly oscillatory diffusion coefficient, which can be seen as a means to modeling rapidly varying…

Numerical Analysis · Mathematics 2021-04-08 Lena Leitenmaier , Olof Runborg

In the iterative algorithm recently proposed by Waxman for solving eigenvalue problems, we point out that the convergence rate may be improved. For many non-singular symmetric potentials which vanish asymptotically, a simple analytical…

Quantum Physics · Physics 2009-11-13 W. A. Berger , H. G. Miller

In this paper, we consider large-scale linearly constrained composite convex optimization problem, whose objective is a sum of a smooth function and a possibly nonsmooth function. We propose a scalable \textbf{F}rank-\textbf{W}olfe based…

Optimization and Control · Mathematics 2015-10-13 Ya-Feng Liu , Xiangfeng Wang , Xin Liu , Shiqian Ma

In this work, we deal with an iteration method for approximating a fixed point of a contraction mapping using the Mann's algorithm under functional random errors. We first show its almost complete convergence to the fixed point by mean of…

Probability · Mathematics 2017-01-24 Bahia Barache , Idir Arab , Abdelnasser Dahmani

The Multiplicative Weights Update (MWU) method is a ubiquitous meta-algorithm that works as follows: A distribution is maintained on a certain set, and at each step the probability assigned to element $\gamma$ is multiplied by $(1 -\epsilon…

Computer Science and Game Theory · Computer Science 2017-03-06 Gerasimos Palaiopanos , Ioannis Panageas , Georgios Piliouras

We consider the long time behavior of Wong-Zakai approximations of stochastic differential equations. These piecewise smooth diffusion approximations are of great importance in many areas, such as those with ordinary differential equations…

Probability · Mathematics 2023-10-10 Pierre Del Moral , Shulan Hu , Ajay Jasra , Hamza Ruzayqat , Xinyu Wang

Concerning Numerical Stochastic Perturbation Theory, we discuss the convergence of the stochastic process (idea of the proof, features of the limit distribution, rate of convergence to equilibrium). Then we also discuss the expected…

High Energy Physics - Lattice · Physics 2015-06-25 F. Di Renzo , L. Scorzato

We study the convergence properties of a class of data augmentation algorithms targeting posterior distributions of Bayesian lasso models with log-concave likelihoods. Leveraging isoperimetric inequalities, we derive a generic convergence…

Statistics Theory · Mathematics 2025-12-24 Jingkai Cui , Qian Qin

In this work, we consider the problem of imbalanced data in a regression framework when the imbalanced phenomenon concerns continuous or discrete covariates. Such a situation can lead to biases in the estimates. In this case, we propose a…

Machine Learning · Statistics 2023-02-21 Samuel Stocksieker , Denys Pommeret , Arthur Charpentier

Monte Carlo simulations using Wang-Landau sampling are performed to study three-dimensional chains of homopolymers on a lattice. We confirm the accuracy of the method by calculating the thermodynamic properties of this system. Our results…

Statistical Mechanics · Physics 2016-08-16 A. G. Cunha Netto , C. J. Silva , A. A. Caparica , R. Dickman

We revisit the problem of estimating the parameters of a partially observed diffusion process, consisting of a hidden state process and an observed process, with a continuous time parameter. The estimation is to be done online, i.e. the…

Optimization and Control · Mathematics 2018-10-16 Simone Carlo Surace , Jean-Pascal Pfister

The rate of convergence of the distribution of the length of the longest increasing subsequence, toward the maximal eigenvalue of certain matrix ensembles, is investigated. For finite-alphabet uniform and nonuniform i.i.d. sources, a rate…

Probability · Mathematics 2012-11-30 Christian Houdré , Zsolt Talata

Bundle adjustment is the common way to solve localization and mapping. It is an iterative process in which a system of non-linear equations is solved using two optimization methods, weighted by a damping factor. In the classic approach, the…

Computer Vision and Pattern Recognition · Computer Science 2023-08-28 Amir Belder , Refael Vivanti , Ayellet Tal