English
Related papers

Related papers: Intrinsic convergence properties of entropic sampl…

200 papers

The thermodynamic properties of systems with long-range interactions is still an ongoing challenge, both from the point of view of theory as well as computer simulation. In this work we study a model system, a Coulomb gas confined inside a…

Statistical Mechanics · Physics 2020-11-04 Sergio Davis , Jalaj Jain , Biswajit Bora

We study a prototypical problem in empirical Bayes. Namely, consider a population consisting of $k$ individuals each belonging to one of $k$ types (some types can be empty). Without any structural restrictions, it is impossible to learn the…

Statistics Theory · Mathematics 2020-05-22 Soham Jana , Yury Polyanskiy , Yihong Wu

Sampling a probability distribution with an unknown normalization constant is a fundamental problem in computational science and engineering. This task may be cast as an optimization problem over all probability measures, and an initial…

Machine Learning · Statistics 2024-09-12 Yifan Chen , Daniel Zhengyu Huang , Jiaoyang Huang , Sebastian Reich , Andrew M. Stuart

It has been known for some time that the entropy of hot QCD is well reproduced by weak coupling techniques. These do not identify with perturbation theory, known to have poor convergence properties, but involve resumming the physics of hard…

High Energy Physics - Phenomenology · Physics 2007-05-23 Jean-Paul Blaizot , Andreas Ipp , Anton Rebhan , Urko Reinosa

Gradient Temporal Difference (GTD) algorithms (Sutton et al., 2008, 2009) are the first $O(d)$ ($d$ is the number features) algorithms that have convergence guarantees for off-policy learning with linear function approximation. Liu et al.…

Machine Learning · Computer Science 2023-09-06 Hengshuai Yao

Sample patterns have many uses in Computer Graphics, ranging from procedural object placement over Monte Carlo image synthesis to non-photorealistic depiction. Their properties such as discrepancy, spectra, anisotropy, or progressiveness…

Graphics · Computer Science 2018-06-19 Thomas Leimkühler , Gurprit Singh , Karol Myszkowski , Hans-Peter Seidel , Tobias Ritschel

We discuss a sampling algorithm which generates flat histogram in energy. In combination with transition matrix Monte Carlo, the density of states and derived quantities such as entropy and free energy as a function of temperature can be…

Statistical Mechanics · Physics 2009-10-31 Jian-Sheng Wang

We present a rigorous derivation for off-lattice implementations of the so-called "random-walk" algorithm recently introduced by Wang and Landau [PRL 86, 2050 (2001)]. Originally developed for discrete systems, the algorithm samples…

Statistical Mechanics · Physics 2009-11-07 M. S. Shell , P. G. Debenedetti , A. Z. Panagiotopoulos

This work studies the widely adopted ancestral sampling algorithms for auto-regressive language models, which is not widely studied in the literature. We use the quality-diversity (Q-D) trade-off to investigate three popular sampling…

Computation and Language · Computer Science 2020-09-16 Moin Nadeem , Tianxing He , Kyunghyun Cho , James Glass

Entropic measures like Shannon entropy (SE), its quantum mechanical analogue von Neumann entropy, and Kullback-Leibler divergence (KL) are key components in many tools used in physics, information theory, machine learning (ML) and quantum…

Machine Learning · Computer Science 2026-04-27 Illia Horenko , Davide Bassetti , Lukáš Pospíšil

We investigate the feasibility of early fault-tolerant quantum algorithms focusing on ground-state energy estimation problems. In particular, we examine the computation of the cumulative distribution function (CDF) of the spectral measure…

In any valid Monte Carlo sampling that realizes microcanonical property we can collect statistics for a transition matrix in energy. This matrix is used to determine the density of states, from which most of the thermodynamical averages can…

Statistical Mechanics · Physics 2009-11-10 Jian-Sheng Wang

This work studies the convergence and finite sample approximations of entropic regularized Wasserstein distances in the Hilbert space setting. Our first main result is that for Gaussian measures on an infinite-dimensional Hilbert space,…

Machine Learning · Statistics 2021-02-16 Minh Ha Quang

Stochastic gradient methods for machine learning and optimization problems are usually analyzed assuming data points are sampled \emph{with} replacement. In practice, however, sampling \emph{without} replacement is very common, easier to…

Machine Learning · Computer Science 2016-10-18 Ohad Shamir

We consider a sublattice-symmetric free-fermion model on a one-dimensional lattice with random hopping amplitudes decaying with the distance as $|t_l|\sim l^{-\alpha}$, and address the question how far an analogue of the random-singlet…

Disordered Systems and Neural Networks · Physics 2022-04-20 Róbert Juhász

Two-timescale Stochastic Approximation (SA) algorithms are widely used in Reinforcement Learning (RL). Their iterates have two parts that are updated using distinct stepsizes. In this work, we develop a novel recipe for their finite sample…

Artificial Intelligence · Computer Science 2018-06-06 Gal Dalal , Balazs Szorenyi , Gugan Thoppe , Shie Mannor

Quantum state tomography is an integral part of quantum computation and offers the starting point for the validation of various quantum devices. One of the central tasks in the field of state tomography is to reconstruct with high fidelity,…

Quantum Physics · Physics 2022-12-21 Rishabh Gupta , Manas Sajjan , Raphael D. Levine , Sabre Kais

The entanglement entropy of the ground state of a quantum lattice model with local interactions usually satisfies an area law. However, in 1D systems some violations may appear in inhomogeneous systems or in random systems. In our…

Quantum Physics · Physics 2018-05-08 Giovanni Ramírez

Within the framework of weighted integrable Hamiltonian systems, we study the long-time behavior of the associated statistical ensembles. We construct an action-dependent angular conjugacy that rectifies the nonuniform angular flow into a…

Dynamical Systems · Mathematics 2025-09-29 Xinyu Liu , Yong Li

The properties of flat minima in the empirical risk landscape of neural networks have been debated for some time. Increasing evidence suggests they possess better generalization capabilities with respect to sharp ones. First, we discuss…

‹ Prev 1 3 4 5 6 7 10 Next ›