English
Related papers

Related papers: Intrinsic convergence properties of entropic sampl…

200 papers

Infinite-dimensional compressed sensing deals with the recovery of analog signals (functions) from linear measurements, often in the form of integral transforms such as the Fourier transform. This framework is well-suited to many real-world…

Information Theory · Computer Science 2021-05-25 Ben Adcock , Vegard Antun , Anders C. Hansen

The concept of probabilistic values, such as Beta Shapley values and weighted Banzhaf values, has gained recent attention in applications like feature attribution and data valuation. However, exact computation of these values is often…

Machine Learning · Computer Science 2024-11-01 Weida Li , Yaoliang Yu

An accelerated class of adaptive scheme of iterative thresholding algorithms is studied analytically and empirically. They are based on the feedback mechanism of the null space tuning techniques (NST+HT+FB). The main contribution of this…

Information Theory · Computer Science 2020-05-15 Ningning Han , Shidong Li , Zhanjie Song

The supervised learning problem to determine a neural network approximation $\mathbb{R}^d\ni x\mapsto\sum_{k=1}^K\hat\beta_k e^{{\mathrm{i}}\omega_k\cdot x}$ with one hidden layer is studied as a random Fourier features algorithm. The…

Numerical Analysis · Mathematics 2020-11-30 Aku Kammonen , Jonas Kiessling , Petr Plecháč , Mattias Sandberg , Anders Szepessy

We introduce Wedge Sampling, a new non-adaptive sampling scheme for low-rank tensor completion. We study recovery of an order-$k$ low-rank tensor of dimension $n \times \cdots \times n$ from a subset of its entries. Unlike the standard…

Machine Learning · Statistics 2026-02-06 Hengrui Luo , Anna Ma , Ludovic Stephan , Yizhe Zhu

Time-parallel algorithms, such as Parareal, are well-understood for linear problems, but their convergence analysis for nonlinear, chaotic systems remains limited. This paper introduces a new theoretical framework for analysing…

Numerical Analysis · Mathematics 2026-04-02 Giancarlo Antonino Antonucci , Raphael Andreas Hauser , Debasmita Samaddar , James Buchanan

Autoregressive (AR) architectures have achieved significant successes in LLMs, inspiring explorations for video generation. In LLMs, top-p/top-k sampling strategies work exceptionally well: language tokens have high semantic density and low…

Computer Vision and Pattern Recognition · Computer Science 2026-02-02 Yizhao Han , Tianxing Shi , Zhao Wang , Zifan Xu , Zhiyuan Pu , Mingxiao Li , Qian Zhang , Wei Yin , Xiao-Xiao Long

Test time adaptation (TTA) equips deep learning models to handle unseen test data that deviates from the training distribution, even when source data is inaccessible. While traditional TTA methods often rely on entropy as a confidence…

Machine Learning · Computer Science 2024-09-17 Afshar Shamsi , Rejisa Becirovic , Ahmadreza Argha , Ehsan Abbasnejad , Hamid Alinejad-Rokny , Arash Mohammadi

Tensor network states are powerful variational ans\"atze for many-body ground states of quantum lattice models. The use of Monte Carlo sampling techniques in tensor network approaches significantly reduces the cost of tensor contractions,…

Strongly Correlated Electrons · Physics 2012-05-01 Andrew J. Ferris , Guifre Vidal

Understanding the asymptotic behavior of physical quantities in the thermodynamic limit is a fundamental problem in statistical mechanics. In this paper, we study how fast the eigenstate expectation values of a local operator converge to a…

Mathematical Physics · Physics 2023-07-04 Yichen Huang

We present a simple and efficient approximation scheme which greatly facilitates extension of Wang-Landau sampling (or similar techniques) in large systems for the estimation of critical behavior. The method, presented in an algorithmic…

Statistical Mechanics · Physics 2007-05-23 A. Malakis , A. Peratzakis , N. G. Fytas

Most diffusion models assume that the reverse process adheres to a Gaussian distribution. However, this approximation has not been rigorously validated, especially at singularities, where t=0 and t=1. Improperly dealing with such…

Computer Vision and Pattern Recognition · Computer Science 2024-03-21 Pengze Zhang , Hubery Yin , Chen Li , Xiaohua Xie

We extend the study of finite-entanglement scaling from one-dimensional gapless models to two-dimensional systems with a Fermi surface. In particular, we show that the entanglement entropy of a contractible spatial region with linear size…

Strongly Correlated Electrons · Physics 2024-01-11 Quinten Mortier , Ming-Hao Li , Jutho Haegeman , Nick Bultinck

Flow Matching has become a cornerstone of modern generative models like Stable Diffusion 3, largely due to the efficiency of its Rectified Flow (RF) variant. The success of RF hinges on iteratively learning straight trajectories, pushing…

Machine Learning · Computer Science 2026-05-19 Vansh Bansal , Saptarshi Roy , Purnamrita Sarkar , Alessandro Rinaldo

The performance of flow matching and diffusion models can be greatly improved at inference time using reward alignment algorithms, yet efficiency remains a major limitation. While several algorithms were proposed, we demonstrate that a…

Machine Learning · Computer Science 2026-02-12 Peter Holderrieth , Uriel Singer , Tommi Jaakkola , Ricky T. Q. Chen , Yaron Lipman , Brian Karrer

Finding parameters that minimise a loss function is at the core of many machine learning methods. The Stochastic Gradient Descent algorithm is widely used and delivers state of the art results for many problems. Nonetheless, Stochastic…

Machine Learning · Computer Science 2018-09-26 Yao Zhang , Andrew M. Saxe , Madhu S. Advani , Alpha A. Lee

We give a Markov chain based perfect sampler for uniform sampling solutions of constraint satisfaction problems (CSP). Under some mild Lov\'asz local lemma conditions where each constraint of the CSP has a small number of forbidden local…

Data Structures and Algorithms · Computer Science 2021-07-09 Kun He , Xiaoming Sun , Kewen Wu

Entropy and free-energy estimation are key in thermodynamic characterization of simulated systems ranging from spin models through polymers, colloids, protein structure, and drug-design. Current techniques suffer from being model specific,…

Statistical Mechanics · Physics 2019-10-30 Ram Avinery , Micha Kornreich , Roy Beck

We propose a flat-histogram Monte Carlo method to efficiently sample fractal landscapes such as escape time functions of open chaotic systems. This is achieved by using a random-walk step which depends on the height of the landscape via the…

Statistical Mechanics · Physics 2013-05-31 Jorge C. Leitão , João M. Viana Parente Lopes , Eduardo G. Altmann

Density level sets can be estimated using plug-in methods, excess mass algorithms or a hybrid of the two previous methodologies. The plug-in algorithms are based on replacing the unknown density by some nonparametric estimator, usually the…

Statistics Theory · Mathematics 2016-11-26 A. Rodríguez-Casal , P. Saavedra-Nieves
‹ Prev 1 4 5 6 7 8 10 Next ›