English
Related papers

Related papers: AdaAnn: Adaptive Annealing Scheduler for Probabili…

200 papers

Auxiliary variable methods such as the Parallel Tempering and the cluster Monte Carlo methods generate samples that follow a target distribution by using proposal and auxiliary distributions. In sampling from complex distributions, these…

Computation · Statistics 2012-07-16 Takamitsu Araki , Kazushi Ikeda

Modern data workflows are inherently adaptive, repeatedly querying the same dataset to refine and validate sequential decisions, but such adaptivity can lead to overfitting and invalid statistical inference. Adaptive Data Analysis (ADA)…

Machine Learning · Computer Science 2026-02-10 Joon Suk Huh

We examine the formulation and numerical treatment of dissipative particle dynamics (DPD) and momentum-conserving molecular dynamics. We show that it is possible to improve both the accuracy and the stability of DPD by employing a pairwise…

Computational Physics · Physics 2020-02-14 Benedict Leimkuhler , Xiaocheng Shang

Simulated annealing - moving from a tractable distribution to a distribution of interest via a sequence of intermediate distributions - has traditionally been used as an inexact method of handling isolated modes in Markov chain samplers.…

Computational Physics · Physics 2007-05-23 Radford M. Neal

Adaptive optimizers such as Adam have achieved great success in training large-scale models like large language models and diffusion models. However, they often generalize worse than non-adaptive methods, such as SGD on classical…

Machine Learning · Computer Science 2025-12-23 Yiheng Zhang , Shaowu Wu , Yuanzhuo Xu , Jiajun Wu , Shang Xu , Steve Drew , Xiaoguang Niu

Active domain adaptation (ADA) aims to improve the model adaptation performance by incorporating active learning (AL) techniques to label a maximally-informative subset of target samples. Conventional AL methods do not consider the…

Computer Vision and Pattern Recognition · Computer Science 2023-07-24 Duojun Huang , Jichang Li , Weikai Chen , Junshi Huang , Zhenhua Chai , Guanbin Li

The anomaly detection of time series is a hotspot of time series data mining. The own characteristics of different anomaly detectors determine the abnormal data that they are good at. There is no detector can be optimizing in all types of…

Machine Learning · Statistics 2019-07-19 Hui Ye , Xiaopeng Ma , Qingfeng Pan , Huaqiang Fang , Hang Xiang , Tongzhen Shao

Estimating the Number of Distinct Values (NDV) is fundamental for numerous data management tasks, especially within database applications. However, most existing works primarily focus on introducing new statistical or learned estimators,…

A variational method for computing conformational properties of molecules with Lennard-Jones potentials for the monomer-monomer interactions is presented. The approach is tailored to deal with angular degrees of freedom, {\it rotors}, and…

chem-ph · Physics 2016-08-31 Carsten Peterson , Ola Sommelius , Bo Söderberg

The rise of mobile devices equipped with numerous sensors, such as LiDAR and cameras, has spurred the adoption of multi-modal deep intelligence for distributed sensing tasks, such as smart cabins and driving assistance. However, the arrival…

Machine Learning · Computer Science 2024-11-01 Fenmin Wu , Sicong Liu , Kehao Zhu , Xiaochen Li , Bin Guo , Zhiwen Yu , Hongkai Wen , Xiangrui Xu , Lehao Wang , Xiangyu Liu

Guided diffusion sampling relies on approximating often intractable likelihood scores, which introduces significant noise into the sampling dynamics. We propose using adaptive moment estimation to stabilize these noisy likelihood scores…

Machine Learning · Computer Science 2026-04-24 Christian Belardi , Justin Lovelace , Kilian Q. Weinberger , Carla P. Gomes

Autoregressive generative models can estimate complex continuous data distributions, like trajectory rollouts in an RL environment, image intensities, and audio. Most state-of-the-art models discretize continuous data into several bins and…

Machine Learning · Computer Science 2022-08-04 Qiyang Li , Ajay Jain , Pieter Abbeel

Annealed Sequential Monte Carlo (ASMC) samplers are special cases of SMC samplers where the sequence of distributions can be embedded in a smooth path of distributions. Using this underlying path and a performance model based on the…

Computation · Statistics 2025-12-03 Saifuddin Syed , Alexandre Bouchard-Côté , Kevin Chern , Arnaud Doucet

Annealing algorithms such as simulated annealing and population annealing are widely used both for sampling the Gibbs distribution and solving optimization problems (i.e. finding ground states). For both statistical mechanics and…

Statistical Mechanics · Physics 2024-05-13 Amin Barzegar , Firas Hamze , Christopher Amey , Jonathan Machta

We present a novel framework for assimilating planar PIV experimental data using a variational approach to enhance the predictions of the Spalart-Allmaras RANS turbulence model. Our method applies three-dimensional constraints to the…

Fluid Dynamics · Physics 2026-01-27 Uttam Cadambi Padmanaban , Bharathram Ganapathisubramani , Sean Symon

Vanilla gradient methods are often highly sensitive to the choice of stepsize, which typically requires manual tuning. Adaptive methods alleviate this issue and have therefore become widely used. Among them, AdaGrad has been particularly…

Machine Learning · Statistics 2026-02-16 Matia Bojovic , Saverio Salzo , Massimiliano Pontil

Deep learning-based diagnostic models often suffer performance drops due to distribution shifts between training (source) and test (target) domains. Collecting and labeling sufficient target domain data for model retraining represents an…

Computer Vision and Pattern Recognition · Computer Science 2025-07-02 Yaofei Duan , Yuhao Huang , Xin Yang , Luyi Han , Xinyu Xie , Zhiyuan Zhu , Ping He , Ka-Hou Chan , Ligang Cui , Sio-Kei Im , Dong Ni , Tao Tan

This article is concerned with the mathematical analysis of a family of adaptive importance sampling algorithms applied to diffusion processes. These methods, referred to as Adaptive Biasing Potential methods, are designed to efficiently…

Probability · Mathematics 2018-05-10 Michel Benaïm , Charles-Edouard Bréhier

Modern software systems generate extensive heterogeneous log data with dynamic formats, fragmented event sequences, and varying temporal patterns, making anomaly detection both crucial and challenging. To address these complexities, we…

Artificial Intelligence · Computer Science 2025-12-17 Przemek Pospieszny , Wojciech Mormul , Karolina Szyndler , Sanjeev Kumar

Time series data analysis is a critical component in various domains such as finance, healthcare, and meteorology. Despite the progress in deep learning for time series analysis, there remains a challenge in addressing the non-stationary…

Machine Learning · Computer Science 2025-09-12 Han Yu , Peikun Guo , Akane Sano