English
Related papers

Related papers: Time-Averaged Drift Approximations are Inconsisten…

200 papers

Drift analysis is one of the state-of-the-art techniques for the runtime analysis of randomized search heuristics (RSHs) such as evolutionary algorithms (EAs), simulated annealing etc. The vast majority of existing drift theorems yield…

Neural and Evolutionary Computing · Computer Science 2018-05-30 Per Kristian Lehre , Carsten Witt

Deploying deep models in real-world scenarios remains challenging due to significant performance drops under distribution shifts between training and deployment environments. Test-Time Adaptation (TTA) has recently emerged as a promising…

Machine Learning · Computer Science 2025-12-01 Zixian Su , Jingwei Guo , Xi Yang , Qiufeng Wang , Kaizhu Huang

Diffusion models are powerful generative models that map noise to data using stochastic processes. However, for many applications such as image editing, the model input comes from a distribution that is not random noise. As such, diffusion…

Computer Vision and Pattern Recognition · Computer Science 2023-12-06 Linqi Zhou , Aaron Lou , Samar Khanna , Stefano Ermon

The molecular motion in heterogeneous media displays anomalous diffusion by the mean-squared displacement $\langle X^2(t) \rangle = 2 D t^\alpha$. Motivated by experiments reporting populations of the anomalous diffusion parameters $\alpha$…

Biological Physics · Physics 2025-10-09 Yann Lanoiselée , Gianni Pagnini , Agnieszka Wyłomańska

Aligning large language models (LLMs) to human preferences typically relies on aggregating pooled feedback into a single reward model. However, this standard approach assumes that all labelers share the same underlying preferences, ignoring…

Machine Learning · Computer Science 2026-05-11 Federico Echenique , Alireza Fallah , Baihe Huang , Michael I. Jordan

A major bottleneck of standard auto-regressive large language models is that their inference process is inherently sequential, resulting in very long and costly inference times. To circumvent this, practitioners proposed a class of language…

Machine Learning · Computer Science 2025-11-11 Sitan Chen , Kevin Cong , Jerry Li

Online updating of time series forecasting models aims to tackle the challenge of concept drifting by adjusting forecasting models based on streaming data. While numerous algorithms have been developed, most of them focus on model design…

Machine Learning · Computer Science 2024-03-25 YiFan Zhang , Weiqi Chen , Zhaoyang Zhu , Dalin Qin , Liang Sun , Xue Wang , Qingsong Wen , Zhang Zhang , Liang Wang , Rong Jin

Machine learning (ML) algorithms deployed in real-world environments are often faced with the challenge of adapting models to concept drift, where the task data distributions are shifting over time. The problem becomes even more difficult…

Machine Learning · Computer Science 2026-01-19 Adam Piaseczny , Md Kamran Chowdhury Shisher , Shiqiang Wang , Christopher G. Brinton

Diffusion models have shown promise in forecasting future data from multivariate time series. However, few existing methods account for recurring structures, or patterns, that appear within the data. We present Pattern-Guided Diffusion…

Machine Learning · Computer Science 2025-12-17 Vivian Lin , Kuk Jin Jang , Wenwen Si , Insup Lee

Data-driven predictive analytics are in use today across a number of industrial applications, but further integration is hindered by the requirement of similarity among model training and test data distributions. This paper addresses the…

Machine Learning · Computer Science 2017-10-20 Yunwen Xu , Rui Xu , Weizhong Yan , Paul Ardis

Data-driven models (DDM) based on machine learning and other AI techniques play an important role in the perception of increasingly autonomous systems. Due to the merely implicit definition of their behavior mainly based on the data used…

Software Engineering · Computer Science 2022-06-15 Janek Groß , Rasmus Adler , Michael Kläs , Jan Reich , Lisa Jöckel , Roman Gansch

Scaling by training on large datasets has been shown to enhance the quality and fidelity of image generation and manipulation with diffusion models; however, such large datasets are not always accessible in medical imaging due to cost and…

Computer Vision and Pattern Recognition · Computer Science 2025-04-14 Yousef Yeganeh , Azade Farshad , Ioannis Charisiadis , Marta Hasny , Martin Hartenberger , Björn Ommer , Nassir Navab , Ehsan Adeli

In the pursuit of autonomous learning systems, the foundational assumption of stationarity, the premise that data distributions and model behaviors remain constant, is fundamentally untenable. Historically, the research community has…

Machine Learning · Computer Science 2026-05-05 Xiaoyu Yang , En Yu , Jie Lu

Test-time adaptation (TTA) is an effective approach to mitigate performance degradation of trained models when encountering input distribution shifts at test time. However, existing TTA methods often suffer significant performance drops…

Machine Learning · Computer Science 2025-02-06 Minguk Jang , Hye Won Chung

Timeseries generated from a dynamical source can often be modeled as sample paths of a stochastic differential equation (SDE). The timeseries thus reflects the motion of a particle which flows along the direction provided by a drift /…

Dynamical Systems · Mathematics 2025-11-03 Suddhasattwa Das

Test-time adaptation (TTA) seeks to tackle potential distribution shifts between training and test data by adapting a given model w.r.t. any test sample. Although recent TTA has shown promising performance, we still face two key challenges:…

Machine Learning · Computer Science 2025-08-27 Mingkui Tan , Guohao Chen , Jiaxiang Wu , Yifan Zhang , Yaofo Chen , Peilin Zhao , Shuaicheng Niu

The mean-squared displacement (MSD) is an averaged quantity widely used to assess anomalous diffusion. In many cases, such as molecular motors with finite processivity, dynamics of the system of interest produce trajectories of varying…

Statistical Mechanics · Physics 2020-10-07 Chapin S. Korosec , David A. Sivak , Nancy R. Forde

Large Language Models (LLMs) excel at single-turn tasks such as instruction following and summarization, yet real-world deployments require sustained multi-turn interactions where user goals and conversational context persist and evolve. A…

Computation and Language · Computer Science 2025-11-25 Vardhan Dongre , Ryan A. Rossi , Viet Dac Lai , David Seunghyun Yoon , Dilek Hakkani-Tür , Trung Bui

Spatiotemporal prediction over graphs (STPG) is challenging, because real-world data suffers from the Out-of-Distribution (OOD) generalization problem, where test data follow different distributions from training ones. To address this…

Machine Learning · Computer Science 2025-01-03 Zhaobin Mo , Haotian Xiang , Xuan Di

Data Drift is the phenomenon where the generating model behind the data changes over time. Due to data drift, any model built on the past training data becomes less relevant and inaccurate over time. Thus, detecting and controlling for data…

Machine Learning · Computer Science 2025-04-29 Subhadip Bandyopadhyay , Joy Bose , Sujoy Roy Chowdhury