English
Related papers

Related papers: Time-Averaged Drift Approximations are Inconsisten…

200 papers

Machine learning models struggle with generalization when encountering out-of-distribution (OOD) samples with unexpected distribution shifts. For vision tasks, recent studies have shown that test-time adaptation employing diffusion models…

Computer Vision and Pattern Recognition · Computer Science 2024-04-03 Yun-Yun Tsai , Fu-Chen Chen , Albert Y. C. Chen , Junfeng Yang , Che-Chun Su , Min Sun , Cheng-Hao Kuo

We study the estimation of time-homogeneous drift functions in multivariate stochastic differential equations with known diffusion coefficient, from multiple trajectories observed at high frequency over a fixed time horizon. We formulate…

Machine Learning · Statistics 2026-02-23 Marcos Tapia Costa , Nikolas Kantas , George Deligiannidis

We consider a simple mean reverting diffusion process, with piecewise constant drift and diffusion coefficients, discontinuous at a fixed threshold. We discuss estimation of drift and diffusion parameters from discrete observations of the…

Statistics Theory · Mathematics 2024-03-12 Sara Mazzonetto , Paolo Pigato

Diffusion-based generative models (DBGMs) perturb data to a target noise distribution and reverse this process to generate samples. The choice of noising process, or inference diffusion process, affects both likelihoods and sample quality.…

Machine Learning · Computer Science 2023-03-06 Raghav Singhal , Mark Goldstein , Rajesh Ranganath

We study efficiency of non-parametric estimation of diffusions (stochastic differential equations driven by Brownian motion) from long stationary trajectories. First, we introduce estimators based on conditional expectation which is…

Probability · Mathematics 2021-05-26 Xi Chen , Ilya Timofeyev

We propose the Fourier Adaptive Lite Diffusion Architecture (FALDA), a novel probabilistic framework for time series forecasting. First, we introduce the Diffusion Model for Residual Regression (DMRR) framework, which unifies…

Machine Learning · Computer Science 2025-05-19 Xinyan Wang , Rui Dai , Kaikui Liu , Xiangxiang Chu

Diffusion models (DMs) are a powerful generative framework that have attracted significant attention in recent years. However, the high computational cost of training DMs limits their practical applications. In this paper, we start with a…

Machine Learning · Computer Science 2024-04-12 Tianshuo Xu , Peng Mi , Ruilin Wang , Yingcong Chen

Motion prediction is a challenging problem in autonomous driving as it demands the system to comprehend stochastic dynamics and the multi-modal nature of real-world agent interactions. Diffusion models have recently risen to prominence, and…

Robotics · Computer Science 2024-05-03 Jiahui Li , Tianle Shen , Zekai Gu , Jiawei Sun , Chengran Yuan , Yuhang Han , Shuo Sun , Marcelo H. Ang

Leveraging neural networks as surrogate models for turbulence simulation is a topic of growing interest. At the same time, embodying the inherent uncertainty of simulations in the predictions of surrogate models remains very challenging.…

Fluid Dynamics · Physics 2024-10-10 Qiang Liu , Nils Thuerey

Wang et al. [PNAS 106 (2009) 15160] have found that in several systems the linear time dependence of the mean-square displacement (MSD) of diffusing colloidal particles, typical of normal diffusion, is accompanied by a non-Gaussian…

Statistical Mechanics · Physics 2015-06-19 Mykyta V. Chubynsky , Gary W. Slater

This paper addresses the nonparametric estimation of the drift function over a compact domain for a time-homogeneous diffusion process, based on high-frequency discrete observations from $N$ independent trajectories. We propose a neural…

Machine Learning · Statistics 2026-04-01 Yuzhen Zhao , Yating Liu , Marc Hoffmann

We consider the problem of nonparametric estimation of the drift and diffusion coefficients of a Stochastic Differential Equation (SDE), based on $n$ independent replicates $\left\{X_i(t)\::\: t\in [0,1]\right\}_{1 \leq i \leq n}$, observed…

Statistics Theory · Mathematics 2023-11-28 Neda Mohammadi , Leonardo Santoro , Victor M. Panaretos

The notion of concept drift refers to the phenomenon that the distribution, which is underlying the observed data, changes over time; as a consequence machine learning models may become inaccurate and need adjustment. Many unsupervised…

Machine Learning · Computer Science 2022-02-22 Fabian Hinder , Valerie Vaquet , Barbara Hammer

While many real-world data streams imply that they change frequently in a nonstationary way, most of deep learning methods optimize neural networks on training data, and this leads to severe performance degradation when dataset shift…

Machine Learning · Computer Science 2021-07-02 Wonju Lee , Seok-Yong Byun , Jooeun Kim , Minje Park , Kirill Chechil

Accurate prediction of human or vehicle trajectories with good diversity that captures their stochastic nature is an essential task for many applications. However, many trajectory prediction models produce unreasonable trajectory samples…

Computer Vision and Pattern Recognition · Computer Science 2025-02-10 Qingze , Liu , Danrui Li , Samuel S. Sohn , Sejong Yoon , Mubbasir Kapadia , Vladimir Pavlovic

While most ML models expect independent and identically distributed data, this assumption is often violated in real-world scenarios due to distribution shifts, resulting in the degradation of machine learning model performance. Until now,…

Machine Learning · Computer Science 2024-11-19 Kai Helli , David Schnurr , Noah Hollmann , Samuel Müller , Frank Hutter

Diffusion-based visuomotor policies effectively capture multimodal action distributions through iterative denoising, but their high inference latency limits real-time robotic control. Recent flow matching and consistency-based methods…

Computer Vision and Pattern Recognition · Computer Science 2026-03-13 Chongyang Xu , Yixian Zou , Ziliang Feng , Fanman Meng , Shuaicheng Liu

In the classic machine learning framework, models are trained on historical data and used to predict future values. It is assumed that the data distribution does not change over time (stationarity). However, in real-world scenarios, the…

Machine Learning · Statistics 2023-06-13 Mansour Zoubeirou A Mayaki , Michel Riveill

We derive consistency and asymptotic normality results for quasi-maximum likelihood methods for drift parameters of ergodic stochastic processes observed in discrete time in an underlying continuous-time setting. The special feature of our…

Statistics Theory · Mathematics 2021-09-20 Teppei Ogihara , Mitja Stadje

A non-parametric diffusion model with an additive fractional Brownian motion noise is considered in this work. The drift is a non-parametric function that will be estimated by two methods. On one hand, we propose a locally linear estimator…

Probability · Mathematics 2014-03-13 Bruno Saussereau