English
Related papers

Related papers: Online Smoothing for Diffusion Processes Observed …

200 papers

We consider the problem of statistical inference for a class of partially-observed diffusion processes, with discretely-observed data and finite-dimensional parameters. We construct unbiased estimators of the score function, i.e. the…

Methodology · Statistics 2021-05-12 Jeremy Heng , Jeremie Houssineau , Ajay Jasra

We introduce a novel algorithm for online estimation of acoustic impulse responses (AIRs) which allows for fast convergence by exploiting prior knowledge about the fundamental structure of AIRs. The proposed method assumes that the…

Audio and Speech Processing · Electrical Eng. & Systems 2021-05-10 Thomas Haubner , Andreas Brendel , Walter Kellermann

In many problems in machine learning and operations research, we need to optimize a function whose input is a random variable or a probability density function, i.e. to solve optimization problems in an infinite dimensional space. On the…

Machine Learning · Computer Science 2019-02-11 Changbo Zhu , Huan Xu

Real-time forecasting from streaming data poses critical challenges: handling non-stationary dynamics, operating under strict computational limits, and adapting rapidly without catastrophic forgetting. However, many existing approaches face…

Machine Learning · Computer Science 2025-10-20 Christopher Salazar , Krithika Manohar , Ashis G. Banerjee

Diffusion Transformers (DiT) have emerged as powerful generative models for various tasks, including image, video, and speech synthesis. However, their inference process remains computationally expensive due to the repeated evaluation of…

Machine Learning · Computer Science 2025-05-23 Joseph Liu , Joshua Geddes , Ziyu Guo , Haomiao Jiang , Mahesh Kumar Nandwana

We propose an online algorithm for tracking a multidimensional time-varying parameter of a time series, which is also allowed to be a predictable process with respect to the underlying time series. The algorithm is driven by a gain…

Statistics Theory · Mathematics 2013-11-15 Eduard Belitser , Paulo Serra

Discrete diffusion models have emerged as powerful tools for high-quality data generation. Despite their success in discrete spaces, such as text generation tasks, the acceleration of discrete diffusion models remains under-explored. In…

Machine Learning · Computer Science 2024-12-09 Zixiang Chen , Huizhuo Yuan , Yongqian Li , Yiwen Kou , Junkai Zhang , Quanquan Gu

In this work, we build upon the recently introduced Multiscale Robin Coupled Method with Oversampling and Smoothing (MRCM-OS) to develop two highly efficient iterative multiscale methods. The MRCM-OS methodology demonstrated the ability to…

Numerical Analysis · Mathematics 2025-02-25 Dilong Zhou , Rafael T. Guiraldello , Felipe Pereira

The aim of this paper is to introduce a new computational fluid dynamics method to be called unsmoothed particle hydrodynamics SPH$-i$ which makes few assumptions and makes no assumption beyond the Navier-Stokes equations. The most…

Fluid Dynamics · Physics 2018-08-01 Kalale Chola

Diffusion models have achieved state-of-the-art performance, demonstrating remarkable generalisation capabilities across diverse domains. However, the mechanisms underpinning these strong capabilities remain only partially understood. A…

Machine Learning · Computer Science 2025-10-03 Tyler Farghly , Peter Potaptchik , Samuel Howard , George Deligiannidis , Jakiw Pidstrigach

Existing high-dimensional online learning methods often face the challenge that their error bounds, or per-batch sample sizes, diverge as the number of data batches increases. To address this issue, we propose an asynchronous decomposition…

Machine Learning · Statistics 2026-03-24 Shixiang Liu , Zhifan Li , Hanming Yang , Jianxin Yin

We deal with the problem of gradient estimation for stochastic differentiable relaxations of algorithms, operators, simulators, and other non-differentiable functions. Stochastic smoothing conventionally perturbs the input of a…

Machine Learning · Computer Science 2024-10-11 Felix Petersen , Christian Borgelt , Aashwin Mishra , Stefano Ermon

In various practical situations, we encounter data from stochastic processes which can be efficiently modelled by an appropriate parametric model for subsequent statistical analyses. Unfortunately, the most common estimation and inference…

Methodology · Statistics 2022-04-12 Rohan Hore , Abhik Ghosh

Screening feature selection methods are often used as a preprocessing step for reducing the number of variables before training step. Traditional screening methods only focus on dealing with complete high dimensional datasets. Modern…

Machine Learning · Statistics 2021-04-08 Mingyuan Wang , Adrian Barbu

We develop a Bayesian inference method for diffusions observed discretely and with noise, which is free of discretisation bias. Unlike existing unbiased inference methods, our method does not rely on exact simulation techniques. Instead,…

Methodology · Statistics 2021-03-10 Neil K. Chada , Jordan Franks , Ajay Jasra , Kody J. H. Law , Matti Vihola

Traditional static functional data analysis is facing new challenges due to streaming data, where data constantly flow in. A major challenge is that storing such an ever-increasing amount of data in memory is nearly impossible. In addition,…

Methodology · Statistics 2023-10-11 Jinhan Xie , Enze Shi , Peijun Sang , Zuofeng Shang , Bei Jiang , Linglong Kong

This paper presents an algorithm for Monte Carlo fixed-lag smoothing in state-space models defined by a diffusion process observed through noisy discrete-time measurements. Based on a particles approximation of the filtering and smoothing…

Applications · Statistics 2015-06-17 Anne Cuzol , Etienne Mémin

Bayesian inference for nonlinear diffusions, observed at discrete times, is a challenging task that has prompted the development of a number of algorithms, mainly within the computational statistics community. We propose a new direction,…

Computation · Statistics 2022-01-11 Matthew M. Graham , Alexandre H. Thiery , Alexandros Beskos

Online and stochastic gradient methods have emerged as potent tools in large scale optimization with both smooth convex and nonsmooth convex problems from the classes $C^{1,1}(\reals^p)$ and $C^{1,0}(\reals^p)$ respectively. However to our…

Numerical Analysis · Mathematics 2014-10-30 Ziqiang Shi , Rujie Liu

Data in modern economic and financial applications often arrive as a stream, requiring models and inference to be updated in real time -- yet most semiparametric methods remain batch-based and computationally impractical in large-scale…

Econometrics · Economics 2026-03-10 Xiaohong Chen , Elie Tamer , Qingsong Yao