English
Related papers

Related papers: Online Smoothing for Diffusion Processes Observed …

200 papers

Diffusion models have seen rapid adoption in robotic imitation learning, enabling autonomous execution of complex dexterous tasks. However, action synthesis is often slow, requiring many steps of iterative denoising, limiting the extent to…

Robotics · Computer Science 2024-10-14 Sigmund H. Høeg , Yilun Du , Olav Egeland

We consider applying stochastic approximation (SA) methods to solve nonsmooth variational inclusion problems. Existing studies have shown that the averaged iterates of SA methods exhibit asymptotic normality, with an optimal limiting…

Machine Learning · Statistics 2025-08-13 Liwei Jiang , Abhishek Roy , Krishna Balasubramanian , Damek Davis , Dmitriy Drusvyatskiy , Sen Na

Stochastic differential equations (SDEs) provide a flexible framework for modeling temporal dynamics in partially observed systems. A central task is to calibrate such models from data, which requires inferring latent trajectories and…

Machine Learning · Statistics 2026-05-08 Yu Wang , Arnab Ganguly

Penalized estimation methods for diffusion processes and dependent data have recently gained significant attention due to their effectiveness in handling high-dimensional stochastic systems. In this work, we introduce an adaptive…

Statistics Theory · Mathematics 2024-12-24 Alessandro De Gregorio , Dario Frisardi , Francesco Iafrate , Stefano Iacus

Recent years have witnessed significant progress in developing effective training and fast sampling techniques for diffusion models. A remarkable advancement is the use of stochastic differential equations (SDEs) and their…

Computer Vision and Pattern Recognition · Computer Science 2024-08-26 Defang Chen , Zhenyu Zhou , Jian-Ping Mei , Chunhua Shen , Chun Chen , Can Wang

We introduce methodology for real-time inference in general-state-space hidden Markov models. Specifically, we extend recent advances in controlled sequential Monte Carlo (CSMC) methods-originally proposed for offline smoothing-to the…

Computation · Statistics 2025-08-04 Liwen Xue , Axel Finke , Adam M. Johansen

We study a discrete denoising diffusion framework that integrates a sample-efficient estimator of single-site conditionals with round-robin noising and denoising dynamics for generative modeling over discrete state spaces. Rather than…

Machine Learning · Computer Science 2026-03-02 Karthik Elamvazhuthi , Abhijith Jayakumar , Andrey Y. Lokhov

This paper presents a new methodology, called AFSSEN, to simultaneously select significant predictors and produce smooth estimates in a high-dimensional function-on-scalar linear model with a sub-Gaussian errors. Outcomes are assumed to lie…

Methodology · Statistics 2019-05-27 Ardalan Mirshani , Matthew Reimherr

Recent diffusion distillation methods have achieved remarkable progress, enabling high-quality ${\sim}4$-step sampling for large-scale text-conditional image and video diffusion models. However, further reducing the number of sampling steps…

Computer Vision and Pattern Recognition · Computer Science 2026-03-04 Nikita Starodubcev , Ilya Drobyshevskiy , Denis Kuznedelev , Artem Babenko , Dmitry Baranchuk

Many spatial processes exhibit nonstationary features. We estimate a variance function from a single process observation where the errors are nonstationary and correlated. We propose a difference-based approach for a one-dimensional…

Methodology · Statistics 2016-05-24 Eunice J. Kim , Zhengyuan Zhu

This paper deals with a general class of transformation models that contains many important semiparametric regression models as special cases. It develops a self-induced smoothing for the maximum rank correlation estimator, resulting in…

Methodology · Statistics 2013-02-28 Junyi Zhang , Zhezhen Jin , Yongzhao Shao , Zhiliang Ying

Multivariate time series data appear often as realizations of non-stationary processes where the covariance matrix or spectral matrix smoothly evolve over time. Most of the current approaches estimate the time-varying spectral properties…

Methodology · Statistics 2023-12-04 Anass El Yaagoubi Bourakna , Marco Pinto , Norbert Fortin , Hernando Ombao

In this paper, we propose offline and online adaptive enrichment algorithms for the generalized multiscale approximation of a mixed finite element method with velocity elimination to solve the subsurface flow problem in high-contrast and…

Numerical Analysis · Mathematics 2020-07-20 Zhengkang He , Eric T. Chung , Jie Chen , Zhangxin Chen

We develop a domain-decomposition model reduction method for linear steady-state convection-diffusion equations with random coefficients. Of particular interest to this effort are the diffusion equations with random diffusivities, and the…

Numerical Analysis · Mathematics 2018-02-13 Lin Mu , Guannan Zhang

We study online linear optimization with matrix variables constrained by the operator norm, a setting where the geometry renders designing data-dependent and efficient adaptive algorithms challenging. The best-known adaptive regret bounds…

Optimization and Control · Mathematics 2026-02-10 Ruichen Jiang , Zakaria Mhammedi , Mehryar Mohri , Aryan Mokhtari

We analyze an online learning algorithm that adaptively combines outputs of two constituent algorithms (or the experts) running in parallel to model an unknown desired signal. This online learning algorithm is shown to achieve (and in some…

Machine Learning · Computer Science 2012-10-01 Mehmet A. Donmez , Sait Tunc , Suleyman S. Kozat

Diffusion-based generative models have demonstrated exceptional performance, yet their iterative sampling procedures remain computationally expensive. A prominent strategy to mitigate this cost is distillation, with offline distillation…

Machine Learning · Computer Science 2025-10-24 Nimrod Berman , Ilan Naiman , Moshe Eliasof , Hedi Zisling , Omri Azencot

Diffusion models achieve strong generation quality, diversity, and distribution coverage, but their performance often comes with expensive inference. In this work, we propose Stochastic Transition-Map Distillation (STMD), a teacher-free…

Machine Learning · Computer Science 2026-05-11 George Rapakoulias , Peter Garud , Lingjiong Zhu , Panagiotis Tsiotras

Stochastic differential equations are an important modeling class in many disciplines. Consequently, there exist many methods relying on various discretization and numerical integration schemes. In this paper, we propose a novel,…

Machine Learning · Computer Science 2019-05-29 Gabriele Abbati , Philippe Wenk , Michael A Osborne , Andreas Krause , Bernhard Schölkopf , Stefan Bauer

Microscopic processes on surfaces such as adsorption, desorption, diffusion and reaction of interacting particles can be simulated using kinetic Monte Carlo (kMC) algorithms. Even though kMC methods are accurate, they are computationally…

Mathematical Physics · Physics 2013-12-24 Yannis Pantazis , Markos Katsoulakis