English
Related papers

Related papers: Real-time Inference and Extrapolation via a Diffus…

200 papers

Accurate long-term traffic forecasting remains a critical challenge in intelligent transportation systems, particularly when predicting high-frequency traffic phenomena such as shock waves and congestion boundaries over extended rollout…

Machine Learning · Computer Science 2025-08-28 Owais Ahmad , Milad Ramezankhani , Anirudh Deodhar

Inference-time alignment provides an efficient alternative for aligning LLMs with humans. However, these approaches still face challenges, such as limited scalability due to policy-specific value functions and latency during the inference…

Computation and Language · Computer Science 2025-05-27 Ruizhe Chen , Wenhao Chai , Zhifei Yang , Xiaotian Zhang , Joey Tianyi Zhou , Tony Quek , Soujanya Poria , Zuozhu Liu

Simulating and controlling physical systems described by partial differential equations (PDEs) are crucial tasks across science and engineering. Recently, diffusion generative models have emerged as a competitive class of methods for these…

Machine Learning · Computer Science 2025-06-27 Peiyan Hu , Rui Wang , Xiang Zheng , Tao Zhang , Haodong Feng , Ruiqi Feng , Long Wei , Yue Wang , Zhi-Ming Ma , Tailin Wu

While generative modeling on time series facilitates more capable and flexible probabilistic forecasting, existing generative time series models do not address the multi-dimensional properties of time series data well. The prevalent…

Machine Learning · Computer Science 2026-02-09 Haoran Zhang , Haixuan Liu , Yong Liu , Yunzhong Qiu , Yuxuan Wang , Jianmin Wang , Mingsheng Long

Diffusion models have emerged as powerful generative priors for solving PDE-constrained inverse problems. Compared to end-to-end approaches relying on massive paired datasets, explicitly decoupling the prior distribution of physical…

Numerical Analysis · Mathematics 2026-04-23 Haibo Liu , Guang Lin

Efficient inference is a critical challenge in deep generative modeling, particularly as diffusion models grow in capacity and complexity. While increased complexity often improves accuracy, it raises compute costs, latency, and memory…

Machine Learning · Computer Science 2025-09-24 Siu Hang Ho , Prasad Ganesan , Nguyen Duong , Daniel Schlabig

This paper explores the efficacy of diffusion-based generative models as neural operators for partial differential equations (PDEs). Neural operators are neural networks that learn a mapping from the parameter space to the solution space of…

Machine Learning · Computer Science 2024-12-17 Katsiaryna Haitsiukevich , Onur Poyraz , Pekka Marttinen , Alexander Ilin

Diffusion models have found widespread adoption in various areas. However, their sampling process is slow because it requires hundreds to thousands of network evaluations to emulate a continuous process defined by differential equations. In…

Machine Learning · Computer Science 2023-07-25 Hongkai Zheng , Weili Nie , Arash Vahdat , Kamyar Azizzadenesheli , Anima Anandkumar

Tabular data generation has recently attracted a growing interest due to its different application scenarios. However, generating time series of tabular data, where each element of the series depends on the others, remains a largely…

Machine Learning · Computer Science 2025-04-21 Fabrizio Garuti , Enver Sangineto , Simone Luetto , Lorenzo Forni , Rita Cucchiara

Diffusion transformers (DiTs) struggle to generate images at resolutions higher than their training resolutions. The primary obstacle is that the explicit positional encodings(PE), such as RoPE, need extrapolating to unseen positions which…

Computer Vision and Pattern Recognition · Computer Science 2025-09-25 Shen Zhang , Siyuan Liang , Yaning Tan , Zhaowei Chen , Linze Li , Ge Wu , Yuhao Chen , Shuheng Li , Zhenyu Zhao , Caihua Chen , Jiajun Liang , Yao Tang

Operator learning for time-dependent partial differential equations (PDEs) has seen rapid progress in recent years, enabling efficient approximation of complex spatiotemporal dynamics. However, most existing methods rely on fixed time step…

Machine Learning · Computer Science 2025-10-07 Zhikai Wu , Sifan Wang , Shiyang Zhang , Sizhuang He , Min Zhu , Anran Jiao , Lu Lu , David van Dijk

We propose DiTTO, a novel diffusion-based framework for generating realistic, precisely configurable, and diverse multi-device storage traces. Leveraging advanced diffusion techniques, DiTTO enables the synthesis of high-fidelity continuous…

Computer Vision and Pattern Recognition · Computer Science 2025-09-04 Seohyun Kim , Junyoung Lee , Jongho Park , Jinhyung Koo , Sungjin Lee , Yeseong Kim

We present a new scientific machine learning method that learns from data a computationally inexpensive surrogate model for predicting the evolution of a system governed by a time-dependent nonlinear partial differential equation (PDE), an…

Numerical Analysis · Mathematics 2022-02-28 Elizabeth Qian , Ionut-Gabriel Farcas , Karen Willcox

Diffusion models have gained attention in speech enhancement tasks, providing an alternative to conventional discriminative methods. However, research on target speech extraction under multi-speaker noisy conditions remains relatively…

Audio and Speech Processing · Electrical Eng. & Systems 2024-10-08 Leying Zhang , Yao Qian , Linfeng Yu , Heming Wang , Hemin Yang , Long Zhou , Shujie Liu , Yanmin Qian

With the development of Artificial Intelligence, numerous real-world tasks have been accomplished using technology integrated with deep learning. To achieve optimal performance, deep neural networks typically require large volumes of data…

Machine Learning · Computer Science 2025-05-09 Yuren Zhang , Zhongnan Pu , Lei Jing

For imitation learning algorithms to scale to real-world challenges, they must handle high-dimensional observations, offline learning, and policy-induced covariate-shift. We propose DITTO, an offline imitation learning algorithm which…

Machine Learning · Computer Science 2025-03-24 Branton DeMoss , Paul Duckworth , Jakob Foerster , Nick Hawes , Ingmar Posner

Video-diffusion models have recently set the standard in video generation, inpainting, and domain translation thanks to their training stability and high perceptual fidelity. Building on these strengths, we repurpose conditional video…

Computational Engineering, Finance, and Science · Computer Science 2025-07-28 Jaewan Park , Farid Ahmed , Kazuma Kobayashi , Seid Koric , Syed Bahauddin Alam , Iwona Jasiuk , Diab Abueidda

Fast and accurate surrogates for physics-driven partial differential equations (PDEs) are essential in fields such as aerodynamics, porous media design, and flow control. However, many transformer-based models and existing neural operators…

Machine Learning · Computer Science 2026-01-27 Prajwal Chauhan , Salah Eddine Choutri , Saif Eddin Jabari

Transfer learning (TL) enables the transfer of knowledge gained in learning to perform one task (source) to a related but different task (target), hence addressing the expense of data acquisition and labeling, potential computational power…

Machine Learning · Computer Science 2022-12-20 Somdatta Goswami , Katiana Kontolati , Michael D. Shields , George Em Karniadakis

We propose a new formulation of temporal action detection (TAD) with denoising diffusion, DiffTAD in short. Taking as input random temporal proposals, it can yield action proposals accurately given an untrimmed long video. This presents a…

Computer Vision and Pattern Recognition · Computer Science 2023-07-17 Sauradip Nag , Xiatian Zhu , Jiankang Deng , Yi-Zhe Song , Tao Xiang