English
Related papers

Related papers: Autoregressive Denoising Diffusion Models for Mult…

200 papers

Score-based modeling through stochastic differential equations (SDEs) has provided a new perspective on diffusion models, and demonstrated superior performance on continuous data. However, the gradient of the log-likelihood function, i.e.,…

Machine Learning · Computer Science 2023-03-07 Haoran Sun , Lijun Yu , Bo Dai , Dale Schuurmans , Hanjun Dai

Autoregressive surrogate models (or \textit{emulators}) of spatiotemporal systems provide an avenue for fast, approximate predictions, with broad applications across science and engineering. At inference time, however, these models are…

Machine Learning · Computer Science 2025-07-10 Chris Pedersen , Laure Zanna , Joan Bruna

Employing a forward diffusion chain to gradually map the data to a noise distribution, diffusion-based generative models learn how to generate the data by inferring a reverse diffusion chain. However, this approach is slow and costly…

Machine Learning · Statistics 2023-09-08 Huangjie Zheng , Pengcheng He , Weizhu Chen , Mingyuan Zhou

The probability prediction of multivariate time series is a notoriously challenging but practical task. On the one hand, the challenge is how to effectively capture the cross-series correlations between interacting time series, to achieve…

Machine Learning · Computer Science 2023-07-24 Shibo Feng , Chunyan Miao , Ke Xu , Jiaxiang Wu , Pengcheng Wu , Yang Zhang , Peilin Zhao

We provide an overview of the diffusion model as a method to generate new samples. Generative models have been recently adopted for tasks such as art generation (Stable Diffusion, Dall-E) and text generation (ChatGPT). Diffusion models in…

Machine Learning · Statistics 2025-06-13 Justin Le

Probabilistic forecasting of time series is an important matter in many applications and research fields. In order to draw conclusions from a probabilistic forecast, we must ensure that the model class used to approximate the true…

Machine Learning · Computer Science 2022-07-12 David Rügamer , Philipp F. M. Baumann , Thomas Kneib , Torsten Hothorn

We introduce a novel deep learning approach that harnesses the power of generative artificial intelligence to enhance the accuracy of contextual forecasting in sewerage systems. By developing a diffusion-based model that processes…

Machine Learning · Computer Science 2025-06-11 Nicholas A. Pearson , Francesca Cairoli , Luca Bortolussi , Davide Russo , Francesca Zanello

While diffusion models can successfully generate data and make predictions, they are predominantly designed for static images. We propose an approach for efficiently training diffusion models for probabilistic spatiotemporal forecasting,…

Machine Learning · Computer Science 2023-10-12 Salva Rühling Cachay , Bo Zhao , Hailey Joren , Rose Yu

We explain how to use diffusion models to learn inverse renormalization group flows of statistical and quantum field theories. Diffusion models are a class of machine learning models which have been used to generate samples from complex…

High Energy Physics - Theory · Physics 2023-09-07 Jordan Cotler , Semon Rezchikov

Recently, research on denoising diffusion models has expanded its application to the field of image restoration. Traditional diffusion-based image restoration methods utilize degraded images as conditional input to effectively guide the…

Computer Vision and Pattern Recognition · Computer Science 2024-10-25 Zhenning Shi , Haoshuai Zheng , Chen Xu , Changsheng Dong , Bin Pan , Xueshuo Xie , Along He , Tao Li , Huazhu Fu

In this work, we propose DiffWave, a versatile diffusion probabilistic model for conditional and unconditional waveform generation. The model is non-autoregressive, and converts the white noise signal into structured waveform through a…

Audio and Speech Processing · Electrical Eng. & Systems 2021-04-01 Zhifeng Kong , Wei Ping , Jiaji Huang , Kexin Zhao , Bryan Catanzaro

Diffusion-based graph generative models have recently obtained promising results for graph generation. However, existing diffusion-based graph generative models are mostly one-shot generative models that apply Gaussian diffusion in the…

Artificial Intelligence · Computer Science 2023-07-19 Lingkai Kong , Jiaming Cui , Haotian Sun , Yuchen Zhuang , B. Aditya Prakash , Chao Zhang

In this work, we initiate the idea of using denoising diffusion models to learn priors for online decision making problems. Our special focus is on the meta-learning for bandit framework, with the goal of learning a strategy that performs…

Machine Learning · Computer Science 2023-01-31 Yu-Guan Hsieh , Shiva Prasad Kasiviswanathan , Branislav Kveton , Patrick Blöbaum

In this work, we propose an approach to generalize denoising diffusion probabilistic models for stock market predictions and portfolio management. Present works have demonstrated the efficacy of modeling interstock relations for market…

Machine Learning · Computer Science 2024-03-22 Divyanshu Daiya , Monika Yadav , Harshit Singh Rao

Diffusion and flow-based models have enabled significant progress in generation tasks across various modalities and have recently found applications in predictive learning. However, unlike typical generation tasks that encourage sample…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Yu Zhang , Xingzhuo Guo , Haoran Xu , Jialong Wu , Mingsheng Long

Diffusion models have recently been increasingly applied to temporal data such as video, fluid mechanics simulations, or climate data. These methods generally treat subsequent frames equally regarding the amount of noise in the diffusion…

Machine Learning · Computer Science 2024-09-10 David Ruhe , Jonathan Heek , Tim Salimans , Emiel Hoogeboom

Denoising diffusion models are a recent class of generative models exhibiting state-of-the-art performance in image and audio synthesis. Such models approximate the time-reversal of a forward noising process from a target distribution to a…

Machine Learning · Statistics 2023-05-30 Valentin De Bortoli

Recent years witnessed the development of powerful generative models based on flows, diffusion or autoregressive neural networks, achieving remarkable success in generating data from examples with applications in a broad range of areas. A…

Disordered Systems and Neural Networks · Physics 2024-07-22 Davide Ghio , Yatin Dandi , Florent Krzakala , Lenka Zdeborová

Accurate noise modelling is important for training of deep learning reconstruction algorithms. While noise models are well known for traditional imaging techniques, the noise distribution of a novel sensor may be difficult to determine a…

Machine Learning · Computer Science 2018-07-11 Felix Horger , Tobias Würfl , Vincent Christlein , Andreas Maier

Diffusion models represent a class of generative models that produce data by denoising a sample corrupted by white noise. Despite the success of diffusion models in computer vision, audio synthesis, and point cloud generation, so far they…

Statistical Mechanics · Physics 2025-01-17 Kanta Masuki , Yuto Ashida