English
Related papers

Related papers: Generative Time Series Forecasting with Diffusion,…

200 papers

Variable selection for high-dimensional, highly correlated data has long been a challenging problem, often yielding unstable and unreliable models. We propose a resample-aggregate framework that exploits diffusion models' ability to…

Methodology · Statistics 2025-08-20 Minjie Wang , Xiaotong Shen , Wei Pan

Deep Gaussian processes (DGPs) provide a robust paradigm for Bayesian deep learning. In DGPs, a set of sparse integration locations called inducing points are selected to approximate the posterior distribution of the model. This is done to…

Machine Learning · Computer Science 2024-07-25 Jian Xu , Delu Zeng , John Paisley

Diffusion-based generative models (DGMs) have recently attracted attention in speech enhancement research (SE) as previous works showed a remarkable generalization capability. However, DGMs are also computationally intensive, as they…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-21 Chenda Li , Samuele Cornell , Shinji Watanabe , Yanmin Qian

Denoising of time domain data is a crucial task for many applications such as communication, translation, virtual assistants etc. For this task, a combination of a recurrent neural net (RNNs) with a Denoising Auto-Encoder (DAEs) has shown…

Cosmology and Nongalactic Astrophysics · Physics 2019-05-27 Hongyu Shen , Daniel George , E. A. Huerta , Zhizhen Zhao

The vast applications of deep generative models are anchored in three core capabilities -- generating new instances, reconstructing inputs, and learning compact representations -- across various data types, such as discrete text/protein…

Machine Learning · Computer Science 2024-06-06 Guangyi Liu , Yu Wang , Zeyu Feng , Qiyu Wu , Liping Tang , Yuan Gao , Zhen Li , Shuguang Cui , Julian McAuley , Zichao Yang , Eric P. Xing , Zhiting Hu

Denoising diffusion models (DDMs) offer a promising generative approach for combinatorial optimization, yet they often lack the robust exploration capabilities of traditional metaheuristics like evolutionary algorithms (EAs). We propose a…

Neural and Evolutionary Computing · Computer Science 2025-10-13 Joan Salvà Soler , Günther R. Raidl

Learning disentangled representations leads to interpretable models and facilitates data generation with style transfer, which has been extensively studied on static data such as images in an unsupervised learning framework. However, only a…

Machine Learning · Computer Science 2021-01-20 Jun Han , Martin Renqiang Min , Ligong Han , Li Erran Li , Xuan Zhang

By framing reinforcement learning as a sequence modeling problem, recent work has enabled the use of generative models, such as diffusion models, for planning. While these models are effective in predicting long-horizon state trajectories…

While generative models have shown great success in generating high-dimensional samples conditional on low-dimensional descriptors (learning e.g. stroke thickness in MNIST, hair color in CelebA, or speaker identity in Wavenet), their…

Machine Learning · Computer Science 2019-10-31 Mohammad Lotfollahi , Mohsen Naghipourfar , Fabian J. Theis , F. Alexander Wolf

Diffusion-based methods represented as stochastic differential equations on a continuous-time domain have recently proven successful as a non-adversarial generative model. Training such models relies on denoising score matching, which can…

Machine Learning · Computer Science 2024-11-05 Sarthak Mittal , Korbinian Abstreiter , Stefan Bauer , Bernhard Schölkopf , Arash Mehrjou

Anomaly detection in tabular data remains challenging due to complex feature interactions and the scarcity of anomalous examples. Denoising autoencoders rely on fixed-magnitude noise, limiting adaptability to diverse data distributions.…

Machine Learning · Computer Science 2025-08-04 Timur Sattarov , Marco Schreyer , Damian Borth

While unsupervised variational autoencoders (VAE) have become a powerful tool in neuroimage analysis, their application to supervised learning is under-explored. We aim to close this gap by proposing a unified probabilistic model for…

Machine Learning · Computer Science 2019-07-15 Qingyu Zhao , Ehsan Adeli , Nicolas Honnorat , Tuo Leng , Kilian M. Pohl

We propose an algorithm, guided variational autoencoder (Guided-VAE), that is able to learn a controllable generative model by performing latent representation disentanglement learning. The learning objective is achieved by providing…

Computer Vision and Pattern Recognition · Computer Science 2020-04-06 Zheng Ding , Yifan Xu , Weijian Xu , Gaurav Parmar , Yang Yang , Max Welling , Zhuowen Tu

Variational autoencoders (VAEs) and generative adversarial networks (GANs) enjoy an intuitive connection to manifold learning: in training the decoder/generator is optimized to approximate a homeomorphism between the data distribution and…

Machine Learning · Computer Science 2020-08-28 Henry Li , Ofir Lindenbaum , Xiuyuan Cheng , Alexander Cloninger

We present a new supervised learning technique for the Variational AutoEncoder (VAE) that allows it to learn a causally disentangled representation and generate causally disentangled outcomes simultaneously. We call this approach Causally…

Machine Learning · Statistics 2023-10-10 Seunghwan An , Kyungwoo Song , Jong-June Jeon

Multivariate Time Series forecasting has been an increasingly popular topic in various applications and scenarios. Recently, contrastive learning and Transformer-based models have achieved good performance in many long-term series…

Machine Learning · Computer Science 2023-01-24 Zhe Li , Zhongwen Rao , Lujia Pan , Pengyun Wang , Zenglin Xu

Speech enhancement (SE) is the foundational task of enhancing the clarity and quality of speech in the presence of non-stationary additive noise. While deterministic deep learning models have been commonly employed for SE, recent research…

Audio and Speech Processing · Electrical Eng. & Systems 2025-03-11 Sonal Kumar , Sreyan Ghosh , Utkarsh Tyagi , Anton Jeran Ratnarajah , Chandra Kiran Reddy Evuru , Ramani Duraiswami , Dinesh Manocha

Deep generative models such as conditional variational autoencoders (CVAEs) have shown great promise for predicting trajectories of surrounding agents in autonomous vehicle planning. State-of-the-art models have achieved remarkable accuracy…

Robotics · Computer Science 2025-10-14 Yongxi Cao , Julian F. Schumann , Jens Kober , Joni Pajarinen , Arkady Zgonnikov

This study aims to improve the spatial representation of uncertainties when regressing surface wind speeds from large-scale atmospheric predictors for sub-seasonal forecasting. Sub-seasonal forecasting often relies on large-scale…

Machine Learning · Computer Science 2025-10-21 Ganglin Tian , Anastase Alexandre Charantonis , Camille Le Coz , Alexis Tantet , Riwal Plougonven

Learning from an imbalanced distribution presents a major challenge in predictive modeling, as it generally leads to a reduction in the performance of standard algorithms. Various approaches exist to address this issue, but many of them…

Machine Learning · Computer Science 2024-12-11 Samuel Stocksieker , Denys Pommeret , Arthur Charpentier