English
Related papers

Related papers: SurF: A Generative Model for Multivariate Irregula…

200 papers

Advances in diffusion models for generative artificial intelligence have recently propagated to the time series (TS) domain, demonstrating state-of-the-art performance on various tasks. However, prior works on TS diffusion models often…

Machine Learning · Computer Science 2024-10-21 Seunghan Lee , Kibok Lee , Taeyoung Park

Recurrent Neural Networks can be trained to produce sequences of tokens given some input, as exemplified by recent results in machine translation and image captioning. The current approach to training them consists of maximizing the…

Machine Learning · Computer Science 2015-09-24 Samy Bengio , Oriol Vinyals , Navdeep Jaitly , Noam Shazeer

Deep Neural Networks have spearheaded remarkable advancements in time series forecasting (TSF), one of the major tasks in time series modeling. Nonetheless, the non-stationarity of time series undermines the reliability of pre-trained…

Machine Learning · Computer Science 2025-01-10 HyunGi Kim , Siwon Kim , Jisoo Mok , Sungroh Yoon

We consider a setting where multiple entities inter-act with each other over time and the time-varying statuses of the entities are represented as multiple correlated time series. For example, speed sensors are deployed in different…

Machine Learning · Computer Science 2021-03-23 Razvan-Gabriel Cirstea , Chenjuan Guo , Bin Yang

Turbulent flows have historically presented formidable challenges to predictive computational modeling. Traditional numerical simulations often require vast computational resources, making them infeasible for numerous engineering…

Fluid Dynamics · Physics 2023-11-15 Han Gao , Xu Han , Xiantao Fan , Luning Sun , Li-Ping Liu , Lian Duan , Jian-Xun Wang

Time series forecasting has widespread applications in urban life ranging from air quality monitoring to traffic analysis. However, accurate time series forecasting is challenging because real-world time series suffer from the distribution…

Machine Learning · Computer Science 2022-07-15 Wenying Duan , Xiaoxi He , Lu Zhou , Lothar Thiele , Hong Rao

Environmental sound classification systems often do not perform robustly across different sound classification tasks and audio signals of varying temporal structures. We introduce a multi-stream convolutional neural network with temporal…

Sound · Computer Science 2019-01-28 Xinyu Li , Venkata Chebiyyam , Katrin Kirchhoff

We present a simple yet effective generative model for time series, based on a Recurrent Variational Autoencoder that we refer to as AEQ-RVAE-ST. Recurrent layers often struggle with unstable optimization and poor convergence when modeling…

Machine Learning · Computer Science 2026-04-10 Ruwen Fulek , Markus Lange-Hegermann

The state of the art for physical hazard prediction from weather and climate requires expensive km-scale numerical simulations driven by coarser resolution global inputs. Here, a generative diffusion architecture is explored for downscaling…

Time-fluctuating signals are ubiquitous and diverse in many physical, chemical, and biological systems, among which random telegraph signals (RTSs) refer to a series of instantaneous switching events between two discrete levels from…

Applied Physics · Physics 2022-06-02 Marcel Robitaille , HeeBong Yang , Lu Wang , Na Young Kim

Distribution shift severely degrades the performance of deep forecasting models. While this issue is well-studied for individual time series, it remains a significant challenge in the spatio-temporal domain. Effective solutions like…

Machine Learning · Computer Science 2026-04-20 Zhaobo Hu , Vincent Gauthier , Mehdi Naima

The practical performance of generative diffusion models depends on the appropriate choice of the noise scheduling function, which can also be equivalently expressed as a time reparameterization. In this paper, we present a time scheduler…

Machine Learning · Computer Science 2025-11-25 Dejan Stancevic , Florian Handke , Luca Ambrogioni

Electronic records contain sequences of events, some of which take place all at once in a single visit, and others that are dispersed over multiple visits, each with a different timestamp. We postulate that fine temporal detail, e.g.,…

Machine Learning · Computer Science 2019-04-30 Mohammad Taha Bahadori , Zachary Chase Lipton

We introduce a novel generative smoothness regularization on manifolds (SToRM) model for the recovery of dynamic image data from highly undersampled measurements. The proposed generative framework represents the image time series as a…

Image and Video Processing · Electrical Eng. & Systems 2021-02-01 Qing Zou , Abdul Haseeb Ahmed , Prashant Nagpal , Stanley Kruger , Mathews Jacob

We define a general class of network formation models, Statistical Exponential Random Graph Models (SERGMs), that nest standard exponential random graph models (ERGMs) as a special case. We provide the first general results on when these…

Physics and Society · Physics 2014-06-26 Arun G. Chandrasekhar , Matthew O. Jackson

Deep neural networks for time series must capture complex temporal patterns, to effectively represent dynamic data. Self- and semi-supervised learning methods show promising results in pre-training large models, which -- when finetuned for…

Machine Learning · Computer Science 2025-08-15 Yuhan Xie , William Cappelletti , Mahsa Shoaran , Pascal Frossard

An algorithm is described that can generate random variants of a time series or image while preserving the probability distribution of original values and the pointwise Holder regularity. Thus, it preserves the multifractal properties of…

Data Analysis, Statistics and Probability · Physics 2017-03-22 Christopher J Keylock

Real-world sequential signals, such as audio or video, contain critical information that is often embedded within long periods of silence or noise. While recurrent neural networks (RNNs) are designed to process such data efficiently, they…

Machine Learning · Computer Science 2026-05-01 Bojian Yin , Shurong Wang , Haoyu Tan , Sander Bohte , Federico Corradi , Guoqi Li

Time series forecasting is essential for many practical applications, with the adoption of transformer-based models on the rise due to their impressive performance in NLP and CV. Transformers' key feature, the attention mechanism,…

Machine Learning · Computer Science 2024-02-09 PeiSong Niu , Tian Zhou , Xue Wang , Liang Sun , Rong Jin

RNN-based methods have faced challenges in the Long-term Time Series Forecasting (LTSF) domain when dealing with excessively long look-back windows and forecast horizons. Consequently, the dominance in this domain has shifted towards…

Machine Learning · Computer Science 2023-08-23 Shengsheng Lin , Weiwei Lin , Wentai Wu , Feiyu Zhao , Ruichao Mo , Haotong Zhang