English
Related papers

Related papers: Multi-scale Attention Flow for Probabilistic Time …

200 papers

Recently, denoising diffusion models have led to significant breakthroughs in the generation of images, audio and text. However, it is still an open question on how to adapt their strong modeling ability to model time series. In this paper,…

Machine Learning · Computer Science 2023-06-09 Lifeng Shen , James Kwok

Modeling multivariate time series has long been a subject that has attracted researchers from a diverse range of fields including economics, finance, and traffic. A basic assumption behind multivariate time series forecasting is that its…

Machine Learning · Computer Science 2020-05-26 Zonghan Wu , Shirui Pan , Guodong Long , Jing Jiang , Xiaojun Chang , Chengqi Zhang

Probabilistic forecasting is not only a way to add more information to a prediction of the future, but it also builds on weaknesses in point prediction. Sudden changes in a time series can still be captured by a cumulative distribution…

Machine Learning · Computer Science 2025-11-19 Niklas Erdmann , Lars Bentsen , Roy Stenbro , Heine Nygard Riise , Narada Dilp Warakagoda , Paal E. Engelstad

Understanding temporal dynamics in medical imaging is crucial for applications such as disease progression modeling, treatment planning and anatomical development tracking. However, most deep learning methods either consider only single…

Computer Vision and Pattern Recognition · Computer Science 2025-09-01 Nico Albert Disch , Yannick Kirchhoff , Robin Peretzke , Maximilian Rokuss , Saikat Roy , Constantin Ulrich , David Zimmerer , Klaus Maier-Hein

We address a three-tier numerical framework based on manifold learning for the forecasting of high-dimensional time series. At the first step, we embed the time series into a reduced low-dimensional space using a nonlinear manifold learning…

Numerical Analysis · Mathematics 2023-03-16 Panagiotis Papaioannou , Ronen Talmon , Ioannis Kevrekidis , Constantinos Siettos

Attention-based models have been widely used in many areas, such as computer vision and natural language processing. However, relevant applications in time series classification (TSC) have not been explored deeply yet, causing a significant…

Machine Learning · Computer Science 2022-07-18 Bowen Zhao , Huanlai Xing , Xinhan Wang , Fuhong Song , Zhiwen Xiao

Survival analysis, or time-to-event modelling, is a classical statistical problem that has garnered a lot of interest for its practical use in epidemiology, demographics or actuarial sciences. Recent advances on the subject from the point…

Machine Learning · Computer Science 2021-07-28 Guillaume Ausset , Tom Ciffreo , Francois Portier , Stephan Clémençon , Timothée Papin

Numerous applications of machine learning involve representing probability distributions over high-dimensional data. We propose autoregressive quantile flows, a flexible class of normalizing flow models trained using a novel objective based…

Machine Learning · Computer Science 2023-02-17 Phillip Si , Allan Bishop , Volodymyr Kuleshov

Autoregressive attention-based time series forecasting (TSF) has drawn increasing interest, with mechanisms like linear attention sometimes outperforming vanilla attention. However, deeper Transformer architectures frequently misalign with…

Machine Learning · Computer Science 2026-02-06 Jiecheng Lu , Shihao Yang

We introduce manifold-learning flows (M-flows), a new class of generative models that simultaneously learn the data manifold as well as a tractable probability density on that manifold. Combining aspects of normalizing flows, GANs,…

Machine Learning · Statistics 2020-11-16 Johann Brehmer , Kyle Cranmer

As a highly expressive generative model, diffusion models have demonstrated exceptional success across various domains, including image generation, natural language processing, and combinatorial optimization. However, as data distributions…

Machine Learning · Computer Science 2025-10-27 Myunsoo Kim , Donghyeon Ki , Seong-Woong Shim , Byung-Jun Lee

Neural processes (NPs) learn stochastic processes and predict the distribution of target output adaptively conditioned on a context set of observed input-output pairs. Furthermore, Attentive Neural Process (ANP) improved the prediction…

Machine Learning · Computer Science 2019-10-22 Shenghao Qin , Jiacheng Zhu , Jimmy Qin , Wenshuo Wang , Ding Zhao

User interests are usually dynamic in the real world, which poses both theoretical and practical challenges for learning accurate preferences from rich behavior data. Among existing user behavior modeling solutions, attention networks are…

Information Retrieval · Computer Science 2022-04-14 Chao Chen , Haoyu Geng , Nianzu Yang , Junchi Yan , Daiyue Xue , Jianping Yu , Xiaokang Yang

Time series with long-term structure arise in a variety of contexts and capturing this temporal structure is a critical challenge in time series analysis for both inference and forecasting settings. Traditionally, state space models have…

Machine Learning · Statistics 2020-06-12 Anna K. Yanchenko , Sayan Mukherjee

Time series data are valuable but are often inscrutable. Gaining trust in time series classifiers for finance, healthcare, and other critical applications may rely on creating interpretable models. Researchers have previously been forced to…

Machine Learning · Computer Science 2021-11-09 Yuhui Wang , Diane J. Cook

Efficient anomaly detection and diagnosis in multivariate time-series data is of great importance for modern industrial applications. However, building a system that is able to quickly and accurately pinpoint anomalous observations is a…

Machine Learning · Computer Science 2022-05-17 Shreshth Tuli , Giuliano Casale , Nicholas R. Jennings

We introduce temporal multimodal multivariate learning, a new family of decision making models that can indirectly learn and transfer online information from simultaneous observations of a probability distribution with more than one peak or…

Sparse deep learning has become a popular technique for improving the performance of deep neural networks in areas such as uncertainty quantification, variable selection, and large-scale network compression. However, most existing research…

Machine Learning · Statistics 2023-10-06 Mingxuan Zhang , Yan Sun , Faming Liang

The paper introduces a novel topological method for prediction and modeling for a nonlinear time--series that exhibit recurring patterns. According to the model, global manifold of the reconstructed state--space can be approximated by a few…

Chaotic Dynamics · Physics 2017-11-21 Sajini Anand P S , Prabhakar G Vaidya

Accurate multivariate time series forecasting hinges on inter-series correlations, which often evolve in complex ways across different temporal scales. Existing methods are limited in modeling these multi-scale dependencies and struggle to…

Machine Learning · Computer Science 2026-01-27 Shaoxun Wang , Xingjun Zhang , Qianyang Li , Jiawei Cao , Zhendong Tan