English
Related papers

Related papers: Gridded Transformer Neural Processes for Large Uns…

200 papers

Neural Processes (NPs) are popular methods in meta-learning that can estimate predictive uncertainty on target datapoints by conditioning on a context dataset. Previous state-of-the-art method Transformer Neural Processes (TNPs) achieve…

Machine Learning · Computer Science 2023-03-03 Leo Feng , Hossein Hajimirsadeghi , Yoshua Bengio , Mohamed Osama Ahmed

The effectiveness of neural processes (NPs) in modelling posterior prediction maps -- the mapping from data to posterior predictive distributions -- has significantly improved since their inception. This improvement can be attributed to two…

In this work, we identify open research opportunities in applying Neural Temporal Point Process (NTPP) models to industry scale customer behavior data by carefully reproducing NTPP models published up to date on known literature benchmarks…

Machine Learning · Computer Science 2022-08-19 Dominykas Šeputis , Jevgenij Gamper , Remigijus Paulavičius

Neural Processes (NPs) (Garnelo et al 2018a;b) approach regression by learning to map a context set of observed input-output pairs to a distribution over regression functions. Each function models the distribution of the output given an…

Machine Learning · Computer Science 2019-07-10 Hyunjik Kim , Andriy Mnih , Jonathan Schwarz , Marta Garnelo , Ali Eslami , Dan Rosenbaum , Oriol Vinyals , Yee Whye Teh

Time series forecasting is an important task in many fields ranging from supply chain management to weather forecasting. Recently, Transformer neural network architectures have shown promising results in forecasting on common time series…

Machine Learning · Computer Science 2024-08-08 Rares Cristian , Pavithra Harsha , Clemente Ocejo , Georgia Perakis , Brian Quanz , Ioannis Spantidakis , Hamza Zerhouni

Graph-based spatio-temporal neural networks are effective to model the spatial dependency among discrete points sampled irregularly from unstructured grids, thanks to the great expressiveness of graph neural networks. However, these models…

Machine Learning · Computer Science 2022-04-22 Haitao Lin , Guojiang Zhao , Lirong Wu , Stan Z. Li

In smart mobility, large networks of geographically distributed sensors produce vast amounts of high-frequency spatio-temporal data that must be processed in real time to avoid major disruptions. Traditional centralized approaches are…

Machine Learning · Computer Science 2025-05-23 Ivan Kralj , Lodovico Giaretta , Gordan Ježić , Ivana Podnar Žarko , Šarūnas Girdzijauskas

Accurate and robust weather forecasting remains a fundamental challenge due to the inherent spatio-temporal complexity of atmospheric systems. In this paper, we propose a novel self-supervised learning framework that leverages…

Machine Learning · Computer Science 2025-11-04 Yao Liu

Spatiotemporal forecasting is critical for real-world applications like traffic management, yet capturing reliable interactions remains challenging under noisy and non-stationary conditions. Existing methods primarily rely on historical…

Machine Learning · Computer Science 2026-05-20 Yinghao Ai , Yukai Zhou , Ruoxi Jiang , Junyi An , Chao Qu , Zhijian Zhou , Shiyu Wang , Fenglei Cao , Zenglin Xu , Furao Shen , Yuan Qi

Multivariate Time Series (MTS) forecasting involves modeling temporal dependencies within historical records. Transformers have demonstrated remarkable performance in MTS forecasting due to their capability to capture long-term…

Machine Learning · Computer Science 2024-07-17 Yifan Zhang , Rui Wu , Sergiu M. Dascalu , Frederick C. Harris

Encoder-decoder deep neural networks have been increasingly studied for multi-horizon time series forecasting, especially in real-world applications. However, to forecast accurately, these sophisticated models typically rely on a large…

Time series forecasting is a key component in many industrial and business decision processes and recurrent neural network (RNN) based models have achieved impressive progress on various time series forecasting tasks. However, most of the…

Machine Learning · Computer Science 2021-01-26 Zekai Chen , Jiaze E , Xiao Zhang , Hao Sheng , Xiuzheng Cheng

Many of today's data is time-series data originating from various sources, such as sensors, transaction systems, or production systems. Major challenges with such data include privacy and business sensitivity. Generative time-series models…

Machine Learning · Computer Science 2024-06-19 David Bergström , Mattias Tiger , Fredrik Heintz

We extend Neural Processes (NPs) to sequential data through Recurrent NPs or RNPs, a family of conditional state space models. RNPs model the state space with Neural Processes. Given time series observed on fast real-world time scales but…

Machine Learning · Computer Science 2019-11-07 Timon Willi , Jonathan Masci , Jürgen Schmidhuber , Christian Osendorfer

A new model is presented for multisite statistical downscaling of temperature and precipitation using convolutional conditional neural processes (convCNPs). ConvCNPs are a recently developed class of models that allow deep learning…

Machine Learning · Computer Science 2021-01-21 Anna Vaughan , Will Tebbutt , J. Scott Hosking , Richard E. Turner

With recent advances in sensing technologies, a myriad of spatio-temporal data has been generated and recorded in smart cities. Forecasting the evolution patterns of spatio-temporal data is an important yet demanding aspect of urban…

Machine Learning · Computer Science 2023-11-27 Guangyin Jin , Yuxuan Liang , Yuchen Fang , Zezhi Shao , Jincai Huang , Junbo Zhang , Yu Zheng

Many problems in computational neuroscience, neuroinformatics, pattern/image recognition, signal processing and machine learning generate massive amounts of multidimensional data with multiple aspects and high dimensionality. Tensors (i.e.,…

Emerging Technologies · Computer Science 2014-08-26 Andrzej Cichocki

One of the major sources of uncertainty in the current generation of Global Climate Models (GCMs) is the representation of sub-grid scale physical processes. Over the years, a series of deep-learning-based parameterization schemes have been…

Machine Learning · Computer Science 2024-12-24 Shuochen Wang , Nishant Yadav , Auroop R. Ganguly

Traffic forecasting is an indispensable part of Intelligent transportation systems (ITS), and long-term network-wide accurate traffic speed forecasting is one of the most challenging tasks. Recently, deep learning methods have become…

Artificial Intelligence · Computer Science 2021-04-13 Haoyang Yan , Xiaolei Ma

The representation of nonlinear sub-grid processes, especially clouds, has been a major source of uncertainty in climate models for decades. Cloud-resolving models better represent many of these processes and can now be run globally but…

Atmospheric and Oceanic Physics · Physics 2022-06-08 Stephan Rasp , Michael S. Pritchard , Pierre Gentine