English
Related papers

Related papers: Transformer Neural Processes: Uncertainty-Aware Me…

200 papers

Neural Processes (NPs; Garnelo et al., 2018a,b) are a rich class of models for meta-learning that map data sets directly to predictive stochastic processes. We provide a rigorous analysis of the standard maximum-likelihood objective used to…

Machine Learning · Statistics 2021-01-12 Wessel P. Bruinsma , James Requeima , Andrew Y. K. Foong , Jonathan Gordon , Richard E. Turner

Neural Processes (NPs) are a rapidly evolving class of models designed to directly model the posterior predictive distribution of stochastic processes. Originally developed as a scalable alternative to Gaussian Processes (GPs), which are…

Machine Learning · Computer Science 2026-04-20 Daniel Jenson , Jhonathan Navott , Mengyan Zhang , Makkunda Sharma , Elizaveta Semenova , Seth Flaxman

Neural processes are a family of models which use neural networks to directly parametrise a map from data sets to predictions. Directly parametrising this map enables the use of expressive neural networks in small-data problems where neural…

Machine Learning · Statistics 2024-08-20 Wessel P. Bruinsma

Neural network approaches for meta-learning distributions over functions have desirable properties such as increased flexibility and a reduced complexity of inference. Building on the successes of denoising diffusion models for generative…

Machine Learning · Statistics 2023-06-08 Vincent Dutordoir , Alan Saul , Zoubin Ghahramani , Fergus Simpson

Neural Processes (NPs) have gained attention in meta-learning for their ability to quantify uncertainty, together with their rapid prediction and adaptability. However, traditional NPs are prone to underfitting. Transformer Neural Processes…

Machine Learning · Computer Science 2025-04-22 Jose Lara-Rangel , Nanze Chen , Fengzhe Zhang

Neural Processes (NPs) are meta-learning models that learn to map sets of observations to approximations of the corresponding posterior predictive distributions. By accommodating variable-sized, unstructured collections of observations and…

Machine Learning · Computer Science 2026-02-10 Peiman Mohseni , Nick Duffield

A neural network (NN) is a parameterised function that can be tuned via gradient descent to approximate a labelled collection of data with high precision. A Gaussian process (GP), on the other hand, is a probabilistic model that defines a…

Machine Learning · Computer Science 2018-07-05 Marta Garnelo , Jonathan Schwarz , Dan Rosenbaum , Fabio Viola , Danilo J. Rezende , S. M. Ali Eslami , Yee Whye Teh

The effectiveness of neural processes (NPs) in modelling posterior prediction maps -- the mapping from data to posterior predictive distributions -- has significantly improved since their inception. This improvement can be attributed to two…

Neural Processes (NPs) (Garnelo et al 2018a;b) approach regression by learning to map a context set of observed input-output pairs to a distribution over regression functions. Each function models the distribution of the output given an…

Machine Learning · Computer Science 2019-07-10 Hyunjik Kim , Andriy Mnih , Jonathan Schwarz , Marta Garnelo , Ali Eslami , Dan Rosenbaum , Oriol Vinyals , Yee Whye Teh

Neural Processes (NPs) are a family of conditional generative models that are able to model a distribution over functions, in a way that allows them to perform predictions at test time conditioned on a number of context points. A recent…

Machine Learning · Computer Science 2021-06-14 Jens Petersen , Gregor Köhler , David Zimmerer , Fabian Isensee , Paul F. Jäger , Klaus H. Maier-Hein

Conditional Neural Processes (CNP; Garnelo et al., 2018) are an attractive family of meta-learning models which produce well-calibrated predictions, enable fast inference at test time, and are trainable via a simple maximum likelihood…

Machine Learning · Computer Science 2021-10-19 Stratis Markou , James Requeima , Wessel Bruinsma , Richard Turner

Conditional Neural Processes (CNPs; Garnelo et al., 2018a) are meta-learning models which leverage the flexibility of deep learning to produce well-calibrated predictions and naturally handle off-the-grid and missing data. CNPs scale to…

Machine Learning · Statistics 2022-06-14 Stratis Markou , James Requeima , Wessel P. Bruinsma , Anna Vaughan , Richard E. Turner

Meta-learning aims to train models that can generalize to new tasks with limited labeled data by extracting shared features across diverse task datasets. Additionally, it accounts for prediction uncertainty during both training and…

Machine Learning · Computer Science 2025-03-03 Hyungi Lee , Chaeyun Jang , Dongbok Lee , Juho Lee

Neural Processes (NPs) are popular methods in meta-learning that can estimate predictive uncertainty on target datapoints by conditioning on a context dataset. Previous state-of-the-art method Transformer Neural Processes (TNPs) achieve…

Machine Learning · Computer Science 2023-03-03 Leo Feng , Hossein Hajimirsadeghi , Yoshua Bengio , Mohamed Osama Ahmed

Neural Processes (NPs) are deep probabilistic models that represent stochastic processes by conditioning their prior distributions on a set of context points. Despite their advantages in uncertainty estimation for complex distributions, NPs…

Machine Learning · Computer Science 2025-06-04 Xuesong Wang , He Zhao , Edwin V. Bonilla

Many important problems require modelling large-scale spatio-temporal datasets, with one prevalent example being weather forecasting. Recently, transformer-based approaches have shown great promise in a range of weather forecasting…

Machine Learning · Statistics 2024-10-11 Matthew Ashman , Cristiana Diaconu , Eric Langezaal , Adrian Weller , Richard E. Turner

Time series, spatial data, and images are natural applications of Neural Processes. However, when such data exhibit strong periodicity and quasi-periodicity, existing methods often suffer from underfitting and generalise poorly beyond the…

Machine Learning · Computer Science 2026-05-12 Xianhe Chen , Hao Chen , Yingzhen Li

We present a new family of exchangeable stochastic processes, the Functional Neural Processes (FNPs). FNPs model distributions over functions by learning a graph of dependencies on top of latent representations of the points in the given…

Machine Learning · Computer Science 2019-11-05 Christos Louizos , Xiahan Shi , Klamer Schutte , Max Welling

Representing a signal as a continuous function parameterized by neural network (a.k.a. Implicit Neural Representations, INRs) has attracted increasing attention in recent years. Neural Processes (NPs), which model the distributions over…

Machine Learning · Computer Science 2023-02-22 Zongyu Guo , Cuiling Lan , Zhizheng Zhang , Yan Lu , Zhibo Chen

The standard approaches to neural network implementation yield powerful function approximation capabilities but are limited in their abilities to learn meta representations and reason probabilistic uncertainties in their predictions.…

Machine Learning · Computer Science 2023-10-05 Saurav Jha , Dong Gong , Xuesong Wang , Richard E. Turner , Lina Yao
‹ Prev 1 2 3 10 Next ›