English
Related papers

Related papers: GP-ConvCNP: Better Generalization for Convolutiona…

200 papers

Neural processes are a family of models which use neural networks to directly parametrise a map from data sets to predictions. Directly parametrising this map enables the use of expressive neural networks in small-data problems where neural…

Machine Learning · Statistics 2024-08-20 Wessel P. Bruinsma

Deep neural networks excel at function approximation, yet they are typically trained from scratch for each new function. On the other hand, Bayesian methods, such as Gaussian Processes (GPs), exploit prior knowledge to quickly infer the…

Neural Processes (NPs; Garnelo et al., 2018a,b) are a rich class of models for meta-learning that map data sets directly to predictive stochastic processes. We provide a rigorous analysis of the standard maximum-likelihood objective used to…

Machine Learning · Statistics 2021-01-12 Wessel P. Bruinsma , James Requeima , Andrew Y. K. Foong , Jonathan Gordon , Richard E. Turner

A neural network (NN) is a parameterised function that can be tuned via gradient descent to approximate a labelled collection of data with high precision. A Gaussian process (GP), on the other hand, is a probabilistic model that defines a…

Machine Learning · Computer Science 2018-07-05 Marta Garnelo , Jonathan Schwarz , Dan Rosenbaum , Fabio Viola , Danilo J. Rezende , S. M. Ali Eslami , Yee Whye Teh

Neural processes are a family of probabilistic models that inherit the flexibility of neural networks to parameterize stochastic processes. Despite providing well-calibrated predictions, especially in regression problems, and quick…

Machine Learning · Computer Science 2023-07-04 Peiman Mohseni , Nick Duffield , Bani Mallick , Arman Hasanzadeh

Conditional Neural Processes (CNP; Garnelo et al., 2018) are an attractive family of meta-learning models which produce well-calibrated predictions, enable fast inference at test time, and are trainable via a simple maximum likelihood…

Machine Learning · Computer Science 2021-10-19 Stratis Markou , James Requeima , Wessel Bruinsma , Richard Turner

Neural Processes (NPs) are meta-learning models that learn to map sets of observations to approximations of the corresponding posterior predictive distributions. By accommodating variable-sized, unstructured collections of observations and…

Machine Learning · Computer Science 2026-02-10 Peiman Mohseni , Nick Duffield

We introduce Graph Neural Processes (GNP), inspired by the recent work in conditional and latent neural processes. A Graph Neural Process is defined as a Conditional Neural Process that operates on arbitrary graph data. It takes features of…

Machine Learning · Computer Science 2019-10-03 Andrew Carr , David Wingate

We extend Neural Processes (NPs) to sequential data through Recurrent NPs or RNPs, a family of conditional state space models. RNPs model the state space with Neural Processes. Given time series observed on fast real-world time scales but…

Machine Learning · Computer Science 2019-11-07 Timon Willi , Jonathan Masci , Jürgen Schmidhuber , Christian Osendorfer

Neural processes (NPs) are models for transfer learning with properties reminiscent of Gaussian Processes (GPs). They are adept at modelling data consisting of few observations of many related functions on the same input space and are…

Machine Learning · Statistics 2023-02-24 Miguel Garcia-Ortegon , Andreas Bender , Sergio Bacallado

Neural Processes (NPs) are a popular class of approaches for meta-learning. Similar to Gaussian Processes (GPs), NPs define distributions over functions and can estimate uncertainty in their predictions. However, unlike GPs, NPs and their…

Machine Learning · Computer Science 2023-02-09 Tung Nguyen , Aditya Grover

We introduce the Convolutional Conditional Neural Process (ConvCNP), a new member of the Neural Process family that models translation equivariance in the data. Translation equivariance is an important inductive bias for many learning…

Conditional neural processes (CNPs; Garnelo et al., 2018a) are attractive meta-learning models which produce well-calibrated predictions and are trainable via a simple maximum likelihood procedure. Although CNPs have many advantages, they…

In this paper we cast the well-known convolutional neural network in a Gaussian process perspective. In this way we hope to gain additional insights into the performance of convolutional networks, in particular understand under what…

Machine Learning · Statistics 2019-01-10 Anastasia Borovykh

Conditional Neural Processes~(CNPs) bridge neural networks with probabilistic inference to approximate functions of Stochastic Processes under meta-learning settings. Given a batch of non-{\it i.i.d} function instantiations, CNPs are…

Machine Learning · Computer Science 2022-03-28 Zesheng Ye , Lina Yao

The Conditional Neural Process (CNP) family of models offer a promising direction to tackle few-shot problems by achieving better scalability and competitive predictive performance. However, the current CNP models only capture the overall…

Machine Learning · Computer Science 2022-12-02 Deep Shankar Pandey , Qi Yu

Conditional Neural Processes~(CNPs) formulate distributions over functions and generate function observations with exact conditional likelihoods. CNPs, however, have limited expressivity for high-dimensional observations, since their…

Machine Learning · Computer Science 2023-03-24 Zesheng Ye , Jing Du , Lina Yao

The wide adoption of Convolutional Neural Networks (CNNs) in applications where decision-making under uncertainty is fundamental, has brought a great deal of attention to the ability of these models to accurately quantify the uncertainty in…

Machine Learning · Statistics 2018-05-29 Gia-Lac Tran , Edwin V. Bonilla , John P. Cunningham , Pietro Michiardi , Maurizio Filippone

Neural Processes (NPs) (Garnelo et al 2018a;b) approach regression by learning to map a context set of observed input-output pairs to a distribution over regression functions. Each function models the distribution of the output given an…

Machine Learning · Computer Science 2019-07-10 Hyunjik Kim , Andriy Mnih , Jonathan Schwarz , Marta Garnelo , Ali Eslami , Dan Rosenbaum , Oriol Vinyals , Yee Whye Teh

Stationary stochastic processes (SPs) are a key component of many probabilistic models, such as those for off-the-grid spatio-temporal data. They enable the statistical symmetry of underlying physical phenomena to be leveraged, thereby…

‹ Prev 1 2 3 10 Next ›