English
Related papers

Related papers: Neural Processes

200 papers

Inference for GP models with non-Gaussian noises is computationally expensive when dealing with large datasets. Many recent inference methods approximate the posterior distribution with a simpler distribution defined on a small number of…

Machine Learning · Computer Science 2018-09-11 Linfeng Liu , Liping Liu

We present probabilistic neural programs, a framework for program induction that permits flexible specification of both a computational model and inference algorithm while simultaneously enabling the use of deep neural networks.…

Neural and Evolutionary Computing · Computer Science 2016-12-05 Kenton W. Murray , Jayant Krishnamurthy

Gaussian processes (GPs) are nonparametric Bayesian models that have been applied to regression and classification problems. One of the approaches to alleviate their cubic training cost is the use of local GP experts trained on subsets of…

Machine Learning · Statistics 2021-02-16 Samuel Cohen , Rendani Mbuvha , Tshilidzi Marwala , Marc Peter Deisenroth

Neural fields, which represent signals as a function parameterized by a neural network, are a promising alternative to traditional discrete vector or grid-based representations. Compared to discrete representations, neural representations…

Machine Learning · Computer Science 2023-09-14 Jeffrey Gu , Kuan-Chieh Wang , Serena Yeung

Neural Processes combine the strengths of neural networks and Gaussian processes to achieve both flexible learning and fast prediction in stochastic processes. However, a large class of problems comprises underlying temporal dependency…

Machine Learning · Computer Science 2019-10-29 Gautam Singh , Jaesik Yoon , Youngsung Son , Sungjin Ahn

This paper introduces an active learning framework for manifold Gaussian Process (GP) regression, combining manifold learning with strategic data selection to improve accuracy in high-dimensional spaces. Our method jointly optimizes a…

Machine Learning · Statistics 2026-05-12 Yuanxing Cheng , Lulu Kang , Yiwei Wang , Chun Liu

Recent works have revealed that infinitely-wide feed-forward or recurrent neural networks of any architecture correspond to Gaussian processes referred to as Neural Network Gaussian Processes (NNGPs). While these works have extended the…

Machine Learning · Statistics 2022-03-08 Hyungi Lee , Eunggu Yun , Hongseok Yang , Juho Lee

Gaussian processes have become a popular tool for nonparametric regression because of their flexibility and uncertainty quantification. However, they often use stationary kernels, which limit the expressiveness of the model and may be…

Machine Learning · Computer Science 2025-07-17 Zachary James , Joseph Guinness

Gaussian processes (GPs) are Bayesian nonparametric models for function approximation with principled predictive uncertainty estimates. Deep Gaussian processes (DGPs) are multilayer generalizations of GPs that can represent complex marginal…

Machine Learning · Statistics 2024-09-20 Qiuxian Meng , Yongyou Zhang

Gaussian processes (GPs) are distributions over functions, which provide a Bayesian nonparametric approach to regression and classification. In spite of their success, GPs have limited use in some applications, for example, in some cases a…

Machine Learning · Computer Science 2020-05-28 Alessio Benavoli , Dario Azzimonti , Dario Piga

The vast quantity of information brought by big data as well as the evolving computer hardware encourages success stories in the machine learning community. In the meanwhile, it poses challenges for the Gaussian process (GP) regression, a…

Machine Learning · Statistics 2019-04-10 Haitao Liu , Yew-Soon Ong , Xiaobo Shen , Jianfei Cai

While deep neural networks (DNNs) and Gaussian Processes (GPs) are both popularly utilized to solve problems in reinforcement learning, both approaches feature undesirable drawbacks for challenging problems. DNNs learn complex nonlinear…

Machine Learning · Computer Science 2020-04-14 Imène R. Goumiri , Benjamin W. Priest , Michael D. Schneider

Neural bandits have been shown to provide an efficient solution to practical sequential decision tasks that have nonlinear reward functions. The main contributor to that success is approximate Bayesian inference, which enables neural…

Machine Learning · Computer Science 2022-10-11 Michal Lisicki , Arash Afkanpour , Graham W. Taylor

Graph Neural Networks (GNNs) are powerful and flexible neural networks that use the naturally sparse connectivity information of the data. GNNs represent this connectivity as sparse matrices, which have lower arithmetic intensity and thus…

Machine Learning · Computer Science 2020-09-04 Alok Tripathy , Katherine Yelick , Aydin Buluc

Deep Gaussian Processes (DGPs) combine the expressiveness of Deep Neural Networks (DNNs) with quantified uncertainty of Gaussian Processes (GPs). Expressive power and intractable inference both result from the non-Gaussian distribution over…

Machine Learning · Computer Science 2020-02-26 Chi-Ken Lu , Scott Cheng-Hsin Yang , Xiaoran Hao , Patrick Shafto

In this paper we introduce a novel framework for making exact nonparametric Bayesian inference on latent functions, that is particularly suitable for Big Data tasks. Firstly, we introduce a class of stochastic processes we refer to as…

Machine Learning · Statistics 2016-08-22 Yves-Laurent Kom Samo , Stephen Roberts

Learning-based approaches are increasingly leveraged to manage and coordinate the operation of grid-edge resources in active power distribution networks. Among these, model-based techniques stand out for their superior data efficiency and…

Systems and Control · Electrical Eng. & Systems 2025-05-01 Daniel Glover , Parikshit Pareek , Deepjyoti Deka , Anamika Dubey

Gaussian processes (GPs) are flexible non-parametric models, with a capacity that grows with the available data. However, computational constraints with standard inference procedures have limited exact GPs to problems with fewer than about…

We introduce a class of neural networks derived from probabilistic models in the form of Bayesian belief networks. By imposing additional assumptions about the nature of the probabilistic models represented in the belief networks, we derive…

Disordered Systems and Neural Networks · Physics 2007-05-23 M. J. Barber , J. W. Clark , C. H. Anderson

Graph Neural Networks (GNNs) have advanced spatiotemporal forecasting by leveraging relational inductive biases among sensors (or any other measuring scheme) represented as nodes in a graph. However, current methods often rely on Recurrent…

Machine Learning · Computer Science 2024-05-30 Aref Einizade , Fragkiskos D. Malliaros , Jhony H. Giraldo