English
Related papers

Related papers: Probabilistic Programming with Gaussian Process Me…

200 papers

The Gaussian process (GP) is a popular statistical technique for stochastic function approximation and uncertainty quantification from data. GPs have been adopted into the realm of machine learning in the last two decades because of their…

Machine Learning · Statistics 2024-10-02 Marcus M. Noack , Hengrui Luo , Mark D. Risser

Gaussian processes are a flexible Bayesian nonparametric modelling approach that has been widely applied but poses computational challenges. To address the poor scaling of exact inference methods, approximation methods based on sparse…

Machine Learning · Statistics 2021-06-01 Rui Meng , Herbert Lee , Soper Braden , Priyadip Ray

One obstacle to the use of Gaussian processes (GPs) in large-scale problems, and as a component in deep learning system, is the need for bespoke derivations and implementations for small variations in the model or inference. In order to…

Machine Learning · Statistics 2020-03-04 Mark van der Wilk , Vincent Dutordoir , ST John , Artem Artemev , Vincent Adam , James Hensman

Gaussian processes (GPs) are non-linear probabilistic models popular in many applications. However, na\"ive GP realizations require quadratic memory to store the covariance matrix and cubic computation to perform inference or evaluate the…

Computation · Statistics 2021-05-03 Amanda Muyskens , Benjamin Priest , Imène Goumiri , Michael Schneider

Gaussian processes (GPs) are widely used in non-parametric Bayesian modeling, and play an important role in various statistical and machine learning applications. In a variety tasks of uncertainty quantification, generating random sample…

Computation · Statistics 2024-08-02 Haoyuan Chen , Rui Tuo

The proliferation of capable and efficient machine learning (ML) models marks one of the strongest methodological shifts in signal processing (SP) in its nearly 100-year history. ML models support the development of SP systems that…

Signal Processing · Electrical Eng. & Systems 2026-05-01 Daniel Waxman , Fernando Llorente , Petar M. Djurić

Deep Gaussian processes (DGPs) are multi-layer hierarchical generalisations of Gaussian processes (GPs) and are formally equivalent to neural networks with multiple, infinitely wide hidden layers. DGPs are probabilistic and non-parametric…

Gaussian Processes (GPs) offer an attractive method for regression over small, structured and correlated datasets. However, their deployment is hindered by computational costs and limited guidelines on how to apply GPs beyond simple…

Machine Learning · Computer Science 2023-07-18 Kenza Tazi , Jihao Andreas Lin , Ross Viljoen , Alex Gardner , ST John , Hong Ge , Richard E. Turner

This book is a graduate-level introduction to probabilistic programming. It not only provides a thorough background for anyone wishing to use a probabilistic programming system, but also introduces the techniques needed to design and build…

Machine Learning · Statistics 2021-10-20 Jan-Willem van de Meent , Brooks Paige , Hongseok Yang , Frank Wood

In this work, we present an extension of Gaussian process (GP) models with sophisticated parallelization and GPU acceleration. The parallelization scheme arises naturally from the modular computational structure w.r.t. datapoints in the…

Distributed, Parallel, and Cluster Computing · Computer Science 2014-10-21 Zhenwen Dai , Andreas Damianou , James Hensman , Neil Lawrence

Many problems arising in applications result in the need to probe a probability distribution for functions. Examples include Bayesian nonparametric statistics and conditioned diffusion processes. Standard MCMC algorithms typically become…

Computation · Statistics 2015-03-20 S. L. Cotter , G. O. Roberts , A. M. Stuart , D. White

Gaussian process models are commonly used as emulators for computer experiments. However, developing a Gaussian process emulator can be computationally prohibitive when the number of experimental samples is even moderately large. Local…

Methodology · Statistics 2018-09-26 Chih-Li Sung , Robert B. Gramacy , Benjamin Haaland

Gaussian processes (GPs) are a good choice for function approximation as they are flexible, robust to over-fitting, and provide well-calibrated predictive uncertainty. Deep Gaussian processes (DGPs) are multi-layer generalisations of GPs,…

Machine Learning · Statistics 2017-11-15 Hugh Salimbeni , Marc Deisenroth

The Gaussian process (GP) model, which has been extensively applied as priors of functions, has demonstrated excellent performance. The specification of a large number of parameters affects the computational efficiency and the feasibility…

Machine Learning · Statistics 2020-02-13 Shisheng Cui , Chia-Jung Chang

Designing reward functions is a challenging problem in AI and robotics. Humans usually have a difficult time directly specifying all the desirable behaviors that a robot needs to optimize. One common approach is to learn reward functions…

Robotics · Computer Science 2020-06-05 Erdem Bıyık , Nicolas Huynh , Mykel J. Kochenderfer , Dorsa Sadigh

Probabilistic programs encode stochastic models as ordinary-looking programs with primitives for sampling numbers from predefined distributions and conditioning. Their applications include, among many others, machine learning and modeling…

Formal Languages and Automata Theory · Computer Science 2025-12-16 Dominik Geißler , Tobias Winkler

The composition of multiple Gaussian Processes as a Deep Gaussian Process (DGP) enables a deep probabilistic nonparametric approach to flexibly tackle complex machine learning problems with sound quantification of uncertainty. Existing…

Machine Learning · Statistics 2017-03-02 Kurt Cutajar , Edwin V. Bonilla , Pietro Michiardi , Maurizio Filippone

LLMs are widely used for code generation and mathematical reasoning tasks where they are required to generate structured output. They either need to reason about code, generate code for a given specification, or reason using programs of…

Computation and Language · Computer Science 2026-04-21 Poorva Garg , Renato Lui Geh , Daniel Israel , Todd Millstein , Kyle Richardson , Guy Van den Broeck

Gaussian processes are used in machine learning to learn input-output mappings from observed data. Gaussian process regression is based on imposing a Gaussian process prior on the unknown regressor function and statistically conditioning it…

Machine Learning · Statistics 2019-07-16 Simo Särkkä

Probabilistic Logic Programming (PLP), exemplified by Sato and Kameya's PRISM, Poole's ICL, De Raedt et al's ProbLog and Vennekens et al's LPAD, combines statistical and logical knowledge representation and inference. Inference in these…

Artificial Intelligence · Computer Science 2012-03-21 Muhammad Asiful Islam , C. R. Ramakrishnan , I. V. Ramakrishnan