English
Related papers

Related papers: Additive Gaussian Process Regression

200 papers

We generalize the additive constrained Gaussian process framework to handle interactions between input variables while enforcing monotonicity constraints everywhere on the input space. The block-additive structure of the model is…

Methodology · Statistics 2025-01-22 M. Deronzier , A. F. López-Lopera , F. Bachoc , O. Roustant , J. Rohmer

We investigate the use of derivative information for Batch Active Learning in Gaussian Process regression models. The proposed approach employs the predictive covariance matrix for selection of data batches to exploit full correlation of…

Machine Learning · Computer Science 2024-08-06 Hon Sum Alec Yu , Christoph Zimmer , Duy Nguyen-Tuong

Gaussian Processes (GPs) have been widely used in machine learning to model distributions over functions, with applications including multi-modal regression, time-series prediction, and few-shot learning. GPs are particularly useful in the…

Deep Gaussian Processes (DGPs) are multi-layer, flexible extensions of Gaussian processes but their training remains challenging. Sparse approximations simplify the training but often require optimization over a large number of inducing…

Machine Learning · Statistics 2021-07-20 Ayush Jain , P. K. Srijith , Mohammad Emtiyaz Khan

Simulation of surface processes is a key part of computational chemistry that offers atomic-scale insights into mechanisms of heterogeneous catalysis, diffusion dynamics, as well as quantum tunneling phenomena. The most common theoretical…

Chemical Physics · Physics 2023-05-01 Wei Fang , Yu-Cheng Zhu , Yi-Han Cheng , Yi-Ping Hao , Jeremy O. Richardson

Gaussian graphical models (GGMs) are well-established tools for probabilistic exploration of dependence structures using precision matrices. We develop a Bayesian method to incorporate covariate information in this GGMs setup in a nonlinear…

Large language models (LLMs) are powerful tools that, in a number of settings, overlap with the results of human pattern recognition and reasoning. Retrieval-augmented generation (RAG) further allows LLMs to produce tailored output…

Computation and Language · Computer Science 2026-04-07 Edward L. Wang , Mohammad Sharifi Kiasari , Tianyu Wang , Hayden Helm , Avanti Athreya , Carey Priebe , Vince Lyzinski

Ensuring safety and adapting to the user's behavior are of paramount importance in physical human-robot interaction. Thus, incorporating elastic actuators in the robot's mechanical design has become popular, since it offers intrinsic…

Robotics · Computer Science 2024-05-15 Samuel Tesfazgi , Markus Keßler , Emilio Trigili , Armin Lederer , Sandra Hirche

We consider priors for several nonparametric Bayesian models which use finite random series with a random number of terms. The prior is constructed through distributions on the number of basis functions and the associated coefficients. We…

Statistics Theory · Mathematics 2015-02-10 Weining Shen , Subhashis Ghosal

The main challenges that arise when adopting Gaussian Process priors in probabilistic modeling are how to carry out exact Bayesian inference and how to account for uncertainty on model parameters when making model-based predictions on…

Machine Learning · Statistics 2014-04-08 Maurizio Filippone , Mark Girolami

Gaussian process regression is widely used because of its ability to provide well-calibrated uncertainty estimates and handle small or sparse datasets. However, it struggles with high-dimensional data. One possible way to scale this…

Machine Learning · Statistics 2024-02-02 Bernardo Fichera , Viacheslav Borovitskiy , Andreas Krause , Aude Billard

Data-driven Model Predictive Control (MPC), where the system model is learned from data with machine learning, has recently gained increasing interests in the control community. Gaussian Processes (GP), as a type of statistical models, are…

Systems and Control · Computer Science 2019-10-03 Truong X. Nghiem

We propose a novel Bayesian nonparametric method for hierarchical modelling on a set of related density functions, where grouped data in the form of samples from each density function are available. Borrowing strength across the groups is a…

Computation · Statistics 2014-10-31 G. S. Rodrigues , David J. Nott , S. A. Sisson

Deep Gaussian processes (DGPs) are increasingly popular as predictive models in machine learning (ML) for their non-stationary flexibility and ability to cope with abrupt regime changes in training data. Here we explore DGPs as surrogates…

Methodology · Statistics 2021-08-27 Annie Sauer , Robert B. Gramacy , David Higdon

In this paper, we introduce a novel theoretical framework for Gaussian process regression error analysis, leveraging a function-space decomposition. Based on this framework, we develop a weighted Jacobi iterative method that utilizes…

Numerical Analysis · Mathematics 2026-02-27 Tiantian Sun , Juan Zhang

Substantial research on structured sparsity has contributed to analysis of many different applications. However, there have been few Bayesian procedures among this work. Here, we develop a Bayesian model for structured sparsity that uses a…

Methodology · Statistics 2014-07-09 Barbara E. Engelhardt , Ryan P. Adams

Autonomous racing creates challenging control problems, but Model Predictive Control (MPC) has made promising steps toward solving both the minimum lap-time problem and head-to-head racing. Yet, accurate models of the system are necessary…

Systems and Control · Electrical Eng. & Systems 2023-11-06 Tommaso Benciolini , Chen Tang , Marion Leibold , Catherine Weaver , Masayoshi Tomizuka , Wei Zhan

We introduce graph gamma process (GGP) linear dynamical systems to model real-valued multivariate time series. For temporal pattern discovery, the latent representation under the model is used to decompose the time series into a…

Methodology · Statistics 2020-07-28 Rahi Kalantari , Mingyuan Zhou

Multi-output Gaussian process (MGP) is commonly used as a transfer learning method to leverage information among multiple outputs. A key advantage of MGP is providing uncertainty quantification for prediction, which is highly important for…

Machine Learning · Statistics 2024-09-06 Wang Xinming , Li Yongxiang , Yue Xiaowei , Wu Jianguo

Pairwise comparison data arise in many domains with subjective assessment experiments, for example in image and video quality assessment. In these experiments observers are asked to express a preference between two conditions. However, many…

Machine Learning · Computer Science 2020-04-14 Aliaksei Mikhailiuk , Clifford Wilmot , Maria Perez-Ortiz , Dingcheng Yue , Rafal Mantiuk