English
Related papers

Related papers: Gaussian Process Latent Variable Modeling for Few-…

200 papers

Training and inference in Gaussian processes (GPs) require solving linear systems with $n\times n$ kernel matrices. To address the prohibitive $\mathcal{O}(n^3)$ time complexity, recent work has employed fast iterative methods, like…

Machine Learning · Computer Science 2024-03-12 Kaiwen Wu , Jonathan Wenger , Haydn Jones , Geoff Pleiss , Jacob R. Gardner

Deep Gaussian Processes (DGPs) were proposed as an expressive Bayesian model capable of a mathematically grounded estimation of uncertainty. The expressivity of DPGs results from not only the compositional character but the distribution…

Machine Learning · Computer Science 2021-11-23 Chi-Ken Lu , Patrick Shafto

Gaussian process (GP) regression has been widely used in supervised machine learning due to its flexibility and inherent ability to describe uncertainty in function estimation. In the context of control, it is seeing increasing use for…

Systems and Control · Computer Science 2020-01-01 Lukas Hewing , Juraj Kabzan , Melanie N. Zeilinger

Zero-inflated datasets, which have an excess of zero outputs, are commonly encountered in problems such as climate or rare event modelling. Conventional machine learning approaches tend to overestimate the non-zeros leading to poor…

Machine Learning · Statistics 2018-03-15 Pashupati Hegde , Markus Heinonen , Samuel Kaski

We introduce a novel stochastic variational inference method for Gaussian process ($\mathcal{GP}$) regression, by deriving a posterior over a learnable set of coresets: i.e., over pseudo-input/output, weighted pairs. Unlike former free-form…

Machine Learning · Computer Science 2025-03-06 Mert Ketenci , Adler Perotte , Noémie Elhadad , Iñigo Urteaga

Gaussian processes offer an attractive framework for predictive modeling from longitudinal data, i.e., irregularly sampled, sparse observations from a set of individuals over time. However, such methods have two key shortcomings: (i) They…

Machine Learning · Statistics 2020-12-09 Junjie Liang , Yanting Wu , Dongkuan Xu , Vasant Honavar

Data-driven Model Predictive Control (MPC), where the system model is learned from data with machine learning, has recently gained increasing interests in the control community. Gaussian Processes (GP), as a type of statistical models, are…

Systems and Control · Computer Science 2019-10-03 Truong X. Nghiem

Gaussian processes (GPs) have gained popularity as flexible machine learning models for regression and function approximation with an in-built method for uncertainty quantification. However, GPs suffer when the amount of training data is…

Machine Learning · Statistics 2025-11-26 Jonas Latz , Aretha L. Teckentrup , Simon Urbainczyk

An important issue in model-based control design is that an accurate dynamic model of the system is generally nonlinear, complex, and costly to obtain. This limits achievable control performance in practice. Gaussian process (GP) based…

Systems and Control · Electrical Eng. & Systems 2022-11-08 Yuhan Liu , Pengyu Wang , Roland Tóth

Gaussian Process (GP) models provide a flexible framework for prediction and uncertainty quantification. For most covariance functions, however, exact GP prediction with $n$ points scales as $\mathcal{O}(n^3)$, making it prohibitively…

Computation · Statistics 2026-05-29 Samanyu Arora , Christopher J. Geoga

With the advent of artificial intelligence and machine learning, various domains of science and engineering communities have leveraged data-driven surrogates to model complex systems through fusing numerous sources of information (data)…

Molecular property is usually observed with a limited number of samples, and researchers have considered property prediction as a few-shot problem. One important fact that has been ignored by prior works is that each molecule can be…

Machine Learning · Computer Science 2023-06-30 Xiang Zhuang , Qiang Zhang , Bin Wu , Keyan Ding , Yin Fang , Huajun Chen

We investigate the capabilities and limitations of Gaussian process models by jointly exploring three complementary directions: (i) scalable and statistically efficient inference; (ii) flexible kernels; and (iii) objective functions for…

Machine Learning · Statistics 2017-03-07 Karl Krauth , Edwin V. Bonilla , Kurt Cutajar , Maurizio Filippone

Gaussian processes (GPs) are widely used in nonparametric regression, classification and spatio-temporal modeling, motivated in part by a rich literature on theoretical properties. However, a well known drawback of GPs that limits their use…

Methodology · Statistics 2011-06-29 Anjishnu Banerjee , David Dunson , Surya Tokdar

A latent function decomposition method is proposed for forecasting the capacity of lithium-ion battery cells. The method uses the Multi-Output Gaussian Process, a generative machine learning framework for multi-task and transfer learning.…

Signal Processing · Electrical Eng. & Systems 2021-12-28 Abdallah A. Chehade , Ala A. Hussein

Temporal variations of apparent magnitude, called light curves, are observational statistics of interest captured by telescopes over long periods of time. Light curves afford the exploration of Space Domain Awareness (SDA) objectives such…

Instrumentation and Methods for Astrophysics · Physics 2022-09-01 Imène R. Goumiri , Alec M. Dunton , Amanda L. Muyskens , Benjamin W. Priest , Robert E. Armstrong

Meta-learning for few-shot learning entails acquiring a prior over previous tasks and experiences, such that new tasks be learned from small amounts of data. However, a critical challenge in few-shot learning is task ambiguity: even when a…

Machine Learning · Computer Science 2019-10-18 Chelsea Finn , Kelvin Xu , Sergey Levine

Gaussian processes (GP) are a widely used model for regression problems in supervised machine learning. Implementation of GP regression typically requires $O(n^3)$ logic gates. We show that the quantum linear systems algorithm [Harrow et…

Quantum Physics · Physics 2019-05-29 Zhikuan Zhao , Jack K. Fitzsimons , Joseph F. Fitzsimons

Earth observation from satellite sensory data poses challenging problems, where machine learning is currently a key player. In recent years, Gaussian Process (GP) regression has excelled in biophysical parameter estimation tasks from…

Multi-Output Gaussian Processes (MOGPs) provide a principled probabilistic framework for modelling correlated outputs but face scalability bottlenecks when applied to datasets with high-dimensional output spaces. To maintain tractability,…

Machine Learning · Computer Science 2026-05-29 Xiaoyu Jiang , Xinxing Shi , Sokratia Georgaka , Magnus Rattray , Mauricio A Álvarez