English
Related papers

Related papers: Forward variable selection enables fast and accura…

200 papers

Scalable Gaussian process (GP) inference is essential for sequential decision-making tasks, yet improving GP scalability remains a challenging problem with many open avenues of research. This paper focuses on iterative GPs, where iterative…

Machine Learning · Computer Science 2025-11-21 Alan Yufei Dong , Jihao Andreas Lin , José Miguel Hernández-Lobato

This work proposed kernel selection approaches for probabilistic classifiers based on features produced by the convolutional encoder of a variational autoencoder. Particularly, the developed methodologies allow the selection of the most…

Machine Learning · Computer Science 2025-08-05 Fábio Mendonça , Sheikh Shanawaz Mostafa , Fernando Morgado-Dias , Antonio G. Ravelo-García

We propose a representation of Gaussian processes (GPs) based on powers of the integral operator defined by a kernel function, we call these stochastic processes integral Gaussian processes (IGPs). Sample paths from IGPs are functions…

Machine Learning · Statistics 2019-03-08 Zilong Tan , Sayan Mukherjee

Meta-learning is a powerful approach that exploits historical data to quickly solve new tasks from the same distribution. In the low-data regime, methods based on the closed-form posterior of Gaussian processes (GP) together with Bayesian…

We propose a novel probabilistic framework, termed LVM-GP, for uncertainty quantification in solving forward and inverse partial differential equations (PDEs) with noisy data. The core idea is to construct a stochastic mapping from the…

Machine Learning · Statistics 2025-07-31 Xiaodong Feng , Ling Guo , Xiaoliang Wan , Hao Wu , Tao Zhou , Wenwen Zhou

We propose a new method for simplification of Gaussian process (GP) models by projecting the information contained in the full encompassing model and selecting a reduced number of variables based on their predictive relevance. Our results…

Methodology · Statistics 2017-12-18 Juho Piironen , Aki Vehtari

Variable selection for Gaussian process models is often done using automatic relevance determination, which uses the inverse length-scale parameter of each input variable as a proxy for variable relevance. This implicitly determined…

Methodology · Statistics 2019-04-24 Topi Paananen , Juho Piironen , Michael Riis Andersen , Aki Vehtari

We present a Gaussian Process - Latent Class Choice Model (GP-LCCM) to integrate a non-parametric class of probabilistic machine learning within discrete choice models (DCMs). Gaussian Processes (GPs) are kernel-based algorithms that…

Econometrics · Economics 2023-08-02 Georges Sfeir , Filipe Rodrigues , Maya Abou-Zeid

Automating statistical modelling is a challenging problem in artificial intelligence. The Automatic Statistician takes a first step in this direction, by employing a kernel search algorithm with Gaussian Processes (GP) to provide…

Machine Learning · Statistics 2018-02-15 Hyunjik Kim , Yee Whye Teh

Gaussian process (GP) regression is a Bayesian nonparametric method for regression and interpolation, offering a principled way of quantifying the uncertainties of predicted function values. For the quantified uncertainties to be…

Statistics Theory · Mathematics 2025-08-22 Masha Naslidnyk , Motonobu Kanagawa , Toni Karvonen , Maren Mahsereci

Identifying dynamical system (DS) is a vital task in science and engineering. Traditional methods require numerous calls to the DS solver, rendering likelihood-based or least-squares inference frameworks impractical. For efficient parameter…

Computation · Statistics 2024-09-19 Ying Zhou , Jinglai Li , Xiang Zhou , Hongqiao Wang

Training and inference in Gaussian processes (GPs) require solving linear systems with $n\times n$ kernel matrices. To address the prohibitive $\mathcal{O}(n^3)$ time complexity, recent work has employed fast iterative methods, like…

Machine Learning · Computer Science 2024-03-12 Kaiwen Wu , Jonathan Wenger , Haydn Jones , Geoff Pleiss , Jacob R. Gardner

The interpretability of generative models is considered a key factor in demonstrating their effectiveness and controllability. The generated data are believed to be determined by latent variables that are not directly observable. Therefore,…

Machine Learning · Statistics 2025-08-14 Yuan-Hao Wei , Fu-Hao Deng , Lin-Yong Cui , Yan-Jie Sun

We consider a Gaussian process formulation of the multiple kernel learning problem. The goal is to select the convex combination of kernel matrices that best explains the data and by doing so improve the generalisation on unseen data.…

Machine Learning · Statistics 2011-10-25 Cedric Archambeau , Francis Bach

In addressing the challenge of analysing the large-scale Adolescent Brain Cognition Development (ABCD) fMRI dataset, involving over 5,000 subjects and extensive neuroimaging data, we propose a scalable Bayesian scalar-on-image regression…

Methodology · Statistics 2024-03-21 Anna Menacher , Thomas E. Nichols , Timothy D. Johnson , Jian Kang

In this work we study the non-parametric reconstruction of spatio-temporal dynamical Gaussian processes (GPs) via GP regression from sparse and noisy data. GPs have been mainly applied to spatial regression where they represent one of the…

Machine Learning · Computer Science 2020-10-06 Marco Todescato , Andrea Carron , Ruggero Carli , Gianluigi Pillonetto , Luca Schenato

The Gaussian process latent variable model (GP-LVM) provides a flexible approach for non-linear dimensionality reduction that has been widely applied. However, the current approach for training GP-LVMs is based on maximum likelihood, where…

Machine Learning · Statistics 2014-09-09 Andreas C. Damianou , Michalis K. Titsias , Neil D. Lawrence

Autonomous Land Vehicles (ALV) shall efficiently recognize the ground in unknown environments. A novel $\mathcal{GP}$-based method is proposed for the ground segmentation task in rough driving scenarios. A non-stationary covariance function…

Computer Vision and Pattern Recognition · Computer Science 2021-12-14 Pouria Mehrabi , Hamid D. Taghirad

The multi-view Gaussian process latent variable model (MV-GPLVM) aims to learn a unified representation from multi-view data but is hindered by challenges such as limited kernel expressiveness and low computational efficiency. To overcome…

Machine Learning · Statistics 2025-12-16 Zi Yang , Ying Li , Zhidi Lin , Michael Minyi Zhang , Pablo M. Olmos

Variational inference (VI) seeks to approximate a target distribution $\pi$ by an element of a tractable family of distributions. Of key interest in statistics and machine learning is Gaussian VI, which approximates $\pi$ by minimizing the…

Statistics Theory · Mathematics 2023-04-13 Michael Diao , Krishnakumar Balasubramanian , Sinho Chewi , Adil Salim