English
Related papers

Related papers: Efficient Optimization for Sparse Gaussian Process…

200 papers

Gaussian process regression is a well-established Bayesian machine learning method. We propose a new approach to Gaussian process regression using quantum kernels based on parameterized quantum circuits. By employing a hardware-efficient…

Quantum Physics · Physics 2024-02-06 Frederic Rapp , Marco Roth

Gaussian process regression (GPR) is a powerful machine learning method which has recently enjoyed wider use, in particular in physical sciences. In its original formulation, GPR uses a square matrix of covariances among training data and…

Numerical Analysis · Mathematics 2023-09-08 Sergei Manzhos , Manabu Ihara

Gaussian process regression is a machine learning approach which has been shown its power for estimation of unknown functions. However, Gaussian processes suffer from high computational complexity, as in a basic form they scale cubically…

Machine Learning · Statistics 2018-09-10 Danil Kuzin , Le Yang , Olga Isupova , Lyudmila Mihaylova

Sparsity-constrained optimization has wide applicability in machine learning, statistics, and signal processing problems such as feature selection and compressive Sensing. A vast body of work has studied the sparsity-constrained…

Machine Learning · Statistics 2013-07-17 Sohail Bahmani , Bhiksha Raj , Petros Boufounos

Recent work on simultaneous trajectory estimation and mapping (STEAM) for mobile robots has found success by representing the trajectory as a Gaussian process. Gaussian processes can represent a continuous-time trajectory, elegantly handle…

Robotics · Computer Science 2015-04-13 Xinyan Yan , Vadim Indelman , Byron Boots

We explore algorithms and limitations for sparse optimization problems such as sparse linear regression and robust linear regression. The goal of the sparse linear regression problem is to identify a small number of key features, while the…

Machine Learning · Computer Science 2022-06-30 Eric Price , Sandeep Silwal , Samson Zhou

Approximation algorithms are widely used in many engineering problems. To obtain a data set for approximation a factorial design of experiments is often used. In such case the size of the data set can be very large. Therefore, one of the…

Methodology · Statistics 2014-07-04 Mikhail Belyaev , Evgeny Burnaev , Yermek Kapushev

In this paper we introduce a novel model for Gaussian process (GP) regression in the fully Bayesian setting. Motivated by the ideas of sparsification, localization and Bayesian additive modeling, our model is built around a recursive…

Statistics Theory · Mathematics 2022-06-06 Hengrui Luo , Giovanni Nattino , Matthew T. Pratola

A practical approach to evaluate performance of a Gaussian process regression models (GPR) for irregularly sampled sparse time-series is introduced. The approach entails construction of a secondary autoregressive model using the fine scale…

Methodology · Statistics 2016-11-10 Mehmet Süzen , Abed Ajraou

Gaussian Processes (\textbf{GPs}) are flexible non-parametric models with strong probabilistic interpretation. While being a standard choice for performing inference on time series, GPs have few techniques to work in a streaming setting.…

Machine Learning · Statistics 2021-07-22 Théo Galy-Fajou , Manfred Opper

Task learning in neural networks typically requires finding a globally optimal minimizer to a loss function objective. Conventional designs of swarm based optimization methods apply a fixed update rule, with possibly an adaptive step-size…

Machine Learning · Computer Science 2022-11-29 Chandrajit Bajaj , Omatharv Bharat Vaidya , Yi Wang

A new sparse semiparametric model is proposed, which incorporates the influence of two functional random variables in a scalar response in a flexible and interpretable manner. One of the functional covariates is included through a…

Methodology · Statistics 2024-01-29 Silvia Novo , Philippe Vieu , Germán Aneiros

Approximations to Gaussian processes based on inducing variables, combined with variational inference techniques, enable state-of-the-art sparse approaches to infer GPs at scale through mini batch-based learning. In this work, we address…

Machine Learning · Statistics 2021-07-21 Gia-Lac Tran , Dimitrios Milios , Pietro Michiardi , Maurizio Filippone

In a Bayesian learning setting, the posterior distribution of a predictive model arises from a trade-off between its prior distribution and the conditional likelihood of observed data. Such distribution functions usually rely on additional…

Machine Learning · Statistics 2011-11-01 Andrea Schirru , Simone Pampuri , Giuseppe De Nicolao , Sean McLoone

Sparse Gaussian Processes are a key component of high-throughput Bayesian optimisation (BO) loops -- an increasingly common setting where evaluation budgets are large and highly parallelised. By using representative subsets of the available…

Machine Learning · Computer Science 2022-07-14 Henry B. Moss , Sebastian W. Ober , Victor Picheny

Sparsity-based methods are widely used in machine learning, statistics, and signal processing. There is now a rich class of structured sparsity approaches that expand the modeling power of the sparsity paradigm and incorporate constraints…

Data Structures and Algorithms · Computer Science 2017-12-22 Aleksander Mądry , Slobodan Mitrović , Ludwig Schmidt

Advances in leveraging Gaussian processes (GP) have enabled learning and inferring dynamic grid behavior from scarce PMU measurements. However, real measurements can be corrupted by various random and targeted threats, leading to inaccurate…

Systems and Control · Electrical Eng. & Systems 2025-10-20 Tina Gao , Shimiao Li , Lawrence Pileggi

Gaussian Processes (GPs) are powerful kernelized methods for non-parameteric regression used in many applications. However, their use is limited to a few thousand of training samples due to their cubic time complexity. In order to scale GPs…

Machine Learning · Statistics 2021-12-20 Manuel Schürch , Dario Azzimonti , Alessio Benavoli , Marco Zaffalon

Methods for inference and simulation of linearly constrained Gaussian Markov Random Fields (GMRF) are computationally prohibitive when the number of constraints is large. In some cases, such as for intrinsic GMRFs, they may even be…

Methodology · Statistics 2021-06-04 David Bolin , Jonas Wallin

Gaussian processes (GPs) provide a framework for Bayesian inference that can offer principled uncertainty estimates for a large range of problems. For example, if we consider regression problems with Gaussian likelihoods, a GP model enjoys…

Machine Learning · Computer Science 2022-12-21 Felix Leibfried , Vincent Dutordoir , ST John , Nicolas Durrande