中文
相关论文

相关论文: Multiresolution Kernel Approximation for Gaussian …

200 篇论文

We provide guarantees for approximate Gaussian Process (GP) regression resulting from two common low-rank kernel approximations: based on random Fourier features, and based on truncating the kernel's Mercer expansion. In particular, we…

机器学习 · 统计学 2022-02-22 Constantinos Daskalakis , Petros Dellaportas , Aristeidis Panos

We provide guarantees for approximate Gaussian Process (GP) regression resulting from two common low-rank kernel approximations: based on random Fourier features, and based on truncating the kernel's Mercer expansion. In particular, we…

机器学习 · 统计学 2021-12-16 Constantinos Daskalakis , Petros Dellaportas , Aristeidis Panos

Gaussian processes provide a powerful probabilistic kernel learning framework, which allows learning high quality nonparametric regression models via methods such as Gaussian process regression. Nevertheless, the learning phase of Gaussian…

数值分析 · 数学 2021-01-06 Paz Fink Shustin , Haim Avron

In this work, we investigate Gaussian process regression used to recover a function based on noisy observations. We derive upper and lower error bounds for Gaussian process regression with possibly misspecified correlation functions. The…

统计理论 · 数学 2022-07-20 Wenjia Wang , Bing-Yi Jing

Gaussian Process (GP) regression is a powerful nonparametric Bayesian framework, but its performance depends critically on the choice of covariance kernel. Selecting an appropriate kernel is therefore central to model quality, yet remains…

机器学习 · 计算机科学 2026-01-14 Md Shafiqul Islam , Shakti Prasad Padhy , Douglas Allaire , Raymundo Arróyave

Additive Gaussian Processes (GPs) are popular approaches for nonparametric feature selection. The common training method for these models is Bayesian Back-fitting. However, the convergence rate of Back-fitting in training additive GPs is…

机器学习 · 统计学 2024-04-02 Lu Zou , Liang Ding

Kernel-based models such as kernel ridge regression and Gaussian processes are ubiquitous in machine learning applications for regression and optimization. It is well known that a major downside for kernel-based models is the high…

机器学习 · 计算机科学 2022-06-22 Sattar Vakili , Jonathan Scarlett , Da-shan Shiu , Alberto Bernacchia

Gaussian processes offer an attractive framework for predictive modeling from longitudinal data, i.e., irregularly sampled, sparse observations from a set of individuals over time. However, such methods have two key shortcomings: (i) They…

机器学习 · 统计学 2020-12-09 Junjie Liang , Yanting Wu , Dongkuan Xu , Vasant Honavar

Gaussian processes are powerful, yet analytically tractable models for supervised learning. A Gaussian process is characterized by a mean function and a covariance function (kernel), which are determined by a model selection criterion. The…

机器学习 · 统计学 2016-10-05 Benjamin Fischer , Nico Gorbach , Stefan Bauer , Yatao Bian , Joachim M. Buhmann

Gaussian process regression is a well-established Bayesian machine learning method. We propose a new approach to Gaussian process regression using quantum kernels based on parameterized quantum circuits. By employing a hardware-efficient…

量子物理 · 物理学 2024-02-06 Frederic Rapp , Marco Roth

We introduce new Gaussian Process (GP) high-order approximations to linear operations that are frequently used in various numerical methods. Our method employs the kernel-based GP regression modeling, a non-parametric Bayesian approach to…

计算物理 · 物理学 2025-06-09 Christopher DeGrendele , Dongwook Lee

Gaussian processes are popular and flexible models for spatial, temporal, and functional data, but they are computationally infeasible for large datasets. We discuss Gaussian-process approximations that use basis functions at multiple…

统计方法学 · 统计学 2020-12-22 Matthias Katzfuss , Wenlong Gong

Complex-valued signals are used in the modeling of many systems in engineering and science, hence being of fundamental interest. Often, random complex-valued signals are considered to be proper. A proper complex random variable or process…

Probabilistic machine learning models are distinguished by their ability to integrate prior knowledge of noise statistics, smoothness parameters, and training data uncertainty. A common approach involves modeling data with Gaussian…

统计计算 · 统计学 2025-07-31 Cristian A. Galvis-Florez , Ahmad Farooq , Simo Särkkä

Despite a large corpus of recent work on scaling up Gaussian processes, a stubborn trade-off between computational speed, prediction and uncertainty quantification accuracy, and customizability persists. This is because the vast majority of…

机器学习 · 计算机科学 2025-12-09 Marcus M. Noack , Mark D. Risser , Hengrui Luo , Vardaan Tekriwal , Ronald J. Pandolfi

When the data are sparse, optimization of hyperparameters of the kernel in Gaussian process regression by the commonly used maximum likelihood estimation (MLE) criterion often leads to overfitting. We show that choosing hyperparameters (in…

统计方法学 · 统计学 2023-01-27 Sergei Manzhos , Manabu Ihara

Efficient and accurate low-rank approximations of multiple data sources are essential in the era of big data. The scaling of kernel-based learning algorithms to large datasets is limited by the O(n^2) computation and storage complexity of…

机器学习 · 计算机科学 2020-12-10 Martin Stražar , Tomaž Curk

Matrix approximations are a key element in large-scale algebraic machine learning approaches. The recently proposed method MEKA (Si et al., 2014) effectively employs two common assumptions in Hilbert spaces: the low-rank property of an…

机器学习 · 计算机科学 2022-01-21 Simon Heilig , Maximilian Münch , Frank-Michael Schleif

The paper addresses the problem to estimate the power spectral density of an ARMA zero mean Gaussian process. We propose a kernel based maximum entropy spectral estimator. The latter searches the optimal spectrum over a class of high order…

最优化与控制 · 数学 2020-04-30 Mattia Zorzi

This paper investigates the robustness and optimality of the multi-kernel correntropy (MKC) on linear regression. We first derive an upper error bound for a scalar regression problem in the presence of arbitrarily large outliers and reveal…

系统与控制 · 电气工程与系统科学 2023-10-12 Shilei Li , Yunjiang Lou , Dawei Shi , Lijing Li , Ling Shi