中文
相关论文

相关论文: Fast and Accurate Gaussian Kernel Ridge Regression…

200 篇论文

The low-rank matrix recovery problem often arises in various fields, including signal processing, machine learning, and imaging science. The Riemannian gradient descent (RGD) algorithm has proven to be an efficient algorithm for solving…

最优化与控制 · 数学 2023-05-05 Fengmiao Bian , Jian-Feng Cai , Rui Zhang

In this work, we investigate Gaussian process regression used to recover a function based on noisy observations. We derive upper and lower error bounds for Gaussian process regression with possibly misspecified correlation functions. The…

统计理论 · 数学 2022-07-20 Wenjia Wang , Bing-Yi Jing

Kernel regression is an essential and ubiquitous tool for non-parametric data analysis, particularly popular among time series and spatial data. However, the central operation which is performed many times, evaluating a kernel on the data…

机器学习 · 计算机科学 2017-06-01 Yan Zheng , Jeff M. Phillips

Support for lower precision computation is becoming more common in accelerator hardware due to lower power usage, reduced data movement and increased computational performance. However, computational science and engineering (CSE) problems…

This paper introduces algorithms to select/design kernels in Gaussian process regression/kriging surrogate modeling techniques. We adopt the setting of kernel method solutions in ad hoc functional spaces, namely Reproducing Kernel Hilbert…

机器学习 · 统计学 2022-09-07 Jean-Luc Akian , Luc Bonnet , Houman Owhadi , Éric Savin

Regularized pairwise ranking with Gaussian kernels is one of the cutting-edge learning algorithms. Despite a wide range of applications, a rigorous theoretical demonstration still lacks to support the performance of such ranking estimators.…

机器学习 · 统计学 2023-04-07 Guanhang Lei , Lei Shi

Scaling analysis, in which one infers scaling exponents and a scaling function in a scaling law from given data, is a powerful tool for determining universal properties of critical phenomena in many fields of science. However, there are…

统计力学 · 物理学 2015-07-08 Kenji Harada

When the data are sparse, optimization of hyperparameters of the kernel in Gaussian process regression by the commonly used maximum likelihood estimation (MLE) criterion often leads to overfitting. We show that choosing hyperparameters (in…

统计方法学 · 统计学 2023-01-27 Sergei Manzhos , Manabu Ihara

Developing suitable approximate models for analyzing and simulating complex nonlinear systems is practically important. This paper aims at exploring the skill of a rich class of nonlinear stochastic models, known as the conditional Gaussian…

数值分析 · 数学 2022-06-01 Nan Chen , Yingda Li , Honghu Liu

The increased demand for online prediction and the growing availability of large data sets drives the need for computationally efficient models. While exact Gaussian process regression shows various favorable theoretical properties…

Kernel ridge regression (KRR) is widely used for nonparametric regression over reproducing kernel Hilbert spaces. It offers powerful modeling capabilities at the cost of significant computational costs, which typically require $O(n^3)$…

统计方法学 · 统计学 2024-03-18 Xiaowu Dai , Huiying Zhong

In spatial statistics and machine learning, the kernel matrix plays a pivotal role in prediction, classification, and maximum likelihood estimation. A thorough examination reveals that for large sample sizes, the kernel matrix becomes…

机器学习 · 统计学 2023-11-07 Hao Zhang

I introduce a novel algorithm and accompanying Python library, named mlcausality, designed for the identification of nonlinear Granger causal relationships. This novel algorithm uses a flexible plug-in architecture that enables researchers…

机器学习 · 统计学 2023-09-13 Wojciech "Victor" Fulmyk

The discontinuous Galerkin time-stepping method has many advantageous properties for solving parabolic equations. However, it requires the solution of a large nonsymmetric system at each time-step. This work develops a fully robust and…

数值分析 · 数学 2025-01-29 Iain Smears

This paper is an attempt to bridge the conceptual gaps between researchers working on the two widely used approaches based on positive definite kernels: Bayesian learning or inference using Gaussian processes on the one side, and…

机器学习 · 统计学 2018-07-10 Motonobu Kanagawa , Philipp Hennig , Dino Sejdinovic , Bharath K Sriperumbudur

Automating statistical modelling is a challenging problem in artificial intelligence. The Automatic Statistician takes a first step in this direction, by employing a kernel search algorithm with Gaussian Processes (GP) to provide…

机器学习 · 统计学 2018-02-15 Hyunjik Kim , Yee Whye Teh

Kernel based methods have shown effective performance in many remote sensing classification tasks. However their performance significantly depend on its hyper-parameters. The conventional technique to estimate the parameter comes with high…

机器学习 · 统计学 2018-04-17 Bharath Bhushan Damodaran

Gaussian process regression is a well-established Bayesian machine learning method. We propose a new approach to Gaussian process regression using quantum kernels based on parameterized quantum circuits. By employing a hardware-efficient…

量子物理 · 物理学 2024-02-06 Frederic Rapp , Marco Roth

Gaussian processes are important models in the field of probabilistic numerics. We present a procedure for optimizing Mat\'ern kernel temporal Gaussian processes with respect to the kernel covariance function's hyperparameters. It is based…

机器学习 · 计算机科学 2025-08-14 Wouter M. Kouw

We present a novel preconditioning technique for proximal optimization methods that relies on graph algorithms to construct effective preconditioners. Such combinatorial preconditioners arise from partitioning the graph into forests. We…

最优化与控制 · 数学 2018-02-22 Thomas Möllenhoff , Zhenzhang Ye , Tao Wu , Daniel Cremers