English
Related papers

Related papers: fastkqr: A Fast Algorithm for Kernel Quantile Regr…

200 papers

Kernel-based reinforcement learning (KBRL) stands out among reinforcement learning algorithms for its strong theoretical guarantees. By casting the learning problem as a local kernel approximation, KBRL provides a way of computing a…

Machine Learning · Computer Science 2014-07-22 André M. S. Barreto , Doina Precup , Joelle Pineau

Partial least squares (PLS) is a dimensionality reduction technique used as an alternative to ordinary least squares (OLS) in situations where the data is colinear or high dimensional. Both PLS and OLS provide mean based estimates, which…

Methodology · Statistics 2021-10-18 Alvaro Mendez Civieta , M. Carmen Aguilera-Morillo , Rosa E. Lillo

Existing statistical learning guarantees for general kernel regressors often yield loose bounds when used with finite-rank kernels. Yet, finite-rank kernels naturally appear in several machine learning problems, e.g.\ when fine-tuning a…

Machine Learning · Computer Science 2023-10-04 Tin Sum Cheng , Aurelien Lucchi , Ivan Dokmanić , Anastasis Kratsios , David Belius

Quantile regression (QR) can be used to describe the comprehensive relationship between a response and predictors. Prior domain knowledge and assumptions in application are usually formulated as constraints of parameters to improve the…

Computation · Statistics 2023-05-15 Yongxin Liu , Peng Zeng

Leverage score sampling is crucial to the design of randomized algorithms for large-scale matrix problems, while the computation of leverage scores is a bottleneck of many applications. In this paper, we propose a quantum algorithm to…

Quantum Physics · Physics 2023-09-19 Changpeng Shao

We prove statistical rates of convergence for kernel-based least squares regression from i.i.d. data using a conjugate gradient algorithm, where regularization against overfitting is obtained by early stopping. This method is related to…

Statistics Theory · Mathematics 2016-07-11 Gilles Blanchard , Nicole Krämer

Quantum machine learning has the potential for broad industrial applications, and the development of quantum algorithms for improving the performance of neural networks is of particular interest given the central role they play in machine…

Quantum Physics · Physics 2019-09-09 Jonathan Allcock , Chang-Yu Hsieh , Iordanis Kerenidis , Shengyu Zhang

We present a quantum algorithm for fitting a linear regression model to a given data set using the least squares approach. Different from previous algorithms which yield a quantum state encoding the optimal parameters, our algorithm outputs…

Quantum Physics · Physics 2017-08-01 Guoming Wang

The Neural Tangent Kernel (NTK) characterizes the behavior of infinitely wide neural nets trained under least squares loss by gradient descent. However, despite its importance, the super-quadratic runtime of kernel methods limits the use of…

Machine Learning · Computer Science 2021-07-28 Amir Zandieh

Quantile regression and conditional density estimation can reveal structure that is missed by mean regression, such as multimodality and skewness. In this paper, we introduce a deep learning generative model for joint quantile estimation…

Methodology · Statistics 2023-11-14 Shijie Wang , Minsuk Shin , Ray Bai

This paper presents an accelerated quadrature scheme for the evaluation of layer potentials in three dimensions. Our scheme combines a generic, high order quadrature method for singular kernels called Quadrature by Expansion (QBX) with a…

Numerical Analysis · Mathematics 2019-04-01 Matt Wala , Andreas Klöckner

The basic idea of quantum computing is surprisingly similar to that of kernel methods in machine learning, namely to efficiently perform computations in an intractably large Hilbert space. In this paper we explore some theoretical…

Quantum Physics · Physics 2019-02-06 Maria Schuld , Nathan Killoran

This paper proposes a new method to address the long-standing problem of lack of monotonicity in estimation of the conditional and structural quantile function, also known as quantile crossing problem. Quantile regression is a very powerful…

Machine Learning · Statistics 2021-11-25 Resve A. Saleh , A. K. Md. Ehsanes Saleh

Data depth is a statistical function that generalizes order and quantiles to the multivariate setting and beyond, with applications spanning over descriptive and visual statistics, anomaly detection, testing, etc. The celebrated halfspace…

Machine Learning · Statistics 2023-12-22 Arturo Castellanos , Pavlo Mozharovskyi , Florence d'Alché-Buc , Hicham Janati

Kernel ridge regression (KRR) is a widely used nonparametric method due to its strong theoretical guarantees and computational convenience. However, standard KRR does not distinguish between linear and nonlinear components in the signal,…

Statistics Theory · Mathematics 2026-05-13 Xin Bing , Chao Wang

When solving linear systems $Ax=b$, $A$ and $b$ are given, but the measurements $b$ often contain corruptions. Inspired by recent work on the quantile-randomized Kaczmarz method, we propose an acceleration of the randomized Kaczmarz method…

Numerical Analysis · Mathematics 2024-10-18 Emeric Battaglia , Anna Ma

Standard conformal prediction methods guarantee marginal coverage but often produce inefficient intervals that fail to adapt to local heteroscedasticity, while recent localized approaches often struggle to maintain validity across distinct…

Methodology · Statistics 2025-12-02 Yuan Lu

Among various quantum machine learning (QML) algorithms, the quantum kernel method has especially attracted attention due to its compatibility with noisy intermediate-scale quantum devices and its potential to achieve quantum advantage.…

Quantum Physics · Physics 2024-08-07 Keitaro Anai , Shion Ikehara , Yoshichika Yano , Daichi Okuno , Shuntaro Takeda

Kernel ridge regression (KRR), also known as the least-squares support vector machine, is a fundamental method for learning functions from finite samples. While most existing analyses focus on the noisy setting with constant-level label…

Machine Learning · Statistics 2025-04-14 Jihao Long , Xiaojun Peng , Lei Wu

Quantum machine learning with quantum kernels for classification problems is a growing area of research. Recently, quantum kernel alignment techniques that parameterise the kernel have been developed, allowing the kernel to be trained and…