中文
相关论文

相关论文: Estimating Broad Sense Heritability via Kernel Rid…

200 篇论文

Decision forests are widely used for classification and regression tasks. A lesser known property of tree-based methods is that one can construct a proximity matrix from the tree(s), and these proximity matrices are induced kernels. While…

机器学习 · 统计学 2024-10-14 Sambit Panda , Cencheng Shen , Joshua T. Vogelstein

Kernel ridge regression (KRR) is a widely used nonparametric method due to its strong theoretical guarantees and computational convenience. However, standard KRR does not distinguish between linear and nonlinear components in the signal,…

统计理论 · 数学 2026-05-13 Xin Bing , Chao Wang

Kernel ridge regression is well-known to achieve minimax optimal rates in low-dimensional settings. However, its behavior in high dimensions is much less understood. Recent work establishes consistency for kernel regression under certain…

统计理论 · 数学 2021-04-12 Konstantin Donhauser , Mingqi Wu , Fanny Yang

This paper conducts a comprehensive study of the learning curves of kernel ridge regression (KRR) under minimal assumptions. Our contributions are three-fold: 1) we analyze the role of key properties of the kernel, such as its spectral…

机器学习 · 计算机科学 2024-10-24 Tin Sum Cheng , Aurelien Lucchi , Anastasis Kratsios , David Belius

It is well known that kernel ridge regression (KRR) is a popular nonparametric regression estimator. Nonetheless, in the presence of a large data set with size $n\gg 1,$ the KRR estimator has the drawback to require an intensive…

统计理论 · 数学 2023-01-19 Asma Ben Saber , Abderrazek Karoui

The kernel ridge regression (KRR) approach is extended to include the odd-even effects in nuclear mass predictions by remodulating the kernel function without introducing new weight parameters and inputs in the training network. By taking…

核理论 · 物理学 2021-06-03 X. H. Wu , L. H. Guo , P. W. Zhao

The classical kernel ridge regression problem aims to find the best fit for the output $Y$ as a function of the input data $X\in \mathbb{R}^d$, with a fixed choice of regularization term imposed by a given choice of a reproducing kernel…

机器学习 · 统计学 2025-06-10 Yang Li , Feng Ruan

This paper considers the problem of kernel regression and classification with possibly unobservable response variables in the data, where the mechanism that causes the absence of information is unknown and can depend on both predictors and…

统计理论 · 数学 2022-12-07 Majid Mojirsheibani , William Pouliot , Andre Shakhbandaryan

Meta-learning involves training models on a variety of training tasks in a way that enables them to generalize well on new, unseen test tasks. In this work, we consider meta-learning within the framework of high-dimensional multivariate…

统计理论 · 数学 2024-04-01 Yanhao Jin , Krishnakumar Balasubramanian , Debashis Paul

This paper presents a new perspective on the identification at infinity for the intercept of the sample selection model as identification at the boundary via a transformation of the selection index. This perspective suggests generalizations…

计量经济学 · 经济学 2023-02-13 Zhewen Pan

In this paper, we propose a variable selection method for general nonparametric kernel-based estimation. The proposed method consists of two-stage estimation: (1) construct a consistent estimator of the target function, (2) approximate the…

机器学习 · 统计学 2018-12-05 Kota Matsui , Wataru Kumagai , Kenta Kanamori , Mitsuaki Nishikimi , Takafumi Kanamori

Kernel methods provide a principled approach to nonparametric learning. While their basic implementations scale poorly to large problems, recent advances showed that approximate solvers can efficiently handle massive datasets. A shortcoming…

机器学习 · 计算机科学 2022-01-19 Giacomo Meanti , Luigi Carratino , Ernesto De Vito , Lorenzo Rosasco

We propose a new kernel for biological sequences which borrows ideas and techniques from information theory and data compression. This kernel can be used in combination with any kernel method, in particular Support Vector Machines for…

基因组学 · 定量生物学 2011-01-05 Marco Cuturi , Jean-Philippe Vert

This manuscript delves into the intersection of genomics and phenotypic prediction, focusing on the statistical innovation required to navigate the complexities introduced by noisy covariates and confounders. The primary emphasis is on the…

统计方法学 · 统计学 2024-11-15 Upama Paul Chowdhury , Ronit Bhattacharjee , Susmita Das , Abhik Ghosh

We develop and analyze a principled approach to kernel ridge regression under covariate shift. The goal is to learn a regression function with small mean squared error over a target distribution, based on unlabeled data from there and…

统计方法学 · 统计学 2025-07-25 Kaizheng Wang

We study the risk (i.e. generalization error) of Kernel Ridge Regression (KRR) for a kernel $K$ with ridge $\lambda>0$ and i.i.d. observations. For this, we introduce two objects: the Signal Capture Threshold (SCT) and the Kernel Alignment…

机器学习 · 统计学 2020-06-18 Arthur Jacot , Berfin Şimşek , Francesco Spadaro , Clément Hongler , Franck Gabriel

Recent theoretical studies illustrated that kernel ridgeless regression can guarantee good generalization ability without an explicit regularization. In this paper, we investigate the statistical properties of ridgeless regression with…

机器学习 · 计算机科学 2023-08-30 Jian Li , Yong Liu , Yingying Zhang

We derive and analyze a generic, recursive algorithm for estimating all splits in a finite cluster tree as well as the corresponding clusters. We further investigate statistical properties of this generic clustering algorithm when it…

机器学习 · 统计学 2021-11-02 Ingo Steinwart , Bharath K. Sriperumbudur , Philipp Thomann

Understanding treatment effect heterogeneity is vital to many scientific fields because the same treatment may affect different individuals differently. Quantile regression provides a natural framework for modeling such heterogeneity. We…

统计方法学 · 统计学 2023-07-12 Alexander Giessing , Jingshen Wang

We propose a sound field estimation method based on kernel ridge regression using a rigid spherical microphone array. Kernel ridge regression with physically constrained kernel functions, and further with kernel functions adapted to…

音频与语音处理 · 电气工程与系统科学 2025-08-06 Ryo Matsuda , Juliano G. C. Ribeiro , Hitoshi Akiyama , Jorge Trevino