English
Related papers

Related papers: Time-domain sound field estimation using kernel ri…

200 papers

Distributed machine learning systems have been receiving increasing attentions for their efficiency to process large scale data. Many distributed frameworks have been proposed for different machine learning tasks. In this paper, we study…

Machine Learning · Computer Science 2020-07-01 Hongwei Sun , Qiang Wu

We propose estimators based on kernel ridge regression for nonparametric causal functions such as dose, heterogeneous, and incremental response curves. Treatment and covariates may be discrete or continuous in general spaces. Due to a…

Econometrics · Economics 2022-10-25 Rahul Singh , Liyuan Xu , Arthur Gretton

The divide-and-conquer method has been widely used for estimating large-scale kernel ridge regression estimates. Unfortunately, when the response variable is highly skewed, the divide-and-conquer kernel ridge regression (dacKRR) may…

Machine Learning · Statistics 2021-11-11 Jingyi Zhang , Xiaoxiao Sun

We establish optimal convergence rates for a decomposition-based scalable approach to kernel ridge regression. The method is simple to describe: it randomly partitions a dataset of size N into m subsets of equal size, computes an…

Statistics Theory · Mathematics 2014-05-01 Yuchen Zhang , John C. Duchi , Martin J. Wainwright

This paper focuses on generalization performance analysis for distributed algorithms in the framework of learning theory. Taking distributed kernel ridge regression (DKRR) for example, we succeed in deriving its optimal learning rates in…

Machine Learning · Computer Science 2020-03-30 Shao-Bo Lin , Di Wang , Ding-Xuan Zhou

Many machine learning problems can be formulated as predicting labels for a pair of objects. Problems of that kind are often referred to as pairwise learning, dyadic prediction or network inference problems. During the last decade kernel…

Machine Learning · Statistics 2018-03-06 Michiel Stock , Tapio Pahikkala , Antti Airola , Bernard De Baets , Willem Waegeman

We propose new reproducing kernel-based tests for model checking in conditional moment restriction models. By regressing estimated residuals on kernel functions via kernel ridge regression (KRR), we obtain a coefficient function in a…

Econometrics · Economics 2025-05-05 Yuhao Li

Recent work on background subtraction has shown developments on two major fronts. In one, there has been increasing sophistication of probabilistic models, from mixtures of Gaussians at each pixel [7], to kernel density estimates at each…

Computer Vision and Pattern Recognition · Computer Science 2016-11-17 Manjunath Narayana , Allen Hanson , Erik Learned-Miller

We provide uniform confidence bands for kernel ridge regression (KRR), a widely used nonparametric regression estimator for nonstandard data such as preferences, sequences, and graphs. Despite the prevalence of these data--e.g., student…

Statistics Theory · Mathematics 2025-08-19 Rahul Singh , Suhas Vijaykumar

Kernel ridge regression (KRR) is a foundational tool in machine learning, with recent work emphasizing its connections to neural networks. However, existing theory primarily addresses the i.i.d. setting, while real-world data often exhibits…

Machine Learning · Statistics 2025-10-20 Dechen Zhang , Zhenmei Shi , Yi Zhang , Yingyu Liang , Difan Zou

Over-parameterized models like deep nets and random forests have become very popular in machine learning. However, the natural goals of continuity and differentiability, common in regression models, are now often ignored in modern…

Machine Learning · Computer Science 2023-10-16 Mingxuan Han , Varun Shankar , Jeff M Phillips , Chenglong Ye

Random feature (RF) has been widely used for node consistency in decentralized kernel ridge regression (KRR). Currently, the consistency is guaranteed by imposing constraints on coefficients of features, necessitating that the random…

Machine Learning · Computer Science 2024-09-23 Ruikai Yang , Fan He , Mingzhen He , Jie Yang , Xiaolin Huang

Instrumental variable (IV) regression can be approached through its formulation in terms of conditional moment restrictions (CMR). Building on variants of the generalized method of moments, most CMR estimators are implicitly based on…

Machine Learning · Computer Science 2024-05-21 Heiner Kremer , Bernhard Schölkopf

The effective contact area in rough surface contact plays a critical role in multi-physics phenomena such as wear, sealing, and thermal or electrical conduction. Although accurate numerical methods, like the Boundary Element Method (BEM),…

Computational Engineering, Finance, and Science · Computer Science 2025-04-25 Tarik Sahin , Jacopo Bonari , Sebastian Brandstaeter , Alexander Popp

Kernel methods for deconvolution have attractive features, and prevail in the literature. However, they have disadvantages, which include the fact that they are usually suitable only for cases where the error distribution is infinitely…

Statistics Theory · Mathematics 2009-09-29 Peter Hall , Alexander Meister

Bone age is an important measure for assessing the skeletal and biological maturity of children. Delayed or increased bone age is a serious concern for pediatricians, and needs to be accurately assessed in a bid to determine whether bone…

Computer Vision and Pattern Recognition · Computer Science 2021-04-19 Ibrahim Salim , A. Ben Hamza

Sound field reconstruction refers to the problem of estimating the acoustic pressure field over an arbitrary region of space, using only a limited set of measurements. Physics-informed neural networks have been adopted to solve the problem…

Audio and Speech Processing · Electrical Eng. & Systems 2025-06-05 Stefano Damiano , Toon van Waterschoot

One central theme in machine learning is function estimation from sparse and noisy data. An example is supervised learning where the elements of the training set are couples, each containing an input location and an output response. In the…

Machine Learning · Computer Science 2023-10-05 Alberto Giaretta , Mauro Bisiacco , Gianluigi Pillonetto

For the concise characterization of radio channel measurement setups, different performance metrics like dynamic range and maximum measurable path loss have been proposed. This work further elaborates on these metrics and discusses…

Signal Processing · Electrical Eng. & Systems 2020-08-19 Sven Wittig , Wilhelm Keusgen , Michael Peter , Taro Eichler

Kernel methods are an incredibly popular technique for extending linear models to non-linear problems via a mapping to an implicit, high-dimensional feature space. While kernel methods are computationally cheaper than an explicit feature…

Machine Learning · Statistics 2019-02-26 Philip Milton , Emanuele Giorgi , Samir Bhatt