English
Related papers

Related papers: Convergence guarantees for kernel-based quadrature…

200 papers

We study the problem of estimating linear response statistics under external perturbations using time series of unperturbed dynamics. Based on the fluctuation-dissipation theory, this problem is reformulated as an unsupervised learning task…

Statistics Theory · Mathematics 2020-12-09 He Zhang , John Harlim , Xiantao Li

We establish a Karhunen-Lo`eve expansion for generic centered, second order stochastic processes, which does not rely on topological assumptions. We further investigate in which norms the expansion converges and derive exact average rates…

Probability · Mathematics 2017-03-08 Ingo Steinwart

Conditionally positive definite (CPD) kernels are defined with respect to a function class $\mathcal{F}$. It is well known that such a kernel $K$ is associated with its native space (defined analogously to an RKHS), which in turn gives rise…

Machine Learning · Computer Science 2026-05-26 Rustem Takhanov , Zhenisbek Assylbekov

Computing a consensus object from a set of given objects is a core problem in machine learning and pattern recognition. One popular approach is to formulate it as an optimization problem using the generalized median. Previous methods like…

Computer Vision and Pattern Recognition · Computer Science 2022-09-22 Andreas Nienkötter , Xiaoyi Jiang

In real supervised learning scenarios, it is not uncommon that the training and test sample follow different probability distributions, thus rendering the necessity to correct the sampling bias. Focusing on a particular covariate shift…

Machine Learning · Computer Science 2012-06-22 Yaoliang Yu , Csaba Szepesvari

State-of-the-art neural networks are heavily over-parameterized, making the optimization algorithm a crucial ingredient for learning predictive models with good generalization properties. A recent line of work has shown that in a certain…

Machine Learning · Statistics 2019-11-01 Alberto Bietti , Julien Mairal

In this paper we combine the theory of reproducing kernel Hilbert spaces with the field of collocation methods to solve boundary value problems with special emphasis on reproducing property of kernels. From the reproducing property of…

Numerical Analysis · Mathematics 2019-03-26 Babak Azarnavid , Mahdi Emamjome , Mohammad Nabati , Saeid Abbasbandy

Quantum machine learning techniques are commonly considered one of the most promising candidates for demonstrating practical quantum advantage. In particular, quantum kernel methods have been demonstrated to be able to learn certain…

The Mixup method (Zhang et al. 2018), which uses linearly interpolated data, has emerged as an effective data augmentation tool to improve generalization performance and the robustness to adversarial examples. The motivation is to curtail…

Machine Learning · Computer Science 2020-12-25 Minjin Kim , Young-geun Kim , Dongha Kim , Yongdai Kim , Myunghee Cho Paik

Orthogonality regularization has been developed to prevent deep CNNs from training instability and feature redundancy. Among existing proposals, kernel orthogonality regularization enforces orthogonality by minimizing the residual between…

Computer Vision and Pattern Recognition · Computer Science 2023-06-19 Changhao Wu , Shenan Zhang , Fangsong Long , Ziliang Yin , Tuo Leng

Despite the significance of probabilistic time-series forecasting models, their evaluation metrics often involve intractable integrations. The most widely used metric, the continuous ranked probability score (CRPS), is a strictly proper…

Machine Learning · Statistics 2025-07-25 Masaki Adachi , Masahiro Fujisawa , Michael A Osborne

This paper studies convergence rates for some value function approximations that arise in a collection of reproducing kernel Hilbert spaces (RKHS) $H(\Omega)$. By casting an optimal control problem in a specific class of native spaces,…

Systems and Control · Electrical Eng. & Systems 2023-11-20 Ali Bouland , Shengyuan Niu , Sai Tej Paruchuri , Andrew Kurdila , John Burns , Eugenio Schuster

In this paper, we discuss the convergence analysis of the conjugate gradient-based algorithm for the functional linear model in the reproducing kernel Hilbert space framework, utilizing early stopping results in regularization against…

Statistics Theory · Mathematics 2023-10-05 Naveen Gupta , S. Sivananthan , Bharath K. Sriperumbudur

We propose a framework for hypothesis testing on conditional probability distributions, which we then use to construct statistical tests of functionals of conditional distributions. These tests identify the inputs where the functionals…

Machine Learning · Computer Science 2025-11-03 Pierre-François Massiani , Christian Fiedler , Lukas Haverbeck , Friedrich Solowjow , Sebastian Trimpe

Fair representations are a powerful tool for establishing criteria like statistical parity, proxy non-discrimination, and equality of opportunity in learned models. Existing techniques for learning these representations are typically…

Machine Learning · Computer Science 2020-01-22 Zilong Tan , Samuel Yeom , Matt Fredrikson , Ameet Talwalkar

We consider the kernel partial least squares algorithm for non-parametric regression with stationary dependent data. Probabilistic convergence rates of the kernel partial least squares estimator to the true regression function are…

Statistics Theory · Mathematics 2017-06-13 Marco Singer , Tatyana Krivobokova , Axel Munk

Learning rates for least-squares regression are typically expressed in terms of $L_2$-norms. In this paper we extend these rates to norms stronger than the $L_2$-norm without requiring the regression function to be contained in the…

Machine Learning · Statistics 2020-10-27 Simon Fischer , Ingo Steinwart

This paper presents a general vector-valued reproducing kernel Hilbert spaces (RKHS) framework for the problem of learning an unknown functional dependency between a structured input space and a structured output space. Our formulation…

Machine Learning · Statistics 2016-08-23 Ha Quang Minh , Loris Bazzani , Vittorio Murino

This paper is concerned with inference in threshold regression models when the practitioners do not know whether at the threshold point the true specification has a kink or a jump. We nest previous works that assume either continuity or…

Statistics Theory · Mathematics 2020-01-15 Javier Hidalgo , Jungyoon Lee , Myung Hwan Seo

In finite mixture models, apart from underlying mixing measure, true kernel density function of each subpopulation in the data is, in many scenarios, unknown. Perhaps the most popular approach is to choose some kernel functions that we…

Statistics Theory · Mathematics 2017-09-26 Nhat Ho , XuanLong Nguyen , Ya'acov Ritov
‹ Prev 1 8 9 10 Next ›