English
Related papers

Related papers: On the optimal shape parameter for kernel methods:…

200 papers

An asymptotic theory is established for linear functionals of the predictive function given by kernel ridge regression, when the reproducing kernel Hilbert space is equivalent to a Sobolev space. The theory covers a wide variety of linear…

Statistics Theory · Mathematics 2025-08-25 Rui Tuo , Lu Zou

We develop a new theoretical framework to analyze the generalization error of deep learning, and derive a new fast learning rate for two representative algorithms: empirical risk minimization and Bayesian deep learning. The series of…

Statistics Theory · Mathematics 2017-05-31 Taiji Suzuki

In this work, we propose an unsupervised method for learning dense correspondences between shapes using a recent deep functional map framework. Instead of depending on ground-truth correspondences or the computationally expensive geodesic…

Computer Vision and Pattern Recognition · Computer Science 2020-10-27 Mehmet Aygün , Zorah Lähner , Daniel Cremers

This paper presents new and effective algorithms for learning kernels. In particular, as shown by our empirical results, these algorithms consistently outperform the so-called uniform combination solution that has proven to be difficult to…

Machine Learning · Computer Science 2024-05-01 Corinna Cortes , Mehryar Mohri , Afshin Rostamizadeh

This paper investigates the nonparametric regression problem using SVMs with anisotropic Gaussian RBF kernels. Under the assumption that the target functions are resided in certain anisotropic Besov spaces, we establish the almost optimal…

Machine Learning · Statistics 2018-10-05 Hanyuan Hang , Ingo Steinwart

This work is motivated by the frequent occurrence of boundary value problems with various boundary conditions in the modeling of some problems in engineering and physical science. Here we propose a new technique to force the positive…

Numerical Analysis · Mathematics 2019-06-19 Babak Azarnavid , Mohammad Nabati , Mahdi Emamjome , Kourosh Parand

Models like support vector machines or Gaussian process regression often require positive semi-definite kernels. These kernels may be based on distance functions. While definiteness is proven for common distances and kernels, a proof for a…

Machine Learning · Computer Science 2018-07-11 Martin Zaefferer , Thomas Bartz-Beielstein , Günter Rudolph

In this paper, we consider the problem of estimating the eigenvalues and eigenfunctions of the covariance kernel (i.e., the functional principal components) from sparse and irregularly observed longitudinal data. We approach this problem…

Methodology · Statistics 2007-10-30 Jie Peng , Debashis Paul

There exists a plethora of parametric models for positive definite kernels, and their use is ubiquitous in disciplines as diverse as statistics, machine learning, numerical analysis, and approximation theory. Usually, the kernel parameters…

Machine Learning · Statistics 2025-01-06 Xavier Emery , Emilio Porcu , Moreno Bevilacqua

We develop an interpolation-based modeling framework for parameter-dependent partial differential equations arising in control, inverse problems, and uncertainty quantification. The solution is discretized in the physical domain using…

Numerical Analysis · Mathematics 2026-04-20 Erik Burman , Mats G. Larson , Karl Larsson , Jonatan Vallin

We develop an intrinsic, heat-kernel based fractional Sobolev framework on closed Riemannian manifolds and study the critical fractional Sobolev embedding. We determine the optimal coefficient of the lower-order $L^{p}$ term and prove that…

Analysis of PDEs · Mathematics 2025-12-23 Hao Tan , Zetian Yan , Zhipeng Yang

Kernel based methods have shown effective performance in many remote sensing classification tasks. However their performance significantly depend on its hyper-parameters. The conventional technique to estimate the parameter comes with high…

Machine Learning · Statistics 2018-04-17 Bharath Bhushan Damodaran

Previous work established fundamental bounds on subwavelength resolution for the radar range resolution problem, called superradar [Phys. Rev. Appl. 20, 064046 (2023)]. In this work, we identify the optimal waveforms for distinguishing the…

Signal Processing · Electrical Eng. & Systems 2025-02-14 Andrew N. Jordan , John C. Howell , Achim Kempf , Shunxing Zhang , Derek White

Let $\Omega = [0,1]^d$ be the unit cube in $\mathbb{R}^d$. We study the problem of how efficiently, in terms of the number of parameters, deep neural networks with the ReLU activation function can approximate functions in the Sobolev spaces…

Machine Learning · Statistics 2024-04-09 Jonathan W. Siegel

We recently introduced a scale of kernel-based greedy schemes for approximating the solutions of elliptic boundary value problems. The procedure is based on a generalized interpolation framework in reproducing kernel Hilbert spaces and was…

Numerical Analysis · Mathematics 2025-07-10 Bernard Haasdonk , Gabriele Santin , Tizian Wenzel

We present an approximation scheme for support vector machine models that use an RBF kernel. A second-order Maclaurin series approximation is used for exponentials of inner products between support vectors and test instances. The…

Machine Learning · Statistics 2014-10-06 Marc Claesen , Frank De Smet , Johan A. K. Suykens , Bart De Moor

This paper deals with an inertial proximal algorithm that contains a Tikhonov regularization term, in connection to the minimization problem of a convex lower semicontinuous function $f$. We show that for appropriate Tikhonov regularization…

Optimization and Control · Mathematics 2024-01-09 Szilárd Csaba László

We investigate if kernel regularization methods can achieve minimax convergence rates over a source condition regularity assumption for the target function. These questions have been considered in past literature, but only under specific…

Machine Learning · Statistics 2016-11-15 Gilles Blanchard , Nicole Mücke

In this work, we investigate various approaches that use learning from training data to solve inverse problems, following a bi-level learning approach. We consider a general framework for optimal inversion design, where training data can be…

Numerical Analysis · Mathematics 2021-10-07 Julianne Chung , Matthias Chung , Silvia Gazzola , Mirjeta Pasha

We consider the problem of learning regression functions from pairwise data when there exists prior knowledge that the relation to be learned is symmetric or anti-symmetric. Such prior knowledge is commonly enforced by symmetrizing or…

Machine Learning · Computer Science 2015-06-22 Tapio Pahikkala , Markus Viljanen , Antti Airola , Willem Waegeman
‹ Prev 1 8 9 10 Next ›