English
Related papers

Related papers: Sobolev Norm Learning Rates for Conditional Mean E…

200 papers

Previous analysis of regularized functional linear regression in a reproducing kernel Hilbert space (RKHS) typically requires the target function to be contained in this kernel space. This paper studies the convergence performance of…

Machine Learning · Statistics 2024-02-20 Jiading Liu , Lei Shi

Standard meta-learning for representation learning aims to find a common representation to be shared across multiple tasks. The effectiveness of these methods is often limited when the nuances of the tasks' distribution cannot be captured…

Machine Learning · Computer Science 2021-03-31 Giulia Denevi , Massimiliano Pontil , Carlo Ciliberto

This paper addresses the problem of regression to reconstruct functions, which are observed with superimposed errors at random locations. We address the problem in reproducing kernel Hilbert spaces. It is demonstrated that the estimator,…

Statistics Theory · Mathematics 2021-08-17 Paul Dommel , Alois Pichler

For many machine learning problem settings, particularly with structured inputs such as sequences or sets of objects, a distance measure between inputs can be specified more naturally than a feature representation. However, most standard…

Machine Learning · Statistics 2018-05-28 Lingfei Wu , Ian En-Hsu Yen , Fangli Xu , Pradeep Ravikumar , Michael Witbrock

We develop a rigorous framework for extending neural operators to handle out-of-distribution input functions. We leverage kernel approximation techniques and provide theory for characterizing the input-output function spaces in terms of…

Machine Learning · Computer Science 2026-03-05 Blaine Quackenbush , Paul J. Atzberger

In this article, we study nonparametric inference problems in the context of multivariate or functional time series, including testing for goodness-of-fit, the presence of a change point in the marginal distribution, and the independence of…

Methodology · Statistics 2026-01-22 Deep Ghoshal , Xiaofeng Shao

We consider the regret minimization problem in reinforcement learning (RL) in the episodic setting. In many real-world RL environments, the state and action spaces are continuous or very large. Existing approaches establish regret…

Machine Learning · Computer Science 2022-06-29 Sayak Ray Chowdhury , Rafael Oliveira

Current methods for stochastic hyperparameter learning in Gaussian Processes (GPs) rely on approximations, such as computing biased stochastic gradients or using inducing points in stochastic variational inference. However, when using such…

Machine Learning · Computer Science 2025-08-29 Neta Shoham , Haim Avron

This work is concerned with the kernel-based approximation of a complex-valued function from data, where the frequency response function of a partial differential equation in the frequency domain is of particular interest. In this setting,…

Computational Engineering, Finance, and Science · Computer Science 2024-11-26 Julien Bect , Niklas Georg , Ulrich Römer , Sebastian Schöps

Optimal experimental design seeks to determine the most informative allocation of experiments to infer an unknown statistical quantity. In this work, we investigate the optimal design of experiments for {\em estimation of linear functionals…

Artificial Intelligence · Computer Science 2023-01-18 Mojmír Mutný , Andreas Krause

We study Tikhonov regularization for possibly nonlinear inverse problems with weighted $\ell^1$-penalization. The forward operator, mapping from a sequence space to an arbitrary Banach space, typically an $L^2$-space, is assumed to satisfy…

Numerical Analysis · Mathematics 2021-10-19 Philip Miller , Thorsten Hohage

Nonlinearities in piezoelectric systems can arise from internal factors such as nonlinear constitutive laws or external factors like realizations of boundary conditions. It can be difficult or even impossible to derive detailed models from…

Optimization and Control · Mathematics 2020-04-14 Sai Tej Paruchuri , Jia Guo , Andrew J. Kurdila

This paper combines vector-valued reproducing kernel Hilbert space (vRKHS) embedding with robust adaptive observation, yielding an algorithm that is both non-parametric and robust. The main contribution of this paper lies in the ability of…

Systems and Control · Electrical Eng. & Systems 2025-10-28 Shengyuan Niu , Haoran Wang , Heejip Moon , Andrea L'Afflitto , Andrew Kurdila , Daniel Stilwell

Random feature approximation is arguably one of the most popular techniques to speed up kernel methods in large scale algorithms and provides a theoretical approach to the analysis of deep neural networks. We analyze generalization…

Machine Learning · Computer Science 2023-08-30 Mike Nguyen , Nicole Mücke

Latent space models are widely used for analyzing high-dimensional discrete data matrices, such as patient-feature matrices in electronic health records (EHRs), by capturing complex dependence structures through low-dimensional embeddings.…

Machine Learning · Computer Science 2026-02-19 Weijing Tang , Ming Yuan , Zongqi Xia , Tianxi Cai

We propose algorithms to take point sets for kernel-based interpolation of functions in reproducing kernel Hilbert spaces (RKHSs) by convex optimization. We consider the case of kernels with the Mercer expansion and propose an algorithm by…

Numerical Analysis · Mathematics 2019-08-19 Ken'ichiro Tanaka

While many approaches exist in the literature to learn low-dimensional representations for data collections in multiple modalities, the generalizability of multi-modal nonlinear embeddings to previously unseen data is a rather overlooked…

Machine Learning · Computer Science 2021-05-05 Semih Kaya , Elif Vural

This paper studies an intriguing phenomenon related to the good generalization performance of estimators obtained by using large learning rates within gradient descent algorithms. First observed in the deep learning literature, we show that…

Machine Learning · Statistics 2022-06-06 Gaspard Beugnot , Julien Mairal , Alessandro Rudi

This paper studies a Nystr\"om type subsampling approach to large kernel learning methods in the misspecified case, where the target function is not assumed to belong to the reproducing kernel Hilbert space generated by the underlying…

Machine Learning · Statistics 2018-06-05 Shuai Lu , Peter Mathé , Sergiy Pereverzyev

In this paper, we study the convergence of the spectral embeddings obtained from the leading eigenvectors of certain similarity matrices to their population counterparts. We opt to study this convergence in a uniform (instead of average)…

Statistics Theory · Mathematics 2023-04-26 Ruofei Zhao , Songkai Xue , Yuekai Sun