English
Related papers

Related papers: Towards regularized learning from functional data …

200 papers

Nonlocal operators with integral kernels have become a popular tool for designing solution maps between function spaces, due to their efficiency in representing long-range dependence and the attractive feature of being resolution-invariant.…

Machine Learning · Statistics 2022-05-24 Fei Lu , Qingci An , Yue Yu

Optimal experimental design seeks to determine the most informative allocation of experiments to infer an unknown statistical quantity. In this work, we investigate the optimal design of experiments for {\em estimation of linear functionals…

Artificial Intelligence · Computer Science 2023-01-18 Mojmír Mutný , Andreas Krause

CoVariance Neural Networks (VNNs) perform graph convolutions on the empirical covariance matrix of signals defined over finite-dimensional Hilbert spaces, motivated by robustness and transferability properties. Yet, little is known about…

Machine Learning · Computer Science 2025-09-18 Claudio Battiloro , Andrea Cavallo , Elvin Isufi

The ability to generalize under distributional shifts is essential to reliable machine learning, while models optimized with empirical risk minimization usually fail on non-$i.i.d$ testing data. Recently, invariant learning methods for…

Machine Learning · Computer Science 2021-10-26 Jiashuo Liu , Zheyuan Hu , Peng Cui , Bo Li , Zheyan Shen

Functional autoregressive (FAR) models provide a fundamental framework for analyzing temporally dependent functional data. However, the infinite-dimensional nature of the underlying Hilbert space introduces intrinsic ill-posedness, as the…

Methodology · Statistics 2025-11-17 Ying Niu , Yuwei Zhao , Zhao Chen , Christina Dan Wang

We prove rates of convergence in the statistical sense for kernel-based least squares regression using a conjugate gradient algorithm, where regularization against overfitting is obtained by early stopping. This method is directly related…

Statistics Theory · Mathematics 2010-09-30 Gilles Blanchard , Nicole Kraemer

We consider the random-design least-squares regression problem within the reproducing kernel Hilbert space (RKHS) framework. Given a stream of independent and identically distributed input/output data, we aim to learn a regression function…

Statistics Theory · Mathematics 2016-03-30 Aymeric Dieuleveut , Francis Bach

The notion of reproducing kernel Hilbert space (RKHS) has emerged in system identification during the past decade. In the resulting framework, the impulse response estimation problem is formulated as a regularized optimization defined on an…

Systems and Control · Electrical Eng. & Systems 2022-04-19 Mohammad Khosravi , Roy S. Smith

Since its introduction, the Discrete Variable Representation (DVR) basis set has become an invaluable representation of state vectors and Hermitian operators in non-relativistic quantum dynamics and spectroscopy calculations. On the other…

Computational Physics · Physics 2014-05-30 Hamse Mussa

Random feature approximation is arguably one of the most popular techniques to speed up kernel methods in large scale algorithms and provides a theoretical approach to the analysis of deep neural networks. We analyze generalization…

Machine Learning · Computer Science 2023-08-30 Mike Nguyen , Nicole Mücke

The necessary and sufficient conditions for existence of a generalized representer theorem are presented for learning Hilbert space-valued functions. Representer theorems involving explicit basis functions and Reproducing Kernels are a…

Machine Learning · Computer Science 2018-09-21 Sanket Diwale , Colin Jones

Kernel methods are among the most popular techniques in machine learning. From a frequentist/discriminative perspective they play a central role in regularization theory as they provide a natural choice for the hypotheses space and the…

Machine Learning · Statistics 2012-04-17 Mauricio A. Alvarez , Lorenzo Rosasco , Neil D. Lawrence

This paper extends a conventional, general framework for online adaptive estimation problems for systems governed by unknown nonlinear ordinary differential equations. The central feature of the theory introduced in this paper represents…

Systems and Control · Computer Science 2017-07-11 Parag Bobade , Suprotim Majumdar , Savio Pereira , Andrew J. Kurdila , John B. Ferris

This manuscript presents an algorithm for obtaining an approximation of a nonlinear high order control affine dynamical system. Controlled trajectories of the system are leveraged as the central unit of information via embedding them in…

Optimization and Control · Mathematics 2026-01-23 Moad Abudia , Tejasvi Channagiri , Joel A. Rosenfeld , Rushikesh Kamalapurkar

Predictive models that generalize well under distributional shift are often desirable and sometimes crucial to building robust and reliable machine learning applications. We focus on distributional shift that arises in causal inference from…

Machine Learning · Statistics 2018-02-27 Fredrik D. Johansson , Nathan Kallus , Uri Shalit , David Sontag

Learning with Reproducing Kernel Hilbert Spaces (RKHS) has been widely used in many scientific disciplines. Because a RKHS can be very flexible, it is common to impose a regularization term in the optimization to prevent overfitting.…

Methodology · Statistics 2017-06-06 Jingxiang Chen , Chong Zhang , Michael R. Kosorok , Yufeng Liu

When training data are distributed across{ time or space,} covariate shift across fragments of training data biases cross-validation, compromising model selection and assessment. We present \textit{Fragmentation-Induced covariate-shift…

Machine Learning · Computer Science 2024-11-12 Behraj Khan , Behroz Mirza , Nouman Durrani , Tahir Syed

In this article, we develop a kernel-based framework for constructing dynamic, pathdependent trading strategies under a mean-variance optimisation criterion. Building on the theoretical results of (Muca Cirone and Salvi, 2025), we…

Trading and Market Microstructure · Quantitative Finance 2025-07-16 Owen Futter , Nicola Muca Cirone , Blanka Horvath

In nonparametric classification and regression problems, regularized kernel methods, in particular support vector machines, attract much attention in theoretical and in applied statistics. In an abstract sense, regularized kernel methods…

Machine Learning · Statistics 2011-04-13 Robert Hable

The advent of pre-trained vision-language foundation models has revolutionized the field of zero/few-shot (i.e., low-shot) image recognition. The key challenge to address under the condition of limited training data is how to fine-tune…

Computer Vision and Pattern Recognition · Computer Science 2024-10-16 Kun Ding , Ying Wang , Gaofeng Meng , Shiming Xiang