English
Related papers

Related papers: Shorting Dynamics and Structured Kernel Regulariza…

200 papers

Recent advances in operator learning theory have improved our knowledge about learning maps between infinite dimensional spaces. However, for large-scale engineering problems such as concurrent multiscale simulation for mechanical…

Machine Learning · Computer Science 2022-12-05 Owen Huang , Sourav Saha , Jiachen Guo , Wing Kam Liu

Recent advances in learning or identification of nonlinear dynamics focus on learning a suitable model within a pre-specified model class. However, a key difficulty that remains is the choice of the model class from which the dynamics will…

Systems and Control · Electrical Eng. & Systems 2023-09-29 Charis Stamouli , Evangelos Chatzipantazis , George J. Pappas

Several algorithmic meta-theorems on kernelization have appeared in the last years, starting with the result of Bodlaender et al. [FOCS 2009] on graphs of bounded genus, then generalized by Fomin et al. [SODA 2010] to graphs excluding a…

Data Structures and Algorithms · Computer Science 2014-11-21 Valentin Garnero , Christophe Paul , Ignasi Sau , Dimitrios M. Thilikos

The minimization of a data-fidelity term and an additive regularization functional gives rise to a powerful framework for supervised learning. In this paper, we present a unifying regularization functional that depends on an operator and on…

Machine Learning · Computer Science 2022-06-30 Michael Unser

Devoted to multi-task learning and structured output learning, operator-valued kernels provide a flexible tool to build vector-valued functions in the context of Reproducing Kernel Hilbert Spaces. To scale up these methods, we extend the…

Machine Learning · Computer Science 2018-05-25 Romain Brault , Florence d'Alché-Buc , Markus Heinonen

The theory of positive kernels and associated reproducing kernel Hilbert spaces, especially in the setting of holomorphic functions, has been an important tool for the last several decades in a number of areas of complex analysis and…

Operator Algebras · Mathematics 2016-02-03 Joseph A. Ball , Gregory Marx , Victor Vinnikov

This work presents a nonparametric framework for dissipativity learning in reproducing kernel Hilbert spaces, which enables data-driven certification of stability and performance properties for unknown nonlinear systems without requiring an…

Systems and Control · Electrical Eng. & Systems 2025-11-03 Xiuzhen Ye , Wentao Tang

In this work, we investigate the generalization properties of random feature methods. Our analysis extends prior results for Tikhonov regularization to a broad class of spectral regularization techniques and further generalizes the setting…

Machine Learning · Statistics 2026-03-03 Mike Nguyen , Nicole Mücke

In the absence of explicit regularization, Kernel "Ridgeless" Regression with nonlinear kernels has the potential to fit the training data perfectly. It has been observed empirically, however, that such interpolated solutions can still…

Statistics Theory · Mathematics 2020-07-27 Tengyuan Liang , Alexander Rakhlin

Complex mechanical systems often exhibit strongly nonlinear behavior due to the presence of nonlinearities in the energy dissipation mechanisms, material constitutive relationships, or geometric/connectivity mechanics. Numerical modeling of…

Computational Engineering, Finance, and Science · Computer Science 2024-04-09 Harsh Sharma , David A. Najera-Flores , Michael D. Todd , Boris Kramer

We study random iterations of averaged operators in Hilbert spaces and prove that the associated residuals converge exponentially fast, both in expectation and almost surely. Our results provide quantitative bounds in terms of a single…

Functional Analysis · Mathematics 2025-09-15 James Tian

Reduced modeling of a computationally demanding dynamical system aims at approximating its trajectories, while optimizing the trade-off between accuracy and computational complexity. In this work, we propose to achieve such an approximation…

Machine Learning · Statistics 2025-02-20 Patrick Héas , Cédric Herzet , Benoit Combès

Kernel-based subspace clustering, which addresses the nonlinear structures in data, is an evolving area of research. Despite noteworthy progressions, prevailing methodologies predominantly grapple with limitations relating to (i) the…

Machine Learning · Computer Science 2025-01-22 Kunpeng Xu , Lifei Chen , Shengrui Wang

We investigate if kernel regularization methods can achieve minimax convergence rates over a source condition regularity assumption for the target function. These questions have been considered in past literature, but only under specific…

Machine Learning · Statistics 2016-11-15 Gilles Blanchard , Nicole Mücke

The strategy of early stopping is a regularization technique based on choosing a stopping time for an iterative algorithm. Focusing on non-parametric regression in a reproducing kernel Hilbert space, we analyze the early stopping strategy…

Machine Learning · Statistics 2013-06-18 Garvesh Raskutti , Martin J. Wainwright , Bin Yu

We derive novel deterministic bounds on the approximation error of data-based bilinear surrogate models for unknown nonlinear systems. The surrogate models are constructed using kernel-based extended dynamic mode decomposition to…

Systems and Control · Electrical Eng. & Systems 2025-07-24 Robin Strässer , Manuel Schaller , Julian Berberich , Karl Worthmann , Frank Allgöwer

We propose a kernel-spectral embedding algorithm for learning low-dimensional nonlinear structures from high-dimensional and noisy observations, where the datasets are assumed to be sampled from an intrinsically low-dimensional manifold and…

Machine Learning · Statistics 2023-07-07 Xiucai Ding , Rong Ma

We introduce a regularization loss based on kernel mean embeddings with rotation-invariant kernels on the hypersphere (also known as dot-product kernels) for self-supervised learning of image representations. Besides being fully competitive…

Computer Vision and Pattern Recognition · Computer Science 2023-03-09 Léon Zheng , Gilles Puy , Elisa Riccietti , Patrick Pérez , Rémi Gribonval

In the theory of singular integral operators significant effort is often required to rigorously define such an operator. This is due to the fact that the kernels of such operators are not locally integrable on the diagonal, so the integral…

Classical Analysis and ODEs · Mathematics 2014-03-31 Constanze Liaw , Sergei Treil

We study the convergence of a random iterative sequence of a family of operators on infinite dimensional Hilbert spaces, inspired by the Stochastic Gradient Descent (SGD) algorithm in the case of the noiseless regression, as studied in [1].…

Functional Analysis · Mathematics 2022-09-02 Soumyadip Ghosh , Yingdong Lu , Tomasz J. Nowicki