English
Related papers

Related papers: Error bounds for kernel-based approximations of th…

200 papers

Estimating the dissipativity of nonlinear systems from empirical data is useful for the analysis and control of nonlinear systems, especially when an accurate model is unavailable. Based on a Koopman operator model of the nonlinear system…

Systems and Control · Electrical Eng. & Systems 2026-04-03 Xiuzhen Ye , Wentao Tang

Many scientific problems involve data exhibiting both temporal and cross-sectional dependencies. While linear dependencies have been extensively studied, the theoretical analysis of regression estimators under nonlinear dependencies remains…

Statistics Theory · Mathematics 2025-02-27 Marie-Christine Düker , Adam Waterbury

This paper studies convergence of empirical risks in reproducing kernel Hilbert spaces (RKHS). A conventional assumption in the existing research is that empirical training data do not contain any noise but this may not be satisfied in some…

Optimization and Control · Mathematics 2020-05-19 Shaoyan Guo , Huifu Xu , Liwei Zhang

Koopman operators provide tractable means of learning linear approximations of non-linear dynamics. Many approaches have been proposed to find these operators, typically based upon approximations using an a-priori fixed class of models.…

Systems and Control · Electrical Eng. & Systems 2021-02-09 Mario Sznaier

This paper investigates a general regularization framework for unsupervised domain adaptation in vector-valued regression under the covariate shift assumption, utilizing vector-valued reproducing kernel Hilbert spaces (vRKHS). Covariate…

Statistics Theory · Mathematics 2026-01-30 Markus Holzleitner , Sergiy Pereverzyev , Sergei V. Pereverzyev , Vaibhav Silmana , S. Sivananthan

This paper presents novel generalization bounds for vector-valued neural networks and deep kernel methods, focusing on multi-task learning through an operator-theoretic framework. Our key development lies in strategically combining a…

Machine Learning · Computer Science 2026-05-29 Mahdi Mohammadigohari , Giuseppe Di Fatta , Giuseppe Nicosia , Panos M. Pardalos

We consider autocovariance operators of a stationary stochastic process on a Polish space that is embedded into a reproducing kernel Hilbert space. We investigate how empirical estimates of these operators converge along realizations of the…

Probability · Mathematics 2023-08-08 Mattes Mollenhauer , Stefan Klus , Christof Schütte , Péter Koltai

We study the problem of estimating linear response statistics under external perturbations using time series of unperturbed dynamics. Based on the fluctuation-dissipation theory, this problem is reformulated as an unsupervised learning task…

Statistics Theory · Mathematics 2020-12-09 He Zhang , John Harlim , Xiantao Li

Non-conservative uncertainty bounds are essential for making reliable predictions about latent functions from noisy data, and thus, a key enabler for safe learning-based control. In this domain, kernel methods such as Gaussian process…

Machine Learning · Computer Science 2026-05-26 Amon Lahr , Anna Scampicchio , Johannes Köhler , Melanie N. Zeilinger

Reconstruction of a function from noisy data is often formulated as a regularized optimization problem over an infinite-dimensional reproducing kernel Hilbert space (RKHS). The solution describes the observed data and has a small RKHS norm.…

Machine Learning · Statistics 2013-07-18 Aleksandr Y. Aravkin , Bradley M. Bell , James V. Burke , Gianluigi Pillonetto

We present an empirical, gradient-based method for solving data-driven stochastic optimal control problems using the theory of kernel embeddings of distributions. By embedding the integral operator of a stochastic kernel in a reproducing…

Optimization and Control · Mathematics 2022-09-20 Adam J. Thorpe , Jake A. Gonzales , Meeko M. K. Oishi

Sample reweighting is one of the most widely used methods for correcting the error of least squares learning algorithms in reproducing kernel Hilbert spaces (RKHS), that is caused by future data distributions that are different from the…

Machine Learning · Computer Science 2023-07-24 Duc Hoan Nguyen , Sergei V. Pereverzyev , Werner Zellinger

Estimation of the mean and covariance functions is a fundamental problem in functional data analysis, particularly for discretely observed functional data. In this work, we study a regularization-based framework for estimating the mean and…

Statistics Theory · Mathematics 2026-03-20 Naveen Gupta , Bharath K Sriperumbudur

Spatial temporal reconstruction of dynamical system is indeed a crucial problem with diverse applications ranging from climate modeling to numerous chaotic and physical processes. These reconstructions are based on the harmonious…

Dynamical Systems · Mathematics 2025-05-13 Nishant Panda , Himanshu Singh , J. Nathan Kutz

Motivated by the need of processing functional-valued data, or more general, operatorvalued data, we introduce the notion of the operator reproducing kernel Hilbert space (ORKHS). This space admits a unique operator reproducing kernel which…

Functional Analysis · Mathematics 2016-10-23 Rui Wang , Yuesheng Xu

In this paper, an adaptive non-parametric method is proposed to estimate the scalar-valued nonlinear function that appears in uncertain systems governed by ordinary differential equations (ODEs). By employing an infinite-dimensional…

Optimization and Control · Mathematics 2021-03-15 Jia Guo , Sai Tej Paruchuri , Andrew J. Kurdila

Estimating the ratio of two probability densities from finitely many observations of the densities is a central problem in machine learning and statistics with applications in two-sample testing, divergence estimation, generative modeling,…

Machine Learning · Computer Science 2024-03-12 Werner Zellinger , Stefan Kindermann , Sergei V. Pereverzyev

We introduce a novel conditional density estimation model termed the conditional density operator (CDO). It naturally captures multivariate, multimodal output densities and shows performance that is competitive with recent neural…

Machine Learning · Computer Science 2019-10-30 Ingmar Schuster , Mattes Mollenhauer , Stefan Klus , Krikamol Muandet

The Koopman operator provides an infinite-dimensional linear description of nonlinear dynamical systems that can be leveraged in the context of stability analysis. In particular, Lyapunov functions can be obtained in a systematic way via…

Dynamical Systems · Mathematics 2026-04-01 François-Grégoire Bierwart , Alexandre Mauroy

In this paper, we present an efficient algorithm for solving a class of chance constrained optimization under non-parametric uncertainty. Our algorithm is built on the possibility of representing arbitrary distributions as functions in…

Robotics · Computer Science 2018-11-26 Bharath Gopalakrishnan , Arun Kumar Singh , K. Madhava Krishna , Dinesh Manocha