English
Related papers

Related papers: Spatio-Temporal Prediction via Operator-Valued RKH…

200 papers

We develop a kernel-based approach for estimating the spatially varying Sobolev regularity~$s$ of an unknown $d$-variate function~$f$ from scattered sampling data, which quantifies the degree of local differentiability supported by the…

Numerical Analysis · Mathematics 2026-01-29 Xiaobin Li , Leevan Ling , Yizhong Sun

We develop a mathematical framework to address a broad class of metric and preference learning problems within a Hilbert space. We obtain a novel representer theorem for the simultaneous task of metric and preference learning. Our key…

Machine Learning · Computer Science 2025-10-28 Peyman Morteza

The probabilistic velocity obstacle (PVO) extends the concept of velocity obstacle (VO) to work in uncertain dynamic environments. In this paper, we show how a robust model predictive control (MPC) with PVO constraints under non-parametric…

Systems and Control · Electrical Eng. & Systems 2020-01-27 P. S. Naga Jyotish , Bharath Gopalakrishnan , A. V. S. Sai Bhargav Kumar , Arun Kumar Singh , K. Madhava Krishna , Dinesh Manocha

This paper proposes a multivariate nonlinear function-on-function regression model, which allows both the response and the covariates can be multi-dimensional functions. The model is built upon the multivariate functional reproducing kernel…

Methodology · Statistics 2024-06-28 Xu Haijie , Zhang Chen

Using tools from the theory of operator ideals and s-numbers, we develop a general approach to transfer estimates for $L_2$ -approximation of Sobolev functions into estimates for $L_\infty$-approximation, with precise control of all…

Functional Analysis · Mathematics 2015-05-12 Fernando Cobos , Thomas Kühn , Winfried Sickel

We propose a method for the approximation of high- or even infinite-dimensional feature vectors, which play an important role in supervised learning. The goal is to reduce the size of the training data, resulting in lower storage…

Machine Learning · Statistics 2021-04-06 Patrick Gelß , Stefan Klus , Ingmar Schuster , Christof Schütte

We study the spatio-temporal prediction problem, which has attracted the attention of many researchers due to its critical real-life applications. In particular, we introduce a novel approach to this problem. Our approach is based on the…

Machine Learning · Statistics 2020-07-07 Oguzhan Karaahmetoglu , Suleyman Serdar Kozat

We propose a new point of view for regularizing deep neural networks by using the norm of a reproducing kernel Hilbert space (RKHS). Even though this norm cannot be computed, it admits upper and lower approximations leading to various…

Machine Learning · Statistics 2019-05-15 Alberto Bietti , Grégoire Mialon , Dexiong Chen , Julien Mairal

The performance of adaptive estimators that employ embedding in reproducing kernel Hilbert spaces (RKHS) depends on the choice of the location of basis kernel centers. Parameter convergence and error approximation rates depend on where and…

Systems and Control · Electrical Eng. & Systems 2020-09-08 Sai Tej Paruchuri , Jia Guo , Andrew Kurdila

Reproducing kernel Hilbert spaces (RKHSs) are special Hilbert spaces in one-to-one correspondence with positive definite maps called kernels. They are widely employed in machine learning to reconstruct unknown functions from sparse and…

Systems and Control · Electrical Eng. & Systems 2023-05-03 Mauro Bisiacco , Gianluigi Pillonetto

We present a general nonlinear Bayesian filter for high-dimensional state estimation using the theory of reproducing kernel Hilbert space (RKHS). Applying kernel method and the representer theorem to perform linear quadratic estimation in a…

Signal Processing · Electrical Eng. & Systems 2019-11-26 Kan Li , Jose C. Principe

Koopman representations aim to learn features of nonlinear dynamical systems (NLDS) which lead to linear dynamics in the latent space. Theoretically, such features can be used to simplify many problems in modeling and control of NLDS. In…

Machine Learning · Computer Science 2023-11-27 Mahan Fathi , Clement Gehring , Jonathan Pilault , David Kanaa , Pierre-Luc Bacon , Ross Goroshin

Recently, some works have suggested methods to combine variational probabilistic inference with Monte Carlo sampling. One promising approach is via local optimal transport. In this approach, a gradient steepest descent method based on local…

Machine Learning · Statistics 2019-01-30 Manuel Pulido , Peter Jan vanLeeuwen , Derek J. Posselt

We consider Markov Decision Problems defined over continuous state and action spaces, where an autonomous agent seeks to learn a map from its states to actions so as to maximize its long-term discounted accumulation of rewards. We address…

Machine Learning · Computer Science 2018-04-23 Alec Koppel , Ekaterina Tolstaya , Ethan Stump , Alejandro Ribeiro

Recently, there has been growing interest in characterizing the function spaces underlying neural networks. While shallow and deep scalar-valued neural networks have been linked to scalar-valued reproducing kernel Banach spaces (RKBS),…

Functional Analysis · Mathematics 2025-10-02 Sven Dummer , Tjeerd Jan Heeringa , José A. Iglesias

Accurate long-term predictions are the foundations for many machine learning applications and decision-making processes. However, building accurate long-term prediction models remains challenging due to the limitations of existing temporal…

Machine Learning · Computer Science 2023-09-20 Kshitij Tayal , Arvind Renganathan , Rahul Ghosh , Xiaowei Jia , Vipin Kumar

Approximating the optimal value function $v^*$ for infinite-horizon, nonlinear, autonomous optimal control problems is both challenging and essential for synthesizing real-time optimal feedback. We develop an abstract optimal recovery…

Optimization and Control · Mathematics 2025-12-09 Tobias Ehring , Behzad Azmi , Bernard Haasdonk

Accurate energy demand forecasting is crucial for sustainable and resilient energy development. To meet the Net Zero Representative Concentration Pathways (RCP) $4.5$ scenario in the DACH countries, increased renewable energy production,…

Machine Learning · Computer Science 2024-09-17 Luca Pernigo , Rohan Sen , Davide Baroli

The existing research on spectral algorithms, applied within a Reproducing Kernel Hilbert Space (RKHS), has primarily focused on general kernel functions, often neglecting the inherent structure of the input feature space. Our paper…

Machine Learning · Statistics 2024-03-08 Weichun Xia , Lei Shi

In this paper, we study the problem of early stopping for iterative learning algorithms in a reproducing kernel Hilbert space (RKHS) in the nonparametric regression framework. In particular, we work with the gradient descent and (iterative)…

Machine Learning · Statistics 2024-11-26 Yaroslav Averyanov , Alain Celisse