English
Related papers

Related papers: Adaptive Estimation for Nonlinear Systems using Re…

200 papers

This paper derives a new class of vector-valued reproducing kernel Hilbert spaces (vRKHS) defined in terms of operator-valued kernels for the representation of functional uncertainty arising in nonparametric adaptive control methods. These…

Systems and Control · Electrical Eng. & Systems 2025-10-28 Haoran Wang , Shengyuan Niu , Henry Moon , Ian Willebeek-LeMair , Andrew J. Kurdila , Andrea L'Afflitto , Daniel Stilwell

Non-linear systems of differential equations have attracted the interest in fields like system biology, ecology or biochemistry, due to their flexibility and their ability to describe dynamical systems. Despite the importance of such models…

Methodology · Statistics 2014-05-09 Javier González , Ivan Vujačić , Ernst Wit

Many scientific problems involve data exhibiting both temporal and cross-sectional dependencies. While linear dependencies have been extensively studied, the theoretical analysis of regression estimators under nonlinear dependencies remains…

Statistics Theory · Mathematics 2025-02-27 Marie-Christine Düker , Adam Waterbury

We study the problem of estimating linear response statistics under external perturbations using time series of unperturbed dynamics. Based on the fluctuation-dissipation theory, this problem is reformulated as an unsupervised learning task…

Statistics Theory · Mathematics 2020-12-09 He Zhang , John Harlim , Xiantao Li

Over the last decade, kernel methods for nonlinear processing have successfully been used in the machine learning community. The primary mathematical tool employed in these methods is the notion of the Reproducing Kernel Hilbert Space.…

Machine Learning · Computer Science 2017-04-26 Pantelis Bouboulis , Sergios Theodoridis

In this paper, we consider the coefficient-based regularized distribution regression which aims to regress from probability measures to real-valued responses over a reproducing kernel Hilbert space (RKHS), where the regularization is put on…

Machine Learning · Statistics 2022-08-29 Yuan Mao , Lei Shi , Zheng-Chu Guo

This paper combines vector-valued reproducing kernel Hilbert space (vRKHS) embedding with robust adaptive observation, yielding an algorithm that is both non-parametric and robust. The main contribution of this paper lies in the ability of…

Systems and Control · Electrical Eng. & Systems 2025-10-28 Shengyuan Niu , Haoran Wang , Heejip Moon , Andrea L'Afflitto , Andrew Kurdila , Daniel Stilwell

In this paper we study the convergence of online gradient descent algorithms in reproducing kernel Hilbert spaces (RKHSs) without regularization. We establish a sufficient condition and a necessary condition for the convergence of excess…

Machine Learning · Computer Science 2017-08-11 Yunwen Lei , Lei Shi , Zheng-Chu Guo

In this paper, we consider unregularized online learning algorithms in a Reproducing Kernel Hilbert Spaces (RKHS). Firstly, we derive explicit convergence rates of the unregularized online learning algorithms for classification associated…

Machine Learning · Computer Science 2015-04-28 Yiming Ying , Ding-Xuan Zhou

In this paper, we present an efficient algorithm for solving a class of chance constrained optimization under non-parametric uncertainty. Our algorithm is built on the possibility of representing arbitrary distributions as functions in…

Robotics · Computer Science 2018-11-26 Bharath Gopalakrishnan , Arun Kumar Singh , K. Madhava Krishna , Dinesh Manocha

We consider multi-agent stochastic optimization problems over reproducing kernel Hilbert spaces (RKHS). In this setting, a network of interconnected agents aims to learn decision functions, i.e., nonlinear statistical models, that are…

Optimization and Control · Mathematics 2018-07-04 Alec Koppel , Santiago Paternain , Cedric Richard , Alejandro Ribeiro

This paper describes an adaptive method in continuous time for the estimation of external fields by a team of $N$ agents. The agents $i$ each explore subdomains $\Omega^i$ of a bounded subset of interest $\Omega\subset X := \mathbb{R}^d$.…

Systems and Control · Electrical Eng. & Systems 2021-03-24 Jia Guo , Michael E. Kepler , Sai Tej Paruchuri , Haoran Wang , Andrew J. Kurdila , Daniel J. Stilwell

The persistence of excitation (PE) condition is sufficient to ensure parameter convergence in adaptive estimation problems. Recent results on adaptive estimation in reproducing kernel Hilbert spaces (RKHS) introduce PE conditions for RKHS.…

Systems and Control · Electrical Eng. & Systems 2020-09-08 Sai Tej Paruchuri , Jia Guo , Andrew Kurdila

This paper introduces a solution to the problem of selecting dynamically (online) the ``optimal'' p-norm to combat outliers in linear adaptive filtering without any knowledge on the probability density function of the outliers. The proposed…

Machine Learning · Computer Science 2022-10-24 Yuki Akiyama , Minh Vu , Konstantinos Slavakis

We generalize Jan Willems' behavioral approach to a class of discrete-time nonlinear systems in a vector-valued reproducing kernel Hilbert space (RKHS). Apart from linear time-invariant systems, this class covers nonlinear systems modeled…

Systems and Control · Electrical Eng. & Systems 2026-05-11 Boya Hou , Maxim Raginsky

We develop a new framework for estimating joint probability distributions using tensor product reproducing kernel Hilbert spaces (RKHS). Our framework accommodates a low-dimensional, normalized and positive model of a Radon--Nikodym…

Machine Learning · Statistics 2024-09-25 Damir Filipovic , Michael Multerer , Paul Schneider

This short technical report presents some learning theory results on vector-valued reproducing kernel Hilbert space (RKHS) regression, where the input space is allowed to be non-compact and the output space is a (possibly…

Machine Learning · Statistics 2022-02-17 Junhyunng Park , Krikamol Muandet

The performance of adaptive estimators that employ embedding in reproducing kernel Hilbert spaces (RKHS) depends on the choice of the location of basis kernel centers. Parameter convergence and error approximation rates depend on where and…

Systems and Control · Electrical Eng. & Systems 2020-09-08 Sai Tej Paruchuri , Jia Guo , Andrew Kurdila

This paper proposes a multivariate nonlinear function-on-function regression model, which allows both the response and the covariates can be multi-dimensional functions. The model is built upon the multivariate functional reproducing kernel…

Methodology · Statistics 2024-06-28 Xu Haijie , Zhang Chen

High-dimensional functional data have become increasingly prevalent in modern applications such as high-frequency financial data and neuroimaging data analysis. We investigate a class of high-dimensional linear regression models, where each…

Methodology · Statistics 2025-11-06 Xingche Guo , Yehua Li , Tailen Hsing