English
Related papers

Related papers: A Behavioral Framework for Data-Driven Modeling of…

200 papers

In this paper, an adaptive non-parametric method is proposed to estimate the scalar-valued nonlinear function that appears in uncertain systems governed by ordinary differential equations (ODEs). By employing an infinite-dimensional…

Optimization and Control · Mathematics 2021-03-15 Jia Guo , Sai Tej Paruchuri , Andrew J. Kurdila

In Willems' behavioral systems theory, a dynamical system is identified with the set of all trajectories compatible with its laws of motion. In the linear time-invariant setting this trajectory set is a linear subspace, and its algebraic…

Optimization and Control · Mathematics 2026-05-08 Victor M. Preciado

We study the problem of estimating linear response statistics under external perturbations using time series of unperturbed dynamics. Based on the fluctuation-dissipation theory, this problem is reformulated as an unsupervised learning task…

Statistics Theory · Mathematics 2020-12-09 He Zhang , John Harlim , Xiantao Li

Learning the governing equations from time-series data has gained increasing attention due to its potential to extract useful dynamics from real-world data. Despite significant progress, it becomes challenging in the presence of noise,…

Numerical Analysis · Mathematics 2025-04-03 Hailong Guo , Haibo Li

In this paper we propose a new identification scheme for Hammerstein systems, which are dynamic systems consisting of a static nonlinearity and a linear time-invariant dynamic system in cascade. We assume that the nonlinear function can be…

Systems and Control · Computer Science 2016-05-20 Riccardo Sven Risuleo , Giulio Bottegal , Håkan Hjalmarsson

Volterra series representation is a powerful mathematical model for nonlinear circuits. However, the difficulties in determining higher-order Volterra kernels limited its broader applications. In this work, a systematic approach that…

Mathematical Physics · Physics 2016-05-13 Xiaoyan Y. Z. Xiong , Li Jun Jiang , Jose E. Schutt-Aine , Weng Cho Chew

Learning from examples is one of the key problems in science and engineering. It deals with function reconstruction from a finite set of direct and noisy samples. Regularization in reproducing kernel Hilbert spaces (RKHSs) is widely used to…

Systems and Control · Computer Science 2016-12-30 Gianluigi Pillonetto

In supervised learning using kernel methods, we often encounter a large-scale finite-sum minimization over a reproducing kernel Hilbert space (RKHS). Large-scale finite-sum problems can be solved using efficient variants of Newton method,…

Machine Learning · Computer Science 2022-06-07 Ting-Jui Chang , Shahin Shahrampour

This paper presents a novel Koopman composition operator representation framework for control systems in reproducing kernel Hilbert spaces (RKHSs) that is free of explicit dictionary or input parametrizations. By establishing fundamental…

Systems and Control · Electrical Eng. & Systems 2025-09-03 Petar Bevanda , Bas Driessen , Lucian Cristian Iacob , Stefan Sosnowski , Roland Tóth , Sandra Hirche

In supervised learning, the output variable to be predicted is often represented as a function, such as a spectrum or probability distribution. Despite its importance, functional output regression remains relatively unexplored. In this…

Machine Learning · Statistics 2025-03-19 Minoru Kusaba , Megumi Iwayama , Ryo Yoshida

We consider the random-design least-squares regression problem within the reproducing kernel Hilbert space (RKHS) framework. Given a stream of independent and identically distributed input/output data, we aim to learn a regression function…

Statistics Theory · Mathematics 2016-03-30 Aymeric Dieuleveut , Francis Bach

Sparked by the Willems' fundamental lemma, a class of data-driven control methods has been developed for LTI systems. At the same time, the Koopman operator theory attempts to cast a nonlinear control problem into a standard linear one…

Systems and Control · Electrical Eng. & Systems 2021-03-02 Yingzhao Lian , Renzi Wang , Colin N. Jones

We study recursive regularized learning algorithms in the reproducing kernel Hilbert space (RKHS) with non-stationary online data streams. We introduce the concept of random Tikhonov regularization path and decompose the tracking error of…

Machine Learning · Computer Science 2025-10-24 Xiwei Zhang , Yan Chen , Tao Li

Hamiltonian dynamics describe a wide range of physical systems. As such, data-driven simulations of Hamiltonian systems are important for many scientific and engineering problems. In this work, we propose kernel-based methods for…

Numerical Analysis · Mathematics 2025-09-23 Yasamin Jalalian , Mostafa Samir , Boumediene Hamzi , Peyman Tavallali , Houman Owhadi

A central challenge in reinforcement learning (RL) is to learn models that generalize beyond the tasks on which they are trained, a goal traditionally pursued through multi-task and meta RL. Recently, transformer architectures have emerged…

Machine Learning · Computer Science 2026-05-12 Bowen He , Juncheng Dong , Lin Lin , Xiang Cheng

The fundamental lemma by Jan C. Willems and co-workers, which is deeply rooted in behavioral systems theory, has become one of the supporting pillars of the recent progress on data-driven control and system analysis. This tutorial-style…

Optimization and Control · Mathematics 2023-05-01 Timm Faulwasser , Ruchuan Ou , Guanru Pan , Philipp Schmitz , Karl Worthmann

Suppose that $Y$ is a scalar and $X$ is a second-order stochastic process, where $Y$ and $X$ are conditionally independent given the random variables $\xi_1,...,\xi_p$ which belong to the closed span $L_X^2$ of $X$. This paper investigates…

Statistics Theory · Mathematics 2009-04-02 Tailen Hsing , Haobo Ren

This paper introduces algorithms to select/design kernels in Gaussian process regression/kriging surrogate modeling techniques. We adopt the setting of kernel method solutions in ad hoc functional spaces, namely Reproducing Kernel Hilbert…

Machine Learning · Statistics 2022-09-07 Jean-Luc Akian , Luc Bonnet , Houman Owhadi , Éric Savin

This survey presents recent research on determining control-theoretic properties and designing controllers with rigorous guarantees using semidefinite programming and for nonlinear systems for which no mathematical models but measured…

Optimization and Control · Mathematics 2023-11-06 Tim Martin , Thomas B. Schön , Frank Allgöwer

This paper proposes a new nonlinear approach for additive functional regression with functional response based on kernel methods along with some slight reformulation and implementation of the linear regression and the spectral additive…