English
Related papers

Related papers: A new kernel-based approach for overparameterized …

200 papers

We propose kernel-based approaches for the construction of a single-step and multi-step predictor of the velocity form of nonlinear (NL) systems, which describes the time-difference dynamics of the corresponding NL system and admits a…

Systems and Control · Electrical Eng. & Systems 2024-08-02 Chris Verhoek , Roland Tóth

The notion of reproducing kernel Hilbert space (RKHS) has emerged in system identification during the past decade. In the resulting framework, the impulse response estimation problem is formulated as a regularized optimization defined on an…

Systems and Control · Electrical Eng. & Systems 2022-04-19 Mohammad Khosravi , Roy S. Smith

In this paper, we propose an outlier-robust regularized kernel-based method for linear system identification. The unknown impulse response is modeled as a zero-mean Gaussian process whose covariance (kernel) is given by the recently…

Machine Learning · Statistics 2013-12-25 Giulio Bottegal , Aleksandr Y. Aravkin , Hakan Hjalmarsson , Gianluigi Pillonetto

In this paper, we consider the problem of system identification when side-information is available on the steady-state (or DC) gain of the system. We formulate a general nonparametric identification method as an infinite-dimensional…

Systems and Control · Electrical Eng. & Systems 2022-11-08 Mohammad Khosravi , Roy S. Smith

We propose a new method for input variable selection in nonlinear regression. The method is embedded into a kernel regression machine that can model general nonlinear functions, not being a priori limited to additive models. This is the…

Machine Learning · Computer Science 2018-09-05 Magda Gregorová , Jason Ramapuram , Alexandros Kalousis , Stéphane Marchand-Maillet

This paper presents a kernelized offset-free data-driven predictive control scheme for nonlinear systems. Traditional model-based and data-driven predictive controllers often struggle with inaccurate predictors or persistent disturbances,…

Systems and Control · Electrical Eng. & Systems 2024-12-02 Thomas Oliver de Jong , Mircea Lazar

In order to identify one system (module) in an interconnected dynamic network, one typically has to solve a Multi-Input-Single-Output (MISO) identification problem that requires identification of all modules in the MISO setup. For…

Systems and Control · Electrical Eng. & Systems 2021-01-27 Karthik R. Ramaswamy , Giulio Bottegal , Paul M. J. Van den Hof

We propose a data-driven framework to learn interaction kernels in stochastic multi-agent systems. Our approach aims at identifying the functional form of nonlocal interaction and diffusion terms directly from trajectory data, without any a…

Machine Learning · Computer Science 2026-03-18 Giacomo Albi , Alessandro Alla , Elisa Calzola

Most of existing results on regularized system identification focus on regularized impulse response estimation. Since the impulse response model is a special case of orthonormal basis functions, it is interesting to consider if it is…

Systems and Control · Computer Science 2015-04-14 Tianshi Chen , Lennart Ljung

This paper presents a novel feature of the kernel-based system identification method. We prove that the regularized kernel-based approach for the estimation of a finite impulse response is equivalent to a robust least-squares problem with a…

Optimization and Control · Mathematics 2021-05-27 Mohammad Khosravi , Roy S. Smith

This paper addresses the problem of learning the impulse responses characterizing forward models by means of a regularized kernel-based Prediction Error Method (PEM). The common approach to accomplish that is to approximate the system with…

Optimization and Control · Mathematics 2024-09-20 Giulio Fattore , Marco Peruzzo , Giacomo Sartori , Mattia Zorzi

A different route to identification of time-invariant linear systems has been recently proposed which does not require committing to a specific parametric model structure. Impulse responses are described in a nonparametric Bayesian…

Systems and Control · Electrical Eng. & Systems 2020-05-15 Gianluigi Pillonetto , Alessandro Chiuso , Giuseppe De Nicolao

We present a novel kernel-based machine learning algorithm for identifying the low-dimensional geometry of the effective dynamics of high-dimensional multiscale stochastic systems. Recently, the authors developed a mathematical framework…

Dynamical Systems · Mathematics 2020-02-04 Andreas Bittracher , Stefan Klus , Boumediene Hamzi , Péter Koltai , Christof Schütte

There have been increasing interests on the Volterra series identification with the kernel-based regularization method. The major difficulties are on the kernel design and efficiency of the corresponding implementation. In this paper, we…

Systems and Control · Electrical Eng. & Systems 2025-05-28 Yu Xu , Biqiang Mu , Tianshi Chen

This paper presents a regularized recursive identification algorithm with simultaneous on-line estimation of both the model parameters and the algorithms hyperparameters. A new kernel is proposed to facilitate the algorithm development. The…

Methodology · Statistics 2024-05-14 Bernard Vau , Tudor-Bogdan Airimitoaie

In the last years, the success of kernel-based regularisation techniques in solving impulse response modelling tasks has revived the interest on linear system identification. In this work, an alternative perspective on the same problem is…

Systems and Control · Computer Science 2016-10-25 Anna Marconato , Maarten Schoukens , Johan Schoukens

Function approximation from input and output data is one of the most investigated problems in signal processing. This problem has been tackled with various signal processing and machine learning methods. Although tensors have a rich history…

Statistics Theory · Mathematics 2023-02-16 Christina Auer , Thomas Paireder , Oliver Ploder , Oliver Lang , Mario Huemer

A low-dimensional dynamical system is observed in an experiment as a high-dimensional signal; for example, a video of a chaotic pendulums system. Assuming that we know the dynamical model up to some unknown parameters, can we estimate the…

Machine Learning · Statistics 2021-11-24 Ofir Lindenbaum , Amir Sagiv , Gal Mishne , Ronen Talmon

In this paper, a class of high order numerical schemes is proposed to solve the nonlinear parabolic equations with variable coefficients. This method is based on our previous work [10] for convection-diffusion equations, which relies on a…

Numerical Analysis · Mathematics 2020-12-30 Kaipeng Wang , Andrew Christlieb , Yan Jiang , Mengping Zhang

Conventional physics-based modeling techniques involve high effort, e.g., time and expert knowledge, while data-driven methods often lack interpretability, structure, and sometimes reliability. To mitigate this, we present a data-driven…

Dynamical Systems · Mathematics 2024-08-19 Johannes Rettberg , Jonas Kneifl , Julius Herb , Patrick Buchfink , Jörg Fehr , Bernard Haasdonk