English
Related papers

Related papers: A Behavioral Framework for Data-Driven Modeling of…

200 papers

We propose a novel adaptive learning algorithm based on iterative orthogonal projections in the Cartesian product of multiple reproducing kernel Hilbert spaces (RKHSs). The task is estimating/tracking nonlinear functions which are supposed…

Machine Learning · Computer Science 2015-10-28 Masahiro Yukawa

We propose a novel nonparametric approach for linking covariates to Continuous Time Markov Chains (CTMCs) using the mathematical framework of Reproducing Kernel Hilbert Spaces (RKHS). CTMCs provide a robust framework for modeling…

Methodology · Statistics 2025-05-07 Yuchen Han , Arnab Ganguly , Riten Mitra

The increase in system complexity paired with a growing availability of operational data has motivated a change in the traditional control design paradigm. Instead of modeling the system by first principles and then proceeding with a…

Optimization and Control · Mathematics 2020-10-06 Juan G. Rueda-Escobedo , Johannes Schiffer

Traditional machine learning models, particularly neural networks, are rooted in finite-dimensional parameter spaces and nonlinear function approximations. This report explores an alternative formulation where learning tasks are expressed…

Machine Learning · Computer Science 2025-07-30 Andrew Kiruluta , Andreas Lemos , Priscilla Burity

In statistical learning, identifying underlying structures of true target functions based on observed data plays a crucial role to facilitate subsequent modeling and analysis. Unlike most of those existing methods that focus on some…

Machine Learning · Statistics 2021-05-04 Xin He , Yeheng Ge , Xingdong Feng

We propose a nonlinear function-on-function regression model where both the covariate and the response are random functions. The nonlinear regression is carried out in two steps: we first construct Hilbert spaces to accommodate the…

Methodology · Statistics 2022-07-19 Peijun Sang , Bing Li

This monograph develops a unified, application-driven framework for kernel methods grounded in reproducing kernel Hilbert spaces (RKHS) and optimal transport (OT). Part I lays the theoretical and numerical foundations on positive-definite…

Numerical Analysis · Mathematics 2025-10-07 Philippe G. LeFloch , Jean-Marc Mercier , Shohruh Miryusupov

Recurrent neural networks (RNNs) are brain-inspired models widely used in machine learning for analyzing sequential data. The present work is a contribution towards a deeper understanding of how RNNs process input signals using the response…

Machine Learning · Statistics 2021-02-15 Soon Hoe Lim

Substring kernels are classical tools for representing biological sequences or text. However, when large amounts of annotated data are available, models that allow end-to-end training such as neural networks are often preferred. Links…

Machine Learning · Statistics 2019-10-18 Dexiong Chen , Laurent Jacob , Julien Mairal

Providing flexibility and user-interpretability in nonlinear system identification can be achieved by means of block-oriented methods. One of such block-oriented system structures is the parallel Wiener-Hammerstein system, which is a sum of…

Numerical Analysis · Computer Science 2016-09-27 Philippe Dreesen , David Westwick , Johan Schoukens , Mariya Ishteva

The aim of this study is to present a good modernistic strategy for solving some well-known classes of Lane-Emden type singular differential equations. The proposed approach is based on the reproducing kernel Hilbert space (RKHS) and…

We propose a novel Bayesian methodology for inference in functional linear and logistic regression models based on the theory of reproducing kernel Hilbert spaces (RKHS's). We introduce general models that build upon the RKHS generated by…

Methodology · Statistics 2025-09-09 José R. Berrendero , Antonio Coín , Antonio Cuevas

In this work, we consider the problem of learning nonlinear operators that correspond to discrete-time nonlinear dynamical systems with inputs. Given an initial state and a finite input trajectory, such operators yield a finite output…

Optimization and Control · Mathematics 2024-12-25 Mircea Lazar

Nonlinearities in piezoelectric systems can arise from internal factors such as nonlinear constitutive laws or external factors like realizations of boundary conditions. It can be difficult or even impossible to derive detailed models from…

Optimization and Control · Mathematics 2020-04-14 Sai Tej Paruchuri , Jia Guo , Andrew J. Kurdila

The reproducing kernel Hilbert space (RKHS) embedding method is a recently introduced estimation approach that seeks to identify the unknown or uncertain function in the governing equations of a nonlinear set of ordinary differential…

Optimization and Control · Mathematics 2020-07-14 Jia Guo , Sai Tej Paruchuri , Andrew J. Kurdila

In this paper, we introduce a new distribution regression model for probability distributions. This model is based on a Reproducing Kernel Hilbert Space (RKHS) regression framework, where universal kernels are built using Wasserstein…

Statistics Theory · Mathematics 2019-10-07 Thi Thien Trang Bui , J-M Loubes , Laurent Risser , Patricia Balaresque

We study a class of dynamical systems modelled as Markov chains that admit an invariant distribution via the corresponding transfer, or Koopman, operator. While data-driven algorithms to reconstruct such operators are well known, their…

Machine Learning · Computer Science 2022-12-14 Vladimir Kostic , Pietro Novelli , Andreas Maurer , Carlo Ciliberto , Lorenzo Rosasco , Massimiliano Pontil

Traditionally, kernel methods rely on the representer theorem which states that the solution to a learning problem is obtained as a linear combination of the data mapped into the reproducing kernel Hilbert space (RKHS). While elegant from…

Machine Learning · Computer Science 2021-08-30 Riikka Huusari , Sahely Bhadra , Cécile Capponi , Hachem Kadri , Juho Rousu

Over the last decade, kernel methods for nonlinear processing have successfully been used in the machine learning community. The primary mathematical tool employed in these methods is the notion of the Reproducing Kernel Hilbert Space.…

Machine Learning · Computer Science 2017-04-26 Pantelis Bouboulis , Sergios Theodoridis

Reproducing kernel Hilbert spaces (RKHSs) are key spaces for machine learning that are becoming popular also for linear system identification. In particular, the so-called stable RKHSs can be used to model absolutely summable impulse…

Machine Learning · Computer Science 2020-05-07 Mauro Bisiacco , Gianluigi Pillonetto