English
Related papers

Related papers: Regularized system identification using orthonorma…

200 papers

This paper proposes a method for constructing one-step prediction tubes for nonlinear systems using reproducing kernel Hilbert spaces. We approximate a bounded reproducing kernel Hilbert space (RKHS) hypothesis set by a finite-dimensional…

Systems and Control · Electrical Eng. & Systems 2026-04-08 Jannis Lübsen , Annika Eichler

In this paper we derive the asymptotic distributions of two distinct regularized estimators for functional canonical correlation as well as their associated eigenvalues, eigenvectors and projection operators. The methods we developed…

Statistics Theory · Mathematics 2015-02-10 David B. King

Regularized kernel methods such as, e.g., support vector machines and least-squares support vector regression constitute an important class of standard learning algorithms in machine learning. Theoretical investigations concerning…

Machine Learning · Statistics 2012-03-21 Robert Hable

We develop a multi-kernel based regression method for graph signal processing where the target signal is assumed to be smooth over a graph. In multi-kernel regression, an effective kernel function is expressed as a linear combination of…

Machine Learning · Statistics 2018-03-14 Arun Venkitaraman , Saikat Chatterjee , Peter Händel

An operator theoretic approach to orthogonal rational functions on the unit circle with poles in its exterior is presented in this paper. This approach is based on the identification of a suitable matrix representation of the multiplication…

Classical Analysis and ODEs · Mathematics 2007-05-23 Luis Velazquez

Kernel mean embeddings, a widely used technique in machine learning, map probability distributions to elements of a reproducing kernel Hilbert space (RKHS). For supervised learning problems, where input-output pairs are observed, the…

Machine Learning · Statistics 2024-10-24 Ambrus Tamás , Balázs Csanád Csáji

From the optimization point of view, a difficulty with parallel MRI with simultaneous coil sensitivity estimation is the multiplicative nature of the non-linear forward operator: the image being reconstructed and the coil sensitivities…

Numerical Analysis · Mathematics 2018-02-06 Yonggui Zhu , Tuomo Valkonen

While local basis function (LBF) estimation algorithms, commonly used for identifying/tracking systems with time-varying parameters, demonstrate good performance under the assumption of normally distributed measurement noise, the estimation…

Signal Processing · Electrical Eng. & Systems 2025-04-01 Maciej Niedźwiecki , Artur Gańcza , Wojciech Żuławiński , Agnieszka Wyłomańska

Ridgeless regression has garnered attention among researchers, particularly in light of the ``Benign Overfitting'' phenomenon, where models interpolating noisy samples demonstrate robust generalization. However, kernel ridgeless regression…

Machine Learning · Computer Science 2024-06-04 Fan He , Mingzhen He , Lei Shi , Xiaolin Huang , Johan A. K. Suykens

The identification of continuous-time (CT) systems from discrete-time (DT) input and output signals, i.e., the sampled data, has received considerable attention for half a century. The state-of-the-art methods are parametric methods and…

Systems and Control · Electrical Eng. & Systems 2024-10-29 Xiaozhu Fang , Biqiang Mu , Tianshi Chen

Since many physical laws -- from classical mechanics to electromagnetism -- are formulated as two-body interactions, the same perspective naturally extends to biological and social dynamics. Here we focus on rhythmic phenomena, where phase…

Adaptation and Self-Organizing Systems · Physics 2025-08-26 Ryosuke Yoneda , Haruma Furukawa , Daigo Fujiwara , Toshio Aoyagi

Rational function approximations find applications in many areas including macro-modeling of high-frequency circuits, model order reduction for controller design, interpolation and extrapolation of system responses, surrogate models for…

Systems and Control · Electrical Eng. & Systems 2022-11-10 Andrew Ma , Arif Ege Engin

Functional linear and single-index models are core regression methods in functional data analysis and are widely used for performing regression in a wide range of applications when the covariates are random functions coupled with scalar…

Statistics Theory · Mathematics 2024-03-28 Krishnakumar Balasubramanian , Hans-Georg Müller , Bharath K. Sriperumbudur

Reconstruction of one-dimensional kinematic distributions from calculations based on high-dimensional Monte-Carlo integration is a standard problem in high-energy physics. Traditionally, this is done by collecting randomly-generated events…

High Energy Physics - Phenomenology · Physics 2026-05-20 Kirill Melnikov , Ivan Novikov , Ivan Pedron

Much recent work has addressed the solution of a family of partial differential equations by computing the inverse operator map between the input and solution space. Toward this end, we incorporate function-valued reproducing kernel Hilbert…

Numerical Analysis · Mathematics 2022-04-05 Kaijun Bao , Xu Qian , Ziyuan Liu , Songhe Song

The so-called tuned-correlated kernel (sometimes also called the first-order stable spline kernel) is one of the most widely used kernels for the regularized impulse response estimation. This kernel can be derived by applying an exponential…

Systems and Control · Electrical Eng. & Systems 2024-12-20 Yusuke Fujimoto , Tianchi Chen

Feedforward generalizable models for implicit shape reconstruction from unoriented point cloud present multiple advantages, including high performance and inference speed. However, they still suffer from generalization issues, ranging from…

Computer Vision and Pattern Recognition · Computer Science 2023-11-23 Amine Ouasfi , Adnane Boukhayma

Kernel methods, being supported by a well-developed theory and coming with efficient algorithms, are among the most popular and successful machine learning techniques. From a mathematical point of view, these methods rest on the concept of…

Machine Learning · Statistics 2023-03-20 Christian Fiedler , Michael Herty , Michael Rom , Chiara Segala , Sebastian Trimpe

The functional linear regression model has been widely studied and utilized for dealing with functional predictors. In this paper, we study the Nystr\"om subsampling method, a strategy used to tackle the computational complexities inherent…

Statistics Theory · Mathematics 2024-10-28 Naveen Gupta , Sivananthan Sampath

Model inference for dynamical systems aims to estimate the future behaviour of a system from observations. Purely model-free statistical methods, such as Artificial Neural Networks, tend to perform poorly for such tasks. They are therefore…

Machine Learning · Computer Science 2019-08-07 David K. E. Green , Filip Rindler