English
Related papers

Related papers: Exploring the Links between the Fundamental Lemma …

200 papers

Learning models of dynamical systems characterized by specific stability properties is of crucial importance in applications. Existing results mainly focus on linear systems or some limited classes of nonlinear systems and stability…

Systems and Control · Electrical Eng. & Systems 2025-03-18 Matteo Scandella , Michelangelo Bin , Thomas Parisini

We propose a method of analysis of dynamical networks based on a recent measure of Granger causality between time series, based on kernel methods. The generalization of kernel Granger causality to the multivariate case, here presented,…

Disordered Systems and Neural Networks · Physics 2009-11-13 Daniele Marinazzo , Mario Pellicoro , Sebastiano Stramaglia

Kernel and linear regression have been recently explored in the prediction of graph signals as the output, given arbitrary input signals that are agnostic to the graph. In many real-world problems, the graph expands over time as new nodes…

Machine Learning · Computer Science 2019-11-27 Arun Venkitaraman , Saikat Chatterjee , Bo Wahlberg

This paper introduces a computational framework to identify nonlinear input-output operators that fit a set of system trajectories while satisfying incremental integral quadratic constraints. The data fitting algorithm is thus regularized…

Optimization and Control · Mathematics 2021-10-25 Henk J. van Waarde , Rodolphe Sepulchre

The use of covariance kernels is ubiquitous in the field of spatial statistics. Kernels allow data to be mapped into high-dimensional feature spaces and can thus extend simple linear additive methods to nonlinear methods with higher order…

Machine Learning · Statistics 2017-11-16 Jean-Francois Ton , Seth Flaxman , Dino Sejdinovic , Samir Bhatt

This paper examines the problem of learning with a finite and possibly large set of p base kernels. It presents a theoretical and empirical analysis of an approach addressing this problem based on ensembles of kernel predictors. This…

Machine Learning · Computer Science 2012-02-20 Corinna Cortes , Mehryar Mohri , Afshin Rostamizadeh

We consider a class of maps from integral Hankel operators to Hankel matrices, which we call restriction maps. In the simplest case, such a map is simply a restriction of the integral kernel onto integers. More generally, it is given by an…

Functional Analysis · Mathematics 2018-10-02 Nazar Miheisi , Alexander Pushnitski

Instrumental variable regression is a foundational tool for causal analysis across the social and biomedical sciences. Recent advances use kernel methods to estimate nonparametric causal relationships, with general data types, while…

Statistics Theory · Mathematics 2026-01-21 Marvin Lob , Rahul Singh , Suhas Vijaykumar

We study regression models for the situation where both dependent and independent variables are square-integrable stochastic processes. Questions concerning the definition and existence of the corresponding functional linear regression…

Statistics Theory · Mathematics 2011-02-28 Guozhong He , Hans-Georg Müller , Jane-Ling Wang , Wenjing Yang

Kernel-based tests provide a simple yet effective framework that use the theory of reproducing kernel Hilbert spaces to design non-parametric testing procedures. In this paper we propose new theoretical tools that can be used to study the…

Statistics Theory · Mathematics 2022-09-02 Tamara Fernández , Nicolás Rivera

This paper derives error bounds for regression in continuous time over subsets of certain types of Riemannian manifolds.The regression problem is typically driven by a nonlinear evolution law taking values on the manifold, and it is cast as…

Dynamical Systems · Mathematics 2022-09-09 Nathan Powell , Jia Guo , Sai Tej Parachuri , John Burns , Boone Estes , Andrew Kurdila

Multiple Kernel Learning is a conventional way to learn the kernel function in kernel-based methods. MKL algorithms enhance the performance of kernel methods. However, these methods have a lower complexity compared to deep learning models…

Machine Learning · Computer Science 2023-05-05 Ahmad Navid Ghanizadeh , Kamaledin Ghiasi-Shirazi , Reza Monsefi , Mohammadreza Qaraei

The kernel matrix used in kernel methods encodes all the information required for solving complex nonlinear problems defined on data representations in the input space using simple, but implicitly defined, solutions. Spectral analysis on…

Machine Learning · Computer Science 2020-10-26 Alexandros Iosifidis

Natural language processing often involves computations with semantic or syntactic graphs to facilitate sophisticated reasoning based on structural relationships. While convolution kernels provide a powerful tool for comparing graph…

Computation and Language · Computer Science 2018-02-13 Sahil Garg , Greg Ver Steeg , Aram Galstyan

Learning with kernels is an important concept in machine learning. Standard approaches for kernel methods often use predefined kernels that require careful selection of hyperparameters. To mitigate this burden, we propose in this paper a…

Machine Learning · Computer Science 2020-06-26 Yufan Zhou , Changyou Chen , Jinhui Xu

Kernel methods have been among the most popular techniques in machine learning, where learning tasks are solved using the property of reproducing kernel Hilbert space (RKHS). In this paper, we propose a novel data analysis framework with…

Machine Learning · Statistics 2020-03-03 Yuka Hashimoto , Isao Ishikawa , Masahiro Ikeda , Fuyuta Komura , Takeshi Katsura , Yoshinobu Kawahara

This paper considers the problem of kernel regression and classification with possibly unobservable response variables in the data, where the mechanism that causes the absence of information is unknown and can depend on both predictors and…

Statistics Theory · Mathematics 2022-12-07 Majid Mojirsheibani , William Pouliot , Andre Shakhbandaryan

Ridgeless regression has garnered attention among researchers, particularly in light of the ``Benign Overfitting'' phenomenon, where models interpolating noisy samples demonstrate robust generalization. However, kernel ridgeless regression…

Machine Learning · Computer Science 2024-06-04 Fan He , Mingzhen He , Lei Shi , Xiaolin Huang , Johan A. K. Suykens

The role of kernels is central to machine learning. Motivated by the importance of power-law distributions in statistical modeling, in this paper, we propose the notion of power-law kernels to investigate power-laws in learning problem. We…

Machine Learning · Computer Science 2013-04-02 Debarghya Ghoshdastidar , Ambedkar Dukkipati

In data science, individual observations are often assumed to come independently from an underlying probability space. Kernel matrices formed from large sets of such observations arise frequently, for example during classification tasks. It…

Machine Learning · Statistics 2026-05-27 Mikhail Lepilov