English
Related papers

Related papers: Metric on random dynamical systems with vector-val…

200 papers

We develop sampling formulas for high-dimensional functions in reproducing kernel Hilbert spaces, where we rely on irregular samples that are taken at determining sequences of data points. We place particular emphasis on sampling formulas…

Machine Learning · Computer Science 2025-04-21 Armin Iske , Lennart Ohlsen

In this paper, we study the problem of identifying the impulse response of a linear time invariant (LTI) dynamical system from the knowledge of the input signal and a finite set of noisy output observations. We adopt an approach based on…

Systems and Control · Computer Science 2015-03-20 Francesco Dinuzzo

The Hilbert Schmidt Independence Criterion (HSIC) is a kernel dependence measure that has applications in various aspects of machine learning. Conveniently, the objectives of different dimensionality reduction applications using HSIC often…

Machine Learning · Statistics 2019-09-12 Chieh Wu , Jared Miller , Yale Chang , Mario Sznaier , Jennifer Dy

We consider the prediction problem of a continuous-time stochastic process on an entire time-interval in terms of its recent past. The approach we adopt is based on functional kernel nonparametric regression estimation techniques where…

Statistics Theory · Mathematics 2007-06-13 Anestis Antoniadis , Efstathios Paparoditis , Theofanis Sapatinas

Learning the kernel functions used in kernel methods has been a vastly explored area in machine learning. It is now widely accepted that to obtain 'good' performance, learning a kernel function is the key challenge. In this work we focus on…

Machine Learning · Computer Science 2016-01-08 Chetan Tonde , Ahmed Elgammal

Tree structured graphical models are powerful at expressing long range or hierarchical dependency among many variables, and have been widely applied in different areas of computer science and statistics. However, existing methods for…

Machine Learning · Statistics 2014-01-17 Le Song , Han Liu , Ankur Parikh , Eric Xing

A methodological framework for ensemble-based estimation and simulation of high dimensional dynamical systems such as the oceanic or atmospheric flows is proposed. To that end, the dynamical system is embedded in a family of reproducing…

Mathematical Physics · Physics 2024-01-02 Benjamin Dufée , Bérenger Hug , Etienne Mémin , Gilles Tissot

In the context of kernel optimization, we prove a result that yields new factorizations and realizations. Our initial context is that of general positive operator-valued kernels. We further present implications for Hilbert space-valued…

Operator Algebras · Mathematics 2024-10-14 Palle E. T. Jorgensen , James Tian

Kernel methods are among the most popular techniques in machine learning. From a frequentist/discriminative perspective they play a central role in regularization theory as they provide a natural choice for the hypotheses space and the…

Machine Learning · Statistics 2012-04-17 Mauricio A. Alvarez , Lorenzo Rosasco , Neil D. Lawrence

Learning a distance metric from the given training samples plays a crucial role in many machine learning tasks, and various models and optimization algorithms have been proposed in the past decade. In this paper, we generalize several…

Machine Learning · Computer Science 2013-09-24 Faqiang Wang , Wangmeng Zuo , Lei Zhang , Deyu Meng , David Zhang

We propose a new method for input variable selection in nonlinear regression. The method is embedded into a kernel regression machine that can model general nonlinear functions, not being a priori limited to additive models. This is the…

Machine Learning · Computer Science 2018-09-05 Magda Gregorová , Jason Ramapuram , Alexandros Kalousis , Stéphane Marchand-Maillet

Operator-Valued Kernels (OVKs) and associated vector-valued Reproducing Kernel Hilbert Spaces provide an elegant way to extend scalar kernel methods when the output space is a Hilbert space. Although primarily used in finite dimension for…

Machine Learning · Statistics 2020-08-24 Pierre Laforgue , Alex Lambert , Luc Brogat-Motte , Florence d'Alché-Buc

In this article we study the field of Hilbertian metrics and positive definit (pd) kernels on probability measures, they have a real interest in kernel methods. Firstly we will make a study based on the Alpha-Beta-divergence to have a…

Methodology · Statistics 2018-09-18 Mactar Ndaw , Macoumba Ndour , Papa Ngom

We provide a unified framework for independence and mean independence tests based on the Hilbert-Schmidt independence criterion, extending some previous results in the literature to hold in general topological spaces. We also present a…

Methodology · Statistics 2026-05-01 Daniel Diz-Castro , Manuel Febrero-Bande , Wenceslao González-Manteiga

The support vector machine (SVM) is a popular machine learning classification method which produces a nonlinear decision boundary in a feature space by constructing linear boundaries in a transformed Hilbert space. It is well known that…

Quantum Physics · Physics 2017-10-31 Rupak Chatterjee , Ting Yu

Regularized kernel methods such as support vector machines (SVM) and support vector regression (SVR) constitute a broad and flexible class of methods which are theoretically well investigated and commonly used in nonparametric…

Methodology · Statistics 2013-05-07 Robert Hable

This work outlines a consistent method of identifying subsystems in finite-dimensional Hilbert spaces, independent of the underlying inner-product structure. Such Hilbert spaces arise in $\mathcal{P}\mathcal{T}$-symmetric quantum mechanics,…

Quantum Physics · Physics 2025-03-25 Himanshu Badhani , Sibasish Ghosh

The reproducing kernel Hilbert space (RKHS) embedding method is a recently introduced estimation approach that seeks to identify the unknown or uncertain function in the governing equations of a nonlinear set of ordinary differential…

Optimization and Control · Mathematics 2020-07-14 Jia Guo , Sai Tej Paruchuri , Andrew J. Kurdila

In this paper, we introduce a new distribution regression model for probability distributions. This model is based on a Reproducing Kernel Hilbert Space (RKHS) regression framework, where universal kernels are built using Wasserstein…

Statistics Theory · Mathematics 2019-10-07 Thi Thien Trang Bui , J-M Loubes , Laurent Risser , Patricia Balaresque

In this paper, we discuss the solution of certain matrix-valued partial differential equations. Such PDEs arise, for example, when constructing a Riemannian contraction metric for a dynamical system given by an autonomous ODE. We develop…

Numerical Analysis · Mathematics 2017-06-29 Peter Giesl , Holger Wendland