English
Related papers

Related papers: Robust Kernel (Cross-) Covariance Operators in Rep…

200 papers

Kernel methods, being supported by a well-developed theory and coming with efficient algorithms, are among the most popular and successful machine learning techniques. From a mathematical point of view, these methods rest on the concept of…

Machine Learning · Statistics 2023-03-20 Christian Fiedler , Michael Herty , Michael Rom , Chiara Segala , Sebastian Trimpe

How does one find dimensions in multivariate data that are reliably expressed across repetitions? For example, in a brain imaging study one may want to identify combinations of neural signals that are reliably expressed across multiple…

Machine Learning · Statistics 2022-12-05 Lucas C. Parra , Stefan Haufe , Jacek P. Dmochowski

Kernel method is a very powerful tool in machine learning. The trick of kernel has been effectively and extensively applied in many areas of machine learning, such as support vector machine (SVM) and kernel principal component analysis…

Networking and Internet Architecture · Computer Science 2011-05-17 Shujie Hou , Robert C. Qiu

Decentralized machine learning is a promising emerging paradigm in view of global challenges of data ownership and privacy. We consider learning of linear classification and regression models, in the setting where the training data is…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-06-20 Lie He , An Bian , Martin Jaggi

Machine learning algorithms in high-dimensional settings are highly susceptible to the influence of even a small fraction of structured outliers, making robust optimization techniques essential. In particular, within the…

Machine Learning · Computer Science 2025-04-25 Changyu Gao , Andrew Lowy , Xingyu Zhou , Stephen J. Wright

Canonical Correlation Analysis (CCA) is a classic technique for multi-view data analysis. To overcome the deficiency of linear correlation in practical multi-view learning tasks, various CCA variants were proposed to capture nonlinear…

Machine Learning · Computer Science 2019-07-05 Yaxin Shi , Yuangang Pan , Donna Xu , Ivor Tsang

In this paper, we illustrate the effectiveness of reproducing kernel Hilbert space techniques in the study of composition operators. For weighted Hardy spaces on the unit disk, we characterize the composition operators whose adjoint is…

Functional Analysis · Mathematics 2026-01-28 Preeti Kumari , P. Muthukumar , Antti Rasila

The performance of reproducing kernel Hilbert space-based methods is known to be sensitive to the choice of the reproducing kernel. Choosing an adequate reproducing kernel can be challenging and computationally demanding, especially in…

Machine Learning · Computer Science 2023-11-07 Emilio Ruiz-Moreno , Baltasar Beferull-Lozano

Most of previous machine learning algorithms are proposed based on the i.i.d. hypothesis. However, this ideal assumption is often violated in real applications, where selection bias may arise between training and testing process. Moreover,…

Computer Vision and Pattern Recognition · Computer Science 2018-08-24 Zheyan Shen , Peng Cui , Kun Kuang , Bo Li , Peixuan Chen

In contrast with Mercer kernel-based approaches as used e.g., in Kernel Principal Component Analysis (KPCA), it was previously shown that Singular Value Decomposition (SVD) inherently relates to asymmetric kernels and Asymmetric Kernel…

Machine Learning · Computer Science 2025-03-11 Qinghua Tao , Francesco Tonin , Alex Lambert , Yingyi Chen , Panagiotis Patrinos , Johan A. K. Suykens

In this paper we review existing methods for robust functional principal component analysis (FPCA) and propose a new method for FPCA that can be applied to longitudinal data where only a few observations per trajectory are available. This…

Methodology · Statistics 2020-12-04 Graciela Boente , Matias Salibian-Barrera

CoVariance Neural Networks (VNNs) perform graph convolutions on the empirical covariance matrix of signals defined over finite-dimensional Hilbert spaces, motivated by robustness and transferability properties. Yet, little is known about…

Machine Learning · Computer Science 2025-09-18 Claudio Battiloro , Andrea Cavallo , Elvin Isufi

Depth measures have gained popularity in the statistical literature for defining level sets in complex data structures like multivariate data, functional data, and graphs. Despite their versatility, integrating depth measures into…

The kernel trick concept, formulated as an inner product in a feature space, facilitates powerful extensions to many well-known algorithms. While the kernel matrix involves inner products in the feature space, the sample covariance matrix…

Computation · Statistics 2017-07-20 Tomer Lancewicki

It is often said that control and estimation problems are in duality. Recently, in (Aubin-Frankowski,2021), we found new reproducing kernels in Linear-Quadratic optimal control by focusing on the Hilbert space of controlled trajectories,…

Optimization and Control · Mathematics 2022-10-14 Pierre-Cyril Aubin-Frankowski , Alain Bensoussan

We present estimators for smooth Hilbert-valued parameters, where smoothness is characterized by a pathwise differentiability condition. When the parameter space is a reproducing kernel Hilbert space, we provide a means to obtain efficient,…

Statistics Theory · Mathematics 2023-09-28 Alex Luedtke , Incheoul Chung

We study inference for censored survival data where some covariates are distorted by some unknown functions of an observable confounding variable in a multiplicative form. Example of this kind of data in medical studies is the common…

Methodology · Statistics 2020-06-03 Yanyan Liu , Yuanshan Wu , Jing Zhang , Haibo Zhou

A meta-model of the input-output data of a computationally expensive simulation is often employed for prediction, optimization, or sensitivity analysis purposes. Fitting is enabled by a designed experiment, and for computationally expensive…

Methodology · Statistics 2023-12-01 Andrew Gill , David J. Warne , Antony M. Overstall , Clare McGrory , James M. McGree

The problem of testing changes in covariance has received increasing attention in recent years, especially in the context of high-dimensional testing. A number of approaches have been proposed, all limited to the two-sample problem and…

Methodology · Statistics 2016-09-06 Yi-Hui Zhou

Feature matters. How to train a deep network to acquire discriminative features across categories and polymerized features within classes has always been at the core of many computer vision tasks, specially for large-scale recognition…

Computer Vision and Pattern Recognition · Computer Science 2017-10-31 Yu Liu , Hongyang Li , Xiaogang Wang