English
Related papers

Related papers: Robust Kernel (Cross-) Covariance Operators in Rep…

200 papers

In this paper we analyze different ways of performing principal component analysis throughout three different approaches: robust covariance and correlation matrix estimation, projection pursuit approach and non-parametric maximum entropy…

Statistics Theory · Mathematics 2019-03-04 María Camila Vásquez-Correa , Henry Laniado Rodas

Kernel methods are powerful machine learning techniques which implement generic non-linear functions to solve complex tasks in a simple way. They Have a solid mathematical background and exhibit excellent performance in practice. However,…

Machine Learning · Computer Science 2021-01-27 J. Emmanuel Johnson , Valero Laparra , Adrián Pérez-Suay , Miguel D. Mahecha , Gustau Camps-Valls

Kernel approximation methods create explicit, low-dimensional kernel feature maps to deal with the high computational and memory complexity of standard techniques. This work studies a supervised kernel learning methodology to optimize such…

Machine Learning · Computer Science 2020-02-17 Mert Al , Zejiang Hou , Sun-Yuan Kung

We study the problem of high-dimensional linear regression in a robust model where an $\epsilon$-fraction of the samples can be adversarially corrupted. We focus on the fundamental setting where the covariates of the uncorrupted samples are…

Machine Learning · Computer Science 2018-06-04 Ilias Diakonikolas , Weihao Kong , Alistair Stewart

Canonical correlation analysis (CCA) is a classic statistical method for discovering latent co-variation that underpins two or more observed random vectors. Several extensions and variations of CCA have been proposed that have strengthened…

Machine Learning · Computer Science 2023-12-22 Paris A. Karakasis , Nicholas D. Sidiropoulos

This paper presents a study on an $\ell_1$-penalized covariance regression method. Conventional approaches in high-dimensional covariance estimation often lack the flexibility to integrate external information. As a remedy, we adopt the…

Methodology · Statistics 2025-02-24 Kwan-Young Bak , Seongoh Park

Improvement of statistical learning models in order to increase efficiency in solving classification or regression problems is still a goal pursued by the scientific community. In this way, the support vector machine model is one of the…

Machine Learning · Statistics 2019-11-22 Anderson Ara , Mateus Maia , Samuel Macêdo , Francisco Louzada

Principal component analysis (PCA) is a widely used unsupervised dimensionality reduction technique in machine learning, applied across various fields such as bioinformatics, computer vision and finance. However, when the response variables…

Applications · Statistics 2025-06-25 Theodosios Papazoglou , Guosheng Yin

Modern bio-technologies have produced a vast amount of high-throughput data with the number of predictors far greater than the sample size. In order to identify more novel biomarkers and understand biological mechanisms, it is vital to…

Machine Learning · Statistics 2018-05-18 Kevin He , Jian Kang , Hyokyoung Grace Hong , Ji Zhu , Yanming Li , Huazhen Lin , Han Xu , Yi Li

Self-supervised learning (SSL) has emerged as a powerful paradigm for representation learning by optimizing geometric objectives, such as invariance to augmentations, variance preservation, and feature decorrelation, without requiring…

Machine Learning · Statistics 2026-03-09 M. Hadi Sepanj , Benyamin Ghojogh , Saed Moradi , Paul Fieguth

To improve precision of estimation and power of testing hypothesis for an unconditional treatment effect in randomized clinical trials with binary outcomes, researchers and regulatory agencies recommend using g-computation as a reliable…

Methodology · Statistics 2023-03-29 Ting Ye , Marlena Bannick , Yanyao Yi , Jun Shao

Recently, Graph Neural Network (GNN)-based vulnerability detection systems have achieved remarkable success. However, the lack of explainability poses a critical challenge to deploy black-box models in security-related domains. For this…

Cryptography and Security · Computer Science 2024-01-29 Sicong Cao , Xiaobing Sun , Xiaoxue Wu , David Lo , Lili Bo , Bin Li , Wei Liu

This paper presents a robust and kernelized data-enabled predictive control (RoKDeePC) algorithm to perform model-free optimal control for nonlinear systems using only input and output data. The algorithm combines robust predictive control…

Systems and Control · Electrical Eng. & Systems 2022-06-07 Linbin Huang , John Lygeros , Florian Dörfler

The use of kernel functions is a common technique to extract important features from data sets. A quantum computer can be used to estimate kernel entries as transition amplitudes of unitary circuits. Quantum kernels exist that, subject to…

The support vector machine (SVM) is a popular machine learning classification method which produces a nonlinear decision boundary in a feature space by constructing linear boundaries in a transformed Hilbert space. It is well known that…

Quantum Physics · Physics 2017-10-31 Rupak Chatterjee , Ting Yu

In order to fully utilize "big data", it is often required to use "big models". Such models tend to grow with the complexity and size of the training data, and do not make strong parametric assumptions upfront on the nature of the…

Machine Learning · Statistics 2015-04-17 Vikas Sindhwani , Haim Avron

Function encoders are a recent technique that learn neural network basis functions to form compact, adaptive representations of Hilbert spaces of functions. We show that function encoders provide a principled connection to feature learning…

Machine Learning · Computer Science 2025-09-26 Su Ann Low , Quentin Rommel , Kevin S. Miller , Adam J. Thorpe , Ufuk Topcu

This paper proposes distributed algorithms to solve robust convex optimization (RCO) when the constraints are affected by nonlinear uncertainty. We adopt a scenario approach by randomly sampling the uncertainty set. To facilitate the…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-01-16 Keyou You , Roberto Tempo , Pei Xie

Quantum kernel methods leverage a kernel function computed by embedding input information into the Hilbert space of a quantum system. However, large Hilbert spaces can hinder generalization capability, and the scalability of quantum kernels…

Quantum Physics · Physics 2024-04-16 Rodrigo Martínez-Peña , Miguel C. Soriano , Roberta Zambrini

Distributionally Robust Optimization (DRO) provides a framework for decision-making under distributional uncertainty, yet its effectiveness can be compromised by outliers in the training data. This paper introduces a principled approach to…

Machine Learning · Computer Science 2025-11-04 Shuyao Li , Ilias Diakonikolas , Jelena Diakonikolas