English
Related papers

Related papers: On the Limitation of Kernel Dependence Maximizatio…

200 papers

High-dimensional variable selection is an important issue in many scientific fields, such as genomics. In this paper, we develop a sure independence feature screening pro- cedure based on kernel canonical correlation analysis (KCCA-SIS, for…

Methodology · Statistics 2016-10-04 Tianqi Liu , Kuang-Yao Lee , Hongyu Zhao

Evaluation of statistical dependencies between two data samples is a basic problem of data science/machine learning, and HSIC (Hilbert-Schmidt Information Criterion)~\cite{HSIC} is considered the state-of-art method. However, for size $n$…

Machine Learning · Computer Science 2025-09-03 Jarek Duda , Jagoda Bracha , Adrian Przybysz

In this paper, we aim to perform sensitivity analysis of set-valued models and, in particular, to quantify the impact of uncertain inputs on feasible sets, which are key elements in solving a robust optimization problem under constraints.…

Measurements of systems taken along a continuous functional dimension, such as time or space, are ubiquitous in many fields, from the physical and biological sciences to economics and engineering.Such measurements can be viewed as…

The Hilbert--Schmidt Independence Criterion (HSIC) is a popular measure of the dependency between two random variables. The statistic dHSIC is an extension of HSIC that can be used to test joint independence of $d$ random variables. Such…

Statistics Theory · Mathematics 2020-05-15 David Rindt , Dino Sejdinovic , David Steinsaltz

In machine learning and pattern recognition, feature selection has been a hot topic in the literature. Unsupervised feature selection is challenging due to the loss of labels which would supply the related information.How to define an…

Machine Learning · Computer Science 2015-01-14 Chang Liu , Yi Xu

We consider an independence feature screening technique for identifying explanatory variables that locally contribute to the response variable in high-dimensional regression analysis. Without requiring a specific parametric form of the…

Statistics Theory · Mathematics 2016-03-31 Jinyuan Chang , Cheng Yong Tang , Yichao Wu

We introduce a general non-parametric independence test between right-censored survival times and covariates, which may be multivariate. Our test statistic has a dual interpretation, first in terms of the supremum of a potentially infinite…

Methodology · Statistics 2021-11-23 Tamara Fernandez , Arthur Gretton , David Rindt , Dino Sejdinovic

Hilbert-Schmidt independence criterion and distance covariance are methods to describe independence of random variables using either the Kronecker product of positive definite kernels or the Kronecker product of conditionally negative…

Functional Analysis · Mathematics 2022-01-05 Jean Carlo Guella

We propose a greedy strategy to spectrally train a deep network for multi-class classification. Each layer is defined as a composition of linear weights with the feature map of a Gaussian kernel acting as the activation function. At each…

Machine Learning · Computer Science 2020-11-11 Chieh Wu , Aria Masoomi , Arthur Gretton , Jennifer Dy

Modeling users' dynamic preferences from historical behaviors lies at the core of modern recommender systems. Due to the diverse nature of user interests, recent advances propose the multi-interest networks to encode historical behaviors…

Information Retrieval · Computer Science 2022-07-19 Zhaocheng Liu , Yingtao Luo , Di Zeng , Qiang Liu , Daqing Chang , Dongying Kong , Zhi Chen

The optimization of high dimensional functions is a key issue in engineering problems but it frequently comes at a cost that is not acceptable since it usually involves a complex and expensive computer code. Engineers often overcome this…

Machine Learning · Statistics 2019-06-18 Adrien Spagnol , Rodolphe Le Riche , Sebastien Da Veiga

Causal inference grows increasingly complex as the number of confounders increases. Given treatments $X$, confounders $Z$ and outcomes $Y$, we develop a non-parametric method to test the \textit{do-null} hypothesis $H_0:\; p(y|\text{\it…

Methodology · Statistics 2024-06-04 Robert Hu , Dino Sejdinovic , Robin J. Evans

We consider the problem of feature selection in multi-label classification, considering the costs assigned to groups of features. In this task, the goal is to select a subset of features that will be useful for predicting the label vector,…

Machine Learning · Statistics 2024-08-06 Tomasz Klonecki , Paweł Teisseyre , Jaesung Lee

We propose a feature selection method that finds non-redundant features from a large and high-dimensional data in nonlinear way. Specifically, we propose a nonlinear extension of the non-negative least-angle regression (LARS) called…

Machine Learning · Statistics 2014-11-11 Makoto Yamada , Avishek Saha , Hua Ouyang , Dawei Yin , Yi Chang

We provide a unified framework for independence and mean independence tests based on the Hilbert-Schmidt independence criterion, extending some previous results in the literature to hold in general topological spaces. We also present a…

Methodology · Statistics 2026-05-01 Daniel Diz-Castro , Manuel Febrero-Bande , Wenceslao González-Manteiga

Detecting influential features in non-linear and/or high-dimensional data is a challenging and increasingly important task in machine learning. Variable selection methods have thus been gaining much attention as well as post-selection…

Statistics Theory · Mathematics 2021-06-18 Tobias Freidling , Benjamin Poignard , Héctor Climente-González , Makoto Yamada

We propose an estimator of the Hilbert-Schmidt Independence Criterion obtained from an appropriate modification of the usual estimator. We then get asymptotic normality of this estimator both under independence hypothesis and under the…

Statistics Theory · Mathematics 2022-06-24 Terence Kevin Manfoumbi Djonguet , Guy Martial Nkiet , Alban Mbina Mbina

The maximal information coefficient (MIC), which measures the amount of dependence between two variables, is able to detect both linear and non-linear associations. However, computational cost grows rapidly as a function of the dataset…

Information Theory · Computer Science 2015-08-18 Ali Mousavi , Richard G. Baraniuk

Multivariate time series data that capture the temporal evolution of interconnected systems are ubiquitous in diverse areas. Understanding the complex relationships and potential dependencies among co-observed variables is crucial for the…

Methodology · Statistics 2023-11-03 Zhaolu Liu , Robert L. Peach , Felix Laumann , Sara Vallejo Mengod , Mauricio Barahona