English
Related papers

Related papers: Robust rank correlation based screening

200 papers

Although much progress has been made in classification with high-dimensional features \citep{Fan_Fan:2008, JGuo:2010, CaiSun:2014, PRXu:2014}, classification with ultrahigh-dimensional features, wherein the features much outnumber the…

Machine Learning · Statistics 2016-11-14 Yanming Li , Hyokyoung Hong , Jian Kang , Kevin He , Ji Zhu , Yi Li

Random hypothesis sampling lies at the core of many popular robust fitting techniques such as RANSAC. In this paper, we propose a novel hypothesis sampling scheme based on incremental computation of distances between partial rankings…

Computer Vision and Pattern Recognition · Computer Science 2011-06-02 Hoi Sim Wong , Tat-Jun Chin , Jin Yu , David Suter

Principal component regression uses principal components as regressors. It is particularly useful in prediction settings with high-dimensional covariates. The existing literature treating of Bayesian approaches is relatively sparse. We…

Methodology · Statistics 2020-01-28 Philippe Gagnon , Mylène Bédard , Alain Desgagné

We advocate a numerically reliable and accurate approach for practical parameter identifiability analysis: Applying column subset selection (CSS) to the sensitivity matrix, instead of computing an eigenvalue decomposition of the Fischer…

Numerical Analysis · Mathematics 2022-05-10 Katherine J. Pearce , Ilse C. F. Ipsen , Mansoor A. Haider , Arvind K. Saibaba , Ralph C. Smith

High-dimensional covariates often admit linear factor structure. To effectively screen correlated covariates in high-dimension, we propose a conditional variable screening test based on non-parametric regression using neural networks due to…

Econometrics · Economics 2024-08-21 Jianqing Fan , Weining Wang , Yue Zhao

Ranking systems have an unprecedented influence on how and what information people access, and their impact on our society is being analyzed from different perspectives, such as users' discrimination. A notable example is represented by…

Information Retrieval · Computer Science 2022-08-24 Guilherme Ramos , Ludovico Boratto , Mirko Marras

Variable selection is crucial in high-dimensional omics-based analyses, since it is biologically reasonable to assume only a subset of non-noisy features contributes to the data structures. However, the task is particularly hard in an…

Methodology · Statistics 2022-03-22 Emilie Eliseussen , Thomas Fleischer , Valeria Vitelli

Conditional independence (CI) testing arises naturally in many scientific problems and applications domains. The goal of this problem is to investigate the conditional independence between a response variable $Y$ and another variable $X$,…

Methodology · Statistics 2025-10-07 Adel Javanmard , Mohammad Mehrabi

In many problem settings, parameter vectors are not merely sparse but dependent in such a way that non-zero coefficients tend to cluster together. We refer to this form of dependency as "region sparsity." Classical sparse regression…

Machine Learning · Statistics 2019-01-28 Anqi Wu , Oluwasanmi Koyejo , Jonathan W. Pillow

Respondent-Driven Sampling (RDS) employs a variant of a link-tracing network sampling strategy to collect data from hard-to-reach populations. By tracing the links in the underlying social network, the process exploits the social structure…

Applications · Statistics 2009-04-14 Krista J. Gile , Mark S. Handcock

We introduce a framework for filtering features that employs the Hilbert-Schmidt Independence Criterion (HSIC) as a measure of dependence between the features and the labels. The key idea is that good features should maximise such…

Machine Learning · Computer Science 2007-05-23 Le Song , Alex Smola , Arthur Gretton , Karsten Borgwardt , Justin Bedo

In a typical supervised machine learning setting, the predictions on all test instances are based on a common subset of features discovered during model training. However, using a different subset of features that is most informative for…

Machine Learning · Computer Science 2021-06-10 Yasitha Warahena Liyanage , Daphney-Stavroula Zois , Charalampos Chelmis

Classical dependence measures such as Pearson correlation, Spearman's $\rho$, and Kendall's $\tau$ can detect only monotonic or linear dependence. To overcome these limitations, Szekely et al.(2007) proposed distance covariance as a…

Computation · Statistics 2019-02-07 Arin Chaudhuri , Wenhao Hu

Identifying dependency in multivariate data is a common inference task that arises in numerous applications. However, existing nonparametric independence tests typically require computation that scales at least quadratically with the sample…

Methodology · Statistics 2021-07-08 Shai Gorsky , Li Ma

Variable selection, also known as feature selection in machine learning, plays an important role in modeling high dimensional data and is key to data-driven scientific discoveries. We consider here the problem of detecting influential…

Methodology · Statistics 2014-09-24 Bo Jiang , Jun S. Liu

Causal inference has been increasingly reliant on observational studies with rich covariate information. To build tractable causal procedures, such as the doubly robust estimators, it is imperative to first extract important features from…

Methodology · Statistics 2022-02-08 Dingke Tang , Dehan Kong , Wenliang Pan , Linbo Wang

Ensuring safety of nonlinear systems under model uncertainty and external disturbances is crucial, especially for real-world control tasks. Predictive methods such as robust model predictive control (RMPC) require solving nonconvex…

Systems and Control · Electrical Eng. & Systems 2023-11-14 Zeyang Li , Chuxiong Hu , Weiye Zhao , Changliu Liu

In this paper we propose a class of weighted rank correlation coefficients extending the Spearman's rho. The proposed class constructed by giving suitable weights to the distance between two sets of ranks to place more emphasis on items…

Statistics Theory · Mathematics 2020-01-22 M. Sanatgar , A. Dolati , M. Amini

Model selection criteria are rules used to select the best statistical model among a set of candidate models, striking a trade-off between goodness of fit and model complexity. Most popular model selection criteria measure the goodness of…

Statistics Theory · Mathematics 2023-04-13 Angel Felipe , Maria Jaenada , Pedro Miranda , Leandro Pardo

We propose a novel deep symbolic regression approach to enhance the robustness and interpretability of data-driven mathematical expression discovery. Our work is aligned with the popular DSR framework which focuses on learning a…

Machine Learning · Computer Science 2026-03-30 Zachary Bastiani , Robert M. Kirby , Jacob Hochhalter , Shandian Zhe