中文
相关论文

相关论文: Sure Independence Screening for Ultra-High Dimensi…

200 篇论文

We propose a new model-free feature screening method based on energy distances for ultrahigh-dimensional binary classification problems. With a high probability, the proposed method retains only relevant features after discarding all the…

统计方法学 · 统计学 2023-05-19 Sarbojit Roy , Soham Sarkar , Subhajit Dutta , Anil K. Ghosh

We propose a novel application of the Simultaneous Orthogonal Matching Pursuit (S-OMP) procedure for sparsistant variable selection in ultra-high dimensional multi-task regression problems. Screening of variables, as introduced in…

机器学习 · 统计学 2010-12-20 Mladen Kolar , Eric P. Xing

We propose the Sobolev Independence Criterion (SIC), an interpretable dependency measure between a high dimensional random variable X and a response variable Y . SIC decomposes to the sum of feature importance scores and hence can be used…

机器学习 · 计算机科学 2019-11-01 Youssef Mroueh , Tom Sercu , Mattia Rigotti , Inkit Padhi , Cicero Dos Santos

We consider the high-dimensional discriminant analysis problem. For this problem, different methods have been proposed and justified by establishing exact convergence rates for the classification risk, as well as the l2 convergence results…

机器学习 · 统计学 2013-06-28 Mladen Kolar , Han Liu

In a high-dimensional setting, sparse model has shown its power in computational and statistical efficiency. We consider variables selection problem with a broad class of simultaneous sparsity regularization, enforcing both feature-wise and…

最优化与控制 · 数学 2021-09-27 Xinyu Zhang

We propose a flexible nonparametric regression method for ultrahigh-dimensional data. As a first step, we propose a fast screening method based on the favored smoothing bandwidth of the marginal local constant regression. Then, an iterative…

统计方法学 · 统计学 2018-07-30 Yang Feng , Yichao Wu , Leonard Stefanski

The uncertainty quantification and error control of classifiers are crucial in many high-consequence decision-making scenarios. We propose a selective classification framework that provides an indecision option for any observations that…

统计方法学 · 统计学 2022-10-11 Bowen Gang , Yuantao Shi , Wenguang Sun

How to select the active variables which have significant impact on the event of interest is a very important and meaningful problem in the statistical analysis of ultrahigh-dimensional data. Sure independent screening procedure has been…

统计方法学 · 统计学 2023-03-28 Xuerui Li , Yanyan Liu , Yankai Peng , Jing Zhang

Analysis of high-dimensional data has led to increased interest in both single index models (SIMs) and the best-subset selection. SIMs provide an interpretable and flexible modeling framework for high-dimensional data, while the best-subset…

机器学习 · 统计学 2025-08-19 Borui Tang , Jin Zhu , Junxian Zhu , Xueqin Wang , Heping Zhang

A ubiquitous feature of data of our era is their extra-large sizes and dimensions. Analyzing such high-dimensional data poses significant challenges, since the feature dimension is often much larger than the sample size. This thesis…

统计理论 · 数学 2025-09-11 Kai Yang

Unsupervised dimension selection is an important problem that seeks to reduce dimensionality of data, while preserving the most useful characteristics. While dimensionality reduction is commonly utilized to construct low-dimensional…

机器学习 · 统计学 2018-11-01 Jayaraman J. Thiagarajan , Rushil Anirudh , Rahul Sridhar , Peer-Timo Bremer

We provide here a framework to analyze the phase transition phenomenon of slice inverse regression (SIR), a supervised dimension reduction technique introduced by \cite{Li:1991}. Under mild conditions, the asymptotic ratio $\rho= \lim p/n$…

统计理论 · 数学 2016-11-22 Qian Lin , Zhigen Zhao , Jun S. Liu

In high dimensional regression settings, sparsity enforcing penalties have proved useful to regularize the data-fitting term. A recently introduced technique called screening rules propose to ignore some variables in the optimization…

机器学习 · 统计学 2017-12-29 Eugene Ndiaye , Olivier Fercoq , Alexandre Gramfort , Joseph Salmon

Estimation of structure, such as in variable selection, graphical modelling or cluster analysis is notoriously difficult, especially for high-dimensional data. We introduce stability selection. It is based on subsampling in combination with…

统计方法学 · 统计学 2009-05-16 Nicolai Meinshausen , Peter Buehlmann

The Dantzig selector is a widely used and effective method for variable selection in ultra-high-dimensional data. Feature splitting is an efficient processing technique that involves dividing these ultra-high-dimensional variable datasets…

统计计算 · 统计学 2025-04-04 Xiaofei Wu , Yue Chao , Rongmei Liang , Shi Tang , Zhiming Zhang

We propose a novel high-dimensional linear regression estimator: the Discrete Dantzig Selector, which minimizes the number of nonzero regression coefficients subject to a budget on the maximal absolute correlation between the features and…

统计方法学 · 统计学 2017-01-20 Rahul Mazumder , Peter Radchenko

Independence screening methods such as the two sample $t$-test and the marginal correlation based ranking are among the most widely used techniques for variable selection in ultrahigh dimensional data sets. In this short note, simple…

统计方法学 · 统计学 2020-11-17 Run Wang , Somak Dutta , Vivekananda Roy

Lasso and other regularization procedures are attractive methods for variable selection, subject to a proper choice of shrinkage parameter. Given a set of potential subsets produced by a regularization algorithm, a consistent model…

统计方法学 · 统计学 2014-02-26 Minh-Ngoc Tran

This article investigates uncertainty quantification of the generalized linear lasso~(GLL), a popular variable selection method in high-dimensional regression settings. In many fields of study, researchers use data-driven methods to select…

统计理论 · 数学 2023-07-11 Quentin Duchemin , Yohann de Castro

This paper introduces a novel approach for cardinality-constrained Poisson regression to address feature selection challenges in high-dimensional count data. We formulate the problem as a mixed-integer conic optimization, enabling the use…

最优化与控制 · 数学 2025-04-18 Kota Kurihara , Yoichi Izunaga