English
Related papers

Related papers: RaSE: A Variable Screening Framework via Random Su…

200 papers

Variable screening is a fast dimension reduction technique for assisting high dimensional feature selection. As a preselection method, it selects a moderate size subset of candidate variables for further refining via feature selection to…

Statistics Theory · Mathematics 2015-06-09 Xiangyu Wang , Chenlei Leng , David B. Dunson

Classification and probability estimation are fundamental tasks with broad applications across modern machine learning and data science, spanning fields such as biology, medicine, engineering, and computer science. Recent development of…

Methodology · Statistics 2026-03-25 Liyun Zeng , Hao Helen Zhang

A new line of research for feature selection based on neural networks has recently emerged. Despite its superiority to classical methods, it requires many training iterations to converge and detect informative features. The computational…

Machine Learning · Computer Science 2022-11-29 Ghada Sokar , Zahra Atashgahi , Mykola Pechenizkiy , Decebal Constantin Mocanu

Ultra-high dimensional longitudinal data are increasingly common and the analysis is challenging both theoretically and methodologically. We offer a new automatic procedure for finding a sparse semivarying coefficient model, which is widely…

Methodology · Statistics 2014-09-24 Ming-Yen Cheng , Toshio Honda , Jialiang Li , Heng Peng

Embedding is a useful technique to project a high-dimensional feature into a low-dimensional space, and it has many successful applications including link prediction, node classification and natural language processing. Current approaches…

Information Retrieval · Computer Science 2020-09-21 Meimei Liu , Hongxia Yang

Jointing visual-semantic embeddings (VSE) have become a research hotpot for the task of image annotation, which suffers from the issue of semantic gap, i.e., the gap between images' visual features (low-level) and labels' semantic features…

Computer Vision and Pattern Recognition · Computer Science 2018-08-14 Guibing Guo , Songlin Zhai , Fajie Yuan , Yuan Liu , Xingwei Wang

Standard approaches for variable selection in linear models are not tailored to deal properly with high-dimensional and incomplete data. Currently, methods dedicated to high-dimensional data handle missing values by ad-hoc strategies, like…

Methodology · Statistics 2021-06-09 Avner Bar-Hen , Vincent Audigier

An important problem in the analysis of high-dimensional omics data is to identify subsets of molecular variables that are associated with a phenotype of interest. This requires addressing the challenges of high dimensionality, strong…

Methodology · Statistics 2022-04-05 Fan Wang , Sylvia Richardson , Steven M. Hill

This paper introduces RISE, a robust individualized decision learning framework with sensitive variables, where sensitive variables are collectible data and important to the intervention decision, but their inclusion in decision making is…

Machine Learning · Computer Science 2022-11-15 Xiaoqing Tan , Zhengling Qi , Christopher W. Seymour , Lu Tang

Iterative feature space optimization involves systematically evaluating and adjusting the feature space to improve downstream task performance. However, existing works suffer from three key limitations:1) overlooking differences among data…

Machine Learning · Computer Science 2026-05-26 Yanping Wu , Yanyong Huang , Zhengzhang Chen , Zijun Yao , Yanjie Fu , Kunpeng Liu , Xiao Luo , Dongjie Wang

Variational Autoencoders (VAEs) are powerful generative models for learning latent representations. Standard VAEs generate dispersed and unstructured latent spaces by utilizing all dimensions, which limits their interpretability, especially…

Computer Vision and Pattern Recognition · Computer Science 2025-05-21 Farshad Sangari Abiz , Reshad Hosseini , Babak N. Araabi

The analysis of high-dimensional data, common in fields such as genomics, is complicated by the presence of cellwise contamination, where individual cells rather than entire rows are corrupted. This contamination poses a significant…

Methodology · Statistics 2026-03-31 Anthony Christidis , Jeyshinee Pyneeandee , Gabriela Cohen-Freue

Variable selection in ultra-high dimensional regression problems has become an important issue. In such situations, penalized regression models may face computational problems and some pre screening of the variables may be necessary. A…

Methodology · Statistics 2020-05-01 Abhik Ghosh , Magne Thoresen

Recent developments in differentiable and neural rendering have made impressive breakthroughs in a variety of 2D and 3D tasks, e.g. novel view synthesis, 3D reconstruction. Typically, differentiable rendering relies on a dense viewpoint…

Computer Vision and Pattern Recognition · Computer Science 2024-09-24 Michal Nazarczuk , Thomas Tanay , Sibi Catley-Chandar , Richard Shaw , Radu Timofte , Eduardo Pérez-Pellitero

Feature screening is useful and popular to detect informative predictors for ultrahigh-dimensional data before developing proceeding statistical analysis or constructing statistical models. While a large body of feature screening procedures…

Methodology · Statistics 2020-08-12 Li-Pang Chen

The goal of this presentation is to build an efficient non-parametric Bayes classifier in the presence of large numbers of predictors. When analyzing such data, parametric models are often too inflexible while non-parametric procedures tend…

Methodology · Statistics 2013-01-07 Abhishek Bhattacharya

It is now practically the norm for data to be very high dimensional in areas such as genetics, machine vision, image analysis and many others. When analyzing such data, parametric models are often too inflexible while nonparametric…

Methodology · Statistics 2011-05-31 Abhishek Bhattacharya , Garritt Page , David Dunson

Variable selection in ultrahigh-dimensional linear regression is challenging due to its high computational cost. Therefore, a screening step is usually conducted before variable selection to significantly reduce the dimension. Here we…

Methodology · Statistics 2025-04-29 Run Wang , An Nguyen , Somak Dutta , Vivekananda Roy

Feature selection reduces the dimensionality of data by identifying a subset of the most informative features. In this paper, we propose an innovative framework for unsupervised feature selection, called fractal autoencoders (FAE). It…

Machine Learning · Computer Science 2022-01-06 Xinxing Wu , Qiang Cheng

We show how random subspace methods can be adapted to estimating local projections with many controls. Random subspace methods have their roots in the machine learning literature and are implemented by averaging over regressions estimated…

Econometrics · Economics 2024-06-04 Viet Hoang Dinh , Didier Nibbering , Benjamin Wong