English
Related papers

Related papers: A robust variable screening procedure for ultra-hi…

200 papers

This paper introduces a novel framework for dynamic classification in high dimensional spaces, addressing the evolving nature of class distributions over time or other index variables. Traditional discriminant analysis techniques are…

Methodology · Statistics 2025-02-18 Wenbo Ouyang , Ruiyang Wu , Ning Hao , Hao Helen Zhang

In this article, we introduce a new variable selection technique through trimming for finite mixture of regression models. Compared to the traditional variable selection techniques, the new method is robust and not sensitive to outliers.…

Methodology · Statistics 2019-05-06 Sijia Xiang , Weixin Yao

The panel data regression models have gained increasing attention in different areas of research including but not limited to econometrics, environmental sciences, epidemiology, behavioral and social sciences. However, the presence of…

Methodology · Statistics 2020-11-24 Beste Hamiye Beyaztas , Soutir Bandyopadhyay

Feature screening is an important method to reduce the dimension and capture informative variables in ultrahigh-dimensional data analysis. Many methods have been developed for feature screening. These methods, however, are challenged by…

Methodology · Statistics 2019-01-08 Li-Pang Chen

Identification of differentially expressed genes (DE-genes) is commonly conducted in modern biomedical researches. However, unwanted variation inevitably arises during the data collection process, which could make the detection results…

Methodology · Statistics 2017-11-07 Hung Hung

Modern variable selection procedures make use of penalization methods to execute simultaneous model selection and estimation. A popular method is the LASSO (least absolute shrinkage and selection operator), the use of which requires…

Methodology · Statistics 2023-01-12 Meadhbh O'Neill , Kevin Burke

Classification of high-dimensional low sample size (HDLSS) data poses a challenge in a variety of real-world situations, such as gene expression studies, cancer research, and medical imaging. This article presents the development and…

Machine Learning · Statistics 2026-05-27 Jyotishka Ray Choudhury , Aytijhya Saha , Sarbojit Roy , Subhajit Dutta

This paper presents a fast methodology, called ROBOUT, to identify outliers in a response variable conditional on a set of linearly related predictors, retrieved from a large granular dataset. ROBOUT is shown to be effective and…

Methodology · Statistics 2021-04-27 Matteo Farnè , Angelos Vouldis

We propose a sparse regression method based on the non-concave penalized density power divergence loss function which is robust against infinitesimal contamination in very high dimensionality. Present methods of sparse and robust regression…

Methodology · Statistics 2021-05-18 Abhik Ghosh , Subhabrata Majumdar

Variable selection is a procedure to attain the truly important predictors from inputs. Complex nonlinear dependencies and strong coupling pose great challenges for variable selection in high-dimensional data. In addition, real-world…

Methodology · Statistics 2023-07-04 Keyao Wang , Huiwen Wang , Jichang Zhao , Lihong Wang

We develop a Bayesian variable selection method, called SVEN, based on a hierarchical Gaussian linear model with priors placed on the regression coefficients as well as on the model space. Sparsity is achieved by using degenerate spike…

Methodology · Statistics 2020-08-04 Dongjin Li , Somak Dutta , Vivekananda Roy

Varying coefficient models have numerous applications in a wide scope of scientific areas. While enjoying nice interpretability, they also allow flexibility in modeling dynamic impacts of the covariates. But, in the new era of big data, it…

Methodology · Statistics 2014-10-27 Ming-Yen Cheng , Toshio Honda , Jin-Ting Zhang

Herein, we propose a Spearman rank correlation based screening procedure for ultrahigh-dimensional data with censored response case. The proposed method is model-free without specifying any regression forms of predictors or response…

Methodology · Statistics 2022-11-28 Hongni Wang , Jingxin Yan , Xiaodong Yan

Linear and Quadratic Discriminant Analysis are well-known classical methods but can heavily suffer from non-Gaussian distributions and/or contaminated datasets, mainly because of the underlying Gaussian assumption that is not robust. To…

Machine Learning · Statistics 2022-01-11 Pierre Houdouin , Frédéric Pascal , Matthieu Jonckheere , Andrew Wang

We propose a novel diverse feature selection method based on determinantal point processes (DPPs). Our model enables one to flexibly define diversity based on the covariance of features (similar to orthogonal matching pursuit) or…

Machine Learning · Computer Science 2014-11-25 Nematollah Kayhan Batmanghelich , Gerald Quon , Alex Kulesza , Manolis Kellis , Polina Golland , Luke Bornn

Reliable outlier detection in high-dimensional data is crucial in modern science, yet it remains a challenging task. Traditional methods often break down in these settings due to their reliance on asymptotic behaviors with respect to sample…

Methodology · Statistics 2025-11-05 Seong-ho Lee , Yongho Jeon

Feature screening is an important tool in analyzing ultrahigh-dimensional data, particularly in the field of Omics and oncology studies. However, most attention has been focused on identifying features that have a linear or monotonic impact…

Methodology · Statistics 2023-05-10 Yaxian Chen , KF Lam , Zhonghua Liu

Robust model fitting is a core algorithm in a large number of computer vision applications. Solving this problem efficiently for datasets highly contaminated with outliers is, however, still challenging due to the underlying computational…

Computer Vision and Pattern Recognition · Computer Science 2021-03-08 Giang Truong , Huu Le , David Suter , Erchuan Zhang , Syed Zulqarnain Gilani

Several areas have been improved with Deep Learning during the past years. Implementing Deep Neural Networks (DNN) for non-safety related applications have shown remarkable achievements over the past years; however, for using DNNs in safety…

Variable selection is of increasing importance to address the difficulties of high dimensionality in many scientific areas. In this paper, we demonstrate a property for distance covariance, which is incorporated in a novel feature screening…

Methodology · Statistics 2014-09-03 Jing Kong , Sijian Wang , Grace Wahba