English
Related papers

Related papers: Robust Ultra-High-Dimensional Variable Selection W…

200 papers

When fitting statistical models, some predictors are often found to be correlated with each other, and functioning together. Many group variable selection methods are developed to select the groups of predictors that are closely related to…

Methodology · Statistics 2021-03-25 Zhiyuan Li

We consider the problem of simultaneous variable selection and estimation of the corresponding regression coefficients in an ultra-high dimensional linear regression models, an extremely important problem in the recent era. The adaptive…

Methodology · Statistics 2023-09-22 Abhik Ghosh , Maria Jaenada , Leandro Pardo

Sure Independence Screening is a fast procedure for variable selection in ultra-high dimensional regression analysis. Unfortunately, its performance greatly deteriorates with increasing dependence among the predictors. To solve this issue,…

Methodology · Statistics 2018-11-15 Yixin Wang , Stefan Van Aelst

This paper presents a new approach to classification of high dimensional spectroscopy data and demonstrates that it outperforms other current state-of-the art approaches. The specific task we consider is identifying whether samples contain…

Machine Learning · Computer Science 2020-03-27 James Houston , Frank G. Glavin , Michael G. Madden

Motivation: The high dimensionality of genomic data calls for the development of specific classification methodologies, especially to prevent over-optimistic predictions. This challenge can be tackled by compression and variable selection,…

Methodology · Statistics 2021-04-10 G. Durif , L. Modolo , J. Michaelsson , J. E. Mold , S. Lambert-Lacroix , F. Picard

Knowing the features of a complex system that are highly relevant to a particular target variable is of fundamental interest in many areas of science. Existing approaches are often limited to linear settings, sometimes lack guarantees, and…

Machine Learning · Computer Science 2023-07-06 Francesco Quinzan , Ashkan Soleymani , Patrick Jaillet , Cristian R. Rojas , Stefan Bauer

This manuscript delves into the intersection of genomics and phenotypic prediction, focusing on the statistical innovation required to navigate the complexities introduced by noisy covariates and confounders. The primary emphasis is on the…

Methodology · Statistics 2024-11-15 Upama Paul Chowdhury , Ronit Bhattacharjee , Susmita Das , Abhik Ghosh

Kernel methods form a powerful, versatile, and theoretically-grounded unifying framework to solve nonlinear problems in signal processing and machine learning. The standard approach relies on the kernel trick to perform pairwise evaluations…

Machine Learning · Computer Science 2019-12-11 Kan Li , Jose C. Principe

DNA sequence classification requires not only high predictive accuracy but also the ability to uncover latent site interactions, combinatorial regulation, and epistasis-like higher-order dependencies. Although the standard Transformer…

Machine Learning · Computer Science 2026-03-30 Zhixuan Cao , Yishu Xu , Xuang WU

Background: Selecting feature genes to predict phenotypes is one of the typical tasks in analyzing genomics data. Though many general-purpose algorithms were developed for prediction, dealing with highly correlated genes in the prediction…

Applications · Statistics 2022-04-11 Li Xing , Songwan Joun , Kurt Mackay , Mary Lesperance , Xuekui Zhang

In genetic studies of complex diseases, the underlying mode of inheritance is often not known. Thus, the most powerful test or other optimal procedure for one model, e.g. recessive, may be quite inefficient if another model, e.g. dominant,…

Statistics Theory · Mathematics 2007-06-13 Gang Zheng , Boris Freidlin , Joseph L. Gastwirth

In this paper, a robust weighted score for unbalanced data (ROWSU) is proposed for selecting the most discriminative feature for high dimensional gene expression binary classification with class-imbalance problem. The method addresses one…

Machine Learning · Statistics 2024-01-24 Zardad Khan , Amjad Ali , Saeed Aldahmani

Modern data often arises with multiple modalities. For example, covariates and a network are observed on the same subjects, and both contain useful information. Effectively integrating these modalities is important and challenging,…

Methodology · Statistics 2025-11-25 Tao Shen , Wanjie Wang

Variable selection for structured covariates lying on an underlying known graph is a problem motivated by practical applications, and has been a topic of increasing interest. However, most of the existing methods may not be scalable to high…

Methodology · Statistics 2016-04-27 Changgee Chang , Suprateek Kundu , Qi Long

This paper explores the integration of symmetries into the Koopman-operator framework for the analysis and efficient learning of equivariant dynamical systems using a group-convolutional approach. Approximating the Koopman operator by…

Dynamical Systems · Mathematics 2025-05-27 Hans Harder , Feliks Nüske , Friedrich M. Philipp , Manuel Schaller , Karl Worthmann , Sebastian Peitz

Among inferential problems in functional data analysis, domain selection is one of the practical interests aiming to identify sub-interval(s) of the domain where desired functional features are displayed. Motivated by applications in…

Methodology · Statistics 2026-03-26 Yeonjoo Park , Aiguo Han

Genome variants which re-occur independently across evolutionary lineages are key molecular signatures of adaptation. Inferring the dynamics of such genetic changes from pandemic-scale genomic datasets is now possible, which opens up…

The analysis of high-dimensional data, common in fields such as genomics, is complicated by the presence of cellwise contamination, where individual cells rather than entire rows are corrupted. This contamination poses a significant…

Methodology · Statistics 2026-03-31 Anthony Christidis , Jeyshinee Pyneeandee , Gabriela Cohen-Freue

Epigenetics plays a crucial role in understanding the underlying molecular processes of several types of cancer as well as the determination of innovative therapeutic tools. To investigate the complex interplay between genetics and…

Methodology · Statistics 2024-08-29 Iris Ivy Gauran , Patrick Wincy Reyes , Erniel Barrios , Hernando Ombao

One main obstacle for the wide use of deep learning in medical and engineering sciences is its interpretability. While neural network models are strong tools for making predictions, they often provide little information about which features…

Machine Learning · Statistics 2021-12-06 Vu Dinh , Lam Si Tung Ho