English
Related papers

Related papers: Strong Sure Screening of Ultra-high Dimensional Ca…

200 papers

It is of importance to develop statistical techniques to analyze high-dimensional data in the presence of both complex dependence and possible outliers in real-world applications such as imaging data analyses. We propose a new robust…

Methodology · Statistics 2021-10-01 Bingyuan Liu , Qi Zhang , Lingzhou Xue , Peter X. K. Song , Jian Kang

Current statistical inference problems in areas like astronomy, genomics, and marketing routinely involve the simultaneous testing of thousands -- even millions -- of null hypotheses. For high-dimensional multivariate distributions, these…

Methodology · Statistics 2017-04-25 Weixin Cai , Nima S. Hejazi , Alan E. Hubbard

Clinical research often focuses on complex traits in which many variables play a role in mechanisms driving, or curing, diseases. Clinical prediction is hard when data is high-dimensional, but additional information, like domain knowledge…

Methodology · Statistics 2020-05-21 Mirrelijn M. van Nee , Lodewyk F. A. Wessels , Mark A. van de Wiel

In this paper we introduce a novel approach for an important problem of break detection. Specifically, we are interested in detection of an abrupt change in the covariance structure of a high-dimensional random process -- a problem, which…

Statistics Theory · Mathematics 2020-07-30 Valeriy Avanesov , Nazar Buzun

High-dimensional clustering analysis is a challenging problem in statistics and machine learning, with broad applications such as the analysis of microarray data and RNA-seq data. In this paper, we propose a new clustering procedure called…

Methodology · Statistics 2022-10-31 Tianqi Liu , Yu Lu , Biqing Zhu , Hongyu Zhao

Feature selection and instance selection are two important techniques of data processing. However, such selections have mostly been studied separately, while existing work towards the joint selection conducts feature/instance selection…

Machine Learning · Computer Science 2022-05-18 Wei Fan , Kunpeng Liu , Hao Liu , Hengshu Zhu , Hui Xiong , Yanjie Fu

The identification of strong gravitational lenses in large surveys has historically been a rather time consuming exercise. Early data from the Herschel Astrophysical Terahertz Large Area Survey (Herschel-ATLAS) demonstrate that lenses can…

Cosmology and Nongalactic Astrophysics · Physics 2012-06-22 Jo Short , Elizabeth Pearson , Peter Coles , Steve Eales

Variable selection in ultrahigh-dimensional linear regression is challenging due to its high computational cost. Therefore, a screening step is usually conducted before variable selection to significantly reduce the dimension. Here we…

Methodology · Statistics 2025-04-29 Run Wang , An Nguyen , Somak Dutta , Vivekananda Roy

We consider detection and localization of an abrupt break in the covariance structure of high-dimensional random data. The paper proposes a novel testing procedure for this problem. Due to its nature, the approach requires a properly chosen…

Statistics Theory · Mathematics 2019-07-16 Valeriy Avanesov

Predicting user responses, such as click-through rate and conversion rate, are critical in many web applications including web search, personalised recommendation, and online advertising. Different from continuous raw features that we…

Machine Learning · Computer Science 2016-01-12 Weinan Zhang , Tianming Du , Jun Wang

In this paper, we investigate score function-based tests to check the significance of an ultrahigh-dimensional sub-vector of the model coefficients when the nuisance parameter vector is also ultrahigh-dimensional in linear models. We first…

Methodology · Statistics 2024-11-12 Weichao Yang , Xu Guo , Lixing Zhu

The vulnerability in the algorithm supply chain of deep learning has imposed new challenges to image retrieval systems in the downstream. Among a variety of techniques, deep hashing is gaining popularity. As it inherits the algorithmic…

Computer Vision and Pattern Recognition · Computer Science 2023-04-11 Yanru Xiao , Cong Wang , Xing Gao

Feature extraction and selection in the presence of nonlinear dependencies among the data is a fundamental challenge in unsupervised learning. We propose using a Gram-Schmidt (GS) type orthogonalization process over function spaces to…

Machine Learning · Computer Science 2025-07-16 Bahram Yaghooti , Netanel Raviv , Bruno Sinopoli

During the last years, deep learning trackers achieved stimulating results while bringing interesting ideas to solve the tracking problem. This progress is mainly due to the use of learned deep features obtained by training deep…

Computer Vision and Pattern Recognition · Computer Science 2020-12-24 Ahmed Zgaren , Wassim Bouachir , Riadh Ksantini

Foundation models have recently gained attention within the field of machine learning thanks to its efficiency in broad data processing. While researchers had attempted to extend this success to time series models, the main challenge is…

Machine Learning · Computer Science 2023-11-22 Trang H. Tran , Lam M. Nguyen , Kyongmin Yeo , Nam Nguyen , Roman Vaculin

Among inferential problems in functional data analysis, domain selection is one of the practical interests aiming to identify sub-interval(s) of the domain where desired functional features are displayed. Motivated by applications in…

Methodology · Statistics 2026-03-26 Yeonjoo Park , Aiguo Han

Classification is one of the core problems in Computer-Aided Diagnosis (CAD), targeting for early cancer detection using 3D medical imaging interpretation. High detection sensitivity with desirably low false positive (FP) rate is critical…

Computer Vision and Pattern Recognition · Computer Science 2014-05-20 Meizhu Liu , Le Lu , Xiaojing Ye , Shipeng Yu

In this era of big data, feature selection techniques, which have long been proven to simplify the model, makes the model more comprehensible, speed up the process of learning, have become more and more important. Among many developed…

Machine Learning · Statistics 2019-11-20 Thu Nguyen

This paper introduces a novel approach to active feature acquisition for classification, which is the task of sequentially selecting the most informative subset of features to achieve optimal prediction performance during testing while…

Machine Learning · Computer Science 2023-06-27 Ali Mirzaei , Vahid Pourahmadi , Hamid Sheikhzadeh , Alireza Abdollahpourrostam

Feature selection is frequently used as a pre-processing step to machine learning. It is a process of choosing a subset of original features so that the feature space is optimally reduced according to a certain evaluation criterion. The…

Computer Vision and Pattern Recognition · Computer Science 2014-01-07 Vijendra Singh , Shivani Pathak