English
Related papers

Related papers: Optimal Test-Data Piling in HDLSS Classification w…

200 papers

Covariance and Hessian matrices have been analyzed separately in the literature for classification problems. However, integrating these matrices has the potential to enhance their combined power in improving classification performance. We…

Machine Learning · Computer Science 2024-10-10 Agus Hartoyo , Jan Argasiński , Aleksandra Trenk , Kinga Przybylska , Anna Błasiak , Alessandro Crimi

We study the classification problem for high-dimensional data with $n$ observations on $p$ features where the $p \times p$ covariance matrix $\Sigma$ exhibits a spiked eigenvalue structure and the vector $\zeta$, given by the difference…

Machine Learning · Statistics 2026-02-12 Yin-Jen Chen , Minh Tang

In many modern data sets, High dimension low sample size (HDLSS) data is prevalent in many fields of studies. There has been an increased focus recently on using machine learning and statistical methods to mine valuable information out of…

Optimization and Control · Mathematics 2023-05-23 Srivathsan Amruth , Xin Yee Lam

We consider the high-dimensional discriminant analysis problem. For this problem, different methods have been proposed and justified by establishing exact convergence rates for the classification risk, as well as the l2 convergence results…

Machine Learning · Statistics 2013-06-28 Mladen Kolar , Han Liu

The Classification on high-dimension low-sample-size data (HDLSS) is a challenging problem and it is common to have class-imbalanced data in most application fields. We term this as Imbalanced HDLSS (IHDLSS). Recent theoretical results…

Machine Learning · Computer Science 2022-06-09 Liran Shen , Meng Joo Er , Qingbo Yin

We consider the problem of solving a large-scale system of linear equations in a distributed or federated manner by a taskmaster and a set of machines, each possessing a subset of the equations. We provide a comprehensive comparison of two…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-06-24 Boris Velasevic , Rohit Parasnis , Christopher G. Brinton , Navid Azizan

We consider detection and localization of an abrupt break in the covariance structure of high-dimensional random data. The paper proposes a novel testing procedure for this problem. Due to its nature, the approach requires a properly chosen…

Statistics Theory · Mathematics 2019-07-16 Valeriy Avanesov

Huge amount of applications in various fields, such as gene expression analysis or computer vision, undergo data sets with high-dimensional low-sample-size (HDLSS), which has putted forward great challenges for standard statistical and…

Machine Learning · Computer Science 2022-06-07 Liran Shen , Meng Joo Er , Qingbo Yin

Set classification aims to classify a set of observations as a whole, as opposed to classifying individual observations separately. To formally understand the unfamiliar concept of binary set classification, we first investigate the optimal…

Machine Learning · Statistics 2020-06-29 Zhao Ren , Sungkyu Jung , Xingye Qiao

In recent years many sparse linear discriminant analysis methods have been proposed for high-dimensional classification and variable selection. However, most of these proposals focus on binary classification and they are not directly…

Methodology · Statistics 2015-04-23 Qing Mai , Yi Yang , Hui Zou

Motivation: The high dimensionality of genomic data calls for the development of specific classification methodologies, especially to prevent over-optimistic predictions. This challenge can be tackled by compression and variable selection,…

Methodology · Statistics 2021-04-10 G. Durif , L. Modolo , J. Michaelsson , J. E. Mold , S. Lambert-Lacroix , F. Picard

The paper considers variable selection in linear regression models where the number of covariates is possibly much larger than the number of observations. High dimensionality of the data brings in many complications, such as (possibly…

Methodology · Statistics 2016-11-29 Haeran Cho , Piotr Fryzlewicz

Clinical research often focuses on complex traits in which many variables play a role in mechanisms driving, or curing, diseases. Clinical prediction is hard when data is high-dimensional, but additional information, like domain knowledge…

Methodology · Statistics 2020-05-21 Mirrelijn M. van Nee , Lodewyk F. A. Wessels , Mark A. van de Wiel

We study the problem of storing a data object in a set of data nodes that fail independently with given probabilities. Our problem is a natural generalization of a homogenous storage allocation problem where all the nodes had the same…

Information Theory · Computer Science 2012-02-09 Vasileios Ntranos , Giuseppe Caire , Alexandros G. Dimakis

For high-dimensional classification, it is well known that naively performing the Fisher discriminant rule leads to poor results due to diverging spectra and noise accumulation. Therefore, researchers proposed independence rules to…

Machine Learning · Statistics 2011-11-10 Jianqing Fan , Yang Feng , Xin Tong

High-quality pre-training data is crutial for large language models, where quality captures factual reliability and semantic value, and diversity ensures broad coverage and distributional heterogeneity. Existing approaches typically rely on…

Computation and Language · Computer Science 2025-10-23 Hongyi He , Xiao Liu , Zhenghao Lin , Mingni Tang , Yi Cheng , Jintao Wang , Wenjie Li , Peng Cheng , Yeyun Gong

Identifying informative predictors in a high dimensional regression model is a critical step for association analysis and predictive modeling. Signal detection in the high dimensional setting often fails due to the limited sample size. One…

Methodology · Statistics 2020-04-08 Molei Liu , Yin Xia , Kelly Cho , Tianxi Cai

Classification of high-dimensional low sample size (HDLSS) data poses a challenge in a variety of real-world situations, such as gene expression studies, cancer research, and medical imaging. This article presents the development and…

Machine Learning · Statistics 2026-05-27 Jyotishka Ray Choudhury , Aytijhya Saha , Sarbojit Roy , Subhajit Dutta

Matrix valued data has become increasingly prevalent in many applications. Most of the existing clustering methods for this type of data are tailored to the mean model and do not account for the dependence structure of the features, which…

Machine Learning · Statistics 2023-12-07 Inbeom Lee , Siyi Deng , Yang Ning

Over the last two decades, many exciting variable selection methods have been developed for finding a small group of covariates that are associated with the response from a large pool. Can the discoveries from these data mining approaches…

Statistics Theory · Mathematics 2017-07-24 Jianqing Fan , Qi-Man Shao , Wen-Xin Zhou
‹ Prev 1 2 3 10 Next ›