English
Related papers

Related papers: Optimal Test-Data Piling in HDLSS Classification w…

200 papers

We consider high-dimensional measurement errors with high-frequency data. Our objective is on recovering the high-dimensional cross-sectional covariance matrix of the random errors with optimality. In this problem, not all components of the…

Statistics Theory · Mathematics 2024-04-03 Jinyuan Chang , Qiao Hu , Cheng Liu , Cheng Yong Tang

In high-dimension, low-sample size (HDLSS) data, it is not always true that closeness of two objects reflects a hidden cluster structure. We point out the important fact that it is not the closeness, but the "values" of distance that…

Machine Learning · Statistics 2013-12-30 Yoshikazu Terada

Data driven classification that relies on neural networks is based on optimization criteria that involve some form of distance between the output of the network and the desired label. Using the same mathematical analysis, for a multitude of…

Machine Learning · Computer Science 2019-06-25 Kalliopi Basioti , George V. Moustakides

High dimensional classification has been highlighted for last two decades and much research has been conducted in order to circumvent challenges encountered in high dimensions. While existing methods have focused mainly on developing…

Methodology · Statistics 2022-11-16 Seungchul Baek

This paper aims to develop an optimality theory for linear discriminant analysis in the high-dimensional setting. A data-driven and tuning free classification rule, which is based on an adaptive constrained $\ell_1$ minimization approach,…

Methodology · Statistics 2018-04-10 T. Tony Cai , Linjun Zhang

We study a hypothesis testing problem in which data is compressed distributively and sent to a detector that seeks to decide between two possible distributions for the data. The aim is to characterize all achievable encoding rates and…

Information Theory · Computer Science 2011-02-01 Md. Saifur Rahman , Aaron B. Wagner

In this work, we develop a pipeline that associates Persistence Diagrams to digital data via the most appropriate filtration for the type of data considered. Using a grid search approach, this pipeline determines optimal representation…

Computer Vision and Pattern Recognition · Computer Science 2023-09-28 Francesco Conti , Davide Moroni , Maria Antonietta Pascali

Horizontal federated learning (HFL) enables distributed clients to train a shared model and keep their data privacy. In training high-quality HFL models, the data heterogeneity among clients is one of the major concerns. However, due to the…

Human-Computer Interaction · Computer Science 2022-08-17 Xumeng Wang , Wei Chen , Jiazhi Xia , Zhen Wen , Rongchen Zhu , Tobias Schreck

Recently, high-dimensional heterogeneous data have attracted a lot of attention and discussion. Under heterogeneity, semiparametric regression is a popular choice to model data in statistics. In this paper, we take advantages of expectile…

Statistics Theory · Mathematics 2019-08-20 Jun Zhao , Guan'ao Yan , Yi Zhang

In high-dimensional classification problems, a commonly used approach is to first project the high-dimensional features into a lower dimensional space, and base the classification on the resulting lower dimensional projections. In this…

Statistics Theory · Mathematics 2025-08-05 Xin Bing , Marten Wegkamp

This paper explores the homogeneity of coefficients in high-dimensional regression, which extends the sparsity concept and is more general and suitable for many applications. Homogeneity arises when one expects regression coefficients…

Methodology · Statistics 2013-04-01 Tracy Ke , Jianqing Fan , Yichao Wu

We consider the problem of estimating how well a model class is capable of fitting a distribution of labeled data. We show that it is often possible to accurately estimate this "learnability" even when given an amount of data that is too…

Machine Learning · Computer Science 2019-03-26 Weihao Kong , Gregory Valiant

Random feature ridge regression is often analyzed in the high-dimensional regime under the homogeneous sampling model $x_i=\Sigma^{1/2}x_i'$, where the vectors $x_i'$ have iid entries and the same covariance matrix $\Sigma$ is shared by all…

Machine Learning · Statistics 2026-05-19 Issa-Mbenard Dabo , Jérémie Bigot

Detecting the components common or correlated across multiple data sets is challenging due to a large number of possible correlation structures among the components. Even more challenging is to determine the precise structure of these…

Information Theory · Computer Science 2019-02-01 Tanuj Hasija , Christian Lameiro , Timothy Marrinan , Peter J. Schreier

It has been a long time, since data mining technologies have made their ways to the field of data management. Classification is one of the most important data mining tasks for label prediction, categorization of objects into groups,…

Databases · Computer Science 2015-11-12 Mohammad Khabbaz

Data is of high quality if it is fit for its intended use. The quality of data is influenced by the underlying data model and its quality. One major quality problem is the heterogeneity of data as quality aspects such as understandability…

Machine Learning · Computer Science 2021-11-15 Viola Wenz , Arno Kesper , Gabriele Taentzer

The dramatic growth of big datasets presents a new challenge to data storage and analysis. Data reduction, or subsampling, that extracts useful information from datasets is a crucial step in big data analysis. We propose an orthogonal…

Methodology · Statistics 2021-06-01 Lin Wang , Jake Elmstedt , Weng Kee Wong , Hongquan Xu

In binary classification, imbalance refers to situations in which one class is heavily under-represented. This issue is due to either a data collection process or because one class is indeed rare in a population. Imbalanced classification…

Methodology · Statistics 2022-01-07 Arezou Mojiri , Abbas Khalili , Ali Zeinal Hamadani

In this article the authors develop an intrinsic measure for quantifying heterogeneity in training data for supervised learning. This measure is the variance of a random variable which factors through the influences of pairs of training…

Machine Learning · Computer Science 2026-03-10 Fenix W. Huang , Henning S. Mortveit , Christian M. Reidys

Federated Learning (FL) enables decentralized training of machine learning models on distributed data while preserving privacy. However, in real-world FL settings, client data is often non-identically distributed and imbalanced, resulting…

Machine Learning · Computer Science 2025-09-18 Gergely D. Németh , Eros Fanì , Yeat Jeng Ng , Barbara Caputo , Miguel Ángel Lozano , Nuria Oliver , Novi Quadrianto