English
Related papers

Related papers: Extreme-K categorical samples problem

200 papers

We consider the utilization of a computational model to guide the optimal acquisition of experimental data to inform the stochastic description of model input parameters. Our formulation is based on the recently developed consistent…

Computation · Statistics 2021-05-04 Scott N. Walsh , Tim M. Wildey , John D. Jakeman

In several Machine Learning (ML) clustering and dimensionality reduction approaches, such as non-negative matrix factorization (NMF), RESCAL, and K-Means clustering, users must select a hyper-parameter k to define the number of clusters or…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-07-30 Ryan Barron , Maksim E. Eren , Manish Bhattarai , Ismael Boureima , Cynthia Matuszek , Boian S. Alexandrov

We study the problem of {\em list-decodable mean estimation} for bounded covariance distributions. Specifically, we are given a set $T$ of points in $\mathbb{R}^d$ with the promise that an unknown $\alpha$-fraction of points in $T$, where…

Machine Learning · Computer Science 2020-06-23 Ilias Diakonikolas , Daniel M. Kane , Daniel Kongsgaard

Although linear and quadratic discriminant analysis are widely recognized classical methods, they can encounter significant challenges when dealing with non-Gaussian distributions or contaminated datasets. This is primarily due to their…

Machine Learning · Statistics 2023-11-14 Pierre Houdouin , Matthieu Jonckheere , Frederic Pascal

Purpose: The primary goal of this study is to explore the application of evaluation metrics to different clustering algorithms using the data provided from the Canadian Longitudinal Study (CLSA), focusing on cognitive features. The…

Machine Learning · Computer Science 2025-05-19 ChenNingZhi Sheng

Density Estimation Trees (DETs) are decision trees trained on a multivariate dataset to estimate its probability density function. While not competitive with kernel techniques in terms of accuracy, they are incredibly fast, embarrassingly…

Applications · Statistics 2016-12-21 Lucio Anderlini

In this paper, we study the strong consistency of the sparse K-means clustering for high dimensional data. We prove the consistency in both risk and clustering for the Euclidean distance. We discuss the characterization of the limit of the…

Statistics Theory · Mathematics 2025-04-15 Jeungju Kim , Johan Lim

Hierarchical clustering is a powerful tool for exploratory data analysis, organizing data into a tree of clusterings from which a partition can be chosen. This paper generalizes these ideas by proving that, for any reasonable hierarchy, one…

Machine Learning · Computer Science 2025-11-13 Andrew Draganov , Pascal Weber , Rasmus Skibdahl Melanchton Jørgensen , Anna Beer , Claudia Plant , Ira Assent

This paper aims to address the challenge of data generation beyond the training data and proposes a framework for Structural Extrapolated Data GEneration (SEDGE) based on suitable assumptions on the underlying data-generating process. We…

Machine Learning · Computer Science 2026-05-15 Kun Zhang , Jiaqi Sun , Yiqing Li , Ignavier Ng , Namrata Deka , Shaoan Xie

Nearest neighbor (k-NN) graphs are widely used in machine learning and data mining applications, and our aim is to better understand what they reveal about the cluster structure of the unknown underlying distribution of points. Moreover, is…

Machine Learning · Statistics 2011-05-06 Samory Kpotufe , Ulrike von Luxburg

In response to the need for learning tools tuned to big data analytics, the present paper introduces a framework for efficient clustering of huge sets of (possibly high-dimensional) data. Building on random sampling and consensus (RANSAC)…

Machine Learning · Statistics 2016-11-17 Panagiotis A. Traganitis , Konstantinos Slavakis , Georgios B. Giannakis

Exploratory data analysis (EDA) is a vital procedure for data science projects. In this work, we introduce a stable equilibrium point (SEP) - based framework for improving the efficiency and solution quality of EDA. By exploiting the SEPs…

Machine Learning · Computer Science 2023-06-08 Yuxuan Song , Yongyu Wang

In this paper, we introduce a variation of the group testing problem where each test is specified by an ordered subset of items and returns the first defective item in the specified order or returns null if there are no defectives. We refer…

Information Theory · Computer Science 2024-09-30 Waqar Mirza , Nikhil Karamchandani , Niranjan Balachandran

Categorical variables are of uttermost importance in biomedical research. When two of them are considered, it is often the case that one wants to test whether or not they are statistically dependent. We show weaknesses of classical methods…

Model explainability is crucial for human users to be able to interpret how a proposed classifier assigns labels to data based on its feature values. We study generalized linear models constructed using sets of feature value rules, which…

Machine Learning · Statistics 2023-11-06 Sanjeeb Dash , Soumyadip Ghosh , Joao Goncalves , Mark S. Squillante

Tensor classification has become increasingly crucial in statistics and machine learning, with applications spanning neuroimaging, computer vision, and recommendation systems. However, the high dimensionality of tensors presents significant…

Methodology · Statistics 2024-09-24 Elynn Chen , Yuefeng Han , Jiayu Li

This paper studies clustering of data sequences using the k-medoids algorithm. All the data sequences are assumed to be generated from \emph{unknown} continuous distributions, which form clusters with each cluster containing a composite set…

Machine Learning · Computer Science 2019-03-27 Tiexing Wang , Qunwei Li , Donald J. Bucci , Yingbin Liang , Biao Chen , Pramod K. Varshney

Models like support vector machines or Gaussian process regression often require positive semi-definite kernels. These kernels may be based on distance functions. While definiteness is proven for common distances and kernels, a proof for a…

Machine Learning · Computer Science 2018-07-11 Martin Zaefferer , Thomas Bartz-Beielstein , Günter Rudolph

Inferring evolutionary histories (phylogenetic trees) has important applications in biology, criminology and public health. However, phylogenetic trees are complex mathematical objects that reside in a non-Euclidean space, which complicates…

Methodology · Statistics 2017-10-16 Amy Willis

EODECA (Engineered Ordinary Differential Equations as Classification Algorithm) is a novel approach at the intersection of machine learning and dynamical systems theory, presenting a unique framework for classification tasks [1]. This…

Machine Learning · Computer Science 2024-05-21 Raffaele Marino , Lorenzo Buffoni , Lorenzo Chicchi , Lorenzo Giambagli , Duccio Fanelli