English
Related papers

Related papers: The generalized underlap coefficient with an appli…

200 papers

We study the classic $k$-means/median clustering, which are fundamental problems in unsupervised learning, in the setting where data are partitioned across multiple sites, and where we are allowed to discard a small portion of the data by…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-10-12 Jiecao Chen , Erfan Sadeqi Azer , Qin Zhang

The Kendall plot ($\K$-plot) is a plot measuring dependence between the components of a bivariate random variable. The $\K$-plot graphs the Kendall distribution function against the distribution function of $VU$, where $V$ and $U$ are…

Statistics Theory · Mathematics 2018-11-22 Albert Vexler , Georgios Afendras , Marianthi Markatou

One important tool is the optimal clustering of data into useful categories. Dividing similar objects into a smaller number of clusters is of importance in many applications. These include search engines, monitoring of academic performance,…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-09-21 Gavriel Yarmish , Philip Listowsky , Simon Dexter

When units in observational studies are clustered in groups, such as students in schools or patients in hospitals, researchers often address confounding by adjusting for cluster-level covariates or cluster membership. In this paper, we…

Methodology · Statistics 2026-02-06 Eli Ben-Michael , Avi Feller , Luke Keele

There has been a wide interest to extend univariate and multivariate nonparametric procedures to clustered and hierarchical data. Traditionally, parametric mixed models have been used to account for the correlation structures among the…

Statistics Theory · Mathematics 2018-03-02 Jaakko Nevalainen , Denis Larocque , Hannu Oja , Ilkka Pörsti

Multivariate hypergeometric distribution arises frequently in elementary statistics and probability courses, for simultaneously studying the occurence law of specified events, when sampling without replacement from a finite population with…

Statistics Theory · Mathematics 2021-01-05 X. G. Duan

In the context of unsupervised learning, effective clustering plays a vital role in revealing patterns and insights from unlabeled data. However, the success of clustering algorithms often depends on the relevance and contribution of…

Machine Learning · Computer Science 2025-03-18 Fabian Galis , Darian Onchis

Datasets may contain observations with multiple labels. If the labels are not mutually exclusive, and if the labels vary greatly in frequency, obtaining a sample that includes sufficient observations with scarcer labels to make inferences…

Machine Learning · Computer Science 2026-05-27 Simon Chung , Colby J. Vorland , Donna L. Maney , Andrew W. Brown

A popular measure of association is the tail dependence coefficient which measures the strength of dependence in either the lower-left or upper-right tail of a bivariate distribution. In this paper, we develop the idea of quantile…

Statistics Theory · Mathematics 2024-02-09 A. Dastbaravarde , A. Dolati

We propose a method for estimating coefficients in multivariate regression when there is a clustering structure to the response variables. The proposed method includes a fusion penalty, to shrink the difference in fitted values from…

Machine Learning · Statistics 2018-03-28 Bradley S. Price , Ben Sherwood

This article is devoted to the study of overlap measures of densities of two exponential populations. Various Overlapping Coefficients, namely: Matusita's measure $\rho$, Morisita's measure $\lambda$ and Weitzman's measure $\Delta$. A new…

Methodology · Statistics 2017-04-11 Hamza Dhaker , Papa Ngom , Malick Mbodj

A cluster tree provides a highly-interpretable summary of a density function by representing the hierarchy of its high-density clusters. It is estimated using the empirical tree, which is the cluster tree constructed from a density…

Statistics Theory · Mathematics 2017-02-14 Jisu Kim , Yen-Chi Chen , Sivaraman Balakrishnan , Alessandro Rinaldo , Larry Wasserman

Until recently obtaining data on populations of networks was typically rare. However, with the advancement of automatic monitoring devices and the growing social and scientific interest in networks, such data has become more widely…

Methodology · Statistics 2020-01-22 Mirko Signorelli , Ernst Wit

Classification and clustering are both important topics in statistical learning. A natural question herein is whether predefined classes are really different from one another, or whether clusters are really there. Specifically, we may be…

Machine Learning · Statistics 2015-09-22 Qiyi Lu , Xingye Qiao

Clustering is a common technique for statistical data analysis, Clustering is the process of grouping the data into classes or clusters so that objects within a cluster have high similarity in comparison to one another, but are very…

Machine Learning · Computer Science 2012-03-12 T Soni Madhulatha

In this paper we explore different regression models based on Clusterwise Linear Regression (CLR). CLR aims to find the partition of the data into $k$ clusters, such that linear regressions fitted to each of the clusters minimize overall…

Machine Learning · Computer Science 2018-05-01 Igor Gitman , Jieshi Chen , Eric Lei , Artur Dubrawski

Whether class labels in a given data set correspond to meaningful clusters is crucial for the evaluation of clustering algorithms using real-world data sets. This property can be quantified by separability measures. The central aspects of…

Machine Learning · Statistics 2025-04-11 Jana Gauss , Fabian Scheipl , Moritz Herrmann

Clustering is a widely used technique with a long and rich history in a variety of areas. However, most existing algorithms do not scale well to large datasets, or are missing theoretical guarantees of convergence. This paper introduces a…

Machine Learning · Statistics 2024-10-16 Yijia Zhou , Kyle A. Gallivan , Adrian Barbu

Genetic data are frequently categorical and have complex dependence structures that are not always well understood. For this reason, clustering and classification based on genetic data, while highly relevant, are challenging statistical…

Methodology · Statistics 2016-06-13 Gabriela Bettella Cybis , Marcio Valk , Silvia Regina Costa Lopes

Population annealing is a powerful sequential Monte Carlo algorithm designed to study the equilibrium behavior of general systems in statistical physics through massive parallelism. In addition to the remarkable scaling capabilities of the…

Statistical Mechanics · Physics 2022-10-19 Paul L. Ebert , Denis Gessert , Martin Weigel