English
Related papers

Related papers: Identifying bias in cluster quality metrics

200 papers

Detecting and analyzing dense groups or communities from social and information networks has attracted immense attention over last one decade due to its enormous applicability in different domains. Community detection is an ill-defined…

Social and Information Networks · Computer Science 2016-04-13 Tanmoy Chakraborty , Ayushi Dalmia , Animesh Mukherjee , Niloy Ganguly

Weak gravitational lensing has been used extensively in the past decade to constrain the masses of galaxy clusters, and is the most promising observational technique for providing the mass calibration necessary for precision cosmology with…

Cosmology and Nongalactic Astrophysics · Physics 2015-05-14 Rachel Mandelbaum , Uros Seljak , Tobias Baldauf , Robert E. Smith

Growth mixture models are an important tool for detecting group structure in repeated measures data. Unlike traditional clustering methods, they explicitly model the repeat measurements on observations, and the statistical framework they…

Methodology · Statistics 2017-10-20 Abby Flynt , Nema Dean

This paper deals with nonparametric estimation of conditional den-sities in mixture models in the case when additional covariates are available. The proposed approach consists of performing a prelim-inary clustering algorithm on the…

Statistics Theory · Mathematics 2015-02-09 Stéphane Auray , Nicolas Klutchnikoff , Laurent Rouvière

Clustering is a popular form of unsupervised learning for geometric data. Unfortunately, many clustering algorithms lead to cluster assignments that are hard to explain, partially because they depend on all the features of the data in a…

Machine Learning · Computer Science 2020-09-23 Sanjoy Dasgupta , Nave Frost , Michal Moshkovitz , Cyrus Rashtchian

The caustic technique for measuring mass profiles of galaxy clusters relies on the assumption of spherical symmetry. When applied to aspherical galaxy clusters, the method yields mass estimates affected by the cluster orientation. Here we…

Cosmology and Nongalactic Astrophysics · Physics 2015-06-19 Jacob Svensmark , Radoslaw Wojtak , Steen H. Hansen

The new particle accelerators and its experiments create a challenging data processing environment, characterized by large amount of data where only small portion of it carry the expected new scientific information. Modern detectors, such…

Data Analysis, Statistics and Probability · Physics 2016-11-17 Erez Etzion , David Primor , Giora Mikenberg , Nir Amram , Hagit Messer

We estimate the bias on weak lensing mass measurements of shear-selected galaxy cluster samples. The mass bias is expected to be significant because constructions of cluster samples from peaks in weak lensing mass maps and measurements of…

Astrophysics of Galaxies · Physics 2020-03-25 Kai-Feng Chen , Masamune Oguri , Yen-Ting Lin , Satoshi Miyazaki

Algorithms for community detection are usually stochastic, leading to different partitions for different choices of random seeds. Consensus clustering has proven to be an effective technique to derive more stable and accurate partitions…

Physics and Society · Physics 2019-04-23 Aditya Tandon , Aiiad Albeshri , Vijey Thayananthan , Wadee Alhalabi , Santo Fortunato

So-called "classification trimmed likelihood curves" have been proposed as a useful heuristic tool to determine the number of clusters and trimming proportion in trimming-based robust clustering methods. However, these curves needs a…

We present a first procedure that can estimate -- with statistical consistency guarantees -- any local-maxima of a density, under benign distributional conditions. The procedure estimates all such local maxima, or $\textit{modal-sets}$, of…

Machine Learning · Statistics 2017-05-30 Heinrich Jiang , Samory Kpotufe

Notions of community quality underlie network clustering. While studies surrounding network clustering are increasingly common, a precise understanding of the realtionship between different cluster quality metrics is unknown. In this paper,…

Social and Information Networks · Computer Science 2016-08-04 Scott Emmons , Stephen Kobourov , Mike Gallant , Katy Börner

Modularity is a popular measure of community structure. However, maximizing the modularity can lead to many competing partitions, with almost the same modularity, that are poorly correlated with each other. It can also produce illusory…

Physics and Society · Physics 2014-12-30 Pan Zhang , Cristopher Moore

Inferring cluster structure in microarray datasets is a fundamental task for the -omic sciences. A fundamental question in Statistics, Data Analysis and Classification, is the prediction of the number of clusters in a dataset, usually…

Data Structures and Algorithms · Computer Science 2011-02-16 Filippo Utro

Peer-grouping is used in many sectors for organisational learning, policy implementation, and benchmarking. Clustering provides a statistical, data-driven method for constructing meaningful peer groups, but peer groups must be compatible…

Applications · Statistics 2021-07-14 Daniel William Kennedy , Jessica Cameron , Paul Pao-Yen Wu , Kerrie Mengersen

Estimating influential nodes in large scale networks including but not limited to social networks, biological networks, communication networks, emerging smart grids etc. is a topic of fundamental interest. To understand influences of nodes…

Social and Information Networks · Computer Science 2014-06-13 Sima Das

Performance of clustering algorithms is evaluated with the help of accuracy metrics. There is a great diversity of clustering algorithms, which are key components of many data analysis and exploration systems. However, there exist only few…

Data Structures and Algorithms · Computer Science 2019-02-18 Artem Lutov , Mourad Khayati , Philippe Cudré-Mauroux

Several methods have been proposed to estimate the number of clusters in a dataset; the basic ideal behind all of them has been to study an index that measures inter-cluster separation and intra-cluster cohesion over a range of cluster…

Computer Vision and Pattern Recognition · Computer Science 2016-01-12 Bhaskar Mukhoty , Ruchir Gupta , Y. N. Singh

We investigate properties that intuitively ought to be satisfied by graph clustering quality functions, that is, functions that assign a score to a clustering of a graph. Graph clustering, also known as network community detection, is often…

Computer Vision and Pattern Recognition · Computer Science 2014-07-23 Twan van Laarhoven , Elena Marchiori

Many membrane-bound molecules in cells form small clusters. It has been hypothesized that these clusters convert an analog extracellular signal into a digital intracellular signal and that this conversion increases signaling fidelity.…

Molecular Networks · Quantitative Biology 2019-08-28 Edward Roob , Nicola Trendel , Pieter Rein ten Wolde , Andrew Mugler