English
Related papers

Related papers: Accuracy Evaluation of Overlapping and Multi-resol…

200 papers

We construct a method by which we can calculate the precision with which an algorithm identifies the shape of a cluster. We present our results for several well known clustering algorithms and suggest ways to improve performance for newer…

Computational Geometry · Computer Science 2017-07-27 Clark Alexander , Sofya Akhmametyeva

Cluster analysis is widely used in the areas of machine learning and data mining. Fuzzy clustering is a particular method that considers that a data point can belong to more than one cluster. Fuzzy clustering helps obtain flexible clusters,…

Machine Learning · Computer Science 2018-06-06 Aybükë Oztürk , Stéphane Lallich , Jérôme Darmont

This paper proposes the use of "multicalibration" to yield interpretable and reliable confidence scores for outputs generated by large language models (LLMs). Multicalibration asks for calibration not just marginally, but simultaneously…

Machine Learning · Statistics 2024-04-09 Gianluca Detommaso , Martin Bertran , Riccardo Fogliato , Aaron Roth

The advent of large pre-trained models has brought about a paradigm shift in both visual representation learning and natural language processing. However, clustering unlabeled images, as a fundamental and classic machine learning problem,…

Computer Vision and Pattern Recognition · Computer Science 2024-04-29 Tianzhe Chu , Shengbang Tong , Tianjiao Ding , Xili Dai , Benjamin David Haeffele , René Vidal , Yi Ma

Matrices are two-dimensional data structures allowing one to conceptually organize information. For example, adjacency matrices are useful to store the links of a network; correlation matrices are simple ways to arrange gene co-expression…

Disordered Systems and Neural Networks · Physics 2022-09-29 Flaviano Morone

Deep image clustering methods are typically evaluated on small-scale balanced classification datasets while feature-based $k$-means has been applied on proprietary billion-scale datasets. In this work, we explore the performance of…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Nikolas Adaloglou , Felix Michels , Kaspar Senft , Diana Petrusheva , Markus Kollmann

A recent trend in data mining has explored (hyper)graph clustering algorithms for data with categorical relationship types. Such algorithms have applications in the analysis of social, co-authorship, and protein interaction networks, to…

Data Structures and Algorithms · Computer Science 2024-01-09 Alex Crane , Brian Lavallee , Blair D. Sullivan , Nate Veldt

Spectral clustering is one of the most widely used techniques for extracting the underlying global structure of a data set. Compressed sensing and matrix completion have emerged as prevailing methods for efficiently recovering sparse and…

Numerical Analysis · Mathematics 2010-11-05 Blake Hunter , Thomas Strohmer

In the big data era, the key feature that each algorithm needs to have is the possibility of efficiently running in parallel in a distributed environment. The popular Silhouette metric to evaluate the quality of a clustering, unfortunately,…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-03-27 Marco Gaido

Clustering multi-dimensional points is a fundamental task in many fields, and density-based clustering supports many applications as it can discover clusters of arbitrary shapes. This paper addresses the problem of Density-Peaks Clustering…

Databases · Computer Science 2022-12-01 Daichi Amagata , Takahiro Hara

We examine overlapping clustering schemes with functorial constraints, in the spirit of Carlsson--Memoli. This avoids issues arising from the chaining required by partition-based methods. Our principal result shows that any clustering…

Machine Learning · Computer Science 2016-08-16 Jared Culbertson , Dan P. Guralnik , Jakob Hansen , Peter F. Stiller

Clustering problems have numerous applications and are becoming more challenging as the size of the data increases. In this paper, we consider designing clustering algorithms that can be used in MapReduce, the most popular programming…

Distributed, Parallel, and Cluster Computing · Computer Science 2011-09-09 Alina Ene , Sungjin Im , Benjamin Moseley

K-means plays a vital role in data mining and is the simplest and most widely used algorithm under the Euclidean Minimum Sum-of-Squares Clustering (MSSC) model. However, its performance drastically drops when applied to vast amounts of…

Machine Learning · Computer Science 2023-11-27 Rustam Mussabayev , Nenad Mladenovic , Bassem Jarboui , Ravil Mussabayev

Clustering provides a common means of identifying structure in complex data, and there is renewed interest in clustering as a tool for the analysis of large data sets in many fields. A natural question is how many clusters are appropriate…

Data Analysis, Statistics and Probability · Physics 2007-05-23 Susanne Still , William Bialek

Clustering is often used for discovering structure in data. Clustering systems differ in the objective function used to evaluate clustering quality and the control strategy used to search the space of clusterings. Ideally, the search…

Artificial Intelligence · Computer Science 2014-11-17 D. Fisher

One of the challenges of high granularity calorimeters, such as that to be built to cover the endcap region in the CMS Phase-2 Upgrade for HL-LHC, is that the large number of channels causes a surge in the computing load when clustering…

Instrumentation and Detectors · Physics 2020-01-29 Marco Rovere , Ziheng Chen , Antonio Di Pilato , Felice Pantaleo , Chris Seez

Clustering is an essential data mining tool that aims to discover inherent cluster structure in data. As such, the study of clusterability, which evaluates whether data possesses such structure, is an integral part of cluster analysis. Yet,…

Machine Learning · Computer Science 2016-02-24 Margareta Ackerman , Andreas Adolfsson , Naomi Brownstein

This paper considers clustered multi-task compressive sensing, a hierarchical model that solves multiple compressive sensing tasks by finding clusters of tasks that leverage shared information to mutually improve signal reconstruction. The…

Signal Processing · Electrical Eng. & Systems 2023-10-03 Alexander Lin , Demba Ba

In this work, we aim to solve a practical use-case of unsupervised clustering which has applications in predictive maintenance in the energy operations sector using quantum computers. Using only cloud access to quantum computers, we…

Quantum Physics · Physics 2022-09-13 Stephen DiAdamo , Corey O'Meara , Giorgio Cortiana , Juan Bernabé-Moreno

The proliferation of high-dimensional data from sources such as social media, sensor networks, and online platforms has created new challenges for clustering algorithms. Multi-view clustering, which integrates complementary information from…

Machine Learning · Computer Science 2026-01-23 Chakib Fettal , Lazhar Labiod , Mohamed Nadif