English
Related papers

Related papers: Quantifying uncertainty in spectral clusterings: e…

200 papers

We study the uncertainty in galaxy cluster mass estimates derived from X-ray data assuming hydrostatic equilibrium (HE) for the intra cluster gas. Using a Monte-Carlo procedure we generate a general class of mass models allowing very…

Astrophysics · Physics 2007-05-23 C. Balland , A. Blanchard

Consistency is a key property of all statistical procedures analyzing randomly sampled data. Surprisingly, despite decades of work, little is known about consistency of most clustering algorithms. In this paper we investigate consistency of…

Statistics Theory · Mathematics 2008-12-18 Ulrike von Luxburg , Mikhail Belkin , Olivier Bousquet

Graph Spectral Clustering methods (GSC) allow representing clusters of diverse shapes, densities, etc. However, the results of such algorithms, when applied e.g. to text documents, are hard to explain to the user, especially due to…

Monte Carlo integration is a commonly used technique to compute intractable integrals and is typically thought to perform poorly for very high-dimensional integrals. To show that this is not always the case, we examine Monte Carlo…

Methodology · Statistics 2023-05-26 Yanbo Tang

Regression tasks, notably in safety-critical domains, require proper uncertainty quantification, yet the literature remains largely classification-focused. In this light, we introduce a family of measures for total, aleatoric, and epistemic…

Machine Learning · Computer Science 2025-10-30 Christopher Bülte , Yusuf Sale , Gitta Kutyniok , Eyke Hüllermeier

Partitioning ocean flows into regions dynamically distinct from their surroundings based on material transport can assist search-and-rescue planning by reducing the search domain. The spectral clustering method partitions the domain by…

Atmospheric and Oceanic Physics · Physics 2020-08-28 Guilherme S. Vieira , Irina I. Rypina , Michael R. Allshouse

Clustering of data sets is a standard problem in many areas of science and engineering. The method of spectral clustering is based on embedding the data set using a kernel function, and using the top eigenvectors of the normalized Laplacian…

Statistics Theory · Mathematics 2015-04-08 Geoffrey Schiebinger , Martin J. Wainwright , Bin Yu

Clustering is often a challenging problem because of the inherent ambiguity in what the "correct" clustering should be. Even when the number of clusters $K$ is known, this ambiguity often still exists, particularly when there is variation…

Information Theory · Computer Science 2025-05-09 Kayvon Mazooji , Ilan Shomorony

We consider the problem of numerical approximation of integrals of random fields over a unit hypercube. We use a stratified Monte Carlo quadrature and measure the approximation performance by the mean squared error. The quadrature is…

Probability · Mathematics 2011-05-05 Konrad Abramowicz , Oleg Seleznjev

The efficient evaluation of high-dimensional integrals is of importance in both theoretical and practical fields of science, such as data science, statistical physics, and machine learning. However, exact computation methods suffer from the…

Statistics Theory · Mathematics 2017-12-15 Radislav Vaisman , Robert Salomone , Dirk P. Kroese

Model-based clustering is a powerful tool that is often used to discover hidden structure in data by grouping observational units that exhibit similar response values. Recently, clustering methods have been developed that permit…

Methodology · Statistics 2025-06-24 Sally Paganin , Garritt L. Page , Fernando Andrés Quintana

A cluster tree provides a highly-interpretable summary of a density function by representing the hierarchy of its high-density clusters. It is estimated using the empirical tree, which is the cluster tree constructed from a density…

Statistics Theory · Mathematics 2017-02-14 Jisu Kim , Yen-Chi Chen , Sivaraman Balakrishnan , Alessandro Rinaldo , Larry Wasserman

In cluster tomography, we propose measuring the number of clusters $N$ intersected by a line segment of length $\ell$ across a finite sample. As expected, the leading order of $N(\ell)$ scales as $a\ell$, where $a$ depends on microscopic…

Disordered Systems and Neural Networks · Physics 2024-02-13 Helen S. Ansell , Samuel J. Frank , István A. Kovács

ML models have errors when used for predictions. The errors are unknown but can be quantified by model uncertainty. When multiple ML models are trained using the same training points, their model uncertainties may be statistically…

Machine Learning · Statistics 2025-09-23 Xiaoping Du

Pixel-space full spectrum fitting exploiting non-linear $\chi^2$ minimization became a \emph{de facto} standard way of deriving internal kinematics from absorption line spectra of galaxies and star clusters. However, reliable estimation of…

Instrumentation and Methods for Astrophysics · Physics 2020-04-29 Igor V. Chilingarian , Kirill A. Grishin

Clustering graphs based on a comparison of the number of links within clusters and the expected value of this quantity in a random graph has gained a lot of attention and popularity in the last decade. Recently, Aldecoa and Marin proposed a…

Data Structures and Algorithms · Computer Science 2013-10-23 Tobias Fleck , Andrea Kappes , Dorothea Wagner

In the data mining field many clustering methods have been proposed, yet standard versions do not take into account uncertain databases. This paper deals with a new approach to cluster uncertain data by using a hierarchical clustering…

Artificial Intelligence · Computer Science 2015-01-13 Wiem Maalel , Kuang Zhou , Arnaud Martin , Zied Elouedi

The theoretical analysis of spectral clustering mainly focuses on consistency, while there is relatively little research on its generalization performance. In this paper, we study the excess risk bounds of the popular spectral clustering…

Machine Learning · Computer Science 2022-07-19 Shaojie Li , Sheng Ouyang , Yong Liu

We study hierarchical clusterings of metric spaces that change over time. This is a natural geometric primitive for the analysis of dynamic data sets. Specifically, we introduce and study the problem of finding a temporally coherent…

Data Structures and Algorithms · Computer Science 2017-10-23 Tamal K. Dey , Alfred Rossi , Anastasios Sidiropoulos

Monte Carlo simulations are based on the manipulation of random numbers to evaluate probable outcomes, with applicability in a variety of different fields. By assigning probabilities, which can be determined a priori, to various events, it…

Physics Education · Physics 2022-01-03 Parasuraman Swaminathan