Fast-VAT: Accelerating Cluster Tendency Visualization using Cython and Numba
Abstract
Visual Assessment of Cluster Tendency (VAT) is a widely used unsupervised technique to assess the presence of cluster structure in unlabeled datasets. However, its standard implementation suffers from significant performance limitations due to its O(n^2) time complexity and inefficient memory usage. In this work, we present Fast-VAT, a high-performance reimplementation of the VAT algorithm in Python, augmented with Numba's Just-In-Time (JIT) compilation and Cython's static typing and low-level memory optimizations. Our approach achieves up to 50x speedup over the baseline implementation, while preserving the output fidelity of the original method. We validate Fast-VAT on a suite of real and synthetic datasets -- including Iris, Mall Customers, and Spotify subsets -- and verify cluster tendency using Hopkins statistics, PCA, and t-SNE. Additionally, we compare VAT's structural insights with clustering results from DBSCAN and K-Means to confirm its reliability.
Keywords
Cite
@article{arxiv.2507.15904,
title = {Fast-VAT: Accelerating Cluster Tendency Visualization using Cython and Numba},
author = {MSR Avinash and Ismael Lachheb},
journal= {arXiv preprint arXiv:2507.15904},
year = {2025}
}
Comments
10 pages, 3 figures, 3 tables. Code available at https://github.com/Ashx098/VAT-Optimized