English
Related papers

Related papers: Efficient Multivector Retrieval with Token-Aware C…

200 papers

The K-means algorithm is arguably the most popular data clustering method, commonly applied to processed datasets in some "feature spaces", as is in spectral clustering. Highly sensitive to initializations, however, K-means encounters a…

Machine Learning · Computer Science 2019-06-04 Feiyu Chen , Yuchen Yang , Liwei Xu , Taiping Zhang , Yin Zhang

In addition to finding meaningful clusters, centroid-based clustering algorithms such as K-means or mean-shift should ideally find centroids that are valid patterns in the input space, representative of data in their cluster. This is…

Machine Learning · Computer Science 2014-06-17 Weiran Wang , Miguel Á. Carreira-Perpiñán

Centroid-based clustering algorithms, such as hard K-means (HKM) and fuzzy K-means (FKM), have suffered from learning bias towards large clusters. Their centroids tend to be crowded in large clusters, compromising performance when the true…

Machine Learning · Computer Science 2024-06-07 Yudong He

Common clustering methods, such as $k$-means and convex clustering, group similar vector-valued observations into clusters. However, with the increasing prevalence of matrix-valued observations, which often exhibit low rank characteristics,…

Optimization and Control · Mathematics 2024-12-24 Meixia Lin , Yangjing Zhang

Retrieval augmentation is a powerful but expensive method to make language models more knowledgeable about the world. Memory-based methods like LUMEN pre-compute token representations for retrieved passages to drastically speed up…

Computation and Language · Computer Science 2023-08-30 Yury Zemlyanskiy , Michiel de Jong , Luke Vilnis , Santiago Ontañón , William W. Cohen , Sumit Sanghai , Joshua Ainslie

The Tabu Search (TS) metaheuristic has been proposed for K-Means clustering as an alternative to Lloyd's algorithm, which for all its ease of implementation and fast runtime, has the major drawback of being trapped at local optima. While…

Machine Learning · Computer Science 2017-03-27 Kojo Sarfo Gyamfi , James Brusey , Andrew Hunt

Clustering is a useful data exploratory method with its wide applicability in multiple fields. However, data clustering greatly relies on initialization of cluster centers that can result in large intra-cluster variance and dead centers,…

Machine Learning · Computer Science 2017-05-15 Vibin Vijay , Raghunath Vp , Amarjot Singh , SN Omar

This paper addresses the limitations of conventional vector quantization algorithms, particularly K-Means and its variant K-Means++, and investigates the Stochastic Quantization (SQ) algorithm as a scalable alternative for high-dimensional…

Machine Learning · Computer Science 2025-03-11 Anton Kozyriev , Vladimir Norkin

This paper considers clustered multi-task compressive sensing, a hierarchical model that solves multiple compressive sensing tasks by finding clusters of tasks that leverage shared information to mutually improve signal reconstruction. The…

Signal Processing · Electrical Eng. & Systems 2023-10-03 Alexander Lin , Demba Ba

Streaming video understanding requires models to robustly encode, store, and retrieve information from a continuous video stream to support accurate video question answering (VQA). Existing state-of-the-art approaches rely on key-value…

Computer Vision and Pattern Recognition · Computer Science 2026-02-23 Vatsal Agarwal , Saksham Suri , Matthew Gwilliam , Pulkit Kumar , Abhinav Shrivastava

Medical image segmentation is essential for clinical diagnosis and treatment planning. Although transformer-based methods have achieved remarkable results, their high computational cost hinders clinical deployment. To address this issue, we…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Yaxuan Jiao , Qing Xu , Yuxiang Luo , Xiangjian He , Zhen Chen , Wenting Duan

Convex clustering is a modern method with both hierarchical and $k$-means clustering characteristics. Although convex clustering can capture complex clustering structures hidden in data, the existing convex clustering algorithms are not…

Machine Learning · Statistics 2023-12-22 Daniel J. W. Touw , Patrick J. F. Groenen , Yoshikazu Terada

Quantum computing is a promising paradigm based on quantum theory for performing fast computations. Quantum algorithms are expected to surpass their classical counterparts in terms of computational complexity for certain tasks, including…

As datasets continue to grow in size and complexity, finding succinct yet accurate data summaries poses a key challenge. Centroid-based clustering, a widely adopted approach to address this challenge, finds informative summaries of datasets…

Machine Learning · Computer Science 2026-03-11 Martino Ciaperoni , Collin Leiber , Aristides Gionis , Heikki Mannila

Traditional KV cache eviction strategies, which discard less critical KV-pairs based on attention scores, often degrade generation quality, causing context loss or hallucinations. Recent efforts shift toward KV merging, merging eviction…

Computation and Language · Computer Science 2025-11-14 Kunxi Li , Yufan Xiong , Zhonghua Jiang , Yiyun Zhou , Zhaode Wang , Chengfei Lv , Shengyu Zhang

The k-means clustering algorithm is a popular algorithm that partitions data into k clusters. There are many improvements to accelerate the standard algorithm. Most current research employs upper and lower bounds on point-to-cluster…

Machine Learning · Computer Science 2024-10-22 Andreas Lang , Erich Schubert

Clustering is a long-standing problem area in data mining. The centroid-based classical approaches to clustering mainly face difficulty in the case of high dimensional inputs such as images. With the advent of deep neural networks, a common…

Machine Learning · Computer Science 2024-12-02 Debapriya Roy

Finding high-importance patterns in data is an emerging data mining task known as High-utility itemset mining (HUIM). Given a minimum utility threshold, a HUIM algorithm extracts all the high-utility itemsets (HUIs) whose utility values are…

Databases · Computer Science 2023-03-28 Shan Huang , Wensheng Gan , Jinbao Miao , Xuming Han , Philippe Fournier-Viger

Data-target association is an important step in multi-target localization for the intelligent operation of un- manned systems in numerous applications such as search and rescue, traffic management and surveillance. The objective of this…

Systems and Control · Computer Science 2017-05-31 Samuel Silva , Rengan Suresh , Feng Tao , Johnathan Votion , Yongcan Cao

Multi-vector models dominate Visual Document Retrieval (VDR) due to their fine-grained matching capabilities, but their high storage and computational costs present a major barrier to practical deployment. In this paper, we propose…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Yibo Yan , Mingdong Ou , Yi Cao , Jiahao Huo , Xin Zou , Shuliang Liu , James Kwok , Xuming Hu