English
Related papers

Related papers: OneBatchPAM: A Fast and Frugal K-Medoids Algorithm

200 papers

In the $k$-cut problem, we are given an edge-weighted graph $G$ and an integer $k$, and have to remove a set of edges with minimum total weight so that $G$ has at least $k$ connected components. The current best algorithms are an…

Data Structures and Algorithms · Computer Science 2019-03-22 Anupam Gupta , Euiwoong Lee , Jason Li

Bat Algorithm (BA) is a nature-inspired metaheuristic search algorithm designed to efficiently explore complex problem spaces and find near-optimal solutions. The algorithm is inspired by the echolocation behavior of bats, which acts as a…

Neural and Evolutionary Computing · Computer Science 2024-07-23 Shahla U. Umar , Tarik A. Rashid , Aram M. Ahmed , Bryar A. Hassan , Mohammed Rashad Baker

MAP is the problem of finding a most probable instantiation of a set of variables in a Bayesian network, given evidence. Unlike computing marginals, posteriors, and MPE (a special case of MAP), the time and space complexity of MAP is not…

Artificial Intelligence · Computer Science 2013-01-14 James D. Park , Adnan Darwiche

Efficient Maximum Inner Product Search (MIPS) is an important task that has a wide applicability in recommendation systems and classification with a large number of classes. Solutions based on locality-sensitive hashing (LSH) as well as…

Machine Learning · Computer Science 2015-12-01 Alex Auvolat , Sarath Chandar , Pascal Vincent , Hugo Larochelle , Yoshua Bengio

This paper gives a k-means approximation algorithm that is efficient in the relational algorithms model. This is an algorithm that operates directly on a relational database without performing a join to convert it to a matrix whose rows…

Data Structures and Algorithms · Computer Science 2021-05-24 Benjamin Moseley , Kirk Pruhs , Alireza Samadian , Yuyan Wang

In many applications, it is of interest to approximate data, given by mxn matrix A, by a matrix B of at most rank k, which is much smaller than m and n. The best approximation is given by singular value decomposition, which is too time…

Numerical Analysis · Mathematics 2007-05-23 Shmuel Friedland , Mostafa Kaveh , Amir Niknejad , Hossein Zare

$K$-means, a simple and effective clustering algorithm, is one of the most widely used algorithms in multimedia and computer vision community. Traditional $k$-means is an iterative algorithm---in each iteration new cluster centers are…

Computer Vision and Pattern Recognition · Computer Science 2013-12-12 Jingdong Wang , Jing Wang , Qifa Ke , Gang Zeng , Shipeng Li

Sequence clustering in a streaming environment is challenging because it is computationally expensive, and the sequences may evolve over time. K-medoids or Partitioning Around Medoids (PAM) is commonly used to cluster sequences since it…

Machine Learning · Computer Science 2022-06-27 Azqa Nadeem , Sicco Verwer

For very large values of $k$, we consider methods for fast $k$-means clustering of massive datasets with $10^7\sim10^9$ points in high-dimensions ($d\geq100$). All current practical methods for this problem have runtimes at least…

Machine Learning · Computer Science 2025-02-11 Jack Spalding-Jamieson , Eliot Wong Robson , Da Wei Zheng

A new algorithm is proposed which accelerates the mini-batch k-means algorithm of Sculley (2010) by using the distance bounding approach of Elkan (2003). We argue that, when incorporating distance bounds into a mini-batch algorithm, already…

Machine Learning · Statistics 2016-09-14 James Newling , François Fleuret

The $K$-medoids problem is a challenging combinatorial clustering task, widely used in data analysis applications. While numerous algorithms have been proposed to solve this problem, none of these are able to obtain an exact (globally…

Machine Learning · Computer Science 2024-05-22 Xi He , Max A. Little

Similarity search based on a distance function in metric spaces is a fundamental problem for many applications. Queries for similar objects lead to the well-known machine learning task of nearest-neighbours identification. Many data…

Information Retrieval · Computer Science 2022-08-05 Felipe Ortega , Maria Jesus Algar , Isaac Martín de Diego , Javier M. Moguerza

Mini-batch optimization has proven to be a powerful paradigm for large-scale learning. However, the state of the art parallel mini-batch algorithms assume synchronous operation or cyclic update orders. When worker nodes are heterogeneous…

Optimization and Control · Mathematics 2015-05-20 Hamid Reza Feyzmahdavian , Arda Aytekin , Mikael Johansson

Existing methods for retrieving k-nearest neighbours suffer from the curse of dimensionality. We argue this is caused in part by inherent deficiencies of space partitioning, which is the underlying strategy used by most existing methods. We…

Data Structures and Algorithms · Computer Science 2017-04-07 Ke Li , Jitendra Malik

The K-Means clustering using LLoyd's algorithm is an iterative approach to partition the given dataset into K different clusters. The algorithm assigns each point to the cluster based on the following objective function \[\ \min…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-05-21 Ashish Srivastava , Mohammed Nawfal

We present PrecisionBatching, a quantized inference algorithm for speeding up neural network execution on traditional hardware platforms at low bitwidths without the need for retraining or recalibration. PrecisionBatching decomposes a…

Machine Learning · Computer Science 2020-03-03 Maximilian Lam , Zachary Yedidia , Colby Banbury , Vijay Janapa Reddi

The Random Batch Method (RBM) is an effective technique to reduce the computational complexity when solving certain stochastic differential problems (SDEs) involving interacting particles. It can transform the computational complexity from…

Numerical Analysis · Mathematics 2024-12-23 Yanshun Zhao , Jingrun Chen , Zhiwen Zhang

We present a new local-search algorithm for the $k$-median clustering problem. We show that local optima for this algorithm give a $(2.836+\epsilon)$-approximation; our result improves upon the $(3+\epsilon)$-approximate local-search…

Data Structures and Algorithms · Computer Science 2021-11-09 Vincent Cohen-Addad , Anupam Gupta , Lunjia Hu , Hoon Oh , David Saulpic

This paper studies a multi-armed bandit (MAB) version of the range-searching problem. In its basic form, range searching considers as input a set of points (on the real line) and a collection of (real) intervals. Here, with each specified…

Machine Learning · Computer Science 2021-05-05 Siddharth Barman , Ramakrishnan Krishnamurthy , Saladi Rahul

We present a new fast online clustering algorithm that reliably recovers arbitrary-shaped data clusters in high throughout data streams. Unlike the existing state-of-the-art online clustering methods based on k-means or k-medoid, it does…

Artificial Intelligence · Computer Science 2015-06-11 Krzysztof Choromanski , Sanjiv Kumar , Xiaofeng Liu