English
Related papers

Related papers: On EM algorithms and their proximal generalization…

200 papers

$K$-means, a simple and effective clustering algorithm, is one of the most widely used algorithms in multimedia and computer vision community. Traditional $k$-means is an iterative algorithm---in each iteration new cluster centers are…

Computer Vision and Pattern Recognition · Computer Science 2013-12-12 Jingdong Wang , Jing Wang , Qifa Ke , Gang Zeng , Shipeng Li

We propose a simple and efficient clustering method for high-dimensional data with a large number of clusters. Our algorithm achieves high-performance by evaluating distances of datapoints with a subset of the cluster centres. Our…

Machine Learning · Computer Science 2022-03-30 Georgios Exarchakis , Omar Oubari , Gregor Lenz

We consider the problem of clustering with $K$-means and Gaussian mixture models with a constraint on the separation between the centers in the context of real-valued data. We first propose a dynamic programming approach to solving the…

Computation · Statistics 2023-01-24 He Jiang , Ery Arias-Castro

Evolutionary multi-objective clustering (EMOC), a modern clustering technique, has been widely applied to extract patterns, allowing us to analyze different aspects of complex data by considering multiple criteria. In this article, we…

Machine Learning · Computer Science 2022-04-04 Cristina Y. Morimoto , Aurora Pozo , Marcílio C. P. de Souto

The expectation-maximization (EM) algorithm is a well-known iterative method for computing maximum likelihood estimates from incomplete data. Despite its numerous advantages, a main drawback of the EM algorithm is its frequently observed…

Computation · Statistics 2018-08-14 Nicholas C. Henderson , Ravi Varadhan

We present a new automated cluster search algorithm, stressing its advantages relatively to others available in the literature. Applying it to the photometric data of the ESO Imaging Survey (EIS, Renzini & da Costa 1997) allowed us to…

Astrophysics · Physics 2007-05-23 Catarina Lobo , Angela Iovino , Guido Chincarini

Euclidean distance matrices (EDM) are matrices of squared distances between points. The definition is deceivingly simple: thanks to their many useful properties they have found applications in psychometrics, crystallography, machine…

Other Computer Science · Computer Science 2016-11-15 Ivan Dokmanic , Reza Parhizkar , Juri Ranieri , Martin Vetterli

As a kind of basic machine learning method, clustering algorithms group data points into different categories based on their similarity or distribution. We present a clustering algorithm by finding hyper-planes to distinguish the data…

Computer Vision and Pattern Recognition · Computer Science 2020-04-28 Luhong Diao , Jinying Gao1 , Manman Deng

We study k-median clustering under the sequential no-substitution setting. In this setting, a data stream is sequentially observed, and some of the points are selected by the algorithm as cluster centers. However, a point can be selected as…

Machine Learning · Computer Science 2022-04-14 Tom Hess , Michal Moshkovitz , Sivan Sabato

While the problem of approximate nearest neighbor search has been well-studied for Euclidean space and $\ell_1$, few non-trivial algorithms are known for $\ell_p$ when ($2 < p < \infty$). In this paper, we revisit this fundamental problem…

Computational Geometry · Computer Science 2015-12-08 Yair Bartal , Lee-Ad Gottlieb

Kernel-based K-means clustering has gained popularity due to its simplicity and the power of its implicit non-linear representation of the data. A dominant concern is the memory requirement since memory scales as the square of the number of…

Machine Learning · Statistics 2016-12-05 Farhad Pourkamali-Anaraki , Stephen Becker

In the past decade computational biology has grown from a cottage industry with a handful of researchers to an attractive interdisciplinary field, catching the attention and imagination of many quantitatively-minded scientists. Of interest…

Methodology · Statistics 2011-04-13 Xiaodan Fan , Yuan Yuan , Jun S. Liu

Kriging or Gaussian Process Regression is applied in many fields as a non-linear regression model as well as a surrogate model in the field of evolutionary computation. However, the computational and space complexity of Kriging, that is…

Machine Learning · Computer Science 2017-02-07 Bas van Stein , Hao Wang , Wojtek Kowalczyk , Michael Emmerich , Thomas Bäck

In this paper, we consider the equilibrium problems and also their regularized problems under the setting of Hadamard spaces. The solution to the regularized problem is represented in terms of resolvent operators. As an essential machinery…

Optimization and Control · Mathematics 2018-07-31 Poom Kumam , Parin Chaipunya

We consider the approximability of center-based clustering problems where the points to be clustered lie in a metric space, and no candidate centers are specified. We call such problems "continuous", to distinguish from "discrete"…

Data Structures and Algorithms · Computer Science 2022-09-05 Deeparnab Chakrabarty , Maryam Negahbani , Ankita Sarkar

The MM principle is a device for creating optimization algorithms satisfying the ascent or descent property. The current survey emphasizes the role of the MM principle in nonlinear programming. For smooth functions, one can construct an…

Optimization and Control · Mathematics 2015-07-29 Kenneth Lange , Kevin L. Keys

Advances in numerical optimization have supported breakthroughs in several areas of signal processing. This paper focuses on the recent enhanced variants of the proximal gradient numerical optimization algorithm, which combine quasi-Newton…

Signal Processing · Electrical Eng. & Systems 2020-01-28 Niccolò Antonello , Lorenzo Stella , Panagiotis Patrinos , Toon van Waterschoot

Kernel methods are powerful tools in various data analysis tasks. Yet, in many cases, their time and space complexity render them impractical for large datasets. Various kernel approximation methods were proposed to overcome this issue,…

Machine Learning · Computer Science 2022-05-24 Roy Mitz , Yoel Shkolnisky

In this paper, we study clustering with respect to the k-modes objective function, a natural formulation of clustering for categorical data. One of the main contributions of this paper is to establish the connection between k-modes and…

Artificial Intelligence · Computer Science 2007-05-23 Zengyou He

In this paper we study constrained subspace approximation problem. Given a set of $n$ points $\{a_1,\ldots,a_n\}$ in $\mathbb{R}^d$, the goal of the {\em subspace approximation} problem is to find a $k$ dimensional subspace that best…

Data Structures and Algorithms · Computer Science 2025-04-30 Aditya Bhaskara , Sepideh Mahabadi , Madhusudhan Reddy Pittu , Ali Vakilian , David P. Woodruff