English
Related papers

Related papers: Projection onto the probability simplex: An effici…

200 papers

In the past few years powerful generalizations to the Euclidean k-means problem have been made, such as Bregman clustering [7], co-clustering (i.e., simultaneous clustering of rows and columns of an input matrix) [9,18], and tensor…

Data Structures and Algorithms · Computer Science 2009-11-09 Stefanie Jegelka , Suvrit Sra , Arindam Banerjee

The acceleration of gradient-based optimization methods is a subject of significant practical and theoretical importance, particularly within machine learning applications. While much attention has been directed towards optimizing within…

Optimization and Control · Mathematics 2024-11-12 Shi Chen , Qin Li , Oliver Tse , Stephen J. Wright

A novel clustering technique based on the projection onto convex set (POCS) method, called POCS-based clustering algorithm, is proposed in this paper. The proposed POCS-based clustering algorithm exploits a parallel projection method of…

Machine Learning · Computer Science 2023-03-24 Le-Anh Tran , Henock M. Deberneh , Truong-Dong Do , Thanh-Dat Nguyen , My-Ha Le , Dong-Chul Park

We consider optimization problems on manifolds with equality and inequality constraints. A large body of work treats constrained optimization in Euclidean spaces. In this work, we consider extensions of existing algorithms from the…

Optimization and Control · Mathematics 2019-04-26 Changshuo Liu , Nicolas Boumal

Based on the correspondence of projection to an eigenvalue problem via the underlying group structure, we generalize the projection algorithm proposed by Morrison et al. This algorithm is eligible for large-scale computations, because we…

Nuclear Theory · Physics 2007-05-23 H. Nakada , T. Sebe , T. Otsuka

In this paper I present a kind of proof for classical Euclidean geometric problems which relies on both synthetic and analytic geometry. Using the elementary tools of polynomial algebra and multivariate calculus we manage to reduce the…

Algebraic Geometry · Mathematics 2020-05-05 Davide Antonio Nello Maran

Spectral clustering is a powerful unsupervised machine learning algorithm for clustering data with non convex or nested structures. With roots in graph theory, it uses the spectral properties of the Laplacian matrix to project the data in a…

Quantum Physics · Physics 2021-06-15 Iordanis Kerenidis , Jonas Landman

We design a new algorithm for the Euclidean $k$-means problem that operates in the local model of differential privacy. Unlike in the non-private literature, differentially private algorithms for the $k$-means objective incur both additive…

Machine Learning · Computer Science 2021-06-29 Uri Stemmer

This paper introduces a new method for performing computational inference on log-Gaussian Cox processes. The likelihood is approximated directly by making novel use of a continuously specified Gaussian random field. We show that for…

Computation · Statistics 2015-11-02 Daniel Simpson , Janine Illian , Finn Lindgren , Sigrunn Sørbye , Håvard Rue

This article focuses on numerical efficiency of projection algorithms for solving linear optimization problems. The theoretical foundation for this approach is provided by the basic result that bounded finite dimensional linear optimization…

Optimization and Control · Mathematics 2023-09-08 Evgeni Nurminski , Roman Tarasov

An efficient algorithm to enumerate the vertices of a two-dimensional (2D) projection of a polytope, is presented in this paper. The proposed algorithm uses the support function of the polytope to be projected and enumerated for vertices.…

Computational Geometry · Computer Science 2016-12-01 Amit Gurung , Rajarshi Ray

In this paper, we extend the proximal point algorithm for vector optimization from the Euclidean space to the Riemannian context. Under suitable assumptions on the objective function the well definition and full convergence of the method to…

Optimization and Control · Mathematics 2015-12-21 G. C. Bento , O. P. Ferreira , Y. R. L. Pereira

In general, the clustering problem is NP-hard, and global optimality cannot be established for non-trivial instances. For high-dimensional data, distance-based methods for clustering or classification face an additional difficulty, the…

Statistics Theory · Mathematics 2016-04-26 Tsvetan Asamov , Adi Ben-Israel

Many iterative methods for solving optimization or feasibility problems have been invented, and often convergence of the iterates to some solution is proven. Under favourable conditions, one might have additional bounds on the distance of…

Optimization and Control · Mathematics 2020-04-14 Heinz H. Bauschke , Minh N. Dao , Dominikus Noll , Hung M. Phan

Starting with the recursive extended Euclid's algorithm, we apply a systematic approach using matrix notation to transform it into an iterative algorithm. The partial correctness proof derived from the transformation turns out to be very…

Discrete Mathematics · Computer Science 2016-07-04 Hing Leung

We present a simple spectral approach to the well-studied constrained clustering problem. It captures constrained clustering as a generalized eigenvalue problem with graph Laplacians. The algorithm works in nearly-linear time and provides…

Social and Information Networks · Computer Science 2016-01-20 Mihai Cucuringu , Ioannis Koutis , Sanjay Chawla , Gary Miller , Richard Peng

The k-means++ algorithm of Arthur and Vassilvitskii (SODA 2007) is a state-of-the-art algorithm for solving the k-means clustering problem and is known to give an O(log k)-approximation in expectation. Recently, Lattanzi and Sohler (ICML…

Data Structures and Algorithms · Computer Science 2020-02-19 Davin Choo , Christoph Grunau , Julian Portmann , Václav Rozhoň

Spectral clustering has become a popular technique due to its high performance in many contexts. It comprises three main steps: create a similarity graph between N objects to cluster, compute the first k eigenvectors of its Laplacian matrix…

Data Structures and Algorithms · Computer Science 2016-05-24 Nicolas Tremblay , Gilles Puy , Remi Gribonval , Pierre Vandergheynst

Clustering, a fundamental activity in unsupervised learning, is notoriously difficult when the feature space is high-dimensional. Fortunately, in many realistic scenarios, only a handful of features are relevant in distinguishing clusters.…

Machine Learning · Statistics 2020-10-23 Zhiyue Zhang , Kenneth Lange , Jason Xu

A problem based on the Extended Euclidean Algorithm applied to a class of polynomials with many factors is presented and believed to be hard. If so, it is a one-way function well suited for applications in digital signicatures.

Cryptography and Security · Computer Science 2008-01-16 Ephraim Feig , Vivian Feig