English
Related papers

Related papers: Coresets for Gaussian Mixture Models of Any Shape

200 papers

We study the construction of coresets for kernel density estimates. That is we show how to approximate the kernel density estimate described by a large point set with another kernel density estimate with a much smaller point set. For…

Machine Learning · Computer Science 2017-10-13 Jeff M. Phillips , Wai Ming Tai

Designing small-sized \emph{coresets}, which approximately preserve the costs of the solutions for large datasets, has been an important research direction for the past decade. We consider coreset construction for a variety of general…

Data Structures and Algorithms · Computer Science 2024-10-11 Lingxiao Huang , Jian Li , Pinyan Lu , Xuan Wu

We obtain the first strong coresets for the $k$-median and subspace approximation problems with sum of distances objective function, on $n$ points in $d$ dimensions, with a number of weighted points that is independent of both $n$ and $d$;…

Data Structures and Algorithms · Computer Science 2022-04-15 Christian Sohler , David P. Woodruff

$k$-Clustering in $\mathbb{R}^d$ (e.g., $k$-median and $k$-means) is a fundamental machine learning problem. While near-linear time approximation algorithms were known in the classical setting for a dataset with cardinality $n$, it remains…

Quantum Physics · Physics 2023-06-06 Yecheng Xue , Xiaoyu Chen , Tongyang Li , Shaofeng H. -C. Jiang

We develop and analyze a method to reduce the size of a very large set of data points in a high dimensional Euclidean space R d to a small set of weighted points such that the result of a predetermined data analysis task on the reduced set…

Data Structures and Algorithms · Computer Science 2018-07-13 Dan Feldman , Melanie Schmidt , Christian Sohler

A coreset (or core-set) of an input set is its small summation, such that solving a problem on the coreset as its input, provably yields the same result as solving the same problem on the original (full) set, for a given family of problems…

Machine Learning · Computer Science 2019-10-22 Ibrahim Jubran , Alaa Maalouf , Dan Feldman

Coresets are modern data-reduction tools that are widely used in data analysis to improve efficiency in terms of running time, space and communication complexity. Our main result is a fast algorithm to construct a small coreset for k-Median…

Data Structures and Algorithms · Computer Science 2020-07-16 Vladimir Braverman , Shaofeng H. -C. Jiang , Robert Krauthgamer , Xuan Wu

Coresets are arguably the most popular compression paradigm for center-based clustering objectives such as $k$-means. Given a point set $P$, a coreset $\Omega$ is a small, weighted summary that preserves the cost of all candidate solutions…

Data Structures and Algorithms · Computer Science 2024-05-03 Nikhil Bansal , Vincent Cohen-Addad , Milind Prabhu , David Saulpic , Chris Schwiegelshohn

In optimization or machine learning problems we are given a set of items, usually points in some metric space, and the goal is to minimize or maximize an objective function over some space of candidate solutions. For example, in clustering…

Machine Learning · Computer Science 2020-11-19 Dan Feldman

In projective clustering we are given a set of n points in $R^d$ and wish to cluster them to a set $S$ of $k$ linear subspaces in $R^d$ according to some given distance function. An $\eps$-coreset for this problem is a weighted (scaled)…

Data Structures and Algorithms · Computer Science 2020-11-30 Adiel Statman , Liat Rozenberg , Dan Feldman

Many applications infer the structure of a probabilistic graphical model from data to elucidate the relationships between variables. But how can we train graphical models on a massive data set? In this paper, we show how to construct…

Artificial Intelligence · Computer Science 2017-10-17 Alejandro Molina , Alexander Munteanu , Kristian Kersting

We present algorithms that create coresets in an online setting for clustering problems according to a wide subset of Bregman divergences. Notably, our coresets have a small additive error, similar in magnitude to the lightweight coresets…

Data Structures and Algorithms · Computer Science 2020-12-14 Rachit Chhaya , Jayesh Choudhari , Anirban Dasgupta , Supratim Shit

We investigate coresets - succinct, small summaries of large data sets - so that solutions found on the summary are provably competitive with solution found on the full data set. We provide an overview over the state-of-the-art in coreset…

Machine Learning · Statistics 2017-06-06 Olivier Bachem , Mario Lucic , Andreas Krause

Coresets have emerged as a powerful tool to summarize data by selecting a small subset of the original observations while retaining most of its information. This approach has led to significant computational speedups but the performance of…

Statistics Theory · Mathematics 2020-12-10 Paxton Turner , Jingbo Liu , Philippe Rigollet

A wide range of optimization problems arising in machine learning can be solved by gradient descent algorithms, and a central question in this area is how to efficiently compress a large-scale dataset so as to reduce the computational…

Machine Learning · Computer Science 2022-10-11 Jiawei Huang , Ruomin Huang , Wenjie Liu , Nikolaos M. Freris , Hu Ding

We design and mathematically analyze sampling-based algorithms for regularized loss minimization problems that are implementable in popular computational models for large data, in which the access to the data is restricted in some way. Our…

Machine Learning · Computer Science 2019-06-04 Ryan R. Curtin , Sungjin Im , Ben Moseley , Kirk Pruhs , Alireza Samadian

We provide the first streaming algorithm for computing a provable approximation to the $k$-means of sparse Big data. Here, sparse Big Data is a set of $n$ vectors in $\mathbb{R}^d$, where each vector has $O(1)$ non-zeroes entries, and…

Data Structures and Algorithms · Computer Science 2016-02-09 Artem Barger , Dan Feldman

We construct near-optimal coresets for kernel density estimates for points in $\mathbb{R}^d$ when the kernel is positive definite. Specifically we show a polynomial time construction for a coreset of size $O(\sqrt{d}/\varepsilon\cdot…

Machine Learning · Computer Science 2019-04-15 Jeff M. Phillips , Wai Ming Tai

We design coresets for Ordered k-Median, a generalization of classical clustering problems such as k-Median and k-Center, that offers a more flexible data analysis, like easily combining multiple objectives (e.g., to increase fairness or…

Data Structures and Algorithms · Computer Science 2019-03-12 Vladimir Braverman , Shaofeng H. -C. Jiang , Robert Krauthgamer , Xuan Wu

Diversity maximization is a fundamental problem in web search and data mining. For a given dataset $S$ of $n$ elements, the problem requires to determine a subset of $S$ containing $k\ll n$ "representatives" which minimize some diversity…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-02-11 Matteo Ceccarello , Andrea Pietracaprina , Geppino Pucci