English
Related papers

Related papers: A Statistical Perspective on Coreset Density Estim…

200 papers

Data analysis in high-dimensional spaces aims at obtaining a synthetic description of a data set, revealing its main structure and its salient features. We here introduce an approach providing this description in the form of a topography of…

Machine Learning · Statistics 2021-03-02 Maria d'Errico , Elena Facco , Alessandro Laio , Alex Rodriguez

This paper defines the notion of class discrepancy for families of functions. It shows that low discrepancy classes admit small offline and streaming coresets. We provide general techniques for bounding the class discrepancy of machine…

Machine Learning · Computer Science 2019-06-13 Zohar Karnin , Edo Liberty

With input sizes becoming massive, coresets -- small yet representative summary of the input -- are relevant more than ever. A weighted set $C_w$ that is a subset of the input is an $\varepsilon$-coreset if the cost of any feasible solution…

Data Structures and Algorithms · Computer Science 2020-09-29 Monika Henzinger , Sagar Kale

We design coresets for Ordered k-Median, a generalization of classical clustering problems such as k-Median and k-Center, that offers a more flexible data analysis, like easily combining multiple objectives (e.g., to increase fairness or…

Data Structures and Algorithms · Computer Science 2019-03-12 Vladimir Braverman , Shaofeng H. -C. Jiang , Robert Krauthgamer , Xuan Wu

Coreset selection is a method for selecting a small, representative subset of an entire dataset. It has been primarily researched in image classification, assuming there is only one object per image. However, coreset selection for object…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Hojun Lee , Suyoung Kim , Junhoo Lee , Jaeyoung Yoo , Nojun Kwak

Model compression is crucial for deployment of neural networks on devices with limited computational and memory resources. Many different methods show comparable accuracy of the compressed model and similar compression rates. However, the…

Machine Learning · Computer Science 2020-08-21 Ben Mussay , Daniel Feldman , Samson Zhou , Vladimir Braverman , Margarita Osadchy

Kernel density estimators with circular data have been studied extensively for decades, as they allow flexible estimations even when the shape of the underlying density is complex. Many recent studies have examined bias correction methods;…

Methodology · Statistics 2026-03-03 Yasuhito Tsuruta

Determinantal point processes (DPPs) are random configurations of points with tunable negative dependence. Because sampling is tractable, DPPs are natural candidates for subsampling tasks, such as minibatch selection or coreset…

Machine Learning · Statistics 2024-11-04 Rémi Bardenet , Subhroshekhar Ghosh , Hugo Simon-Onfroy , Hoang-Son Tran

A Bayesian coreset is a small, weighted subset of data that replaces the full dataset during Bayesian inference, with the goal of reducing computational cost. Although past work has shown empirically that there often exists a coreset with…

Machine Learning · Statistics 2023-01-13 Naitong Chen , Zuheng Xu , Trevor Campbell

In recent years we have witnessed an increase on the development of methods for submodular optimization, which have been motivated by the wide applicability of submodular functions in real-world data-science problems. In this paper, we…

Data Structures and Algorithms · Computer Science 2022-09-15 Guangyi Zhang , Nikolaj Tatti , Aristides Gionis

In projective clustering we are given a set of n points in $R^d$ and wish to cluster them to a set $S$ of $k$ linear subspaces in $R^d$ according to some given distance function. An $\eps$-coreset for this problem is a weighted (scaled)…

Data Structures and Algorithms · Computer Science 2020-11-30 Adiel Statman , Liat Rozenberg , Dan Feldman

Kernel means are frequently used to represent probability distributions in machine learning problems. In particular, the well known kernel density estimator and the kernel mean embedding both have the form of a kernel mean. Unfortunately,…

Machine Learning · Statistics 2015-03-03 E. Cruz Cortés , C. Scott

We study the fundamental question of how informative a dataset is for solving a given decision-making task. In our setting, the dataset provides partial information about unknown parameters that influence task outcomes. Focusing on linear…

Optimization and Control · Mathematics 2025-05-29 Omar Bennouna , Amine Bennouna , Saurabh Amin , Asuman Ozdaglar

We consider the problem of estimating the density of observations taking values in classical or nonclassical spaces such as manifolds and more general metric spaces. Our setting is quite general but also sufficiently rich in allowing the…

Probability · Mathematics 2019-02-12 G. Cleanthous , A. Georgiadis , G. Kerkyacharian , P. Petrushev , D. Picard

Designing coresets--small-space sketches of the data preserving cost of the solutions within $(1\pm \epsilon)$-approximate factor--is an important research direction in the study of center-based $k$-clustering problems, such as $k$-means or…

Computational Geometry · Computer Science 2023-03-03 Sayan Bandyapadhyay , Fedor V. Fomin , Tanmay Inamdar

Density Estimation Trees (DETs) are decision trees trained on a multivariate dataset to estimate its probability density function. While not competitive with kernel techniques in terms of accuracy, they are incredibly fast, embarrassingly…

Applications · Statistics 2016-12-21 Lucio Anderlini

We derive optimal rates of convergence in the supremum norm for estimating the H\"older-smooth mean function of a stochastic process which is repeatedly and discretely observed with additional errors at fixed, multivariate, synchronous…

Statistics Theory · Mathematics 2024-05-09 Max Berger , Philipp Hermann , Hajo Holzmann

Neural network-based methods for (un)conditional density estimation have recently gained substantial attention, as various neural density estimators have outperformed classical approaches in real-data experiments. Despite these empirical…

Machine Learning · Statistics 2025-10-02 Dehao Dai , Jianqing Fan , Yihong Gu , Debarghya Mukherjee

To improve the efficiency and sustainability of learning deep models, we propose CREST, the first scalable framework with rigorous theoretical guarantees to identify the most valuable examples for training non-convex models, particularly…

Machine Learning · Computer Science 2023-06-05 Yu Yang , Hao Kang , Baharan Mirzasoleiman

Nonparametric density estimation is considered for a discretely observed stationary continuous-time process. For each of three given time sampling procedures either random or deterministic, we establish that histograms and frequency…

Statistics Theory · Mathematics 2009-01-19 François-Xavier Lejeune