English
Related papers

Related papers: Towards Deterministic Diverse Subset Sampling

200 papers

A determinantal point process (DPP) is a random process useful for modeling the combinatorial problem of subset selection. In particular, DPPs encourage a random subset Y to contain a diverse set of items selected from a base set Y. For…

Machine Learning · Computer Science 2012-10-19 Raja Hafiz Affandi , Alex Kulesza , Emily B. Fox

Generative models have proven to be an outstanding tool for representing high-dimensional probability distributions and generating realistic-looking images. An essential characteristic of generative models is their ability to produce…

Machine Learning · Computer Science 2019-11-26 Mohamed Elfeki , Camille Couprie , Morgane Riviere , Mohamed Elhoseiny

We propose a novel diverse feature selection method based on determinantal point processes (DPPs). Our model enables one to flexibly define diversity based on the covariance of features (similar to orthogonal matching pursuit) or…

Machine Learning · Computer Science 2014-11-25 Nematollah Kayhan Batmanghelich , Gerald Quon , Alex Kulesza , Manolis Kellis , Polina Golland , Luke Bornn

Determinantal point processes (DPPs) have attracted significant attention in machine learning for their ability to model subsets drawn from a large item collection. Recent work shows that nonsymmetric DPP (NDPP) kernels have significant…

Machine Learning · Computer Science 2021-04-14 Mike Gartrell , Insu Han , Elvis Dohmatob , Jennifer Gillenwater , Victor-Emmanuel Brunel

Determinantal point processes (DPPs) have attracted substantial attention as an elegant probabilistic model that captures the balance between quality and diversity within sets. DPPs are conventionally parameterized by a positive…

Machine Learning · Computer Science 2020-11-16 Mike Gartrell , Victor-Emmanuel Brunel , Elvis Dohmatob , Syrine Krichene

Determinantal consensus clustering is a promising and attractive alternative to partitioning about medoids and k-means for ensemble clustering. Based on a determinantal point process or DPP sampling, it ensures that subsets of similar…

Computation · Statistics 2021-02-09 Serge Vicente , Alejandro Murua

A determinantal point process (DPP) is a probabilistic model of set diversity compactly parameterized by a positive semi-definite kernel matrix. To fit a DPP to a given task, we would like to learn the entries of its kernel matrix by…

Machine Learning · Statistics 2014-11-06 Jennifer Gillenwater , Alex Kulesza , Emily Fox , Ben Taskar

Determinantal point processes (DPPs) are well-suited for modeling repulsion and have proven useful in many applications where diversity is desired. While DPPs have many appealing properties, such as efficient sampling, learning the…

Machine Learning · Statistics 2014-02-21 Raja Hafiz Affandi , Emily B. Fox , Ryan P. Adams , Ben Taskar

Dimensionality reduction is a first step of many machine learning pipelines. Two popular approaches are principal component analysis, which projects onto a small number of well chosen but non-interpretable directions, and feature selection,…

Machine Learning · Statistics 2018-12-27 Ayoub Belhadji , Rémi Bardenet , Pierre Chainais

Determinantal point processes (DPPs) are point process models that naturally encode diversity between the points of a given realization, through a positive definite kernel $K$. DPPs possess desirable properties, such as exact sampling or…

Computation · Statistics 2015-07-07 Rémi Bardenet , Michalis K. Titsias

Informative data selection is a key requirement for large language models (LLMs) to minimize the amount of data required for fine-tuning, network distillation, and token pruning, enabling fast and efficient deployment, especially under…

Machine Learning · Computer Science 2026-02-03 Ahmad Sarlak , Abolfazl Razi

Determinantal Point Processes (DPPs) are popular models for point processes with repulsion. They appear in numerous contexts, from physics to graph theory, and display appealing theoretical properties. On the more practical side of things,…

Statistics Theory · Mathematics 2018-08-22 Simon Barthelmé , Pierre-Olivier Amblard , Nicolas Tremblay

In this technical report, we discuss several sampling algorithms for Determinantal Point Processes (DPP). DPPs have recently gained a broad interest in the machine learning and statistics literature as random point processes with negative…

Computation · Statistics 2018-02-26 Nicolas Tremblay , Simon Barthelme , Pierre-Olivier Amblard

Unstructured neural network pruning algorithms have achieved impressive compression rates. However, the resulting - typically irregular - sparse matrices hamper efficient hardware implementations, leading to additional memory usage and…

Determinantal point processes (DPPs) are specific probability distributions over clouds of points that are used as models and computational tools across physics, probability, statistics, and more recently machine learning. Sampling from…

Machine Learning · Computer Science 2022-03-22 Guillaume Gautier , Guillermo Polito , Rémi Bardenet , Michal Valko

Determinantal point processes (DPPs) are an elegant model for encoding probabilities over subsets, such as shopping baskets, of a ground set, such as an item catalog. They are useful for a number of machine learning tasks, including product…

Machine Learning · Statistics 2016-08-17 Mike Gartrell , Ulrich Paquet , Noam Koenigstein

We propose a new class of determinantal point processes (DPPs) which can be manipulated for inference and parameter learning in potentially sublinear time in the number of items. This class, based on a specific low-rank factorization of the…

Machine Learning · Statistics 2016-10-20 Christophe Dupuy , Francis Bach

Determinantal point processes (DPPs) are popular probabilistic models that arise in many machine learning tasks, where distributions of diverse sets are characterized by matrix determinants. In this paper, we develop fast algorithms to find…

Discrete Mathematics · Computer Science 2017-06-15 Insu Han , Prabhanjan Kambadur , Kyoungsoo Park , Jinwoo Shin

Subset selection problems ask for a small, diverse yet representative subset of the given data. When pairwise similarities are captured by a kernel, the determinants of submatrices provide a measure of diversity or independence of items…

Data Structures and Algorithms · Computer Science 2016-07-07 Tarun Kathuria , Amit Deshpande

Determinantal point processes (DPPs) have become a significant tool for recommendation systems, feature selection, or summary extraction, harnessing the intrinsic ability of these probabilistic models to facilitate sample diversity. The…

Machine Learning · Statistics 2020-07-09 Rémi Bardenet , Subhroshekhar Ghosh