English
Related papers

Related papers: Efficient Sampling for k-Determinantal Point Proce…

200 papers

Discrete Determinantal Point Processes (DPPs) have a wide array of potential applications for subsampling datasets. They are however held back in some cases by the high cost of sampling. In the worst-case scenario, the sampling cost scales…

Machine Learning · Computer Science 2023-02-23 Simon Barthelmé , Nicolas Tremblay , Pierre-Olivier Amblard

Determinantal point processes (DPPs) are distributions over sets of items that model diversity using kernels. Their applications in machine learning include summary extraction and recommendation systems. Yet, the cost of sampling from a DPP…

Machine Learning · Statistics 2022-03-22 Guillaume Gautier , Rémi Bardenet , Michal Valko

Given a fixed $n\times d$ matrix $\mathbf{X}$, where $n\gg d$, we study the complexity of sampling from a distribution over all subsets of rows where the probability of a subset is proportional to the squared volume of the parallelepiped…

Machine Learning · Computer Science 2019-02-25 Michał Dereziński

A determinantal point process (DPP) on a collection of $M$ items is a model, parameterized by a symmetric kernel matrix, that assigns a probability to every subset of those items. Recent work shows that removing the kernel symmetry…

Machine Learning · Computer Science 2022-04-21 Insu Han , Mike Gartrell , Jennifer Gillenwater , Elvis Dohmatob , Amin Karbasi

Generative models have proven to be an outstanding tool for representing high-dimensional probability distributions and generating realistic-looking images. An essential characteristic of generative models is their ability to produce…

Machine Learning · Computer Science 2019-11-26 Mohamed Elfeki , Camille Couprie , Morgane Riviere , Mohamed Elhoseiny

Subset selection problems ask for a small, diverse yet representative subset of the given data. When pairwise similarities are captured by a kernel, the determinants of submatrices provide a measure of diversity or independence of items…

Data Structures and Algorithms · Computer Science 2016-07-07 Tarun Kathuria , Amit Deshpande

Determinantal point processes (DPPs) have become a significant tool for recommendation systems, feature selection, or summary extraction, harnessing the intrinsic ability of these probabilistic models to facilitate sample diversity. The…

Machine Learning · Statistics 2020-07-09 Rémi Bardenet , Subhroshekhar Ghosh

Informative data selection is a key requirement for large language models (LLMs) to minimize the amount of data required for fine-tuning, network distillation, and token pruning, enabling fast and efficient deployment, especially under…

Machine Learning · Computer Science 2026-02-03 Ahmad Sarlak , Abolfazl Razi

Determinantal point processes (DPPs) are popular probabilistic models of diversity. In this paper, we investigate DPPs from a new perspective: property testing of distributions. Given sample access to an unknown distribution $q$ over the…

Machine Learning · Computer Science 2020-08-11 Khashayar Gatmiry , Maryam Aliakbarpour , Stefanie Jegelka

We propose a novel diverse feature selection method based on determinantal point processes (DPPs). Our model enables one to flexibly define diversity based on the covariance of features (similar to orthogonal matching pursuit) or…

Machine Learning · Computer Science 2014-11-25 Nematollah Kayhan Batmanghelich , Gerald Quon , Alex Kulesza , Manolis Kellis , Polina Golland , Luke Bornn

Random restart of a given algorithm produces many partitions to yield a consensus clustering. Ensemble methods such as consensus clustering have been recognized as more robust approaches for data clustering than single clustering…

Machine Learning · Statistics 2021-02-09 Serge Vicente , Alejandro Murua

A determinantal point process (DPP) is a random process useful for modeling the combinatorial problem of subset selection. In particular, DPPs encourage a random subset Y to contain a diverse set of items selected from a base set Y. For…

Machine Learning · Computer Science 2012-10-19 Raja Hafiz Affandi , Alex Kulesza , Emily B. Fox

Determinantal point processes (DPPs) have received significant attention as an elegant probabilistic model for discrete subset selection. Most prior work on DPP learning focuses on maximum likelihood estimation (MLE). While efficient and…

Machine Learning · Computer Science 2020-11-20 Lucas Anquetil , Mike Gartrell , Alain Rakotomamonjy , Ugo Tanielian , Clément Calauzènes

In some practical learning tasks, such as traffic video analysis, the number of available training samples is restricted by different factors, such as limited communication bandwidth and computation power. Determinantal Point Process (DPP)…

Machine Learning · Computer Science 2023-08-17 Xiwen Chen , Huayu Li , Rahul Amin , Abolfazl Razi

Determinantal point processes (DPPs), which arise in random matrix theory and quantum physics, are natural models for subset selection problems where diversity is preferred. Among many remarkable properties, DPPs offer tractable algorithms…

Machine Learning · Computer Science 2012-02-20 Alex Kulesza , Ben Taskar

We present a determinantal point process (DPP) inspired alternative to non-maximum suppression (NMS) which has become an integral step in all state-of-the-art object detection frameworks. DPPs have been shown to encourage diversity in…

Computer Vision and Pattern Recognition · Computer Science 2024-06-21 Samik Some , Mithun Das Gupta , Vinay P. Namboodiri

Data collection and labeling is one of the main challenges in employing machine learning algorithms in a variety of real-world applications with limited data. While active learning methods attempt to tackle this issue by labeling only the…

Machine Learning · Computer Science 2019-06-20 Erdem Bıyık , Kenneth Wang , Nima Anari , Dorsa Sadigh

Driven by the need for parallelizable hyperparameter optimization methods, this paper studies \emph{open loop} search methods: sequences that are predetermined and can be generated before a single configuration is evaluated. Examples…

Machine Learning · Statistics 2019-05-10 Jesse Dodge , Kevin Jamieson , Noah A. Smith

Determinantal point processes (DPPs) have garnered attention as an elegant probabilistic model of set diversity. They are useful for a number of subset selection tasks, including product recommendation. DPPs are parametrized by a positive…

Machine Learning · Statistics 2016-02-18 Mike Gartrell , Ulrich Paquet , Noam Koenigstein

Dimensionality reduction is a first step of many machine learning pipelines. Two popular approaches are principal component analysis, which projects onto a small number of well chosen but non-interpretable directions, and feature selection,…

Machine Learning · Statistics 2018-12-27 Ayoub Belhadji , Rémi Bardenet , Pierre Chainais