English
Related papers

Related papers: Determinantal Point Process as an alternative to N…

200 papers

Determinantal point processes (DPPs), which arise in random matrix theory and quantum physics, are natural models for subset selection problems where diversity is preferred. Among many remarkable properties, DPPs offer tractable algorithms…

Machine Learning · Computer Science 2012-02-20 Alex Kulesza , Ben Taskar

Determinantal point processes (a.k.a. DPPs) have recently become popular tools for modeling the phenomenon of negative dependence, or repulsion, in data. However, our understanding of an analogue of a classical parametric statistical theory…

Machine Learning · Statistics 2021-11-22 Subhro Ghosh , Philippe Rigollet

Determinantal point processes (DPPs) have garnered attention as an elegant probabilistic model of set diversity. They are useful for a number of subset selection tasks, including product recommendation. DPPs are parametrized by a positive…

Machine Learning · Statistics 2016-02-18 Mike Gartrell , Ulrich Paquet , Noam Koenigstein

Given a fixed $n\times d$ matrix $\mathbf{X}$, where $n\gg d$, we study the complexity of sampling from a distribution over all subsets of rows where the probability of a subset is proportional to the squared volume of the parallelepiped…

Machine Learning · Computer Science 2019-02-25 Michał Dereziński

We propose discrete determinantal point processes (DPPs) for priors on the model parameter in Bayesian variable selection. By our variable selection method, collinear predictors are less likely to be selected simultaneously because of the…

Methodology · Statistics 2021-05-26 Mutsuki Kojima , Fumiyasu Komaki

Determinantal point processes (DPPs) are repulsive point processes where the interaction between points depends on the determinant of a positive-semi definite matrix. In this paper, we study the limiting process of L-ensembles based on…

Probability · Mathematics 2022-06-01 Simon Barthelmé , Nicolas Tremblay , Konstantin Usevich , Pierre-Olivier Amblard

A determinantal point process (DPP) is an ensemble of random nonnegative-integer-valued Radon measures, whose correlation functions are all given by determinants specified by an integral kernel called the correlation kernel. First we show…

Probability · Mathematics 2020-03-11 Makoto Katori

In this technical report, we discuss several sampling algorithms for Determinantal Point Processes (DPP). DPPs have recently gained a broad interest in the machine learning and statistics literature as random point processes with negative…

Computation · Statistics 2018-02-26 Nicolas Tremblay , Simon Barthelme , Pierre-Olivier Amblard

Determinantal point processes (DPPs) are well-suited for modeling repulsion and have proven useful in many applications where diversity is desired. While DPPs have many appealing properties, such as efficient sampling, learning the…

Machine Learning · Statistics 2014-02-21 Raja Hafiz Affandi , Emily B. Fox , Ryan P. Adams , Ben Taskar

Randomized Numerical Linear Algebra (RandNLA) uses randomness to develop improved algorithms for matrix problems that arise in scientific computing, data science, machine learning, etc. Determinantal Point Processes (DPPs), a seemingly…

Data Structures and Algorithms · Computer Science 2020-05-08 Michał Dereziński , Michael W. Mahoney

Determinantal Point Processes (DPPs) are probabilistic models that arise in quantum physics and random matrix theory and have recently found numerous applications in computer science. DPPs define distributions over subsets of a given ground…

Data Structures and Algorithms · Computer Science 2017-04-25 L. Elisa Celis , Amit Deshpande , Tarun Kathuria , Damian Straszak , Nisheeth K. Vishnoi

When faced with a data set too large to be processed all at once, an obvious solution is to retain only part of it. In practice this takes a wide variety of different forms, and among them "coresets" are especially appealing. A coreset is a…

Machine Learning · Statistics 2020-01-07 Nicolas Tremblay , Simon Barthelmé , Pierre-Olivier Amblard

Determinantal Point Processes (DPPs) have attracted significant interest from the machine-learning community due to their ability to elegantly and tractably model the delicate balance between quality and diversity of sets. DPPs are commonly…

Machine Learning · Computer Science 2019-02-27 Zelda Mariet , Mike Gartrell , Suvrit Sra

We study a mini-batch diversification scheme for stochastic gradient descent (SGD). While classical SGD relies on uniformly sampling data points to form a mini-batch, we propose a non-uniform sampling scheme based on the Determinantal Point…

Machine Learning · Computer Science 2017-09-12 Cheng Zhang , Hedvig Kjellstrom , Stephan Mandt

Symmetric determinantal point processes (DPP's) are a class of probabilistic models that encode the random selection of items that exhibit a repulsive behavior. They have attracted a lot of attention in machine learning, when returning…

Statistics Theory · Mathematics 2018-11-02 Victor-Emmanuel Brunel

We introduce Divnet, a flexible technique for learning networks with diverse neurons. Divnet models neuronal diversity by placing a Determinantal Point Process (DPP) over neurons in a given layer. It uses this DPP to select a subset of…

Machine Learning · Computer Science 2017-04-20 Zelda Mariet , Suvrit Sra

Discrete Determinantal Point Processes (DPPs) have a wide array of potential applications for subsampling datasets. They are however held back in some cases by the high cost of sampling. In the worst-case scenario, the sampling cost scales…

Machine Learning · Computer Science 2023-02-23 Simon Barthelmé , Nicolas Tremblay , Pierre-Olivier Amblard

Determinantal point processes (DPPs) have received significant attention as an elegant probabilistic model for discrete subset selection. Most prior work on DPP learning focuses on maximum likelihood estimation (MLE). While efficient and…

Machine Learning · Computer Science 2020-11-20 Lucas Anquetil , Mike Gartrell , Alain Rakotomamonjy , Ugo Tanielian , Clément Calauzènes

Beam search is a go-to strategy for decoding neural sequence models. The algorithm can naturally be viewed as a subset optimization problem, albeit one where the corresponding set function does not reflect interactions between candidates.…

Computation and Language · Computer Science 2023-06-26 Clara Meister , Martina Forster , Ryan Cotterell

Determinantal Point Processes (DPPs) were introduced by Macchi as a model for repulsive (fermionic) particle distributions. But their recent popularization is largely due to their usefulness for encouraging diversity in the final stage of a…

Numerical Analysis · Mathematics 2021-04-28 Jack Poulson