English
Related papers

Related papers: Inference for determinantal point processes withou…

200 papers

Determinantal point processes (DPPs) have wide-ranging applications in machine learning, where they are used to enforce the notion of diversity in subset selection problems. Many estimators have been proposed, but surprisingly the basic…

Statistics Theory · Mathematics 2017-07-25 Victor-Emmanuel Brunel , Ankur Moitra , Philippe Rigollet , John Urschel

A determinantal point process (DPP) on a collection of $M$ items is a model, parameterized by a symmetric kernel matrix, that assigns a probability to every subset of those items. Recent work shows that removing the kernel symmetry…

Machine Learning · Computer Science 2022-04-21 Insu Han , Mike Gartrell , Jennifer Gillenwater , Elvis Dohmatob , Amin Karbasi

We study determinantal point processes (DPP) through the lens of algebraic statistics. We count the critical points of the log-likelihood function, and we compute them for small models, thereby disproving a conjecture of Brunel, Moitra,…

Statistics Theory · Mathematics 2024-01-17 Hannah Friedman , Bernd Sturmfels , Maksym Zubkov

Determinantal Point Processes (DPPs) were introduced by Macchi as a model for repulsive (fermionic) particle distributions. But their recent popularization is largely due to their usefulness for encouraging diversity in the final stage of a…

Numerical Analysis · Mathematics 2021-04-28 Jack Poulson

Informative data selection is a key requirement for large language models (LLMs) to minimize the amount of data required for fine-tuning, network distillation, and token pruning, enabling fast and efficient deployment, especially under…

Machine Learning · Computer Science 2026-02-03 Ahmad Sarlak , Abolfazl Razi

Given a fixed $n\times d$ matrix $\mathbf{X}$, where $n\gg d$, we study the complexity of sampling from a distribution over all subsets of rows where the probability of a subset is proportional to the squared volume of the parallelepiped…

Machine Learning · Computer Science 2019-02-25 Michał Dereziński

Semi-parametric regression models are used in several applications which require comprehensibility without sacrificing accuracy. Typical examples are spline interpolation in geophysics, or non-linear time series problems, where the system…

Machine Learning · Computer Science 2021-03-10 Michaël Fanuel , Joachim Schreurs , Johan A. K. Suykens

We consider mixture models where location parameters are a priori encouraged to be well separated. We explore a class of determinantal point process (DPP) mixture models, which provide the desired notion of separation or repulsion. Instead…

Methodology · Statistics 2017-05-16 Ilaria Bianchini , Alessandra Guglielmi , Fernando A. Quintana

Sequential recommendation is a popular task in academic research and close to real-world application scenarios, where the goal is to predict the next action(s) of the user based on his/her previous sequence of actions. In the training…

Information Retrieval · Computer Science 2022-04-26 Yuli Liu , Christian Walder , Lexing Xie

Symmetric determinantal point processes (DPP's) are a class of probabilistic models that encode the random selection of items that exhibit a repulsive behavior. They have attracted a lot of attention in machine learning, when returning…

Statistics Theory · Mathematics 2018-11-02 Victor-Emmanuel Brunel

Often we consider machine learning models or statistical analysis methods which we endeavour to alter, by introducing a randomized mechanism, to make the model conform to a differential privacy constraint. However, certain models can often…

Machine Learning · Computer Science 2024-05-24 Jack Fitzsimons , Agustín Freitas Pasqualini , Robert Pisarczyk , Dmitrii Usynin

Determinantal point processes (DPPs) are specific probability distributions over clouds of points that are used as models and computational tools across physics, probability, statistics, and more recently machine learning. Sampling from…

Machine Learning · Computer Science 2022-03-22 Guillaume Gautier , Guillermo Polito , Rémi Bardenet , Michal Valko

By using the framework of Determinantal Point Processes (DPPs), some theoretical results concerning the interplay between diversity and regularization can be obtained. In this paper we show that sampling subsets with kDPPs results in…

Machine Learning · Computer Science 2021-07-22 Joachim Schreurs , Michaël Fanuel , Johan A. K. Suykens

Determinantal Point Processes (DPPs) are elegant probabilistic models of repulsion and diversity over discrete sets of items. But their applicability to large sets is hindered by expensive cubic-complexity matrix operations for basic tasks…

Machine Learning · Computer Science 2016-05-31 Chengtao Li , Stefanie Jegelka , Suvrit Sra

We give a probabilistic introduction to determinantal and permanental point processes. Determinantal processes arise in physics (fermions, eigenvalues of random matrices) and in combinatorics (nonintersecting paths, random spanning trees).…

Probability · Mathematics 2016-08-16 J. Ben Hough , Manjunath Krishnapur , Yuval Peres , Bálint Virág

We study quadrature rules for functions from an RKHS, using nodes sampled from a determinantal point process (DPP). DPPs are parametrized by a kernel, and we use a truncated and saturated version of the RKHS kernel. This link between the…

Machine Learning · Statistics 2020-01-03 Ayoub Belhadji , Rémi Bardenet , Pierre Chainais

When faced with a data set too large to be processed all at once, an obvious solution is to retain only part of it. In practice this takes a wide variety of different forms, and among them "coresets" are especially appealing. A coreset is a…

Machine Learning · Statistics 2020-01-07 Nicolas Tremblay , Simon Barthelmé , Pierre-Olivier Amblard

We consider determinantal point processes on the $d$-dimensional unit sphere $\mathbb S^d$. These are finite point processes exhibiting repulsiveness and with moment properties determined by a certain determinant whose entries are specified…

Methodology · Statistics 2016-07-14 Jesper Møller , Morten Nielsen , Emilio Porcu , Ege Rubak

We propose discrete determinantal point processes (DPPs) for priors on the model parameter in Bayesian variable selection. By our variable selection method, collinear predictors are less likely to be selected simultaneously because of the…

Methodology · Statistics 2021-05-26 Mutsuki Kojima , Fumiyasu Komaki

Determinantal point processes (DPPs) have emerged as a kernelized alternative to vanilla independent sampling for generating efficient minibatches, coresets and other parsimonious representations of large-scale datasets. While theoretical…

Machine Learning · Statistics 2026-05-14 Hoang-Son Tran , Pranav Gupta , Rémi Bardenet , Subhroshekhar Ghosh