English
Related papers

Related papers: Learning Determinantal Point Processes in Sublinea…

200 papers

Given a fixed $n\times d$ matrix $\mathbf{X}$, where $n\gg d$, we study the complexity of sampling from a distribution over all subsets of rows where the probability of a subset is proportional to the squared volume of the parallelepiped…

Machine Learning · Computer Science 2019-02-25 Michał Dereziński

We propose discrete determinantal point processes (DPPs) for priors on the model parameter in Bayesian variable selection. By our variable selection method, collinear predictors are less likely to be selected simultaneously because of the…

Methodology · Statistics 2021-05-26 Mutsuki Kojima , Fumiyasu Komaki

Determinantal point processes (DPPs) are popular probabilistic models of diversity. In this paper, we investigate DPPs from a new perspective: property testing of distributions. Given sample access to an unknown distribution $q$ over the…

Machine Learning · Computer Science 2020-08-11 Khashayar Gatmiry , Maryam Aliakbarpour , Stefanie Jegelka

In this technical report, we discuss several sampling algorithms for Determinantal Point Processes (DPP). DPPs have recently gained a broad interest in the machine learning and statistics literature as random point processes with negative…

Computation · Statistics 2018-02-26 Nicolas Tremblay , Simon Barthelme , Pierre-Olivier Amblard

Randomized Numerical Linear Algebra (RandNLA) uses randomness to develop improved algorithms for matrix problems that arise in scientific computing, data science, machine learning, etc. Determinantal Point Processes (DPPs), a seemingly…

Data Structures and Algorithms · Computer Science 2020-05-08 Michał Dereziński , Michael W. Mahoney

Determinantal point processes (DPPs) are repulsive point processes where the interaction between points depends on the determinant of a positive-semi definite matrix. The contributions of this paper are two-fold. First of all, we introduce…

Probability · Mathematics 2022-06-01 Simon Barthelmé , Nicolas Tremblay , Konstantin Usevich , Pierre-Olivier Amblard

Determinantal point processes (DPPs) are repulsive point processes where the interaction between points depends on the determinant of a positive-semi definite matrix. In this paper, we study the limiting process of L-ensembles based on…

Probability · Mathematics 2022-06-01 Simon Barthelmé , Nicolas Tremblay , Konstantin Usevich , Pierre-Olivier Amblard

Informative data selection is a key requirement for large language models (LLMs) to minimize the amount of data required for fine-tuning, network distillation, and token pruning, enabling fast and efficient deployment, especially under…

Machine Learning · Computer Science 2026-02-03 Ahmad Sarlak , Abolfazl Razi

Determinantal Point Processes (DPPs) are probabilistic models that arise in quantum physics and random matrix theory and have recently found numerous applications in computer science. DPPs define distributions over subsets of a given ground…

Data Structures and Algorithms · Computer Science 2017-04-25 L. Elisa Celis , Amit Deshpande , Tarun Kathuria , Damian Straszak , Nisheeth K. Vishnoi

In-context learning (ICL) is a few-shot learning paradigm that involves learning mappings through input-output pairs and appropriately applying them to new instances. Despite the remarkable ICL capabilities demonstrated by Large Language…

Computation and Language · Computer Science 2024-08-06 Peng Wang , Xiaobin Wang , Chao Lou , Shengyu Mao , Pengjun Xie , Yong Jiang

Dimensionality reduction is a first step of many machine learning pipelines. Two popular approaches are principal component analysis, which projects onto a small number of well chosen but non-interpretable directions, and feature selection,…

Machine Learning · Statistics 2018-12-27 Ayoub Belhadji , Rémi Bardenet , Pierre Chainais

Sequential recommendation is a popular task in academic research and close to real-world application scenarios, where the goal is to predict the next action(s) of the user based on his/her previous sequence of actions. In the training…

Information Retrieval · Computer Science 2022-04-26 Yuli Liu , Christian Walder , Lexing Xie

Determinantal Point Process (DPPs) are statistical models for repulsive point patterns. Both sampling and inference are tractable for DPPs, a rare feature among models with negative dependence that explains their popularity in machine…

Machine Learning · Computer Science 2021-11-30 Michaël Fanuel , Rémi Bardenet

Determinantal point processes (DPPs) are probabilistic models for repulsion. When used to represent the occurrence of random subsets of a finite base set, DPPs allow to model global negative associations in a mathematically elegant and…

Statistics Theory · Mathematics 2019-01-29 Kayvan Sadeghi , Alessandro Rinaldo

Determinantal point processes (DPPs) are specific probability distributions over clouds of points that are used as models and computational tools across physics, probability, statistics, and more recently machine learning. Sampling from…

Machine Learning · Computer Science 2022-03-22 Guillaume Gautier , Guillermo Polito , Rémi Bardenet , Michal Valko

Determinantal point processes (DPPs) have become a significant tool for recommendation systems, feature selection, or summary extraction, harnessing the intrinsic ability of these probabilistic models to facilitate sample diversity. The…

Machine Learning · Statistics 2020-07-09 Rémi Bardenet , Subhroshekhar Ghosh

Determinantal point processes (a.k.a. DPPs) have recently become popular tools for modeling the phenomenon of negative dependence, or repulsion, in data. However, our understanding of an analogue of a classical parametric statistical theory…

Machine Learning · Statistics 2021-11-22 Subhro Ghosh , Philippe Rigollet

Determinantal Point Processes (DPPs) have attracted significant interest from the machine-learning community due to their ability to elegantly and tractably model the delicate balance between quality and diversity of sets. DPPs are commonly…

Machine Learning · Computer Science 2019-02-27 Zelda Mariet , Mike Gartrell , Suvrit Sra

Determinantal Point Processes (DPPs) are popular models for point processes with repulsion. They appear in numerous contexts, from physics to graph theory, and display appealing theoretical properties. On the more practical side of things,…

Statistics Theory · Mathematics 2018-08-22 Simon Barthelmé , Pierre-Olivier Amblard , Nicolas Tremblay

We review how to simulate continuous determinantal point processes (DPPs) and improve the current simulation algorithms in several important special cases as well as detail how certain types of conditional simulation can be carried out.…

Methodology · Statistics 2023-08-23 Frédéric Lavancier , Ege Rubak