English
Related papers

Related papers: Towards Deterministic Diverse Subset Sampling

200 papers

Determinantal point processes (DPPs) have received significant attention as an elegant probabilistic model for discrete subset selection. Most prior work on DPP learning focuses on maximum likelihood estimation (MLE). While efficient and…

Machine Learning · Computer Science 2020-11-20 Lucas Anquetil , Mike Gartrell , Alain Rakotomamonjy , Ugo Tanielian , Clément Calauzènes

Beam search is a go-to strategy for decoding neural sequence models. The algorithm can naturally be viewed as a subset optimization problem, albeit one where the corresponding set function does not reflect interactions between candidates.…

Computation and Language · Computer Science 2023-06-26 Clara Meister , Martina Forster , Ryan Cotterell

Driven by the need for parallelizable hyperparameter optimization methods, this paper studies \emph{open loop} search methods: sequences that are predetermined and can be generated before a single configuration is evaluated. Examples…

Machine Learning · Statistics 2019-05-10 Jesse Dodge , Kevin Jamieson , Noah A. Smith

The Nystr\"om method has long been popular for scaling up kernel methods. Its theoretical guarantees and empirical performance rely critically on the quality of the landmarks selected. We study landmark selection for Nystr\"om using…

Machine Learning · Computer Science 2016-05-31 Chengtao Li , Stefanie Jegelka , Suvrit Sra

Understanding how subsets of items are chosen from offered sets is critical to assortment planning, wireless network planning, and many other applications. There are two seemingly unrelated subset choice models that capture dependencies…

Machine Learning · Computer Science 2023-02-23 Sander Aarts , David B. Shmoys , Alex Coy

Sequential recommendation is a popular task in academic research and close to real-world application scenarios, where the goal is to predict the next action(s) of the user based on his/her previous sequence of actions. In the training…

Information Retrieval · Computer Science 2022-04-26 Yuli Liu , Christian Walder , Lexing Xie

Symmetric determinantal point processes (DPP's) are a class of probabilistic models that encode the random selection of items that exhibit a repulsive behavior. They have attracted a lot of attention in machine learning, when returning…

Statistics Theory · Mathematics 2018-11-02 Victor-Emmanuel Brunel

Online feature selection has been an active research area in recent years. We propose a novel diverse online feature selection method based on Determinantal Point Processes (DPP). Our model aims to provide diverse features which can be…

Machine Learning · Statistics 2019-04-26 Chapman Siu , Richard Yi Da Xu

Often we consider machine learning models or statistical analysis methods which we endeavour to alter, by introducing a randomized mechanism, to make the model conform to a differential privacy constraint. However, certain models can often…

Machine Learning · Computer Science 2024-05-24 Jack Fitzsimons , Agustín Freitas Pasqualini , Robert Pisarczyk , Dmitrii Usynin

We study a mini-batch diversification scheme for stochastic gradient descent (SGD). While classical SGD relies on uniformly sampling data points to form a mini-batch, we propose a non-uniform sampling scheme based on the Determinantal Point…

Machine Learning · Computer Science 2017-09-12 Cheng Zhang , Hedvig Kjellstrom , Stephan Mandt

We review how to simulate continuous determinantal point processes (DPPs) and improve the current simulation algorithms in several important special cases as well as detail how certain types of conditional simulation can be carried out.…

Methodology · Statistics 2023-08-23 Frédéric Lavancier , Ege Rubak

We introduce Deep Sigma Point Processes, a class of parametric models inspired by the compositional structure of Deep Gaussian Processes (DGPs). Deep Sigma Point Processes (DSPPs) retain many of the attractive features of (variational)…

Machine Learning · Statistics 2020-12-29 Martin Jankowiak , Geoff Pleiss , Jacob R. Gardner

Determinantal point processes (DPPs) are repulsive point processes where the interaction between points depends on the determinant of a positive-semi definite matrix. In this paper, we study the limiting process of L-ensembles based on…

Probability · Mathematics 2022-06-01 Simon Barthelmé , Nicolas Tremblay , Konstantin Usevich , Pierre-Olivier Amblard

Selecting diverse and important items, called landmarks, from a large set is a problem of interest in machine learning. As a specific example, in order to deal with large training sets, kernel methods often rely on low rank matrix Nystr\"om…

Machine Learning · Computer Science 2021-12-10 Michaël Fanuel , Joachim Schreurs , Johan A. K. Suykens

Gaussian Process bandit optimization has emerged as a powerful tool for optimizing noisy black box functions. One example in machine learning is hyper-parameter optimization where each evaluation of the target function requires training a…

Machine Learning · Computer Science 2016-11-15 Tarun Kathuria , Amit Deshpande , Pushmeet Kohli

We present the conditional determinantal point process (DPP) approach to obtain new (mostly Fredholm determinantal) expressions for various eigenvalue statistics in random matrix theory. It is well-known that many (especially $\beta=2$)…

Mathematical Physics · Physics 2023-10-23 Alan Edelman , Sungwoo Jeong

In this paper, we introduce the online and streaming MAP inference and learning problems for Non-symmetric Determinantal Point Processes (NDPPs) where data points arrive in an arbitrary order and the algorithms are constrained to use a…

Machine Learning · Computer Science 2021-11-30 Aravind Reddy , Ryan A. Rossi , Zhao Song , Anup Rao , Tung Mai , Nedim Lipka , Gang Wu , Eunyee Koh , Nesreen Ahmed

Existing MAP inference algorithms for determinantal point processes (DPPs) need to calculate determinants or conduct eigenvalue decomposition generally at the scale of the full kernel, which presents a great challenge for real-world…

Machine Learning · Computer Science 2015-03-24 Jinye Zhang , Zhijian Ou

A determinantal point process (DPP) is an ensemble of random nonnegative-integer-valued Radon measures, whose correlation functions are all given by determinants specified by an integral kernel called the correlation kernel. First we show…

Probability · Mathematics 2020-03-11 Makoto Katori

We consider mixture models where location parameters are a priori encouraged to be well separated. We explore a class of determinantal point process (DPP) mixture models, which provide the desired notion of separation or repulsion. Instead…

Methodology · Statistics 2017-05-16 Ilaria Bianchini , Alessandra Guglielmi , Fernando A. Quintana