English
Related papers

Related papers: Batch Active Learning Using Determinantal Point Pr…

200 papers

Leveraging the wealth of unlabeled data produced in recent years provides great potential for improving supervised models. When the cost of acquiring labels is high, probabilistic active learning methods can be used to greedily select the…

Machine Learning · Statistics 2021-02-09 Robert Pinsler , Jonathan Gordon , Eric Nalisnick , José Miguel Hernández-Lobato

We propose discrete determinantal point processes (DPPs) for priors on the model parameter in Bayesian variable selection. By our variable selection method, collinear predictors are less likely to be selected simultaneously because of the…

Methodology · Statistics 2021-05-26 Mutsuki Kojima , Fumiyasu Komaki

We investigate the use of derivative information for Batch Active Learning in Gaussian Process regression models. The proposed approach employs the predictive covariance matrix for selection of data batches to exploit full correlation of…

Machine Learning · Computer Science 2024-08-06 Hon Sum Alec Yu , Christoph Zimmer , Duy Nguyen-Tuong

Sequential recommendation is a popular task in academic research and close to real-world application scenarios, where the goal is to predict the next action(s) of the user based on his/her previous sequence of actions. In the training…

Information Retrieval · Computer Science 2022-04-26 Yuli Liu , Christian Walder , Lexing Xie

One of the long-standing challenges in Artificial Intelligence for learning goal-directed behavior is to build a single agent which can solve multiple tasks. Recent progress in multi-task learning for goal-directed sequential problems has…

Neural and Evolutionary Computing · Computer Science 2017-05-23 Sahil Sharma , Ashutosh Jha , Parikshit Hegde , Balaraman Ravindran

The convergence speed of stochastic gradient descent (SGD) can be improved by actively selecting mini-batches. We explore sampling schemes where similar data points are less likely to be selected in the same mini-batch. In particular, we…

Machine Learning · Statistics 2018-06-21 Cheng Zhang , Cengiz Öztireli , Stephan Mandt , Giampiero Salvi

Active learning shows promise to decrease test bench time for model-based drivability calibration. This paper presents a new strategy for active output selection, which suits the needs of calibration tasks. The strategy is actively learning…

Machine Learning · Computer Science 2021-02-24 Adrian Prochaska , Julien Pillas , Bernard Bäker

Statistical models and methods for determinantal point processes (DPPs) seem largely unexplored. We demonstrate that DPPs provide useful models for the description of spatial point pattern datasets where nearby points repel each other. Such…

Statistics Theory · Mathematics 2016-04-28 Frédéric Lavancier , Jesper Møller , Ege Rubak

Determinantal point processes (DPPs) are popular probabilistic models that arise in many machine learning tasks, where distributions of diverse sets are characterized by matrix determinants. In this paper, we develop fast algorithms to find…

Discrete Mathematics · Computer Science 2017-06-15 Insu Han , Prabhanjan Kambadur , Kyoungsoo Park , Jinwoo Shin

When we can not assume a large amount of annotated data , active learning is a good strategy. It consists in learning a model on a small amount of annotated data (annotation budget) and in choosing the best set of points to annotate in…

Computer Vision and Pattern Recognition · Computer Science 2022-01-19 Umang Aggarwal , Adrian Popescu , Céline Hudelot

Randomized Numerical Linear Algebra (RandNLA) uses randomness to develop improved algorithms for matrix problems that arise in scientific computing, data science, machine learning, etc. Determinantal Point Processes (DPPs), a seemingly…

Data Structures and Algorithms · Computer Science 2020-05-08 Michał Dereziński , Michael W. Mahoney

Determinantal point processes (DPPs) have attracted significant attention in machine learning for their ability to model subsets drawn from a large item collection. Recent work shows that nonsymmetric DPP (NDPP) kernels have significant…

Machine Learning · Computer Science 2021-04-14 Mike Gartrell , Insu Han , Elvis Dohmatob , Jennifer Gillenwater , Victor-Emmanuel Brunel

Determinantal point processes (DPPs) are repulsive point processes where the interaction between points depends on the determinant of a positive-semi definite matrix. The contributions of this paper are two-fold. First of all, we introduce…

Probability · Mathematics 2022-06-01 Simon Barthelmé , Nicolas Tremblay , Konstantin Usevich , Pierre-Olivier Amblard

Centralized training with decentralized execution has become an important paradigm in multi-agent learning. Though practical, current methods rely on restrictive assumptions to decompose the centralized value function across agents for…

Machine Learning · Computer Science 2020-06-11 Yaodong Yang , Ying Wen , Liheng Chen , Jun Wang , Kun Shao , David Mguni , Weinan Zhang

Determinantal point processes (DPPs) have received significant attention as an elegant probabilistic model for discrete subset selection. Most prior work on DPP learning focuses on maximum likelihood estimation (MLE). While efficient and…

Machine Learning · Computer Science 2020-11-20 Lucas Anquetil , Mike Gartrell , Alain Rakotomamonjy , Ugo Tanielian , Clément Calauzènes

Active learning aims to identify the most informative data from an unlabeled data pool that enables a model to reach the desired accuracy rapidly. This benefits especially deep neural networks which generally require a huge number of…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Jihyo Kim , Jeonghyeon Kim , Sangheum Hwang

Active learning aims to reduce the high labeling cost involved in training machine learning models on large datasets by efficiently labeling only the most informative samples. Recently, deep active learning has shown success on various…

Computer Vision and Pattern Recognition · Computer Science 2019-12-12 Sudhanshu Mittal , Maxim Tatarchenko , Özgün Çiçek , Thomas Brox

Determinantal point processes (DPPs) are popular probabilistic models of diversity. In this paper, we investigate DPPs from a new perspective: property testing of distributions. Given sample access to an unknown distribution $q$ over the…

Machine Learning · Computer Science 2020-08-11 Khashayar Gatmiry , Maryam Aliakbarpour , Stefanie Jegelka

Active metric learning is the problem of incrementally selecting high-utility batches of training data (typically, ordered triplets) to annotate, in order to progressively improve a learned model of a metric over some input domain as…

Machine Learning · Computer Science 2021-08-03 Priyadarshini K , Siddhartha Chaudhuri , Vivek Borkar , Subhasis Chaudhuri

The most important obstacles facing multi-document summarization include excessive redundancy in source descriptions and the looming shortage of training data. These obstacles prevent encoder-decoder models from being used directly, but…

Computation and Language · Computer Science 2019-06-04 Sangwoo Cho , Logan Lebanoff , Hassan Foroosh , Fei Liu