English
Related papers

Related papers: Batch Active Learning Using Determinantal Point Pr…

200 papers

Discriminative learning machines often need a large set of labeled samples for training. Active learning (AL) settings assume that the learner has the freedom to ask an oracle to label its desired samples. Traditional AL algorithms…

Machine Learning · Statistics 2018-05-24 Arash Mehrjou , Mehran Khodabandeh , Greg Mori

The Probability Hypothesis Density (PHD) filter, which is used for multi-target tracking based on sensor measurements, relies on the propagation of the first-order moment, or intensity function, of a point process. This algorithm assumes…

Probability · Mathematics 2020-12-11 Nicolas Privault , Timothy Teoh

The Determinantal Point Process (DPP) is a parameterized model for multivariate binary variables, characterized by a correlation kernel matrix. This paper proposes a closed form estimator of this kernel, which is particularly easy to…

Machine Learning · Statistics 2025-05-21 Christian Gouriéroux , Yang Lu

Active learning improves the performance of machine learning methods by judiciously selecting a limited number of unlabeled data points to query for labels, with the aim of maximally improving the underlying classifier's performance. Recent…

Machine Learning · Computer Science 2023-07-21 James Chapman , Bohan Chen , Zheng Tan , Jeff Calder , Kevin Miller , Andrea L. Bertozzi

We introduce BatchGFN -- a novel approach for pool-based active learning that uses generative flow networks to sample sets of data points proportional to a batch reward. With an appropriate reward function to quantify the utility of…

Machine Learning · Computer Science 2023-06-28 Shreshth A. Malik , Salem Lahlou , Andrew Jesson , Moksh Jain , Nikolay Malkin , Tristan Deleu , Yoshua Bengio , Yarin Gal

In this article, recent results about point processes are used in sampling theory. Precisely, we define and study a new class of sampling designs: determinantal sampling designs. The law of such designs is known, and there exists a simple…

Methodology · Statistics 2025-08-27 Vincent Loonis , Xavier Mary

Despite the availability of ever more data enabled through modern sensor and computer technology, it still remains an open problem to learn dynamical systems in a sample-efficient way. We propose active learning strategies that leverage…

Machine Learning · Computer Science 2020-12-08 Mona Buisson-Fenet , Friedrich Solowjow , Sebastian Trimpe

Emerged as one of the best performing techniques for extractive summarization, determinantal point processes select the most probable set of sentences to form a summary according to a probability measure defined by modeling sentence…

Computation and Language · Computer Science 2019-10-28 Sangwoo Cho , Chen Li , Dong Yu , Hassan Foroosh , Fei Liu

Discrete Determinantal Point Processes (DPPs) have a wide array of potential applications for subsampling datasets. They are however held back in some cases by the high cost of sampling. In the worst-case scenario, the sampling cost scales…

Machine Learning · Computer Science 2023-02-23 Simon Barthelmé , Nicolas Tremblay , Pierre-Olivier Amblard

We examine a simple stochastic strategy for adapting well-known single-point acquisition functions to allow batch active learning. Unlike acquiring the top-K points from the pool set, score- or rank-based sampling takes into account that…

Deep learning models in recommender systems are usually trained in the batch mode, namely iteratively trained on a fixed-size window of training data. Such batch mode training of deep learning models suffers from low training efficiency,…

Information Retrieval · Computer Science 2020-09-07 Yichao Wang , Huifeng Guo , Ruiming Tang , Zhirong Liu , Xiuqiang He

In the machine learning domain, active learning is an iterative data selection algorithm for maximizing information acquisition and improving model performance with limited training samples. It is very useful, especially for the industrial…

Machine Learning · Statistics 2020-04-24 Xiaowei Yue , Yuchen Wen , Jeffrey H. Hunt , Jianjun Shi

Active learning aims to reduce labeling efforts by selectively asking humans to annotate the most important data points from an unlabeled pool and is an example of human-machine interaction. Though active learning has been extensively…

Machine Learning · Computer Science 2020-01-31 Hongjing Zhang , S. S. Ravi , Ian Davidson

In supervised learning, we fit a single statistical model to a given data set, assuming that the data is associated with a singular task, which yields well-tuned models for specific use, but does not adapt well to new contexts. By contrast,…

Machine Learning · Computer Science 2020-09-11 Bingjia Wang , Alec Koppel , Vikram Krishnamurthy

While deep learning is a powerful tool for natural language processing (NLP) problems, successful solutions to these problems rely heavily on large amounts of annotated samples. However, manually annotating data is expensive and…

Computation and Language · Computer Science 2021-04-06 Rishi Hazra , Parag Dutta , Shubham Gupta , Mohammed Abdul Qaathir , Ambedkar Dukkipati

We study the problem of training machine learning models incrementally with batches of samples annotated with noisy oracles. We select each batch of samples that are important and also diverse via clustering and importance sampling. More…

Machine Learning · Computer Science 2020-10-30 Gaurav Gupta , Anit Kumar Sahu , Wan-Yi Lin

Multiple change point (MCP) detection in non-stationary time series is challenging due to the variety of underlying patterns. To address these challenges, we propose a novel algorithm that integrates Active Learning (AL) with Deep Gaussian…

Machine Learning · Computer Science 2025-05-28 Hao Zhao , Rong Pan

Discrete diffusion models are promising alternatives to autoregressive approaches for text generation, yet their decoding methods remain under-studied. Standard decoding methods for autoregressive models, such as beam search, do not…

Artificial Intelligence · Computer Science 2026-03-20 Jonathan Lys , Vincent Gripon , Bastien Pasdeloup , Axel Marmoret , Lukas Mauch , Fabien Cardinaux , Ghouthi Boukli Hacene

Recent years have witnessed amazing outcomes from "Big Models" trained by "Big Data". Most popular algorithms for model training are iterative. Due to the surging volumes of data, we can usually afford to process only a fraction of the…

Databases · Computer Science 2015-12-15 Jinyang Gao , H. V. Jagadish , Beng Chin Ooi

We introduce Divnet, a flexible technique for learning networks with diverse neurons. Divnet models neuronal diversity by placing a Determinantal Point Process (DPP) over neurons in a given layer. It uses this DPP to select a subset of…

Machine Learning · Computer Science 2017-04-20 Zelda Mariet , Suvrit Sra