English
Related papers

Related papers: Stream-based Active Learning with Verification Lat…

200 papers

Reinforcement learning (RL) has become the core post-training technique for large language models (LLMs). RL for LLMs involves two stages: generation and training. The LLM first generates samples online, which are then used to derive…

Active learning (AL) is a learning paradigm where an active learner has to train a model (e.g., a classifier) which is in principal trained in a supervised way, but in AL it has to be done by means of a data set with initially unlabeled…

Machine Learning · Computer Science 2015-12-23 Adrian Calma , Tobias Reitmaier , Bernhard Sick , Paul Lukowicz , Mark Embrechts

State-of-the-art machine learning models require access to significant amount of annotated data in order to achieve the desired level of performance. While unlabelled data can be largely available and even abundant, annotation process can…

Machine Learning · Computer Science 2020-10-15 Rahaf Aljundi , Nikolay Chumerin , Daniel Olmeda Reino

We study a robust alternative to empirical risk minimization called distributionally robust learning (DRL), in which one learns to perform against an adversary who can choose the data distribution from a specified set of distributions. We…

Machine Learning · Computer Science 2019-12-19 Charlie Frogner , Sebastian Claici , Edward Chien , Justin Solomon

Digital data collected over the decades and data currently being produced with use of information technology is vastly the unlabeled data or data without description. The unlabeled data is relatively easy to acquire but expensive to label…

Machine Learning · Computer Science 2022-08-02 Kinyua Gikunda

Temporal Action Localization (TAL) aims to predict both action category and temporal boundary of action instances in untrimmed videos, i.e., start and end time. Fully-supervised solutions are usually adopted in most existing works, and…

Computer Vision and Pattern Recognition · Computer Science 2022-12-02 Ding Li , Xuebing Yang , Yongqiang Tang , Chenyang Zhang , Wensheng Zhang

While deep learning is a powerful tool for natural language processing (NLP) problems, successful solutions to these problems rely heavily on large amounts of annotated samples. However, manually annotating data is expensive and…

Computation and Language · Computer Science 2021-04-06 Rishi Hazra , Parag Dutta , Shubham Gupta , Mohammed Abdul Qaathir , Ambedkar Dukkipati

Existing active learning (AL) strategies capture fundamentally different notions of data value, e.g., uncertainty or representativeness. Consequently, the effectiveness of strategies can vary substantially across datasets, models, and even…

Machine Learning · Computer Science 2026-03-27 Denis Huseljic , Marek Herde , Lukas Rauch , Paul Hahn , Bernhard Sick

This is the first work to investigate the effectiveness of BERT-based contextual embeddings in active learning (AL) tasks on cold-start scenarios, where traditional fine-tuning is infeasible due to the absence of labeled data. Our primary…

Machine Learning · Computer Science 2024-07-25 Fabiano Belém , Washington Cunha , Celso França , Claudio Andrade , Leonardo Rocha , Marcos André Gonçalves

Concept drift detection is a crucial task in data stream evolving environments. Most of state of the art approaches designed to tackle this problem monitor the loss of predictive models. However, this approach falls short in many real-world…

Machine Learning · Computer Science 2021-03-09 Vitor Cerqueira , Heitor Murilo Gomes , Albert Bifet , Luis Torgo

Active Learning (AL) and Semi-supervised Learning are two techniques that have been studied to reduce the high cost of deep learning by using a small amount of labeled data and a large amount of unlabeled data. To improve the accuracy of…

Computer Vision and Pattern Recognition · Computer Science 2023-03-17 Jaeseung Lim , Jongkeun Na , Nojun Kwak

Label concepts in multi-label data streams often experience drift in non-stationary environments, either independently or in relation to other labels. Transferring knowledge between related labels can accelerate adaptation, yet research on…

Machine Learning · Computer Science 2025-09-11 Honghui Du , Leandro Minku , Aonghus Lawlor , Huiyu Zhou

One important assumption underlying common classification models is the stationarity of the data. However, in real-world streaming applications, the data concept indicated by the joint distribution of feature and label is not stationary but…

Machine Learning · Computer Science 2018-08-10 Shujian Yu , Xiaoyang Wang , Jose C. Principe

Classifiers operating in a dynamic, real world environment, are vulnerable to adversarial activity, which causes the data distribution to change over time. These changes are traditionally referred to as concept drift, and several approaches…

Machine Learning · Computer Science 2018-03-28 Tegjyot Singh Sethi , Mehmed Kantardzic

In multi-domain learning (MDL) scenarios, high labeling effort is required due to the complexity of collecting data from various domains. Active Learning (AL) presents an encouraging solution to this issue by annotating a smaller number of…

Machine Learning · Computer Science 2023-06-21 Rui He , Zeyu Dai , Shan He , Ke Tang

Active learning (AL) is a machine learning algorithm that can achieve greater accuracy with fewer labeled training instances, for having the ability to ask oracles to label the most valuable unlabeled data chosen iteratively and…

Machine Learning · Computer Science 2022-09-30 Ruoyu Wang

Given a stream of entries over time in a multi-dimensional data setting where concept drift is present, how can we detect anomalous activities? Most of the existing unsupervised anomaly detection approaches seek to detect anomalous events…

Machine Learning · Computer Science 2022-03-07 Siddharth Bhatia , Arjit Jain , Shivin Srivastava , Kenji Kawaguchi , Bryan Hooi

Anomaly detection attempts at finding examples that deviate from the expected behaviour. Usually, anomaly detection is tackled from an unsupervised perspective because anomalous labels are rare and difficult to acquire. However, the lack of…

Machine Learning · Computer Science 2023-01-10 Lorenzo Perini , Daniele Giannuzzi , Jesse Davis

The standard supervised learning paradigm works effectively when training data shares the same distribution as the upcoming testing samples. However, this stationary assumption is often violated in real-world applications, especially when…

Machine Learning · Computer Science 2023-01-18 Yong Bai , Yu-Jie Zhang , Peng Zhao , Masashi Sugiyama , Zhi-Hua Zhou

Many methods have been proposed to detect concept drift, i.e., the change in the distribution of streaming data, due to concept drift causes a decrease in the prediction accuracy of algorithms. However, the most of current detection methods…

Artificial Intelligence · Computer Science 2021-05-05 Hang Yu , Tianyu Liu , Jie Lu , Guangquan Zhang