English
Related papers

Related papers: Streaming Active Learning with Deep Neural Network…

200 papers

Active learning aims to identify the most informative data from an unlabeled data pool that enables a model to reach the desired accuracy rapidly. This benefits especially deep neural networks which generally require a huge number of…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Jihyo Kim , Jeonghyeon Kim , Sangheum Hwang

Re-training a deep learning model each time a single data point receives a new label is impractical due to the inherent complexity of the training process. Consequently, existing active learning (AL) algorithms tend to adopt a batch-based…

Machine Learning · Computer Science 2023-12-19 Yunpyo An , Suyeong Park , Kwang In Kim

Recently, large-scale language-image generative models have gained widespread attention and many works have utilized generated data from these models to further enhance the performance of perception tasks. However, not all generated data…

Computer Vision and Pattern Recognition · Computer Science 2024-06-05 Muzhi Zhu , Chengxiang Fan , Hao Chen , Yang Liu , Weian Mao , Xiaogang Xu , Chunhua Shen

This paper is concerned with pool-based active learning for deep neural networks. Motivated by coreset dataset compression ideas, we present a novel active learning algorithm that queries consecutive points from the pool using…

Machine Learning · Computer Science 2017-11-06 Yonatan Geifman , Ran El-Yaniv

Active learning (AL) aims to enable training high performance classifiers with low annotation cost by predicting which subset of unlabelled instances would be most beneficial to label. The importance of AL has motivated extensive research,…

Machine Learning · Computer Science 2018-06-14 Kunkun Pang , Mingzhi Dong , Yang Wu , Timothy Hospedales

A major problem with Active Learning (AL) is high training costs since models are typically retrained from scratch after every query round. We start by demonstrating that standard AL on neural networks with warm starting fails, both to…

Machine Learning · Computer Science 2023-12-14 Arnav Das , Gantavya Bhatt , Megh Bhalerao , Vianne Gao , Rui Yang , Jeff Bilmes

The cost of drawing object bounding boxes (i.e. labeling) for millions of images is prohibitively high. For instance, labeling pedestrians in a regular urban image could take 35 seconds on average. Active learning aims to reduce the cost of…

Computer Vision and Pattern Recognition · Computer Science 2019-11-22 Hamed H. Aghdam , Abel Gonzalez-Garcia , Joost van de Weijer , Antonio M. López

The ability to dynamically adapt neural networks to newly-available data without performance deterioration would revolutionize deep learning applications. Streaming learning (i.e., learning from one data example at a time) has the potential…

Machine Learning · Computer Science 2022-11-10 Cameron R. Wolfe , Anastasios Kyrillidis

Active learning enables efficient model training by leveraging interactions between machine learning agents and human annotators. We study and propose a novel framework that formulates batch active learning from the sparse approximation's…

Machine Learning · Computer Science 2022-11-08 Maohao Shen , Bowen Jiang , Jacky Yibo Zhang , Oluwasanmi Koyejo

Active learning is able to reduce the amount of labelling effort by using a machine learning model to query the user for specific inputs. While there are many papers on new active learning techniques, these techniques rarely satisfy the…

Machine Learning · Computer Science 2020-06-18 Parmida Atighehchian , Frédéric Branchaud-Charron , Alexandre Lacoste

Active Learning methods create an optimized labeled training set from unlabeled data. We introduce a novel Online Active Deep Learning method for Medical Image Analysis. We extend our MedAL active learning framework to present new results…

We propose Disentanglement based Active Learning (DAL), a new active learning technique based on self-supervision which leverages the concept of disentanglement. Instead of requesting labels from human oracle, our method automatically…

Machine Learning · Computer Science 2021-09-28 Silpa Vadakkeeveetil Sreelatha , Adarsh Kappiyath , Sumitra S

We investigate active learning in the context of deep neural network models for change detection and map updating. Active learning is a natural choice for a number of remote sensing tasks, including the detection of local surface changes:…

Computer Vision and Pattern Recognition · Computer Science 2020-08-26 Vít Růžička , Stefano D'Aronco , Jan Dirk Wegner , Konrad Schindler

One of the challenges in deploying a machine learning model is that the model's performance degrades as the operating environment changes. To maintain the performance, streaming active learning is used, in which the model is retrained by…

Machine Learning · Computer Science 2023-12-18 Shota Horiguchi , Kota Dohi , Yohei Kawaguchi

Motivated by the growing amount of publicly available video data on online streaming services and an increased interest in applications that analyze continuous video streams such as autonomous driving, this technical report provides a…

Computer Vision and Pattern Recognition · Computer Science 2021-01-11 Becky Mashaido

Over the past decade, deep neural networks have demonstrated significant success using the training scheme that involves mini-batch stochastic gradient descent on extensive datasets. Expanding upon this accomplishment, there has been a…

Machine Learning · Computer Science 2024-11-11 Jaehyeon Son , Soochan Lee , Gunhee Kim

The workhorse of machine learning is stochastic gradient descent. To access stochastic gradients, it is common to consider iteratively input/output pairs of a training dataset. Interestingly, it appears that one does not need full…

Machine Learning · Computer Science 2022-12-08 Vivien Cabannes , Francis Bach , Vianney Perchet , Alessandro Rudi

Active learning selects the most informative samples to exploit limited annotation budgets. Existing work follows a cumbersome pipeline that repeats the time-consuming model training and batch data selection multiple times. In this paper,…

Computer Vision and Pattern Recognition · Computer Science 2022-03-22 Yichen Xie , Masayoshi Tomizuka , Wei Zhan

The proliferation of automated data collection schemes and the advances in sensorics are increasing the amount of data we are able to monitor in real-time. However, given the high annotation costs and the time required by quality…

Machine Learning · Statistics 2023-07-17 Davide Cacciarelli , Murat Kulahci , John Sølve Tyssedal

One of the major challenges in training deep architectures for predictive tasks is the scarcity and cost of labeled training data. Active Learning (AL) is one way of addressing this challenge. In stream-based AL, observations are…

Machine Learning · Computer Science 2019-09-05 Andreas Kvistad , Massimiliano Ruocco , Eliezer de Souza da Silva , Erlend Aune