English
Related papers

Related papers: Rethinking deep active learning: Using unlabeled d…

200 papers

A central goal of unsupervised learning is to acquire representations from unlabeled data or experience that can be used for more effective learning of downstream tasks from modest amounts of labeled data. Many prior unsupervised learning…

Machine Learning · Computer Science 2019-03-25 Kyle Hsu , Sergey Levine , Chelsea Finn

Semi-supervised learning algorithms attempt to take advantage of relatively inexpensive unlabeled data to improve learning performance. In this work, we consider statistical models where the data distributions can be characterized by…

Machine Learning · Computer Science 2023-07-18 Jingge Zhu

Supervised learning deals with the inference of a distribution over an output or label space $\CY$ conditioned on points in an observation space $\CX$, given a training dataset $D$ of pairs in $\CX \times \CY$. However, in a lot of…

Machine Learning · Computer Science 2007-11-15 Christos Dimitrakakis , Christian Savu-Krohn

Deep Active Learning (DAL) has been advocated as a promising method to reduce labeling costs in supervised learning. However, existing evaluations of DAL methods are based on different settings, and their results are controversial. To…

Computer Vision and Pattern Recognition · Computer Science 2022-12-07 Yu Li , Muxi Chen , Yannan Liu , Daojing He , Qiang Xu

Semi-supervised learning (SSL) alleviates the cost of data labeling process by exploiting unlabeled data and has achieved promising results. Meanwhile, with the development of large foundation models, exploiting pre-trained models becomes a…

Machine Learning · Computer Science 2025-10-28 Song-Lin Lv , Rui Zhu , Tong Wei , Yu-Feng Li , Lan-Zhe Guo

Active learning aims to reduce labeling efforts by selectively asking humans to annotate the most important data points from an unlabeled pool and is an example of human-machine interaction. Though active learning has been extensively…

Machine Learning · Computer Science 2020-01-31 Hongjing Zhang , S. S. Ravi , Ian Davidson

Active learning is usually applied to acquire labels of informative data points in supervised learning, to maximize accuracy in a sample-efficient way. However, maximizing the accuracy is not the end goal when the results are used for…

Machine Learning · Statistics 2021-10-22 Louis Filstroff , Iiris Sundin , Petrus Mikkola , Aleksei Tiulpin , Juuso Kylmäoja , Samuel Kaski

Deep Neural Networks trained in a fully supervised fashion are the dominant technology in perception-based autonomous driving systems. While collecting large amounts of unlabeled data is already a major undertaking, only a subset of it can…

Computer Vision and Pattern Recognition · Computer Science 2020-04-10 Elmar Haussmann , Michele Fenzi , Kashyap Chitta , Jan Ivanecky , Hanson Xu , Donna Roy , Akshita Mittel , Nicolas Koumchatzky , Clement Farabet , Jose M. Alvarez

In the context of mobile sensing environments, various sensors on mobile devices continually generate a vast amount of data. Analyzing this ever-increasing data presents several challenges, including limited access to annotated data and a…

Machine Learning · Computer Science 2023-05-02 Jason Liu , Shohreh Deldari , Hao Xue , Van Nguyen , Flora D. Salim

We study the problem of reducing the amount of labeled training data required to train supervised classification models. We approach it by leveraging Active Learning, through sequential selection of examples which benefit the model most.…

Machine Learning · Computer Science 2019-01-18 Fedor Zhdanov

One paradigm for learning from few labeled examples while making best use of a large amount of unlabeled data is unsupervised pretraining followed by supervised fine-tuning. Although this paradigm uses unlabeled data in a task-agnostic way,…

Machine Learning · Computer Science 2020-10-27 Ting Chen , Simon Kornblith , Kevin Swersky , Mohammad Norouzi , Geoffrey Hinton

Wildlife camera trap images are being used extensively to investigate animal abundance, habitat associations, and behavior, which is complicated by the fact that experts must first classify the images manually. Artificial intelligence…

Computer Vision and Pattern Recognition · Computer Science 2023-08-03 Ludwig Bothmann , Lisa Wimmer , Omid Charrakh , Tobias Weber , Hendrik Edelhoff , Wibke Peters , Hien Nguyen , Caryl Benjamin , Annette Menzel

A growing specter in the rise of machine learning is whether the decisions made by machine learning models are fair. While research is already underway to formalize a machine-learning concept of fairness and to design frameworks for…

Machine Learning · Computer Science 2020-09-28 Tao Zhang , Tianqing Zhu , Jing Li , Mengde Han , Wanlei Zhou , Philip S. Yu

Deep learning is currently reaching outstanding performances on different tasks, including image classification, especially when using large neural networks. The success of these models is tributary to the availability of large collections…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 Mingyuan Jiu , Xuguang Song , Hichem Sahbi , Shupan Li , Yan Chen , Wei Guo , Lihua Guo , Mingliang Xu

In this paper we revisit the idea of pseudo-labeling in the context of semi-supervised learning where a learning algorithm has access to a small set of labeled samples and a large set of unlabeled samples. Pseudo-labeling works by applying…

Machine Learning · Computer Science 2020-12-11 Paola Cascante-Bonilla , Fuwen Tan , Yanjun Qi , Vicente Ordonez

With significant advances in deep learning, many computer vision applications have reached the inflection point. However, these deep learning models need large amount of labeled data for model training and optimum parameter estimation.…

Computer Vision and Pattern Recognition · Computer Science 2021-10-12 Aakash Varma Nadimpalli , Narsi Reddy , Sreeraj Ramachandran , Ajita Rattani

Active learning (AL) optimizes data labeling efficiency by selecting the most informative instances for annotation. A key component in this procedure is an acquisition function that guides the selection process and identifies the suitable…

Machine Learning · Computer Science 2024-10-08 Abdul Hameed Azeemi , Ihsan Ayyub Qazi , Agha Ali Raza

Recent semi-supervised learning methods have shown to achieve comparable results to their supervised counterparts while using only a small portion of labels in image classification tasks thanks to their regularization strategies. In this…

Machine Learning · Computer Science 2020-09-25 Wei-Hong Li , Chuan-Sheng Foo , Hakan Bilen

Existing algorithms aiming to learn a binary classifier from positive (P) and unlabeled (U) data generally require estimating the class prior or label noises ahead of building a classification model. However, the estimation and classifier…

Machine Learning · Computer Science 2020-09-01 Tianyu Li , Chien-Chih Wang , Yukun Ma , Patricia Ortal , Qifang Zhao , Bjorn Stenger , Yu Hirate

Hyperspectral imaging is a rich source of data, allowing for multitude of effective applications. However, such imaging remains challenging because of large data dimension and, typically, small pool of available training examples. While…

Neural and Evolutionary Computing · Computer Science 2020-10-23 Wojciech Masarczyk , Przemysław Głomb , Bartosz Grabowski , Mateusz Ostaszewski