English
Related papers

Related papers: ALICE: Active Learning with Contrastive Natural La…

200 papers

Large amounts of annotated data have become more important than ever, especially since the rise of deep learning techniques. However, manual annotations are costly. We propose a tool that enables researchers to create large, high-quality,…

Digital Libraries · Computer Science 2021-12-23 Franziska Weeber , Felix Hamborg , Karsten Donnay , Bela Gipp

Active learning (AL) reduces human annotation costs for machine learning systems by strategically selecting the most informative unlabeled data for annotation, but performing it individually may still be insufficient due to restricted data…

Machine Learning · Computer Science 2025-04-25 Jun Zhang , Jue Wang , Huan Li , Zhongle Xie , Ke Chen , Lidan Shou

Contrastive Learning (CL) has achieved impressive performance in self-supervised learning tasks, showing superior generalization ability. Inspired by the success, adopting CL into collaborative filtering (CF) is prevailing in…

Information Retrieval · Computer Science 2023-10-31 An Zhang , Leheng Sheng , Zhibo Cai , Xiang Wang , Tat-Seng Chua

Annotating data is a time-consuming and costly task, but it is inherently required for supervised machine learning. Active Learning (AL) is an established method that minimizes human labeling effort by iteratively selecting the most…

Machine Learning · Computer Science 2025-06-05 Julius Gonsior , Tim Rieß , Anja Reusch , Claudio Hartmann , Maik Thiele , Wolfgang Lehner

In the world of big data, large but costly to label datasets dominate many fields. Active learning, a semi-supervised alternative to the standard PAC-learning model, was introduced to explore whether adaptive labeling could learn concepts…

Machine Learning · Computer Science 2020-06-02 Max Hopkins , Daniel M. Kane , Shachar Lovett

Neural image classifiers can often learn to make predictions by overly relying on non-predictive features that are spuriously correlated with the class labels in the training data. This leads to poor performance in real-world atypical…

Computer Vision and Pattern Recognition · Computer Science 2024-06-10 Sreyan Ghosh , Chandra Kiran Reddy Evuru , Sonal Kumar , Utkarsh Tyagi , Sakshi Singh , Sanjoy Chowdhury , Dinesh Manocha

Active learning (AL) combines data labeling and model training to minimize the labeling cost by prioritizing the selection of high value data that can best improve model performance. In pool-based active learning, accessible unlabeled data…

Machine Learning · Computer Science 2020-07-21 Mingfei Gao , Zizhao Zhang , Guo Yu , Sercan O. Arik , Larry S. Davis , Tomas Pfister

Deep active learning has emerged as a powerful tool for training deep learning models within a predefined labeling budget. These models have achieved performances comparable to those trained in an offline setting. However, deep active…

Machine Learning · Computer Science 2023-09-21 Moseli Mots'oehli , Kyungim Baek

Learning representations unaffected by superficial characteristics is important to ensure that shifts in these characteristics at test time do not compromise downstream prediction performance. For instance, in healthcare applications, we…

Machine Learning · Computer Science 2025-07-28 Minghui Sun , Benjamin A. Goldstein , Matthew M. Engelhard

Active learning (AL) algorithms aim to identify an optimal subset of data for annotation, such that deep neural networks (DNN) can achieve better performance when trained on this labeled subset. AL is especially impactful in industrial…

Computer Vision and Pattern Recognition · Computer Science 2021-11-29 Zeyad Ali Sami Emam , Hong-Min Chu , Ping-Yeh Chiang , Wojciech Czaja , Richard Leapman , Micah Goldblum , Tom Goldstein

Acquiring new knowledge without forgetting what has been learned in a sequence of tasks is the central focus of continual learning (CL). While tasks arrive sequentially, the training data are often prepared and annotated independently,…

Machine Learning · Computer Science 2024-01-31 Thuy-Trang Vu , Shahram Khadivi , Mahsa Ghorbanali , Dinh Phung , Gholamreza Haffari

In real-world data labeling applications, annotators often provide imperfect labels. It is thus common to employ multiple annotators to label data with some overlap between their examples. We study active learning in such settings, aiming…

Machine Learning · Computer Science 2024-07-29 Hui Wen Goh , Jonas Mueller

Natural language inference (NLI) is an increasingly important task for natural language understanding, which requires one to infer the relationship between the sentence pair (premise and hypothesis). Many recent works have used contrastive…

Computation and Language · Computer Science 2022-05-02 Shu'ang Li , Xuming Hu , Li Lin , Lijie Wen

Despite significant progress in continual learning ranging from architectural novelty to clever strategies for mitigating catastrophic forgetting most existing methods rest on a strong but unrealistic assumption the availability of labeled…

Machine Learning · Computer Science 2025-11-25 Hari Chandana Kuchibhotla , K S Ananth , Vineeth N Balasubramanian

We present EASE, a novel method for learning sentence embeddings via contrastive learning between sentences and their related entities. The advantage of using entity supervision is twofold: (1) entities have been shown to be a strong…

Computation and Language · Computer Science 2022-05-10 Sosuke Nishikawa , Ryokan Ri , Ikuya Yamada , Yoshimasa Tsuruoka , Isao Echizen

Semantic segmentation requires pixel-level annotation, which is time-consuming. Active Learning (AL) is a promising method for reducing data annotation costs. Due to the gap between aerial and natural images, the previous AL methods are not…

Computer Vision and Pattern Recognition · Computer Science 2024-05-29 Lianlei Shan , Weiqiang Wang , Ke Lv , Bin Luo

In this paper, we discuss a different type of semi-supervised setting: a coarse level of labeling is available for all observations but the model has to learn a fine level of latent annotation for each one of them. Problems in this setting…

Machine Learning · Computer Science 2017-08-10 Ozsel Kilinc , Ismail Uysal

Contrastive self-supervised learning methods famously produce high quality transferable representations by learning invariances to different data augmentations. Invariances established during pre-training can be interpreted as strong…

Computer Vision and Pattern Recognition · Computer Science 2023-04-05 Ruchika Chavhan , Henry Gouk , Jan Stuehmer , Calum Heggan , Mehrdad Yaghoobi , Timothy Hospedales

Advancements in deep learning techniques have given a boost to the performance of anomaly detection. However, real-world and safety-critical applications demand a level of transparency and reasoning beyond accuracy. The task of anomaly…

Machine Learning · Computer Science 2023-11-03 Laya Rafiee Sevyeri , Ivaxi Sheth , Farhood Farahnak , Samira Ebrahimi Kahou , Shirin Abbasinejad Enger

Labeling a large set of data is expensive. Active learning aims to tackle this problem by asking to annotate only the most informative data from the unlabeled set. We propose a novel active learning approach that utilizes self-supervised…

Computer Vision and Pattern Recognition · Computer Science 2022-07-27 John Seon Keun Yi , Minseok Seo , Jongchan Park , Dong-Geol Choi