English
Related papers

Related papers: Human-in-the-loop: Towards Label Embeddings for Me…

200 papers

Safe artificial intelligence for perception tasks remains a major challenge, partly due to the lack of data with high-quality labels. Annotations themselves are subject to aleatoric and epistemic uncertainty, which is typically ignored…

Machine Learning · Computer Science 2026-02-05 Jonathan Klees , Tobias Riedlinger , Peter Stehr , Bennet Böddecker , Daniel Kondermann , Matthias Rottmann

In microscopy image cell segmentation, it is common to train a deep neural network on source data, containing different types of microscopy images, and then fine-tune it using a support set comprising a few randomly selected and annotated…

Computer Vision and Pattern Recognition · Computer Science 2022-11-21 Youssef Dawoud , Arij Bouazizi , Katharina Ernst , Gustavo Carneiro , Vasileios Belagiannis

Prediction using the ground truth sounds like an oxymoron in machine learning. However, such an unrealistic setting was used in hundreds, if not thousands of papers in the area of finding graph representations. To evaluate the multi-label…

Machine Learning · Computer Science 2021-12-14 Li-Chung Lin , Cheng-Hung Liu , Chih-Ming Chen , Kai-Chin Hsu , I-Feng Wu , Ming-Feng Tsai , Chih-Jen Lin

Neural models for the various flavours of morphological inflection tasks have proven to be extremely accurate given ample labeled data -- data that may be slow and costly to obtain. In this work we aim to overcome this annotation bottleneck…

Computation and Language · Computer Science 2021-10-13 Omer Goldman , Reut Tsarfaty

Ranking a set of objects involves establishing an order allowing for comparisons between any pair of objects in the set. Oftentimes, due to the unavailability of a ground truth of ranked orders, researchers resort to obtaining judgments…

Machine Learning · Statistics 2016-12-19 Rahul Gupta , Shrikanth Narayanan

Multi-class classification annotations have significantly advanced AI applications, with truth inference serving as a critical technique for aggregating noisy and biased annotations. Existing state-of-the-art methods typically model each…

Machine Learning · Computer Science 2025-08-05 Ju Chen , Jun Feng , Shenyu Zhang

Supervised fine-tuning of large language models relies on human-annotated data, yet annotation pipelines routinely involve multiple crowdworkers of heterogeneous expertise. Standard practice aggregates labels via majority vote or simple…

Machine Learning · Computer Science 2026-04-21 Sajjad Ghiasvand , Mark Beliaev , Mahnoosh Alizadeh , Ramtin Pedarsani

Noisy labels can significantly affect the performance of deep neural networks (DNNs). In medical image segmentation tasks, annotations are error-prone due to the high demand in annotation time and in the annotators' expertise. Existing…

Image and Video Processing · Electrical Eng. & Systems 2023-08-08 Jiachen Yao , Yikai Zhang , Songzhu Zheng , Mayank Goswami , Prateek Prasanna , Chao Chen

Deep-learning-based pipelines have shown the potential to revolutionalize microscopy image diagnostics by providing visual augmentations to a trained pathology expert. However, to match human performance, the methods rely on the…

The success of state-of-the-art deep neural networks heavily relies on the presence of large-scale labelled datasets, which are extremely expensive and time-consuming to annotate. This paper focuses on tackling semi-supervised part…

Computer Vision and Pattern Recognition · Computer Science 2022-11-08 Yu Yang , Xiaotian Cheng , Hakan Bilen , Xiangyang Ji

Multi-label network classification is a well-known task that is being used in a wide variety of web-based and non-web-based domains. It can be formalized as a multi-relational learning task for predicting nodes labels based on their…

Machine Learning · Computer Science 2019-02-26 Ahmed Rashed , Josif Grabocka , Lars Schmidt-Thieme

Embedding models, which learn latent representations of users and items based on user-item interaction patterns, are a key component of recommendation systems. In many applications, contextual constraints need to be applied to refine…

Information Retrieval · Computer Science 2019-07-04 Syrine Krichene , Mike Gartrell , Clement Calauzenes

The presence of label noise often misleads the training of deep neural networks. Departing from the recent literature which largely assumes the label noise rate is only determined by the true label class, the errors in human-annotated…

Machine Learning · Computer Science 2021-03-31 Zhaowei Zhu , Tongliang Liu , Yang Liu

Many ways of annotating a dataset for machine learning classification tasks that go beyond the usual class labels exist in practice. These are of interest as they can simplify or facilitate the collection of annotations, while not greatly…

Mammogram classification is directly related to computer-aided diagnosis of breast cancer. Traditional methods requires great effort to annotate the training data by costly manual labeling and specialized computational models to detect…

Computer Vision and Pattern Recognition · Computer Science 2016-12-20 Wentao Zhu , Qi Lou , Yeeleng Scott Vang , Xiaohui Xie

Self-supervised learning (SSL) is an effective method for exploiting unlabelled data to learn a high-level embedding space that can be used for various downstream tasks. However, existing methods to monitor the quality of the encoder --…

Machine Learning · Computer Science 2024-09-11 Isaac Xu , Scott Lowe , Thomas Trappenberg

Embedders play a central role in machine learning, projecting any object into numerical representations that can, in turn, be leveraged to perform various downstream tasks. The evaluation of embedding models typically depends on…

Machine Learning · Computer Science 2024-11-19 Maxime Darrin , Philippe Formont , Ismail Ben Ayed , Jackie CK Cheung , Pablo Piantanida

We combine multi-task learning and semi-supervised learning by inducing a joint embedding space between disparate label spaces and learning transfer functions between label embeddings, enabling us to jointly leverage unlabelled data and…

Computation and Language · Computer Science 2018-04-10 Isabelle Augenstein , Sebastian Ruder , Anders Søgaard

Natural Language Understanding has seen an increasing number of publications in the last few years, especially after robust word embeddings models became prominent, when they proved themselves able to capture and represent semantic…

Computation and Language · Computer Science 2022-12-20 Terry Ruas , William Grosky , Akiko Aizawa

Multi-label classification is a widely encountered problem in daily life, where an instance can be associated with multiple classes. In theory, this is a supervised learning method that requires a large amount of labeling. However,…

Computer Vision and Pattern Recognition · Computer Science 2023-08-02 XIn Zhang , Yuqi Song , Fei Zuo , Xiaofeng Wang