English
Related papers

Related papers: When Annotators Agree but Labels Disagree: The Pro…

200 papers

Applying an object detector, which is neither trained nor fine-tuned on data close to the final application, often leads to a substantial performance drop. In order to overcome this problem, it is necessary to consider a shift between…

Computer Vision and Pattern Recognition · Computer Science 2020-05-27 Alexey Abramov , Christopher Bayer , Claudio Heller

Detecting problematic content, such as hate speech, is a multifaceted and ever-changing task, influenced by social dynamics, user populations, diversity of sources, and evolving language. There has been significant efforts, both in academia…

Computation and Language · Computer Science 2023-10-09 Ali Omrani , Alireza S. Ziabari , Preni Golazizian , Jeffrey Sorensen , Morteza Dehghani

Many existing approaches for learning from labeled data assume the existence of gold-standard labels. According to these approaches, inter-annotator disagreement is seen as noise to be removed, either through refinement of annotation…

Machine Learning · Computer Science 2025-03-21 Jake Vasilakes , Chrysoula Zerva , Sophia Ananiadou

This paper presents one-bit supervision, a novel setting of learning from incomplete annotations, in the scenario of image classification. Instead of training a model upon the accurate label of each sample, our setting requires the model to…

Computer Vision and Pattern Recognition · Computer Science 2021-05-12 Hengtong Hu , Lingxi Xie , Zewei Du , Richang Hong , Qi Tian

Unsupervised domain adaptive object detection aims to adapt detectors from a labelled source domain to an unlabelled target domain. Most existing works take a two-stage strategy that first generates region proposals and then detects objects…

Computer Vision and Pattern Recognition · Computer Science 2021-05-20 Dayan Guan , Jiaxing Huang , Aoran Xiao , Shijian Lu , Yanpeng Cao

Bipartite ranking is a fundamental supervised learning problem, with the goal of learning a ranking over instances with maximal Area Under the ROC Curve (AUC) against a single binary target label. However, one may often observe multiple…

We investigate whether pre-trained bidirectional transformers with sentiment and emotion information improve stance detection in long discussions of contemporary issues. As a part of this work, we create a novel stance detection dataset…

Computation and Language · Computer Science 2020-06-02 Marjan Hosseinia , Eduard Dragut , Arjun Mukherjee

Pairwise preference data have played an important role in the alignment of large language models (LLMs). Each sample of such data consists of a prompt, two different responses to the prompt, and a binary label indicating which of the two…

Computation and Language · Computer Science 2026-05-12 Zhongze Cai , Xiaocheng Li

We propose an approach for unsupervised adaptation of object detectors from label-rich to label-poor domains which can significantly reduce annotation costs associated with detection. Recently, approaches that align distributions of source…

Computer Vision and Pattern Recognition · Computer Science 2019-04-09 Kuniaki Saito , Yoshitaka Ushiku , Tatsuya Harada , Kate Saenko

The proliferation of fake news and filter bubbles makes it increasingly difficult to form an unbiased, balanced opinion towards a topic. To ameliorate this, we propose 360{\deg} Stance Detection, a tool that aggregates news with multiple…

Computation and Language · Computer Science 2018-04-04 Sebastian Ruder , John Glover , Afshin Mehrabani , Parsa Ghaffari

Given labeled points in a high-dimensional vector space, we seek a low-dimensional subspace such that projecting onto this subspace maintains some prescribed distance between points of differing labels. Intended applications include…

Machine Learning · Statistics 2018-12-10 Culver McWhirter , Dustin G. Mixon , Soledad Villar

We propose an annotation approach that captures not only labels but also the reading process underlying annotators' decisions, e.g., what parts of the text they focus on, re-read or skim. Using this framework, we conduct a case study on the…

Computation and Language · Computer Science 2025-12-01 Karin de Langis , William Walker , Khanh Chi Le , Dongyeop Kang

In modern digital environments, users frequently express opinions on contentious topics, providing a wealth of information on prevailing attitudes. The systematic analysis of these opinions offers valuable insights for decision-making in…

Computation and Language · Computer Science 2024-11-26 Bowen Zhang , Genan Dai , Fuqiang Niu , Nan Yin , Xiaomao Fan , Senzhang Wang , Xiaochun Cao , Hu Huang

Domain adaptation for sentiment analysis is challenging due to the fact that supervised classifiers are very sensitive to changes in domain. The two most prominent approaches to this problem are structural correspondence learning and…

Computation and Language · Computer Science 2018-06-15 Jeremy Barnes , Roman Klinger , Sabine Schulte im Walde

Object detection is one of the major problems in computer vision, and has been extensively studied. Most of the existing detection works rely on labor-intensive supervision, such as ground truth bounding boxes of objects or at least…

Computer Vision and Pattern Recognition · Computer Science 2018-08-02 Qingyi Tao , Hao Yang , Jianfei Cai

Recommendation systems increasingly depend on massive human-labeled datasets; however, the human annotators hired to generate these labels increasingly come from homogeneous backgrounds. This poses an issue when downstream predictive models…

Recent deep learning methods for object detection rely on a large amount of bounding box annotations. Collecting these annotations is laborious and costly, yet supervised models do not generalize well when testing on images from a different…

Computer Vision and Pattern Recognition · Computer Science 2019-10-25 Han-Kai Hsu , Chun-Han Yao , Yi-Hsuan Tsai , Wei-Chih Hung , Hung-Yu Tseng , Maneesh Singh , Ming-Hsuan Yang

Recently, detection of label errors and improvement of label quality in datasets for supervised learning tasks has become an increasingly important goal in both research and industry. The consequences of incorrectly annotated data include…

Machine Learning · Computer Science 2025-08-26 Sarina Penquitt , Tobias Riedlinger , Timo Heller , Markus Reischl , Matthias Rottmann

Supervised learning can improve the design of state-of-the-art solvers for combinatorial problems, but labelling large numbers of combinatorial instances is often impractical due to exponential worst-case complexity. Inspired by the recent…

Machine Learning · Computer Science 2022-06-22 Haonan Duan , Pashootan Vaezipoor , Max B. Paulus , Yangjun Ruan , Chris J. Maddison

Gender-Based Violence (GBV) is an increasing problem online, but existing datasets fail to capture the plurality of possible annotator perspectives or ensure the representation of affected groups. We revisit two important stages in the…

Computation and Language · Computer Science 2024-10-07 Aiqi Jiang , Nikolas Vitsakis , Tanvi Dinkar , Gavin Abercrombie , Ioannis Konstas