English
Related papers

Related papers: Efficiently Crowdsourcing Visual Importance with P…

200 papers

Manually annotating object bounding boxes is central to building computer vision datasets, and it is very time consuming (annotating ILSVRC [53] took 35s for one high-quality box [62]). It involves clicking on imaginary corners of a tight…

Computer Vision and Pattern Recognition · Computer Science 2017-08-10 Dim P. Papadopoulos , Jasper R. R. Uijlings , Frank Keller , Vittorio Ferrari

Relying on crowdsourced workers, data crowdsourcing platforms are able to efficiently provide vast amounts of labeled data. Due to the variability in the annotation quality of crowd workers, modern techniques resort to redundant annotations…

Human-Computer Interaction · Computer Science 2023-11-28 Haoyu Liu , Fei Wang , Minmin Lin , Runze Wu , Renyu Zhu , Shiwei Zhao , Kai Wang , Tangjie Lv , Changjie Fan

Face clustering can provide pseudo-labels to the massive unlabeled face data and improve the performance of different face recognition models. The existing clustering methods generally aggregate the features within subgraphs that are often…

Computer Vision and Pattern Recognition · Computer Science 2023-04-24 Yuan Cao , Di Jiang , Guanqun Hou , Fan Deng , Xinjia Chen , Qiang Yang

Whether Large Language Models (LLMs) can outperform crowdsourcing on the data annotation task is attracting interest recently. Some works verified this issue with the average performance of individual crowd workers and LLM workers on some…

Computation and Language · Computer Science 2024-01-19 Jiyi Li

Point feature labeling is a classical problem in cartography and GIS that has been extensively studied for geospatial point data. At the same time, word clouds are a popular visualization tool to show the most important words in text data…

Computational Geometry · Computer Science 2021-09-10 Sujoy Bhore , Robert Ganian , Guangping Li , Martin Nöllenburg , Jules Wulms

Crowd counting problem that counts the number of people in an image has been extensively studied in recent years. In this paper, we introduce a new variant of crowd counting problem, namely "Categorized Crowd Counting", that counts the…

Computer Vision and Pattern Recognition · Computer Science 2019-12-13 Sarkar Snigdha Sarathi Das , Syed Md. Mukit Rashid , Mohammed Eunus Ali

Recent advancements in scene text spotting have focused on end-to-end methodologies that heavily rely on precise location annotations, which are often costly and labor-intensive to procure. In this study, we introduce an innovative approach…

Computer Vision and Pattern Recognition · Computer Science 2025-04-23 Jing Li , Bo Wang

Crowdsourcing utilizes the wisdom of crowds for collective classification via information (e.g., labels of an item) provided by labelers. Current crowdsourcing algorithms are mainly unsupervised methods that are unaware of the quality of…

Social and Information Networks · Computer Science 2016-11-15 Pin-Yu Chen , Chia-Wei Lien , Fu-Jen Chu , Pai-Shun Ting , Shin-Ming Cheng

The ability of learning from noisy labels is very useful in many visual recognition tasks, as a vast amount of data with noisy labels are relatively easy to obtain. Traditionally, the label noises have been treated as statistical outliers,…

Computer Vision and Pattern Recognition · Computer Science 2017-04-11 Yuncheng Li , Jianchao Yang , Yale Song , Liangliang Cao , Jiebo Luo , Li-Jia Li

Data labeling is a necessary but often slow process that impedes the development of interactive systems for modern data analysis. Despite rising demand for manual data labeling, there is a surprising lack of work addressing its high and…

Databases · Computer Science 2015-09-22 Daniel Haas , Jiannan Wang , Eugene Wu , Michael J. Franklin

Clustering algorithms are one of the main analytical methods to detect patterns in unlabeled data. Existing clustering methods typically treat samples in a dataset as points in a metric space and compute distances to group together similar…

Machine Learning · Computer Science 2021-10-12 Tarek Naous , Srinjay Sarkar , Abubakar Abid , James Zou

Modern machine learning is migrating to the era of complex models, which requires a plethora of well-annotated data. While crowdsourcing is a promising tool to achieve this goal, existing crowdsourcing approaches barely acquire a sufficient…

Human-Computer Interaction · Computer Science 2018-03-07 Bo Han , Quanming Yao , Yuangang Pan , Ivor W. Tsang , Xiaokui Xiao , Qiang Yang , Masashi Sugiyama

Scene text detection, which is one of the most popular topics in both academia and industry, can achieve remarkable performance with sufficient training data. However, the annotation costs of scene text detection are huge with traditional…

Computer Vision and Pattern Recognition · Computer Science 2020-12-11 Wenqing Zhang , Yang Qiu , Minghui Liao , Rui Zhang , Xiaolin Wei , Xiang Bai

Existing works often focus on reducing the architecture redundancy for accelerating image classification but ignore the spatial redundancy of the input image. This paper proposes an efficient image classification pipeline to solve this…

Computer Vision and Pattern Recognition · Computer Science 2022-06-08 Chuanguang Yang , Zhulin An , Yongjun Xu

Crowdsourcing has emerged as a popular approach for collecting annotated data to train supervised machine learning models. However, annotator bias can lead to defective annotations. Though there are a few works investigating individual…

Human-Computer Interaction · Computer Science 2021-10-18 Haochen Liu , Joseph Thekinen , Sinem Mollaoglu , Da Tang , Ji Yang , Youlong Cheng , Hui Liu , Jiliang Tang

Learning from crowds describes that the annotations of training data are obtained with crowd-sourcing services. Multiple annotators each complete their own small part of the annotations, where labeling mistakes that depend on annotators…

Human-Computer Interaction · Computer Science 2024-04-16 Shikun Li , Xiaobo Xia , Jiankang Deng , Shiming Ge , Tongliang Liu

Acquiring fine-grained object detection annotations in unconstrained images is time-consuming, expensive, and prone to noise, especially in crowdsourcing scenarios. Most prior object detection methods assume accurate annotations; A few…

Computer Vision and Pattern Recognition · Computer Science 2024-07-12 Zhi Qin Tan , Olga Isupova , Gustavo Carneiro , Xiatian Zhu , Yunpeng Li

The availability of training data for supervision is a frequently encountered bottleneck of medical image analysis methods. While typically established by a clinical expert rater, the increase in acquired imaging data renders traditional…

Crowdsourcing platforms provide marketplaces where task requesters can pay to get labels on their data. Such markets have emerged recently as popular venues for collecting annotations that are crucial in training machine learning models in…

Machine Learning · Computer Science 2017-08-28 Ashish Khetan , Sewoong Oh

Training deep-learning-based vision systems require the manual annotation of a significant number of images. Such manual annotation is highly time-consuming and labor-intensive. Although previous studies have attempted to eliminate the…

Computer Vision and Pattern Recognition · Computer Science 2024-11-08 Takuya Kiyokawa , Naoki Shirakura , Hiroki Katayama , Keita Tomochika , Jun Takamatsu