English
Related papers

Related papers: Vision Transformers Are Good Mask Auto-Labelers

200 papers

Pseudo-labeling is significant for semi-supervised instance segmentation, which generates instance masks and classes from unannotated images for subsequent training. However, in existing pipelines, pseudo-labels that contain valuable…

Computer Vision and Pattern Recognition · Computer Science 2023-08-11 Jie Hu , Chen Chen , Liujuan Cao , Shengchuan Zhang , Annan Shu , Guannan Jiang , Rongrong Ji

The manual annotation of outdoor LiDAR point clouds for instance segmentation is extremely costly and time-consuming. Current methods attempt to reduce this burden but still rely on some form of human labeling. To completely eliminate this…

Computer Vision and Pattern Recognition · Computer Science 2025-10-13 Yongxuan Lyu , Guangfeng Jiang , Hongsi Liu , Jun Liu

A major bottleneck to scaling-up training of self-driving perception systems are the human annotations required for supervision. A promising alternative is to leverage "auto-labelling" offboard perception models that are trained to…

Computer Vision and Pattern Recognition · Computer Science 2023-11-03 Anqi Joyce Yang , Sergio Casas , Nikita Dvornik , Sean Segal , Yuwen Xiong , Jordan Sir Kwang Hu , Carter Fang , Raquel Urtasun

Existing instance segmentation models learn task-specific information using manual mask annotations from base (training) categories. These mask annotations require tremendous human effort, limiting the scalability to annotate novel (new)…

Computer Vision and Pattern Recognition · Computer Science 2023-03-30 Vibashan VS , Ning Yu , Chen Xing , Can Qin , Mingfei Gao , Juan Carlos Niebles , Vishal M. Patel , Ran Xu

Labeling images for visual segmentation is a time-consuming task which can be costly, particularly in application domains where labels have to be provided by specialized expert annotators, such as civil engineering. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2022-09-23 Klara Janouskova , Mattia Rigotti , Ioana Giurgiu , Cristiano Malossi

We introduce the first active learning (AL) model for high-accuracy instance segmentation of moveable parts from RGB images of real indoor scenes. Specifically, our goal is to obtain fully validated segmentation results by humans while…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Ruiqi Wang , Akshay Gadi Patil , Fenggen Yu , Hao Zhang

Image segmentation methods are usually trained with pixel-level annotations, which require significant human effort to collect. The most common solution to address this constraint is to implement weakly-supervised pipelines trained with…

Computer Vision and Pattern Recognition · Computer Science 2020-08-26 Miriam Bellver , Amaia Salvador , Jordi Torres , Xavier Giro-i-Nieto

Two-stage and query-based instance segmentation methods have achieved remarkable results. However, their segmented masks are still very coarse. In this paper, we present Mask Transfiner for high-quality and efficient instance segmentation.…

Computer Vision and Pattern Recognition · Computer Science 2021-11-29 Lei Ke , Martin Danelljan , Xia Li , Yu-Wing Tai , Chi-Keung Tang , Fisher Yu

We propose a method to annotate segmentation masks accurately and automatically using invisible marker for object manipulation. Invisible marker is invisible under visible (regular) light conditions, but becomes visible under invisible…

Robotics · Computer Science 2020-08-04 Kuniyuki Takahashi , Kenta Yonekura

Image segmentation is about grouping pixels with different semantics, e.g., category or instance membership, where each choice of semantics defines a task. While only the semantics of each task differ, current research focuses on designing…

Computer Vision and Pattern Recognition · Computer Science 2022-06-17 Bowen Cheng , Ishan Misra , Alexander G. Schwing , Alexander Kirillov , Rohit Girdhar

Recent approaches for weakly supervised instance segmentations depend on two components: (i) a pseudo label generation model that provides instances which are consistent with a given annotation; and (ii) an instance segmentation model,…

Computer Vision and Pattern Recognition · Computer Science 2020-07-21 Aditya Arun , C. V. Jawahar , M. Pawan Kumar

Cloud analysis is a critical component of weather and climate science, impacting various sectors like disaster management. However, achieving fine-grained cloud analysis, such as cloud segmentation, in remote sensing remains challenging due…

Computer Vision and Pattern Recognition · Computer Science 2023-11-10 Jay Gala , Sauradip Nag , Huichou Huang , Ruirui Liu , Xiatian Zhu

The rise of transformers in vision tasks not only advances network backbone designs, but also starts a brand-new page to achieve end-to-end image recognition (e.g., object detection and panoptic segmentation). Originated from Natural…

Computer Vision and Pattern Recognition · Computer Science 2023-07-12 Qihang Yu , Huiyu Wang , Siyuan Qiao , Maxwell Collins , Yukun Zhu , Hartwig Adam , Alan Yuille , Liang-Chieh Chen

In this work, we tackle the problem of instance segmentation, the task of simultaneously solving object detection and semantic segmentation. Towards this goal, we present a model, called MaskLab, which produces three outputs: box detection,…

Computer Vision and Pattern Recognition · Computer Science 2017-12-14 Liang-Chieh Chen , Alexander Hermans , George Papandreou , Florian Schroff , Peng Wang , Hartwig Adam

Multi-label image classification is about predicting a set of class labels that can be considered as orderless sequential data. Transformers process the sequential data as a whole, therefore they are inherently good at set prediction. The…

Computer Vision and Pattern Recognition · Computer Science 2022-05-17 Vacit Oguz Yazici , Joost van de Weijer , Longlong Yu

We propose an embarrassingly simple point annotation scheme to collect weak supervision for instance segmentation. In addition to bounding boxes, we collect binary labels for a set of points uniformly sampled inside each bounding box. We…

Computer Vision and Pattern Recognition · Computer Science 2022-06-17 Bowen Cheng , Omkar Parkhi , Alexander Kirillov

This paper presents a simple and effective approach to solving the multi-label classification problem. The proposed approach leverages Transformer decoders to query the existence of a class label. The use of Transformer is rooted in the…

Computer Vision and Pattern Recognition · Computer Science 2021-07-23 Shilong Liu , Lei Zhang , Xiao Yang , Hang Su , Jun Zhu

Current weakly supervised object localization and segmentation rely on class-discriminative visualization techniques to generate pseudo-labels for pixel-level training. Such visualization methods, including class activation mapping (CAM)…

Computer Vision and Pattern Recognition · Computer Science 2020-10-20 Xiangwei Shi , Seyran Khademi , Yunqiang Li , Jan van Gemert

Though quite challenging, leveraging large-scale unlabeled or partially labeled images in a cost-effective way has increasingly attracted interests for its great importance to computer vision. To tackle this problem, many Active Learning…

Computer Vision and Pattern Recognition · Computer Science 2018-05-25 Keze Wang , Xiaopeng Yan , Dongyu Zhang , Lei Zhang , Liang Lin

Instance segmentation methods require large datasets with expensive and thus limited instance-level mask labels. Partially supervised instance segmentation aims to improve mask prediction with limited mask labels by utilizing the more…

Computer Vision and Pattern Recognition · Computer Science 2021-04-13 David Biertimpel , Sindi Shkodrani , Anil S. Baslamisli , Nóra Baka