English
Related papers

Related papers: ClipGrader: Leveraging Vision-Language Models for …

200 papers

In the field of Class Incremental Object Detection (CIOD), creating models that can continuously learn like humans is a major challenge. Pseudo-labeling methods, although initially powerful, struggle with multi-scenario incremental learning…

Computer Vision and Pattern Recognition · Computer Science 2024-05-10 Junsu Kim , Yunhoe Ku , Jihyeon Kim , Junuk Cha , Seungryul Baek

Automatic annotation of images with descriptive words is a challenging problem with vast applications in the areas of image search and retrieval. This problem can be viewed as a label-assignment problem by a classifier dealing with a very…

Computer Vision and Pattern Recognition · Computer Science 2017-05-09 Amara Tariq , Hassan Foroosh

In computer vision, multi-label recognition are important tasks with many real-world applications, but classifying previously unseen labels remains a significant challenge. In this paper, we propose a novel algorithm, Aligned Dual moDality…

Computer Vision and Pattern Recognition · Computer Science 2023-10-10 Shichao Xu , Yikang Li , Jenhao Hsiao , Chiuman Ho , Zhu Qi

Existing object detection methods are bounded in a fixed-set vocabulary by costly labeled data. When dealing with novel categories, the model has to be retrained with more bounding box annotations. Natural language supervision is an…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Chuang Lin , Peize Sun , Yi Jiang , Ping Luo , Lizhen Qu , Gholamreza Haffari , Zehuan Yuan , Jianfei Cai

Vision-language models such as CLIP have boosted the performance of open-vocabulary object detection, where the detector is trained on base categories but required to detect novel categories. Existing methods leverage CLIP's strong…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Cheng Shi , Sibei Yang

Continual learning with vision-language models like CLIP offers a pathway toward scalable machine learning systems by leveraging its transferable representations. Existing CLIP-based methods adapt the pre-trained image encoder by adding…

Computer Vision and Pattern Recognition · Computer Science 2025-05-30 Mao-Lin Luo , Zi-Hao Zhou , Tong Wei , Min-Ling Zhang

The image-based 3D object detection task expects that the predicted 3D bounding box has a ``tightness'' projection (also referred to as cuboid), which fits the object contour well on the image while still keeping the geometric attribute on…

Computer Vision and Pattern Recognition · Computer Science 2023-09-13 Jieqi Shi , Peiliang Li , Xiaozhi Chen , Shaojie Shen

Training deep object detectors demands expensive bounding box annotation. Active learning (AL) is a promising technique to alleviate the annotation burden. Performing AL at box-level for object detection, i.e., selecting the most…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Jingyi Liao , Xun Xu , Chuan-Sheng Foo , Lile Cai

Label-efficient LiDAR-based 3D object detection is currently dominated by weakly/semi-supervised methods. Instead of exclusively following one of them, we propose MixSup, a more practical paradigm simultaneously utilizing massive cheap…

Computer Vision and Pattern Recognition · Computer Science 2024-01-30 Yuxue Yang , Lue Fan , Zhaoxiang Zhang

Building robust and generic object detection frameworks requires scaling to larger label spaces and bigger training datasets. However, it is prohibitively costly to acquire annotations for thousands of categories at a large scale. We…

Computer Vision and Pattern Recognition · Computer Science 2022-07-20 Shiyu Zhao , Zhixing Zhang , Samuel Schulter , Long Zhao , Vijay Kumar B. G , Anastasis Stathopoulos , Manmohan Chandraker , Dimitris Metaxas

Existing open-vocabulary object detectors typically enlarge their vocabulary sizes by leveraging different forms of weak supervision. This helps generalize to novel objects at inference. Two popular forms of weak-supervision used in…

Computer Vision and Pattern Recognition · Computer Science 2022-11-30 Hanoona Rasheed , Muhammad Maaz , Muhammad Uzair Khattak , Salman Khan , Fahad Shahbaz Khan

Treating texts as images, combining prompts with textual labels for prompt tuning, and leveraging the alignment properties of CLIP have been successfully applied in zero-shot multi-label image recognition. Nonetheless, relying solely on…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Haonan Xu , Dian Chao , Xiangyu Wu , Zhonghua Wan , Yang Yang

Exploiting pseudo labels (e.g., categories and bounding boxes) of unannotated objects produced by a teacher detector have underpinned much of recent progress in semi-supervised object detection (SSOD). However, due to the limited…

Computer Vision and Pattern Recognition · Computer Science 2023-02-01 Lei Zhang , Yuxuan Sun , Wei Wei

Recent vision-language foundation models still frequently produce outputs misaligned with their inputs, evidenced by object hallucination in captioning and prompt misalignment in the text-to-image generation model. Recent studies have…

Computer Vision and Pattern Recognition · Computer Science 2024-12-25 JeongYeon Nam , Jinbae Im , Wonjae Kim , Taeho Kil

Pseudo-Labeling has emerged as a simple yet effective technique for semi-supervised object detection (SSOD). However, the inevitable noise problem in pseudo-labels significantly degrades the performance of SSOD methods. Recent advances…

Computer Vision and Pattern Recognition · Computer Science 2023-03-07 Yulin He , Wei Chen , Ke Liang , Yusong Tan , Zhengfa Liang , Yulan Guo

Scale variation across object instances remains a key challenge in object detection task. Despite the remarkable progress made by modern detection models, this challenge is particularly evident in the semi-supervised case. While existing…

Computer Vision and Pattern Recognition · Computer Science 2023-03-17 Liang Liu , Boshen Zhang , Jiangning Zhang , Wuhao Zhang , Zhenye Gan , Guanzhong Tian , Wenbing Zhu , Yabiao Wang , Chengjie Wang

Text detection and recognition are essential components of a modern OCR system. Most OCR approaches attempt to obtain accurate bounding boxes of text at the detection stage, which is used as the input of the text recognition stage. We…

Computer Vision and Pattern Recognition · Computer Science 2022-07-27 Jingqun Tang , Wenming Qian , Luchuan Song , Xiena Dong , Lan Li , Xiang Bai

Deep learning has emerged as an effective solution for solving the task of object detection in images but at the cost of requiring large labeled datasets. To mitigate this cost, semi-supervised object detection methods, which consist in…

Computer Vision and Pattern Recognition · Computer Science 2025-02-18 Renaud Vandeghen , Gilles Louppe , Marc Van Droogenbroeck

Large-scale contrastive vision-language pre-training has shown significant progress in visual representation learning. Unlike traditional visual systems trained by a fixed set of discrete labels, a new paradigm was introduced in…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Peng Gao , Shijie Geng , Renrui Zhang , Teli Ma , Rongyao Fang , Yongfeng Zhang , Hongsheng Li , Yu Qiao

Unsupervised and open-vocabulary 3D object detection has recently gained attention, particularly in autonomous driving, where reducing annotation costs and recognizing unseen objects are critical for both safety and scalability. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 In-Jae Lee , Mungyeom Kim , Kwonyoung Ryu , Pierre Musacchio , Jaesik Park