English
Related papers

Related papers: Language-aware Multiple Datasets Detection Pretrai…

200 papers

The astounding performance of transformers in natural language processing (NLP) has motivated researchers to explore their applications in computer vision tasks. DEtection TRansformer (DETR) introduces transformers to object detection tasks…

Computer Vision and Pattern Recognition · Computer Science 2023-07-13 Tahira Shehzadi , Khurram Azeem Hashmi , Didier Stricker , Muhammad Zeshan Afzal

The advancement of object detection (OD) in open-vocabulary and open-world scenarios is a critical challenge in computer vision. This work introduces OmDet, a novel language-aware object detection architecture, and an innovative training…

Computer Vision and Pattern Recognition · Computer Science 2024-02-27 Tiancheng Zhao , Peng Liu , Kyusong Lee

Every data selection method inherently has a target. In practice, these targets often emerge implicitly through benchmark-driven iteration: researchers develop selection strategies, train models, measure benchmark performance, then refine…

Recently, DEtection TRansformer (DETR), an end-to-end object detection pipeline, has achieved promising performance. However, it requires large-scale labeled data and suffers from domain shift, especially when no labeled data is available…

Computer Vision and Pattern Recognition · Computer Science 2022-08-17 Jinze Yu , Jiaming Liu , Xiaobao Wei , Haoyi Zhou , Yohei Nakata , Denis Gudovskiy , Tomoyuki Okuno , Jianxin Li , Kurt Keutzer , Shanghang Zhang

Language Model pre-training uses broad data mixtures to enhance performance across domains and languages. However, training on such heterogeneous text corpora requires extensive and expensive efforts. Since these data sources vary…

Machine Learning · Computer Science 2025-04-08 Alex Iacob , Lorenzo Sani , Meghdad Kurmanji , William F. Shen , Xinchi Qiu , Dongqi Cai , Yan Gao , Nicholas D. Lane

Large-scale pretraining and task-specific fine-tuning is now the standard methodology for many tasks in computer vision and natural language processing. Recently, a multitude of methods have been proposed for pretraining vision and language…

Computation and Language · Computer Science 2021-06-01 Emanuele Bugliarello , Ryan Cotterell , Naoaki Okazaki , Desmond Elliott

The introduction of DETR represents a new paradigm for object detection. However, its decoder conducts classification and box localization using shared queries and cross-attention layers, leading to suboptimal results. We observe that…

Computer Vision and Pattern Recognition · Computer Science 2023-10-25 Manyuan Zhang , Guanglu Song , Yu Liu , Hongsheng Li

This paper presents LP-DETR (Layer-wise Progressive DETR), a novel approach that enhances DETR-based object detection through multi-scale relation modeling. Our method introduces learnable spatial relationships between object queries…

Computer Vision and Pattern Recognition · Computer Science 2025-05-14 Zhengjian Kang , Ye Zhang , Xiaoyu Deng , Xintao Li , Yongzhe Zhang

This paper presents a general scheme for enhancing the convergence and performance of DETR (DEtection TRansformer). We investigate the slow convergence problem in transformers from a new perspective, suggesting that it arises from the…

Computer Vision and Pattern Recognition · Computer Science 2024-07-17 Xiuquan Hou , Meiqin Liu , Senlin Zhang , Ping Wei , Badong Chen , Xuguang Lan

Fine-grained remote sensing datasets often use hierarchical label structures to differentiate objects in a coarse-to-fine manner, with each object annotated across multiple levels. However, embedding this semantic hierarchy into the…

Computer Vision and Pattern Recognition · Computer Science 2026-01-01 Jingzhou Chen , Dexin Chen , Fengchao Xiong , Yuntao Qian , Liang Xiao

How do we build a general and broad object detection system? We use all labels of all concepts ever annotated. These labels span diverse datasets with potentially inconsistent taxonomies. In this paper, we present a simple method for…

Computer Vision and Pattern Recognition · Computer Science 2022-04-27 Xingyi Zhou , Vladlen Koltun , Philipp Krähenbühl

Supervised 3D Object Detection models have been displaying increasingly better performance in single-domain cases where the training data comes from the same environment and sensor as the testing data. However, in real-world scenarios data…

Computer Vision and Pattern Recognition · Computer Science 2023-08-03 Louis Soum-Fontez , Jean-Emmanuel Deschaud , François Goulette

The unsupervised pretraining of object detectors has recently become a key component of object detector training, as it leads to improved performance and faster convergence during the supervised fine-tuning stage. Existing unsupervised…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Ioannis Maniadis Metaxas , Adrian Bulat , Ioannis Patras , Brais Martinez , Georgios Tzimiropoulos

One-to-one set matching is a key design for DETR to establish its end-to-end capability, so that object detection does not require a hand-crafted NMS (non-maximum suppression) to remove duplicate detections. This end-to-end signature is…

Computer Vision and Pattern Recognition · Computer Science 2023-05-17 Ding Jia , Yuhui Yuan , Haodi He , Xiaopei Wu , Haojun Yu , Weihong Lin , Lei Sun , Chao Zhang , Han Hu

Incremental few-shot object detection aims at detecting novel classes without forgetting knowledge of the base classes with only a few labeled training data from the novel classes. Most related prior works are on incremental object…

Computer Vision and Pattern Recognition · Computer Science 2023-02-28 Na Dong , Yongqiang Zhang , Mingli Ding , Gim Hee Lee

Few-shot object detection has been extensively investigated by incorporating meta-learning into region-based detection frameworks. Despite its success, the said paradigm is constrained by several factors, such as (i) low-quality region…

Computer Vision and Pattern Recognition · Computer Science 2021-09-21 Gongjie Zhang , Zhipeng Luo , Kaiwen Cui , Shijian Lu

Infrared-visible object detection aims to achieve robust object detection by leveraging the complementary information of infrared and visible image pairs. However, the commonly existing modality misalignment problem presents two challenges:…

Computer Vision and Pattern Recognition · Computer Science 2025-10-02 Junjie Guo , Chenqiang Gao , Fangcen Liu , Deyu Meng

Self-supervised pre-training, based on the pretext task of instance discrimination, has fueled the recent advance in label-efficient object detection. However, existing studies focus on pre-training only a feature extractor network to learn…

Computer Vision and Pattern Recognition · Computer Science 2024-02-16 Nanqing Dong , Linus Ericsson , Yongxin Yang , Ales Leonardis , Steven McDonagh

Dense object detection is widely used in automatic driving, video surveillance, and other fields. This paper focuses on the challenging task of dense object detection. Currently, detection methods based on greedy algorithms, such as…

Computer Vision and Pattern Recognition · Computer Science 2025-02-12 Yueming Huang , Chenrui Ma , Hao Zhou , Hao Wu , Guowu Yuan

Detection Transformer (DETR) directly transforms queries to unique objects by using one-to-one bipartite matching during training and enables end-to-end object detection. Recently, these models have surpassed traditional detectors on COCO…

Computer Vision and Pattern Recognition · Computer Science 2022-12-13 Jeffrey Ouyang-Zhang , Jang Hyun Cho , Xingyi Zhou , Philipp Krähenbühl