English
Related papers

Related papers: Conditional DETR for Fast Training Convergence

200 papers

Motivated by the remarkable achievements of DETR-based approaches on COCO object detection and segmentation benchmarks, recent endeavors have been directed towards elevating their performance through self-supervised pre-training of…

Computer Vision and Pattern Recognition · Computer Science 2023-12-04 Yan Ma , Weicong Liang , Bohan Chen , Yiduo Hao , Bojian Hou , Xiangyu Yue , Chao Zhang , Yuhui Yuan

Real-time object detection is crucial for real-world applications as it requires high accuracy with low latency. While Detection Transformers (DETR) have demonstrated significant performance improvements, current real-time DETR models are…

Computer Vision and Pattern Recognition · Computer Science 2026-02-25 Jiannan Huang , Aditya Kane , Fengzhe Zhou , Yunchao Wei , Humphrey Shi

We present RiO-DETR: DETR for Real-time Oriented Object Detection, the first real-time oriented detection transformer to the best of our knowledge. Adapting DETR to oriented bounding boxes (OBBs) poses three challenges: semantics-dependent…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Zhangchi Hu , Yifan Zhao , Yansong Peng , Wenzhang Sun , Xiangchen Yin , Jie Chen , Peixi Wu , Hebei Li , Xinghao Wang , Dongsheng Jiang , Xiaoyan Sun

We present in this paper a novel query formulation using dynamic anchor boxes for DETR (DEtection TRansformer) and offer a deeper understanding of the role of queries in DETR. This new formulation directly uses box coordinates as queries in…

Computer Vision and Pattern Recognition · Computer Science 2022-03-31 Shilong Liu , Feng Li , Hao Zhang , Xiao Yang , Xianbiao Qi , Hang Su , Jun Zhu , Lei Zhang

We introduce a highly performant 3D object detector for point clouds using the DETR framework. The prior attempts all end up with suboptimal results because they fail to learn accurate inductive biases from the limited scale of training…

Computer Vision and Pattern Recognition · Computer Science 2023-08-09 Yichao Shen , Zigang Geng , Yuhui Yuan , Yutong Lin , Ze Liu , Chunyu Wang , Han Hu , Nanning Zheng , Baining Guo

The training paradigm of DETRs is heavily contingent upon pre-training their backbone on the ImageNet dataset. However, the limited supervisory signals provided by the image classification task and one-to-one matching strategy result in an…

Computer Vision and Pattern Recognition · Computer Science 2024-02-27 Haodong Ouyang

Temporal Action Detection (TAD) is fundamental yet challenging for real-world video applications. Leveraging the unique benefits of transformers, various DETR-based approaches have been adopted in TAD. However, it has recently been…

Computer Vision and Pattern Recognition · Computer Science 2024-12-20 Jihwan Kim , Miso Lee , Cheol-Ho Cho , Jihyun Lee , Jae-Pil Heo

Detecting the objects in dense and rotated scenes is a challenging task. Recent works on this topic are mostly based on Faster RCNN or Retinanet. As they are highly dependent on the pre-set dense anchors and the NMS operation, the approach…

Computer Vision and Pattern Recognition · Computer Science 2023-12-06 Zhu Yuke , Ruan Yumeng , Yang Lei , Guo Sheng

One-to-one set matching is a key design for DETR to establish its end-to-end capability, so that object detection does not require a hand-crafted NMS (non-maximum suppression) to remove duplicate detections. This end-to-end signature is…

Computer Vision and Pattern Recognition · Computer Science 2023-05-17 Ding Jia , Yuhui Yuan , Haodi He , Xiaopei Wu , Haojun Yu , Weihong Lin , Lei Sun , Chao Zhang , Han Hu

We present a conceptually simple, efficient, and general framework for localization problems in DETR-like models. We add plugins to well-trained models instead of inefficiently designing new models and training them from scratch. The…

Computer Vision and Pattern Recognition · Computer Science 2023-07-25 Yiqun Chen , Qiang Chen , Peize Sun , Shoufa Chen , Jingdong Wang , Jian Cheng

The recently proposed end-to-end transformer detectors, such as DETR and Deformable DETR, have a cascade structure of stacking 6 decoder layers to update object queries iteratively, without which their performance degrades seriously. In…

Computer Vision and Pattern Recognition · Computer Science 2021-04-06 Zhuyu Yao , Jiangbo Ai , Boxun Li , Chi Zhang

Detection Transformers (DETR) formulate object detection as a set prediction problem and enable end-to-end training without post-processing. However, object queries in DETR interact through symmetric self-attention, which enforces uniform…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Ye Zhang , Qi Chen , Wenyou Huang , Rui Liu , Zhengjian Kang

We introduce DEIM, an innovative and efficient training framework designed to accelerate convergence in real-time object detection with Transformer-based architectures (DETR). To mitigate the sparse supervision inherent in one-to-one (O2O)…

Computer Vision and Pattern Recognition · Computer Science 2025-03-27 Shihua Huang , Zhichao Lu , Xiaodong Cun , Yongjun Yu , Xiao Zhou , Xi Shen

Object detection is one of the most significant aspects of computer vision, and it has achieved substantial results in a variety of domains. It is worth noting that there are few studies focusing on slender object detection. CNNs are widely…

Computer Vision and Pattern Recognition · Computer Science 2022-04-25 Wen Feng , Wang Mei , Hu Xiaojie

Modern detection transformers (DETRs) use a set of object queries to predict a list of bounding boxes, sort them by their classification confidence scores, and select the top-ranked predictions as the final detection results for the given…

Computer Vision and Pattern Recognition · Computer Science 2023-11-06 Yifan Pu , Weicong Liang , Yiduo Hao , Yuhui Yuan , Yukang Yang , Chao Zhang , Han Hu , Gao Huang

In this paper, we provide the observation that too few queries assigned as positive samples in DETR with one-to-one set matching leads to sparse supervision on the encoder's output which considerably hurt the discriminative feature learning…

Computer Vision and Pattern Recognition · Computer Science 2023-08-17 Zhuofan Zong , Guanglu Song , Yu Liu

Object detection is a fundamental task for robots to operate in unstructured environments. Today, there are several deep learning algorithms that solve this task with remarkable performance. Unfortunately, training such systems requires…

Computer Vision and Pattern Recognition · Computer Science 2021-06-30 Federico Ceola , Elisa Maiettini , Giulia Pasquale , Lorenzo Rosasco , Lorenzo Natale

The astounding performance of transformers in natural language processing (NLP) has motivated researchers to explore their applications in computer vision tasks. DEtection TRansformer (DETR) introduces transformers to object detection tasks…

Computer Vision and Pattern Recognition · Computer Science 2023-07-13 Tahira Shehzadi , Khurram Azeem Hashmi , Didier Stricker , Muhammad Zeshan Afzal

This paper presents a DETR-based method for cross-domain weakly supervised object detection (CDWSOD), aiming at adapting the detector from source to target domain through weak supervision. We think DETR has strong potential for CDWSOD due…

Computer Vision and Pattern Recognition · Computer Science 2023-04-17 Zongheng Tang , Yifan Sun , Si Liu , Yi Yang

Recent DEtection TRansformer-based (DETR) models have obtained remarkable performance. Its success cannot be achieved without the re-introduction of multi-scale feature fusion in the encoder. However, the excessively increased tokens in…

Computer Vision and Pattern Recognition · Computer Science 2023-03-14 Feng Li , Ailing Zeng , Shilong Liu , Hao Zhang , Hongyang Li , Lei Zhang , Lionel M. Ni