English
Related papers

Related papers: DN-DETR: Accelerate DETR Training by Introducing Q…

200 papers

Detection Transformer (DETR) directly transforms queries to unique objects by using one-to-one bipartite matching during training and enables end-to-end object detection. Recently, these models have surpassed traditional detectors on COCO…

Computer Vision and Pattern Recognition · Computer Science 2022-12-13 Jeffrey Ouyang-Zhang , Jang Hyun Cho , Xingyi Zhou , Philipp Krähenbühl

In this paper, we present a novel training scheme, namely Teach-DETR, to learn better DETR-based detectors from versatile teacher detectors. We show that the predicted boxes from teacher detectors are effective medium to transfer knowledge…

Computer Vision and Pattern Recognition · Computer Science 2022-11-24 Linjiang Huang , Kaixin Lu , Guanglu Song , Liang Wang , Si Liu , Yu Liu , Hongsheng Li

Motivated by the remarkable achievements of DETR-based approaches on COCO object detection and segmentation benchmarks, recent endeavors have been directed towards elevating their performance through self-supervised pre-training of…

Computer Vision and Pattern Recognition · Computer Science 2023-12-04 Yan Ma , Weicong Liang , Bohan Chen , Yiduo Hao , Bojian Hou , Xiangyu Yue , Chao Zhang , Yuhui Yuan

One-to-one set matching is a key design for DETR to establish its end-to-end capability, so that object detection does not require a hand-crafted NMS (non-maximum suppression) to remove duplicate detections. This end-to-end signature is…

Computer Vision and Pattern Recognition · Computer Science 2023-05-17 Ding Jia , Yuhui Yuan , Haodi He , Xiaopei Wu , Haojun Yu , Weihong Lin , Lei Sun , Chao Zhang , Han Hu

DETR is a novel end-to-end transformer architecture object detector, which significantly outperforms classic detectors when scaling up. In this paper, we focus on the compression of DETR with knowledge distillation. While knowledge…

Computer Vision and Pattern Recognition · Computer Science 2025-06-26 Yu Wang , Xin Li , Shengzhao Weng , Gang Zhang , Haixiao Yue , Haocheng Feng , Junyu Han , Errui Ding

We present a conceptually simple, efficient, and general framework for localization problems in DETR-like models. We add plugins to well-trained models instead of inefficiently designing new models and training them from scratch. The…

Computer Vision and Pattern Recognition · Computer Science 2023-07-25 Yiqun Chen , Qiang Chen , Peize Sun , Shoufa Chen , Jingdong Wang , Jian Cheng

Detection transformer (DETR) relies on one-to-one assignment, assigning one ground-truth object to one prediction, for end-to-end detection without NMS post-processing. It is known that one-to-many assignment, assigning one ground-truth…

Computer Vision and Pattern Recognition · Computer Science 2023-09-01 Qiang Chen , Xiaokang Chen , Jian Wang , Shan Zhang , Kun Yao , Haocheng Feng , Junyu Han , Errui Ding , Gang Zeng , Jingdong Wang

The success of deep architectures is at least in part attributed to the layer-by-layer unsupervised pre-training that initializes the network. Various papers have reported extensive empirical analysis focusing on the design and…

Machine Learning · Computer Science 2015-02-13 Vamsi K Ithapu , Sathya Ravi , Vikas Singh

We present in this paper a novel query formulation using dynamic anchor boxes for DETR (DEtection TRansformer) and offer a deeper understanding of the role of queries in DETR. This new formulation directly uses box coordinates as queries in…

Computer Vision and Pattern Recognition · Computer Science 2022-03-31 Shilong Liu , Feng Li , Hao Zhang , Xiao Yang , Xianbiao Qi , Hang Su , Jun Zhu , Lei Zhang

Detection Transformers (DETR) formulate object detection as a set prediction problem and enable end-to-end training without post-processing. However, object queries in DETR interact through symmetric self-attention, which enforces uniform…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Ye Zhang , Qi Chen , Wenyou Huang , Rui Liu , Zhengjian Kang

The astounding performance of transformers in natural language processing (NLP) has motivated researchers to explore their applications in computer vision tasks. DEtection TRansformer (DETR) introduces transformers to object detection tasks…

Computer Vision and Pattern Recognition · Computer Science 2023-07-13 Tahira Shehzadi , Khurram Azeem Hashmi , Didier Stricker , Muhammad Zeshan Afzal

Denoising diffusion models have been a mainstream approach for image generation, however, training these models often suffers from slow convergence. In this paper, we discovered that the slow convergence is partly due to conflicting…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Tiankai Hang , Shuyang Gu , Chen Li , Jianmin Bao , Dong Chen , Han Hu , Xin Geng , Baining Guo

Dense object detection is widely used in automatic driving, video surveillance, and other fields. This paper focuses on the challenging task of dense object detection. Currently, detection methods based on greedy algorithms, such as…

Computer Vision and Pattern Recognition · Computer Science 2025-02-12 Yueming Huang , Chenrui Ma , Hao Zhou , Hao Wu , Guowu Yuan

De-noising is a prominent step in the spectra post-processing procedure. Previous machine learning-based methods are fast but mostly based on supervised learning and require a training set that may be typically expensive in real…

Materials Science · Physics 2024-03-06 Dongchen Huang , Junde Liu , Tian Qian , Hongming Weng

Solving inverse problems requires appropriate regularization techniques to ensure well-posedness and stability. In recent years, denoiser-driven methods have emerged as effective regularization strategies, achieving state-of-the-art…

Numerical Analysis · Mathematics 2026-04-23 Harshit Bajpai , Ankik Kumar Giri , Tim Jahn , Abhinav Jha

Automatic Vehicle Detection (AVD) in diverse driving environments presents unique challenges due to varying lighting conditions, road types, and vehicle types. Traditional methods, such as YOLO and Faster R-CNN, often struggle to cope with…

Computer Vision and Pattern Recognition · Computer Science 2025-02-26 Istiaq Ahmed Fahad , Abdullah Ibne Hanif Arean , Nazmus Sakib Ahmed , Mahmudul Hasan

This paper takes an important step in bridging the performance gap between DETR and R-CNN for graphical object detection. Existing graphical object detection approaches have enjoyed recent enhancements in CNN-based object detection methods,…

Computer Vision and Pattern Recognition · Computer Science 2023-06-26 Tahira Shehzadi , Khurram Azeem Hashmi , Didier Stricker , Marcus Liwicki , Muhammad Zeshan Afzal

Line segment detection is a fundamental low-level task in computer vision, and improvements in this task can impact more advanced methods that depend on it. Most new methods developed for line segment detection are based on Convolutional…

Computer Vision and Pattern Recognition · Computer Science 2024-11-21 Sebastian Janampa , Marios Pattichis

Diffusion Transformers (DiT) have attracted significant attention in research. However, they suffer from a slow convergence rate. In this paper, we aim to accelerate DiT training without any architectural modification. We identify the…

Computer Vision and Pattern Recognition · Computer Science 2024-11-01 Jingfeng Yao , Wang Cheng , Wenyu Liu , Xinggang Wang

The recently proposed Detection Transformer (DETR) model successfully applies Transformer to objects detection and achieves comparable performance with two-stage object detection frameworks, such as Faster-RCNN. However, DETR suffers from…

Computer Vision and Pattern Recognition · Computer Science 2021-08-21 Peng Gao , Minghang Zheng , Xiaogang Wang , Jifeng Dai , Hongsheng Li