English
Related papers

Related papers: Rethinking Transformer-based Set Prediction for Ob…

200 papers

The recently proposed DEtection TRansformer (DETR) has established a fully end-to-end paradigm for object detection. However, DETR suffers from slow training convergence, which hinders its applicability to various detection tasks. We…

Computer Vision and Pattern Recognition · Computer Science 2023-02-07 Gongjie Zhang , Zhipeng Luo , Jiaxing Huang , Shijian Lu , Eric P. Xing

DETR is a novel end-to-end transformer architecture object detector, which significantly outperforms classic detectors when scaling up. In this paper, we focus on the compression of DETR with knowledge distillation. While knowledge…

Computer Vision and Pattern Recognition · Computer Science 2025-06-26 Yu Wang , Xin Li , Shengzhao Weng , Gang Zhang , Haixiao Yue , Haocheng Feng , Junyu Han , Errui Ding

Recent DEtection TRansformer-based (DETR) models have obtained remarkable performance. Its success cannot be achieved without the re-introduction of multi-scale feature fusion in the encoder. However, the excessively increased tokens in…

Computer Vision and Pattern Recognition · Computer Science 2023-03-14 Feng Li , Ailing Zeng , Shilong Liu , Hao Zhang , Hongyang Li , Lei Zhang , Lionel M. Ni

Transformers have revolutionized the object detection landscape by introducing DETRs, acclaimed for their simplicity and efficacy. Despite their advantages, the substantial size of these models poses significant challenges for practical…

Computer Vision and Pattern Recognition · Computer Science 2024-09-11 Yi Liu , Luting Wang , Zongheng Tang , Yue Liao , Yifan Sun , Lijun Zhang , Si Liu

Detection Transformer (DETR) and Deformable DETR have been proposed to eliminate the need for many hand-designed components in object detection while demonstrating good performance as previous complex hand-crafted detectors. However, their…

Computer Vision and Pattern Recognition · Computer Science 2022-11-23 Qianyu Zhou , Xiangtai Li , Lu He , Yibo Yang , Guangliang Cheng , Yunhai Tong , Lizhuang Ma , Dacheng Tao

This paper is on Few-Shot Object Detection (FSOD), where given a few templates (examples) depicting a novel class (not seen during training), the goal is to detect all of its occurrences within a set of images. From a practical perspective,…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Adrian Bulat , Ricardo Guerrero , Brais Martinez , Georgios Tzimiropoulos

The main challenge for small object detection algorithms is to ensure accuracy while pursuing real-time performance. The RT-DETR model performs well in real-time object detection, but performs poorly in small object detection accuracy. In…

Computer Vision and Pattern Recognition · Computer Science 2024-01-17 Ji Huang , Hui Wang

The recently proposed end-to-end transformer detectors, such as DETR and Deformable DETR, have a cascade structure of stacking 6 decoder layers to update object queries iteratively, without which their performance degrades seriously. In…

Computer Vision and Pattern Recognition · Computer Science 2021-04-06 Zhuyu Yao , Jiangbo Ai , Boxun Li , Chi Zhang

Detection Transformers (DETR) are renowned object detection pipelines, however computationally efficient multiscale detection using DETR is still challenging. In this paper, we propose a Cross-Resolution Encoding-Decoding (CRED) mechanism…

Computer Vision and Pattern Recognition · Computer Science 2024-10-08 Ashish Kumar , Jaesik Park

In the recent years, we have witnessed a paradigm shift in the field of Computer Vision, with the forthcoming of the transformer architecture. Detection Transformers has become a state of the art solution to object detection and is a…

Computer Vision and Pattern Recognition · Computer Science 2024-11-25 Irfan Nafiz Shahan , Arban Hossain , Saadman Sakib , Al-Mubin Nabil

Clothing segmentation and fine-grained attribute recognition are challenging tasks at the crossing of computer vision and fashion, which segment the entire ensemble clothing instances as well as recognize detailed attributes of the clothing…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Hao Tian , Yu Cao , P. Y. Mok

This paper is concerned with the matching stability problem across different decoder layers in DEtection TRansformers (DETR). We point out that the unstable matching in DETR is caused by a multi-optimization path problem, which is…

Computer Vision and Pattern Recognition · Computer Science 2023-04-11 Shilong Liu , Tianhe Ren , Jiayu Chen , Zhaoyang Zeng , Hao Zhang , Feng Li , Hongyang Li , Jun Huang , Hang Su , Jun Zhu , Lei Zhang

DETR has set up a simple end-to-end pipeline for object detection by formulating this task as a set prediction problem, showing promising potential. Despite its notable advancements, this paper identifies two key forms of misalignment…

Computer Vision and Pattern Recognition · Computer Science 2024-12-24 Zhi Cai , Songtao Liu , Guodong Wang , Zheng Ge , Xiangyu Zhang , Di Huang

The Detection Transformer (DETR) has revolutionized the design of CNN-based object detection systems, showcasing impressive performance. However, its potential in the domain of multi-frame 3D object detection remains largely unexplored. In…

Computer Vision and Pattern Recognition · Computer Science 2025-08-21 Yifan Zhang , Zhiyu Zhu , Junhui Hou , Dapeng Wu

End-to-end Object Detection with Transformer (DETR)proposes to perform object detection with Transformer and achieve comparable performance with two-stage object detection like Faster-RCNN. However, DETR needs huge computational resources…

Computer Vision and Pattern Recognition · Computer Science 2021-10-19 Minghang Zheng , Peng Gao , Renrui Zhang , Kunchang Li , Xiaogang Wang , Hongsheng Li , Hao Dong

Although detection with Transformer (DETR) is increasingly popular, its global attention modeling requires an extremely long training period to optimize and achieve promising detection performance. Alternative to existing studies that…

Computer Vision and Pattern Recognition · Computer Science 2022-04-13 Zhe Chen , Jing Zhang , Dacheng Tao

We introduce DEIM, an innovative and efficient training framework designed to accelerate convergence in real-time object detection with Transformer-based architectures (DETR). To mitigate the sparse supervision inherent in one-to-one (O2O)…

Computer Vision and Pattern Recognition · Computer Science 2025-03-27 Shihua Huang , Zhichao Lu , Xiaodong Cun , Yongjun Yu , Xiao Zhou , Xi Shen

Transformer-based multi-object tracking (MOT) methods have captured the attention of many researchers in recent years. However, these models often suffer from slow inference speeds due to their structure or other issues. To address this…

Computer Vision and Pattern Recognition · Computer Science 2025-07-31 Pan Liao , Feng Yang , Di Wu , Jinwen Yu , Wenhui Zhao , Dingwen Zhang

Vision transformers (ViTs) are changing the landscape of object detection approaches. A natural usage of ViTs in detection is to replace the CNN-based backbone with a transformer-based backbone, which is straightforward and effective, with…

Computer Vision and Pattern Recognition · Computer Science 2022-06-20 Peixian Chen , Mengdan Zhang , Yunhang Shen , Kekai Sheng , Yuting Gao , Xing Sun , Ke Li , Chunhua Shen

Visual prompted object detection enables interactive and flexible definition of target categories, thereby facilitating open-vocabulary detection. Since visual prompts are derived directly from image features, they often outperform text…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Bo Qian , Dahu Shi , Xing Wei