English
Related papers

Related papers: Object Detection with Transformers: A Review

200 papers

Transformers have shown outstanding results for natural language understanding and, more recently, for image classification. We here extend this work and propose a transformer-based approach for image retrieval: we adopt vision transformers…

Computer Vision and Pattern Recognition · Computer Science 2021-02-11 Alaaeldin El-Nouby , Natalia Neverova , Ivan Laptev , Hervé Jégou

Recently, DEtection TRansformer (DETR), an end-to-end object detection pipeline, has achieved promising performance. However, it requires large-scale labeled data and suffers from domain shift, especially when no labeled data is available…

Computer Vision and Pattern Recognition · Computer Science 2022-08-17 Jinze Yu , Jiaming Liu , Xiaobao Wei , Haoyi Zhou , Yohei Nakata , Denis Gudovskiy , Tomoyuki Okuno , Jianxin Li , Kurt Keutzer , Shanghang Zhang

Transformer, originally devised for natural language processing, has also attested significant success in computer vision. Thanks to its super expressive power, researchers are investigating ways to deploy transformers to reinforcement…

Machine Learning · Computer Science 2023-01-24 Shengchao Hu , Li Shen , Ya Zhang , Yixin Chen , Dacheng Tao

Transformer, as one of the most advanced neural network models in Natural Language Processing (NLP), exhibits diverse applications in the field of anomaly detection. To inspire research on Transformer-based anomaly detection, this review…

Machine Learning · Computer Science 2024-02-15 Mingrui Ma , Lansheng Han , Chunjie Zhou

In this paper, we present a light-weight detection transformer, LW-DETR, which outperforms YOLOs for real-time object detection. The architecture is a simple stack of a ViT encoder, a projector, and a shallow DETR decoder. Our approach…

Computer Vision and Pattern Recognition · Computer Science 2024-06-06 Qiang Chen , Xiangbo Su , Xinyu Zhang , Jian Wang , Jiahui Chen , Yunpeng Shen , Chuchu Han , Ziliang Chen , Weixiang Xu , Fanrong Li , Shan Zhang , Kun Yao , Errui Ding , Gang Zhang , Jingdong Wang

Clothing segmentation and fine-grained attribute recognition are challenging tasks at the crossing of computer vision and fashion, which segment the entire ensemble clothing instances as well as recognize detailed attributes of the clothing…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Hao Tian , Yu Cao , P. Y. Mok

As a core problem in computer vision, the performance of object detection has improved drastically in the past few years. Despite their impressive performance, object detectors suffer from a lack of interpretability. Visualization…

Computer Vision and Pattern Recognition · Computer Science 2021-06-29 Ang Cao , Justin Johnson

Recently, Transformer-based methods, which predict polygon points or Bezier curve control points for localizing texts, are popular in scene text detection. However, these methods built upon detection transformer framework might achieve…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Maoyuan Ye , Jing Zhang , Shanshan Zhao , Juhua Liu , Bo Du , Dacheng Tao

Open-vocabulary object detection, which is concerned with the problem of detecting novel objects guided by natural language, has gained increasing attention from the community. Ideally, we would like to extend an open-vocabulary detector…

Computer Vision and Pattern Recognition · Computer Science 2022-12-01 Yuhang Zang , Wei Li , Kaiyang Zhou , Chen Huang , Chen Change Loy

Transformers have become the dominant model in natural language processing, owing to their ability to pretrain on massive amounts of data, then transfer to smaller, more specific tasks via fine-tuning. The Vision Transformer was the first…

Computer Vision and Pattern Recognition · Computer Science 2020-12-21 Josh Beal , Eric Kim , Eric Tzeng , Dong Huk Park , Andrew Zhai , Dmitry Kislyuk

The recently proposed DEtection TRansformer (DETR) has established a fully end-to-end paradigm for object detection. However, DETR suffers from slow training convergence, which hinders its applicability to various detection tasks. We…

Computer Vision and Pattern Recognition · Computer Science 2023-02-07 Gongjie Zhang , Zhipeng Luo , Jiaxing Huang , Shijian Lu , Eric P. Xing

Visual prompted object detection enables interactive and flexible definition of target categories, thereby facilitating open-vocabulary detection. Since visual prompts are derived directly from image features, they often outperform text…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Bo Qian , Dahu Shi , Xing Wei

Recent proposed DETR variants have made tremendous progress in various scenarios due to their streamlined processes and remarkable performance. However, the learned queries usually explore the global context to generate the final set…

Computer Vision and Pattern Recognition · Computer Science 2023-03-01 Tian Qiu , Linyun Zhou , Wenxiang Xu , Lechao Cheng , Zunlei Feng , Mingli Song

Table detection within document images is a crucial task in document processing, involving the identification and localization of tables. Recent strides in deep learning have substantially improved the accuracy of this task, but it still…

Computer Vision and Pattern Recognition · Computer Science 2024-05-02 Tahira Shehzadi , Shalini Sarode , Didier Stricker , Muhammad Zeshan Afzal

Transformers have significantly impacted domains like natural language processing, computer vision, and robotics, where they improve performance compared to other neural networks. This survey explores how transformers are used in…

Machine Learning · Computer Science 2023-07-13 Pranav Agarwal , Aamer Abdul Rahman , Pierre-Luc St-Charles , Simon J. D. Prince , Samira Ebrahimi Kahou

We present RiO-DETR: DETR for Real-time Oriented Object Detection, the first real-time oriented detection transformer to the best of our knowledge. Adapting DETR to oriented bounding boxes (OBBs) poses three challenges: semantics-dependent…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Zhangchi Hu , Yifan Zhao , Yansong Peng , Wenzhang Sun , Xiangchen Yin , Jie Chen , Peixi Wu , Hebei Li , Xinghao Wang , Dongsheng Jiang , Xiaoyan Sun

The Transformer-based detectors (i.e., DETR) have demonstrated impressive performance on end-to-end object detection. However, transferring DETR to different data distributions may lead to a significant performance degradation. Existing…

Computer Vision and Pattern Recognition · Computer Science 2023-07-04 Peidong Jia , Jiaming Liu , Senqiao Yang , Jiarui Wu , Xiaodong Xie , Shanghang Zhang

Albeit revealing impressive predictive performance for several computer vision tasks, deep neural networks (DNNs) are prone to making overconfident predictions. This limits the adoption and wider utilization of DNNs in many safety-critical…

Computer Vision and Pattern Recognition · Computer Science 2023-11-08 Muhammad Akhtar Munir , Salman Khan , Muhammad Haris Khan , Mohsen Ali , Fahad Shahbaz Khan

Modern detection transformers (DETRs) use a set of object queries to predict a list of bounding boxes, sort them by their classification confidence scores, and select the top-ranked predictions as the final detection results for the given…

Computer Vision and Pattern Recognition · Computer Science 2023-11-06 Yifan Pu , Weicong Liang , Yiduo Hao , Yuhui Yuan , Yukang Yang , Chao Zhang , Han Hu , Gao Huang

Dense object detection is widely used in automatic driving, video surveillance, and other fields. This paper focuses on the challenging task of dense object detection. Currently, detection methods based on greedy algorithms, such as…

Computer Vision and Pattern Recognition · Computer Science 2025-02-12 Yueming Huang , Chenrui Ma , Hao Zhou , Hao Wu , Guowu Yuan