English
Related papers

Related papers: D^2ETR: Decoder-Only DETR with Computationally Eff…

200 papers

We analyze the DETR-based framework on semi-supervised object detection (SSOD) and observe that (1) the one-to-one assignment strategy generates incorrect matching when the pseudo ground-truth bounding box is inaccurate, leading to training…

Computer Vision and Pattern Recognition · Computer Science 2023-07-18 Jiacheng Zhang , Xiangru Lin , Wei Zhang , Kuo Wang , Xiao Tan , Junyu Han , Errui Ding , Jingdong Wang , Guanbin Li

Gaze communication plays a crucial role in daily social interactions. Quantifying this behavior can help in human-computer interaction and digital phenotyping. While end-to-end models exist for gaze target detection, they only utilize a…

Computer Vision and Pattern Recognition · Computer Science 2025-08-19 Ryan Anthony Jalova de Belen , Gelareh Mohammadi , Arcot Sowmya

Transformers have achieved promising results on a variety of tasks. However, the quadratic complexity in self-attention computation has limited the applications, especially in low-resource settings and mobile or edge devices. Existing works…

Sound · Computer Science 2024-01-09 Wentao Zhu

End-to-end object detectors offer a promising NMS-free paradigm for real-time applications, yet their high computational cost remains a significant barrier, particularly for complex scenarios like intersection traffic monitoring. To address…

Computer Vision and Pattern Recognition · Computer Science 2025-10-21 Zixing Wang , Yuhang Zhao

We introduce a highly performant 3D object detector for point clouds using the DETR framework. The prior attempts all end up with suboptimal results because they fail to learn accurate inductive biases from the limited scale of training…

Computer Vision and Pattern Recognition · Computer Science 2023-08-09 Yichao Shen , Zigang Geng , Yuhui Yuan , Yutong Lin , Ze Liu , Chunyu Wang , Han Hu , Nanning Zheng , Baining Guo

We introduce DEIM, an innovative and efficient training framework designed to accelerate convergence in real-time object detection with Transformer-based architectures (DETR). To mitigate the sparse supervision inherent in one-to-one (O2O)…

Computer Vision and Pattern Recognition · Computer Science 2025-03-27 Shihua Huang , Zhichao Lu , Xiaodong Cun , Yongjun Yu , Xiao Zhou , Xi Shen

Recently, DEtection TRansformer (DETR), an end-to-end object detection pipeline, has achieved promising performance. However, it requires large-scale labeled data and suffers from domain shift, especially when no labeled data is available…

Computer Vision and Pattern Recognition · Computer Science 2022-08-17 Jinze Yu , Jiaming Liu , Xiaobao Wei , Haoyi Zhou , Yohei Nakata , Denis Gudovskiy , Tomoyuki Okuno , Jianxin Li , Kurt Keutzer , Shanghang Zhang

Recent proposed DETR variants have made tremendous progress in various scenarios due to their streamlined processes and remarkable performance. However, the learned queries usually explore the global context to generate the final set…

Computer Vision and Pattern Recognition · Computer Science 2023-03-01 Tian Qiu , Linyun Zhou , Wenxiang Xu , Lechao Cheng , Zunlei Feng , Mingli Song

The recently proposed DEtection TRansformer (DETR) has established a fully end-to-end paradigm for object detection. However, DETR suffers from slow training convergence, which hinders its applicability to various detection tasks. We…

Computer Vision and Pattern Recognition · Computer Science 2023-02-07 Gongjie Zhang , Zhipeng Luo , Jiaxing Huang , Shijian Lu , Eric P. Xing

Recently, detection transformers (DETRs) have gradually taken a dominant position in 2D detection thanks to their elegant framework. However, DETR-based detectors for 3D point clouds are still difficult to achieve satisfactory performance.…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Zhe Liu , Jinghua Hou , Xiaoqing Ye , Tong Wang , Jingdong Wang , Xiang Bai

Based on analyzing the character of cascaded decoder architecture commonly adopted in existing DETR-like models, this paper proposes a new decoder architecture. The cascaded decoder architecture constrains object queries to update in the…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Zhixiong Nan , Xianghong Li , Jifeng Dai , Tao Xiang

The recent detection transformer (DETR) simplifies the object detection pipeline by removing hand-crafted designs and hyperparameters as employed in conventional two-stage object detectors. However, how to leverage the simple yet effective…

Computer Vision and Pattern Recognition · Computer Science 2023-03-23 Jingyi Zhang , Jiaxing Huang , Zhipeng Luo , Gongjie Zhang , Xiaoqin Zhang , Shijian Lu

The Euler Characteristic Transform (ECT) has proven to be a powerful representation, combining geometrical and topological characteristics of shapes and graphs. However, the ECT was hitherto unable to learn task-specific representations. We…

Machine Learning · Computer Science 2024-03-20 Ernst Roell , Bastian Rieck

The large attention-based encoder-decoder network (Transformer) has become prevailing recently due to its effectiveness. But the high computation complexity of its decoder raises the inefficiency issue. By examining the mathematic…

Computation and Language · Computer Science 2023-05-12 Yanyang Li , Ye Lin , Tong Xiao , Jingbo Zhu

The recently proposed Detection Transformer (DETR) model successfully applies Transformer to objects detection and achieves comparable performance with two-stage object detection frameworks, such as Faster-RCNN. However, DETR suffers from…

Computer Vision and Pattern Recognition · Computer Science 2021-01-20 Peng Gao , Minghang Zheng , Xiaogang Wang , Jifeng Dai , Hongsheng Li

Arbitrary-oriented object detection (AOOD) is a challenging task to detect objects in the wild with arbitrary orientations and cluttered arrangements. Existing approaches are mainly based on anchor-based boxes or dense points, which rely on…

Computer Vision and Pattern Recognition · Computer Science 2022-05-26 Linhui Dai , Hong Liu , Hao Tang , Zhiwei Wu , Pinhao Song

Existing studies on salient object detection (SOD) focus on extracting distinct objects with edge information and aggregating multi-level features to improve SOD performance. To achieve satisfactory performance, the methods employ refined…

Computer Vision and Pattern Recognition · Computer Science 2022-06-28 Min Seok Lee , Wooseok Shin , Sung Won Han

End-to-end automatic speech recognition (E2E-ASR) can be classified by its decoder architectures, such as connectionist temporal classification (CTC), recurrent neural network transducer (RNN-T), attention-based encoder-decoder, and…

Audio and Speech Processing · Electrical Eng. & Systems 2025-01-15 Yui Sudo , Muhammad Shakeel , Yosuke Fukumoto , Brian Yan , Jiatong Shi , Yifan Peng , Shinji Watanabe

We develop a deep learning algorithm for contour detection with a fully convolutional encoder-decoder network. Different from previous low-level edge detection, our algorithm focuses on detecting higher-level object contours. Our network is…

Computer Vision and Pattern Recognition · Computer Science 2016-03-16 Jimei Yang , Brian Price , Scott Cohen , Honglak Lee , Ming-Hsuan Yang

The Transformer translation model is based on the multi-head attention mechanism, which can be parallelized easily. The multi-head attention network performs the scaled dot-product attention function in parallel, empowering the model by…

Computation and Language · Computer Science 2021-09-13 Hongfei Xu , Qiuhui Liu , Josef van Genabith , Deyi Xiong