English
Related papers

Related papers: RQFormer: Rotated Query Transformer for End-to-End…

200 papers

In this paper, we propose a simple attention mechanism, we call box-attention. It enables spatial interaction between grid features, as sampled from boxes of interest, and improves the learning capability of transformers for several vision…

Computer Vision and Pattern Recognition · Computer Science 2022-03-28 Duy-Kien Nguyen , Jihong Ju , Olaf Booij , Martin R. Oswald , Cees G. M. Snoek

In this paper, we propose a novel query design for the transformer-based object detection. In previous transformer-based detectors, the object queries are a set of learned embeddings. However, each learned embedding does not have an…

Computer Vision and Pattern Recognition · Computer Science 2022-01-05 Yingming Wang , Xiangyu Zhang , Tong Yang , Jian Sun

This paper investigates a phenomenon where query-based object detectors mispredict at the last decoding stage while predicting correctly at an intermediate stage. We review the training process and attribute the overlooked phenomenon to two…

Computer Vision and Pattern Recognition · Computer Science 2023-03-23 Fangyi Chen , Han Zhang , Kai Hu , Yu-kai Huang , Chenchen Zhu , Marios Savvides

Human action recognition has recently become one of the popular research topics in the computer vision community. Various 3D-CNN based methods have been presented to tackle both the spatial and temporal dimensions in the task of video…

Computer Vision and Pattern Recognition · Computer Science 2022-03-22 Thanh-Dat Truong , Quoc-Huy Bui , Chi Nhan Duong , Han-Seok Seo , Son Lam Phung , Xin Li , Khoa Luu

Transformer-based models are unable to process long sequences due to their self-attention operation, which scales quadratically with the sequence length. To address this limitation, we introduce the Longformer with an attention mechanism…

Computation and Language · Computer Science 2020-12-03 Iz Beltagy , Matthew E. Peters , Arman Cohan

Vision Transformers with various attention modules have demonstrated superior performance on vision tasks. While using sparsity-adaptive attention, such as in DAT, has yielded strong results in image classification, the key-value pairs…

Computer Vision and Pattern Recognition · Computer Science 2024-10-14 Nguyen Huu Bao Long , Chenyu Zhang , Yuzhi Shi , Tsubasa Hirakawa , Takayoshi Yamashita , Tohgoroh Matsui , Hironobu Fujiyoshi

Query-based methods have garnered significant attention in object detection since the advent of DETR, the pioneering query-based detector. However, these methods face challenges like slow convergence and suboptimal performance. Notably,…

Computer Vision and Pattern Recognition · Computer Science 2023-12-15 Hongbin Xu , Yamei Xia , Shuai Zhao , Bo Cheng

Real-world Vehicle Routing Problems (RWVRPs) require solving complex, sequence-dependent challenges at scale with constraints such as delivery time window, replenishment or recharging stops, asymmetric travel cost, etc. While recent neural…

Machine Learning · Computer Science 2026-02-04 Saeed Nasehi Basharzad , Farhana Choudhury , Egemen Tanin

End-to-end Object Detection with Transformer (DETR)proposes to perform object detection with Transformer and achieve comparable performance with two-stage object detection like Faster-RCNN. However, DETR needs huge computational resources…

Computer Vision and Pattern Recognition · Computer Science 2021-10-19 Minghang Zheng , Peng Gao , Renrui Zhang , Kunchang Li , Xiaogang Wang , Hongsheng Li , Hao Dong

Although numerous recent tracking approaches have made tremendous advances in the last decade, achieving high-performance visual tracking remains a challenge. In this paper, we propose an end-to-end network model to learn reinforced…

Computer Vision and Pattern Recognition · Computer Science 2020-01-03 Peng Gao , Qiquan Zhang , Fei Wang , Liyi Xiao , Hamido Fujita , Yan Zhang

In this work, we address the challenging task of referring segmentation. The query expression in referring segmentation typically indicates the target object by describing its relationship with others. Therefore, to find the target one…

Computer Vision and Pattern Recognition · Computer Science 2021-08-13 Henghui Ding , Chang Liu , Suchen Wang , Xudong Jiang

Object detection has recently seen an interesting trend in terms of the most innovative research work, this task being of particular importance in the field of remote sensing, given the consistency of these images in terms of geographical…

Computer Vision and Pattern Recognition · Computer Science 2025-06-02 Anasse Boutayeb , Iyad Lahsen-cherif , Ahmed El Khadimi

Although lane detection methods have shown impressive performance in real-world scenarios, most of methods require post-processing which is not robust enough. Therefore, end-to-end detectors like DEtection TRansformer(DETR) have been…

Computer Vision and Pattern Recognition · Computer Science 2023-05-16 Kunyang Zhou , Rui Zhou

Multiple-object tracking (MOT) is a challenging task that requires simultaneous reasoning about location, appearance, and identity of the objects in the scene over time. Our aim in this paper is to move beyond tracking-by-detection…

Computer Vision and Pattern Recognition · Computer Science 2022-10-27 Bruno Korbar , Andrew Zisserman

Rotation detection is a challenging task due to the difficulties of locating the multi-angle objects and separating them effectively from the background. Though considerable progress has been made, for practical settings, there still exist…

Computer Vision and Pattern Recognition · Computer Science 2020-12-09 Xue Yang , Junchi Yan , Ziming Feng , Tao He

Object Detection with Transformers (DETR) and related works reach or even surpass the highly-optimized Faster-RCNN baseline with self-attention network architectures. Inspired by the evidence that pure self-attention possesses a strong…

Computer Vision and Pattern Recognition · Computer Science 2021-12-28 Wenchi Ma , Tianxiao Zhang , Guanghui Wang

With the emergence of VR and AR, 360{\deg} data attracts increasing attention from the computer vision and multimedia communities. Typically, 360{\deg} data is projected into 2D ERP (equirectangular projection) images for feature…

Computer Vision and Pattern Recognition · Computer Science 2023-08-08 Yinjie Zhao , Lichen Zhao , Qian Yu , Jing Zhang , Lu Sheng , Dong Xu

We present a new method that views object detection as a direct set prediction problem. Our approach streamlines the detection pipeline, effectively removing the need for many hand-designed components like a non-maximum suppression…

Computer Vision and Pattern Recognition · Computer Science 2020-05-29 Nicolas Carion , Francisco Massa , Gabriel Synnaeve , Nicolas Usunier , Alexander Kirillov , Sergey Zagoruyko

Transformers have recently gained attention in the computer vision domain due to their ability to model long-range dependencies. However, the self-attention mechanism, which is the core part of the Transformer model, usually suffers from…

Computer Vision and Pattern Recognition · Computer Science 2023-07-28 Reza Azad , René Arimond , Ehsan Khodapanah Aghdam , Amirhossein Kazerouni , Dorit Merhof

To capture user preference, transformer models have been widely applied to model sequential user behavior data. The core of transformer architecture lies in the self-attention mechanism, which computes the pairwise attention scores in a…

Information Retrieval · Computer Science 2024-04-05 Zhen Tian , Wayne Xin Zhao , Changwang Zhang , Xin Zhao , Zhongrui Ma , Ji-Rong Wen