English
Related papers

Related papers: RQFormer: Rotated Query Transformer for End-to-End…

200 papers

Vision Transformer has demonstrated impressive success across various vision tasks. However, its heavy computation cost, which grows quadratically with respect to the token sequence length, largely limits its power in handling large feature…

Computer Vision and Pattern Recognition · Computer Science 2023-08-24 Sucheng Ren , Xingyi Yang , Songhua Liu , Xinchao Wang

Multiple object tracking (MOT) is the task containing detection and association. Plenty of trackers have achieved competitive performance. Unfortunately, for the lack of informative exchange on these subtasks, they are often biased toward…

Computer Vision and Pattern Recognition · Computer Science 2022-09-05 Bin Sun

This study proposes an improved end-to-end multi-target tracking algorithm that adapts to multi-view multi-scale scenes based on the self-attentive mechanism of the transformer's encoder-decoder structure. A multi-dimensional feature…

Computer Vision and Pattern Recognition · Computer Science 2022-11-14 Yong Hong , Deren Li , Shupei Luo , Xin Chen , Yi Yang , Mi Wang

General detectors follow the pipeline that feature maps extracted from ConvNets are shared between classification and regression tasks. However, there exists obvious conflicting requirements in multi-orientation object detection that…

Computer Vision and Pattern Recognition · Computer Science 2019-03-28 Zhixin Zhang , Xudong Chen , Jie Liu , Kaibo Zhou

The global and local contexts significantly contribute to the integrity of predictions in Salient Object Detection (SOD). Unfortunately, existing methods still struggle to generate complete predictions with fine details. There are two major…

Computer Vision and Pattern Recognition · Computer Science 2022-07-19 Yi Ke Yun , Weisi Lin

The attention module, which is a crucial component in Transformer, cannot scale efficiently to long sequences due to its quadratic complexity. Many works focus on approximating the dot-then-exponentiate softmax function in the original…

Machine Learning · Computer Science 2021-11-04 Shengjie Luo , Shanda Li , Tianle Cai , Di He , Dinglan Peng , Shuxin Zheng , Guolin Ke , Liwei Wang , Tie-Yan Liu

Recently, transformer-based networks have shown impressive results in semantic segmentation. Yet for real-time semantic segmentation, pure CNN-based approaches still dominate in this field, due to the time-consuming computation mechanism of…

Computer Vision and Pattern Recognition · Computer Science 2022-10-14 Jian Wang , Chenhui Gou , Qiman Wu , Haocheng Feng , Junyu Han , Errui Ding , Jingdong Wang

Transformer-based QA models use input-wide self-attention -- i.e. across both the question and the input passage -- at all layers, causing them to be slow and memory-intensive. It turns out that we can get by without input-wide…

Computation and Language · Computer Science 2020-05-05 Qingqing Cao , Harsh Trivedi , Aruna Balasubramanian , Niranjan Balasubramanian

Human-Object Interaction (HOI) detection aims to localize human-object pairs and recognize their interactions in images. Although DETR-based methods have recently emerged as the mainstream framework for HOI detection, they still suffer from…

Computer Vision and Pattern Recognition · Computer Science 2025-08-13 Yuxiao Wang , Wolin Liang , Yu Lei , Weiying Xue , Nan Zhuang , Qi Liu

While convolutional neural networks have gained impressive success recently in solving structured prediction problems such as semantic segmentation, it remains a challenge to differentiate individual object instances in the scene. Instance…

Machine Learning · Computer Science 2017-07-14 Mengye Ren , Richard S. Zemel

Transformers have achieved significant success across various domains, relying on self-attention to capture dependencies. However, the standard first-order attention mechanism is often limited by a low-rank bottleneck, struggling to capture…

Computation and Language · Computer Science 2025-12-05 Hanting Chen , Chong Zhu , Kai Han , Yuchuan Tian , Yuchen Liang , Tianyu Guo , Xinghao Chen , Dacheng Tao , Yunhe Wang

The quadratic computation complexity of self-attention has been a persistent challenge when applying Transformer models to vision tasks. Linear attention, on the other hand, offers a much more efficient alternative with its linear…

Computer Vision and Pattern Recognition · Computer Science 2023-09-04 Dongchen Han , Xuran Pan , Yizeng Han , Shiji Song , Gao Huang

Rotated object detection in remote sensing imagery is hindered by three major bottlenecks: non-adaptive receptive field utilization, inadequate long-range multi-scale feature fusion, and discontinuities in angle regression. To address these…

Computer Vision and Pattern Recognition · Computer Science 2026-03-06 Huiran Sun

The task object tracking is vital in numerous applications such as autonomous driving, intelligent surveillance, robotics, etc. This task entails the assigning of a bounding box to an object in a video stream, given only the bounding box…

Computer Vision and Pattern Recognition · Computer Science 2020-12-18 Vladislav Belyaev , Aleksandra Malysheva , Aleksei Shpilman

Text in natural images is of arbitrary orientations, requiring detection in terms of oriented bounding boxes. Normally, a multi-oriented text detector often involves two key tasks: 1) text presence detection, which is a classification…

Computer Vision and Pattern Recognition · Computer Science 2018-03-15 Minghui Liao , Zhen Zhu , Baoguang Shi , Gui-song Xia , Xiang Bai

Local feature matching remains a challenging task, primarily due to difficulties in matching sparse keypoints and low-texture regions. The key to solving this problem lies in effectively and accurately integrating global and local…

Image and Video Processing · Electrical Eng. & Systems 2025-04-01 Yun Liao , Yide Di , Hao Zhou , Kaijun Zhu , Mingyu Lu , Yijia Zhang , Qing Duan , Junhui Liu

Recently, Vision Transformer and its variants have shown great promise on various computer vision tasks. The ability of capturing short- and long-range visual dependencies through self-attention is arguably the main source for the success.…

Computer Vision and Pattern Recognition · Computer Science 2021-07-02 Jianwei Yang , Chunyuan Li , Pengchuan Zhang , Xiyang Dai , Bin Xiao , Lu Yuan , Jianfeng Gao

This paper presents a novel approach, Spectral-Interpretable and -Enhanced Transformer (SIEFormer), which leverages spectral analysis to reinterpret the attention mechanism within Vision Transformer (ViT) and enhance feature adaptability,…

Computer Vision and Pattern Recognition · Computer Science 2026-02-16 Chunming Li , Shidong Wang , Tong Xin , Haofeng Zhang

While transformers have shown great potential on video recognition with their strong capability of capturing long-range dependencies, they often suffer high computational costs induced by the self-attention to the huge number of 3D tokens.…

Computer Vision and Pattern Recognition · Computer Science 2022-11-23 Yuxuan Liang , Pan Zhou , Roger Zimmermann , Shuicheng Yan

Instance segmentation of ships in synthetic aperture radar (SAR) imagery is critical for applications such as maritime monitoring, environmental analysis, and national security. SAR ship images present challenges including scale variation,…

Computer Vision and Pattern Recognition · Computer Science 2025-06-16 F. Gao , Y Li , X He , J Sun , J Wang