English
Related papers

Related papers: HMPE:HeatMap Embedding for Efficient Transformer-B…

200 papers

Transformer-based detectors have advanced small-object detection, but they often remain inefficient and vulnerable to background-induced query noise, which motivates deep decoders to refine low-quality queries. We present HELP…

Computer Vision and Pattern Recognition · Computer Science 2026-04-17 Yangchen Zeng , Zhenyu Yu , Dongming Jiang , Wenbo Zhang , Yifan Hong , Zhanhua Hu , Jiao Luo , Kangning Cui

Moving Object Detection (MOD) is a crucial task for the Autonomous Driving pipeline. MOD is usually handled via 2-stream convolutional architectures that incorporates both appearance and motion cues, without considering the inter-relations…

Computer Vision and Pattern Recognition · Computer Science 2021-06-23 Eslam Mohamed , Ahmad El-Sallab

Detecting 3D objects accurately from multi-view 2D images is a challenging yet essential task in the field of autonomous driving. Current methods resort to integrating depth prediction to recover the spatial information for object query…

Computer Vision and Pattern Recognition · Computer Science 2025-10-20 Haisheng Su , Junjie Zhang , Feixiang Song , Sanping Zhou , Wei Wu , Nanning Zheng , Junchi Yan

In Transformer-based architectures, the attention mechanism is inherently permutation-invariant with respect to the input sequence's tokens. To impose sequential order, token positions are typically encoded using a scheme with either fixed…

Machine Learning · Computer Science 2023-10-31 Giorgio Angelotti

Since self-attention layers in Transformers are permutation invariant by design, positional encodings must be explicitly incorporated to enable spatial understanding. However, fixed-size lookup tables used in traditional learnable position…

Machine Learning · Computer Science 2025-06-18 Huayang Li , Yahui Liu , Hongyu Sun , Deng Cai , Leyang Cui , Wei Bi , Peilin Zhao , Taro Watanabe

In this paper, we address the problem of detecting 3D objects from multi-view images. Current query-based methods rely on global 3D position embeddings (PE) to learn the geometric correspondence between images and 3D space. We claim that…

Computer Vision and Pattern Recognition · Computer Science 2023-03-21 Kaixin Xiong , Shi Gong , Xiaoqing Ye , Xiao Tan , Ji Wan , Errui Ding , Jingdong Wang , Xiang Bai

Human pose estimation on medium and small scales has long been a significant challenge in this field. Most existing methods focus on restoring high-resolution feature maps by stacking multiple costly deconvolutional layers or by…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Zhoujie Xu

Transformer-based methods have swept the benchmarks on 2D and 3D detection on images. Because tokenization before the attention mechanism drops the spatial information, positional encoding becomes critical for those methods. Recent works…

Computer Vision and Pattern Recognition · Computer Science 2023-07-31 Changyong Shu , JIajun Deng , Fisher Yu , Yifan Liu

Transformer-based methods have achieved impressive results in time series forecasting. However, existing Transformers still exhibit limitations in sequence modeling as they tend to overemphasize temporal dependencies. This incurs additional…

Machine Learning · Computer Science 2025-12-16 Tan Wang , Yun Wei Dong , Qi Wang

Human pose estimation (HPE) usually requires large-scale training data to reach high performance. However, it is rather time-consuming to collect high-quality and fine-grained annotations for human body. To alleviate this issue, we revisit…

Computer Vision and Pattern Recognition · Computer Science 2022-05-26 Xixia Xu , Yingguo Gao , Ke Yan , Xue Lin , Qi Zou

State-of-the-art two-stage object detectors apply a classifier to a sparse set of object proposals, relying on region-wise features extracted by RoIPool or RoIAlign as inputs. The region-wise features, in spite of aligning well with the…

Computer Vision and Pattern Recognition · Computer Science 2021-09-01 Zhao-Min Chen , Xin Jin , Borui Zhao , Xiu-Shen Wei , Yanwen Guo

Attribute recognition is a crucial but challenging task due to viewpoint changes, illumination variations and appearance diversities, etc. Most of previous work only consider the attribute-level feature embedding, which might perform poorly…

Computer Vision and Pattern Recognition · Computer Science 2020-05-26 Jie Yang , Jiarou Fan , Yiru Wang , Yige Wang , Weihao Gan , Lin Liu , Wei Wu

Wide Area Motion Imagery (WAMI) yields high-resolution images with a large number of extremely small objects. Target objects have large spatial displacements throughout consecutive frames. This nature of WAMI images makes object tracking…

Computer Vision and Pattern Recognition · Computer Science 2021-12-30 Hakki Motorcu , Hasan F. Ates , H. Fatih Ugurdag , Bahadir Gunturk

Transformers rely on explicit positional encoding to model structure in data. While Rotary Position Embedding (RoPE) excels in 1D domains, its application to image generation reveals significant limitations such as fine-grained spatial…

Computer Vision and Pattern Recognition · Computer Science 2026-03-13 Jiaye Li , Baoyou Chen , Hui Li , Zilong Dong , Jingdong Wang , Siyu Zhu

The 2D heatmap-based approaches have dominated Human Pose Estimation (HPE) for years due to high performance. However, the long-standing quantization error problem in the 2D heatmap-based methods leads to several well-known drawbacks: 1)…

Computer Vision and Pattern Recognition · Computer Science 2022-07-06 Yanjie Li , Sen Yang , Peidong Liu , Shoukui Zhang , Yunxiao Wang , Zhicheng Wang , Wankou Yang , Shu-Tao Xia

3D hand pose estimation (HPE) is the process of locating the joints of the hand in 3D from any visual input. HPE has recently received an increased amount of attention due to its key role in a variety of human-computer interaction…

Computer Vision and Pattern Recognition · Computer Science 2022-06-14 Leyla Khaleghi , Joshua Marshall , Ali Etemad

The main challenge for small object detection algorithms is to ensure accuracy while pursuing real-time performance. The RT-DETR model performs well in real-time object detection, but performs poorly in small object detection accuracy. In…

Computer Vision and Pattern Recognition · Computer Science 2024-01-17 Ji Huang , Hui Wang

Object detection in event streams has emerged as a cutting-edge research area, demonstrating superior performance in low-light conditions, scenarios with motion blur, and rapid movements. Current detectors leverage spiking neural networks,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Xiao Wang , Yu Jin , Wentao Wu , Wei Zhang , Lin Zhu , Bo Jiang , Yonghong Tian

Recent studies have demonstrated the effectiveness of position encoding in transformer architectures. By incorporating positional information, this approach provides essential guidance for modeling dependencies between elements across…

Machine Learning · Computer Science 2025-08-27 Avinash Amballa

Human pose estimation in complicated situations has always been a challenging task. Many Transformer-based pose networks have been proposed recently, achieving encouraging progress in improving performance. However, the remarkable…

Computer Vision and Pattern Recognition · Computer Science 2023-11-27 Chengpeng Wu , Guangxing Tan , Chunyu Li
‹ Prev 1 2 3 10 Next ›