English
Related papers

Related papers: Learning Spatial-Frequency Transformer for Visual …

200 papers

Recently, Transformers have shown promising performance in various vision tasks. To reduce the quadratic computation complexity caused by the global self-attention, various methods constrain the range of attention within a local region to…

Computer Vision and Pattern Recognition · Computer Science 2021-12-30 Sitong Wu , Tianyi Wu , Haoru Tan , Guodong Guo

We propose a novel Transformer-based architecture for the task of generative modelling of 3D human motion. Previous work commonly relies on RNN-based models considering shorter forecast horizons reaching a stationary and often implausible…

Computer Vision and Pattern Recognition · Computer Science 2021-11-30 Emre Aksan , Manuel Kaufmann , Peng Cao , Otmar Hilliges

The recent trend in multiple object tracking (MOT) is heading towards leveraging deep learning to boost the tracking performance. In this paper, we propose a novel solution named TransSTAM, which leverages Transformer to effectively model…

Computer Vision and Pattern Recognition · Computer Science 2022-06-01 Peng Dai , Yiqiang Feng , Renliang Weng , Changshui Zhang

The modeling of high-dimensional spatio-temporal processes presents a fundamental dichotomy between the probabilistic rigor of classical geostatistics and the flexible, high-capacity representations of deep learning. While Gaussian…

Machine Learning · Computer Science 2025-12-22 Yuri Calleo

Currently, many face forgery detection methods aggregate spatial and frequency features to enhance the generalization ability and gain promising performance under the cross-dataset scenario. However, these methods only leverage one level…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Jie Liu , Jingjing Wang , Peng Zhang , Chunmao Wang , Di Xie , Shiliang Pu

Direct RAW-based object detection offers great promise by utilizing RAW data (unprocessed sensor data), but faces inherent challenges due to its wide dynamic range and linear response, which tends to suppress crucial object details. In…

Computer Vision and Pattern Recognition · Computer Science 2025-08-07 Zhuohua Ye , Liming Zhang , Hongru Han

Transformer architecture has been very successful long runner in the field of Deep Learning (DL) and Large Language Models (LLM) because of its powerful attention-based learning and parallel-natured architecture. As the models grow gigantic…

Machine Learning · Computer Science 2026-01-21 Phani Kumar , Nyshadham , Jyothendra Varma , Polisetty V R K , Aditya Rathore

Global Station Weather Forecasting (GSWF) is a key meteorological research area, critical to energy, aviation, and agriculture. Existing time series forecasting methods often ignore or unidirectionally model spatial correlation when…

Machine Learning · Computer Science 2025-09-26 Hongyi Chen , Xiucheng Li , Xinyang Chen , Yun Cheng , Jing Li , Kehai Chen , Liqiang Nie

Single hyperspectral image super-resolution (single-HSI-SR) aims to restore a high-resolution hyperspectral image from a low-resolution observation. However, the prevailing CNN-based approaches have shown limitations in building long-range…

Computer Vision and Pattern Recognition · Computer Science 2023-07-27 Mingjin Zhang , Chi Zhang , Qiming Zhang , Jie Guo , Xinbo Gao , Jing Zhang

3D Swin Transformer (3D-ST) known for its hierarchical attention and window-based processing, excels in capturing intricate spatial relationships within images. Spatial-spectral Transformer (SST), meanwhile, specializes in modeling…

Computer Vision and Pattern Recognition · Computer Science 2024-09-27 Muhammad Ahmad , Manuel Mazzara , Salvatore Distifano

Self-attention has recently been adopted for a wide range of sequence modeling problems. Despite its effectiveness, self-attention suffers from quadratic compute and memory requirements with respect to sequence length. Successful approaches…

Machine Learning · Computer Science 2020-10-27 Aurko Roy , Mohammad Saffar , Ashish Vaswani , David Grangier

Siamese network based trackers formulate the visual tracking task as a similarity matching problem. Almost all popular Siamese trackers realize the similarity learning via convolutional feature cross-correlation between a target branch and…

Computer Vision and Pattern Recognition · Computer Science 2020-11-24 Dongyan Guo , Yanyan Shao , Ying Cui , Zhenhua Wang , Liyan Zhang , Chunhua Shen

Existing deep trackers mainly use convolutional neural networks pre-trained for generic object recognition task for representations. Despite demonstrated successes for numerous vision tasks, the contributions of using pre-trained deep…

Computer Vision and Pattern Recognition · Computer Science 2019-04-04 Xin Li , Chao Ma , Baoyuan Wu , Zhenyu He , Ming-Hsuan Yang

Vision Transformer (ViT) has prevailed in computer vision tasks due to its strong long-range dependency modelling ability. \textcolor{blue}{However, its large model size and weak local feature modeling ability hinder its application in real…

Computer Vision and Pattern Recognition · Computer Science 2025-09-12 Yi Zhang , Lingxiao Wei , Bowei Zhang , Ziwei Liu , Kai Yi , Shu Hu

The trackers based on lightweight neural networks have achieved great success in the field of aerial remote sensing, most of which aggregate multi-stage deep features to lift the tracking quality. However, existing algorithms usually only…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Xinglong Sun , Haijiang Sun , Shan Jiang , Jiacheng Wang , Jiasong Wang

This paper studies semi-supervised video object segmentation through boosting intra-frame interaction. Recent memory network-based methods focus on exploiting inter-frame temporal reference while paying little attention to intra-frame…

Computer Vision and Pattern Recognition · Computer Science 2022-10-13 Yong Liu , Ran Yu , Jiahao Wang , Xinyuan Zhao , Yitong Wang , Yansong Tang , Yujiu Yang

Existing single-modal RGB trackers often face performance bottlenecks in complex dynamic scenes, while the introduction of event sensors offers new potential for enhancing tracking capabilities. However, most current RGB-event fusion…

Computer Vision and Pattern Recognition · Computer Science 2026-04-17 Jinlin You , Muyu Li , Xudong Zhao

Developing robust and discriminative appearance models has been a long-standing research challenge in visual object tracking. In the prevalent Siamese-based paradigm, the features extracted by the Siamese-like networks are often…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Fei Xie , Wankou Yang , Chunyu Wang , Lei Chu , Yue Cao , Chao Ma , Wenjun Zeng

Video Super-Resolution (VSR) aims to restore high-resolution (HR) videos from low-resolution (LR) videos. Existing VSR techniques usually recover HR frames by extracting pertinent textures from nearby frames with known degradation…

Image and Video Processing · Electrical Eng. & Systems 2023-01-02 Zhongwei Qiu , Huan Yang , Jianlong Fu , Daochang Liu , Chang Xu , Dongmei Fu

Transformer-based methods have achieved remarkable results in image super-resolution tasks because they can capture non-local dependencies in low-quality input images. However, this feature-intensive modeling approach is computationally…

Computer Vision and Pattern Recognition · Computer Science 2025-03-27 Wei Long , Xingyu Zhou , Leheng Zhang , Shuhang Gu