English
Related papers

Related papers: STeInFormer: Spatial-Temporal Interaction Transfor…

200 papers

The Detection Transformer (DETR) has revolutionized the design of CNN-based object detection systems, showcasing impressive performance. However, its potential in the domain of multi-frame 3D object detection remains largely unexplored. In…

Computer Vision and Pattern Recognition · Computer Science 2025-08-21 Yifan Zhang , Zhiyu Zhu , Junhui Hou , Dapeng Wu

Remotely sensed imagery interpretation (RSII) faces the three major problems: (1) objective representation of spatial distribution patterns; (2) edge uncertainty problem caused by downsampling encoder and intrinsic edge noises (e.g., mixed…

Computer Vision and Pattern Recognition · Computer Science 2025-05-30 Pengfei Zhang , Chang Li , Yongjun Zhang , Rongjun Qin , Kyle Gao , Jonathan Li

Among the current mainstream change detection networks, transformer is deficient in the ability to capture accurate low-level details, while convolutional neural network (CNN) is wanting in the capacity to understand global information and…

Computer Vision and Pattern Recognition · Computer Science 2023-08-23 Dalong Zheng , Zebin Wu , Jia Liu , Zhihui Wei

3D convolutional neural networks have achieved promising results for video tasks in computer vision, including video saliency prediction that is explored in this paper. However, 3D convolution encodes visual representation merely on fixed…

Computer Vision and Pattern Recognition · Computer Science 2022-01-19 Ziqiang Wang , Zhi Liu , Gongyang Li , Yang Wang , Tianhong Zhang , Lihua Xu , Jijun Wang

Vision transformers have gained popularity recently, leading to the development of new vision backbones with improved features and consistent performance gains. However, these advancements are not solely attributable to novel feature…

Computer Vision and Pattern Recognition · Computer Science 2025-06-23 Xiaowei Hu , Min Shi , Weiyun Wang , Sitong Wu , Linjie Xing , Wenhai Wang , Xizhou Zhu , Lewei Lu , Jie Zhou , Xiaogang Wang , Yu Qiao , Jifeng Dai

As one of the prominent AI-generated content, Deepfake has raised significant safety concerns. Although it has been demonstrated that temporal consistency cues offer better generalization capability, existing methods based on CNNs…

Computer Vision and Pattern Recognition · Computer Science 2025-03-06 Beilin Chu , Xuan Xu , Yufei Zhang , Weike You , Linna Zhou

Transformer-based methods have recently achieved significant success in 3D human pose estimation, owing to their strong ability to model long-range dependencies. However, relying solely on the global attention mechanism is insufficient for…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Guangsheng Xu , Guoyi Zhang , Lejia Ye , Shuwei Gan , Xiaohu Zhang , Xia Yang

Convolution neural networks (CNNs) have succeeded in compressive image sensing. However, due to the inductive bias of locality and weight sharing, the convolution operations demonstrate the intrinsic limitations in modeling the long-range…

Image and Video Processing · Electrical Eng. & Systems 2022-01-03 Dongjie Ye , Zhangkai Ni , Hanli Wang , Jian Zhang , Shiqi Wang , Sam Kwong

Change detection in remote sensing images is an essential tool for analyzing a region at different times. It finds varied applications in monitoring environmental changes, man-made changes as well as corresponding decision-making and…

Computer Vision and Pattern Recognition · Computer Science 2024-07-10 Jay N. Paranjape , Celso de Melo , Vishal M. Patel

Deep neural networks face several challenges in hyperspectral image classification, including high-dimensional data, sparse distribution of ground objects, and spectral redundancy, which often lead to classification overfitting and limited…

Computer Vision and Pattern Recognition · Computer Science 2025-06-12 Guandong Li , Mengxia Ye

In remote sensing, most segmentation networks adopt the UNet architecture, often incorporating modules such as Transformers or Mamba to enhance global-local feature interactions within decoder stages. However, these enhancements typically…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Chengqian Dai , Yonghong Guo , Hongzhao Xiang , Yigui Luo

Learned video compression (LVC) has witnessed remarkable advancements in recent years. Similar as the traditional video coding, LVC inherits motion estimation/compensation, residual coding and other modules, all of which are implemented…

Image and Video Processing · Electrical Eng. & Systems 2023-09-22 Yanbo Gao , Wenjia Huang , Shuai Li , Hui Yuan , Mao Ye , Siwei Ma

Group activity recognition is a crucial yet challenging problem, whose core lies in fully exploring spatial-temporal interactions among individuals and generating reasonable group representations. However, previous methods either model…

Computer Vision and Pattern Recognition · Computer Science 2021-08-31 Shuaicheng Li , Qianggang Cao , Lingbo Liu , Kunlin Yang , Shinan Liu , Jun Hou , Shuai Yi

Long-term time series forecasting (LTSF) has been widely applied in finance, traffic prediction, and other domains. Recently, patch-based transformers have emerged as a promising approach, segmenting data into sub-level patches that serve…

Machine Learning · Computer Science 2024-08-06 Ruixin Ding , Yuqi Chen , Yu-Ting Lan , Wei Zhang

Being spontaneous, micro-expressions are useful in the inference of a person's true emotions even if an attempt is made to conceal them. Due to their short duration and low intensity, the recognition of micro-expressions is a difficult task…

Computer Vision and Pattern Recognition · Computer Science 2022-11-24 Liangfei Zhang , Xiaopeng Hong , Ognjen Arandjelovic , Guoying Zhao

Recent synthetic speech detectors leveraging the Transformer model have superior performance compared to the convolutional neural network counterparts. This improvement could be due to the powerful modeling ability of the multi-head…

Sound · Computer Science 2024-09-10 Duc-Tuan Truong , Ruijie Tao , Tuan Nguyen , Hieu-Thi Luong , Kong Aik Lee , Eng Siong Chng

Recently, a variety of vision transformers have been developed as their capability of modeling long-range dependency. In current transformer-based backbones for medical image segmentation, convolutional layers were replaced with pure…

Computer Vision and Pattern Recognition · Computer Science 2022-08-01 Huimin Huang , Shiao Xie1 , Lanfen Lin , Yutaro Iwamoto , Xianhua Han , Yen-Wei Chen , Ruofeng Tong

Transforming road network data into vector representations using deep learning has proven effective for road network analysis. However, urban road networks' heterogeneous and hierarchical nature poses challenges for accurate representation…

Artificial Intelligence · Computer Science 2025-09-10 Jian Yang , Jiahui Wu , Li Fang , Hongchao Fan , Bianying Zhang , Huijie Zhao , Guangyi Yang , Rui Xin , Xiong You

Skeleton-based action recognition has attracted considerable attention due to its compact representation of the human body's skeletal sructure. Many recent methods have achieved remarkable performance using graph convolutional networks…

Computer Vision and Pattern Recognition · Computer Science 2023-07-20 Jungho Lee , Minhyeok Lee , Suhwan Cho , Sungmin Woo , Sungjun Jang , Sangyoun Lee

Triggered by the success of transformers in various visual tasks, the spatial self-attention mechanism has recently attracted more and more attention in the computer vision community. However, we empirically found that a typical vision…

Computer Vision and Pattern Recognition · Computer Science 2022-11-28 Jiayin Sun , Hong Wang , Qiulei Dong