English
Related papers

Related papers: Multimodal Spatio-temporal Graph Learning for Alig…

200 papers

Skeleton-based action recognition has achieved remarkable results in human action recognition with the development of graph convolutional networks (GCNs). However, the recent works tend to construct complex learning mechanisms with…

Computer Vision and Pattern Recognition · Computer Science 2025-09-15 Dongjingdin Liu , Pengpeng Chen , Miao Yao , Yijing Lu , Zijie Cai , Yuxin Tian

Existing deepfake detectors face several challenges in achieving robustness and generalization. One of the primary reasons is their limited ability to extract relevant information from forgery videos, especially in the presence of various…

Computer Vision and Pattern Recognition · Computer Science 2023-05-01 Zhiyuan Yan , Peng Sun , Yubo Lang , Shuo Du , Shanzhuo Zhang , Wei Wang , Lei Liu

RGBT tracking has attracted increasing attention since RGB and thermal infrared data have strong complementary advantages, which could make trackers all-day and all-weather work. However, how to effectively represent RGBT data for visual…

Computer Vision and Pattern Recognition · Computer Science 2021-07-07 Andong Lu , Chenglong Li , Yuqing Yan , Jin Tang , Bin Luo

Vision-language models (VLMs) demonstrate strong image-level scene understanding but often lack persistent memory, explicit spatial representations, and computational efficiency when reasoning over long video sequences. We present VL-KnG, a…

Zero-shot learning (ZSL) aims to leverage additional semantic information to recognize unseen classes. To transfer knowledge from seen to unseen classes, most ZSL methods often learn a shared embedding space by simply aligning visual…

Computer Vision and Pattern Recognition · Computer Science 2024-11-19 Bowen Duan , Shiming Chen , Yufei Guo , Guo-Sen Xie , Weiping Ding , Yisong Wang

Accurately forecasting the real-time travel demand for dockless scooter-sharing is crucial for the planning and operations of transportation systems. Deep learning models provide researchers with powerful tools to achieve this task, but…

Computers and Society · Computer Science 2024-10-28 Yiming Xu , Xilei Zhao , Xiaojian Zhang , Mudit Paliwal

Temporal action localization in videos presents significant challenges in the field of computer vision. While the boundary-sensitive method has been widely adopted, its limitations include incomplete use of intermediate and global…

Computer Vision and Pattern Recognition · Computer Science 2023-03-07 Qing Song , Yang Zhou , Mengjie Hu , Chun Liu

Automatic Modulation Recognition (AMR) is an essential part of Intelligent Transportation System (ITS) dynamic spectrum allocation. However, current deep learning-based AMR (DL-AMR) methods are challenged to extract discriminative and…

Signal Processing · Electrical Eng. & Systems 2025-08-19 Mingyuan Shao , Zhengqiu Fu , Dingzhao Li , Fuqing Zhang , Yilin Cai , Shaohua Hong , Lin Cao , Yuan Peng , Jie Qi

Traffic object detection under variable illumination is challenging due to the information loss caused by the limited dynamic range of conventional frame-based cameras. To address this issue, we introduce bio-inspired event cameras and…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Zhanwen Liu , Nan Yang , Yang Wang , Yuke Li , Xiangmo Zhao , Fei-Yue Wang

Attempt to fully discover the temporal diversity and chronological characteristics for self-supervised video representation learning, this work takes advantage of the temporal dependencies within videos and further proposes a novel…

Computer Vision and Pattern Recognition · Computer Science 2021-03-18 Yang Liu , Keze Wang , Haoyuan Lan , Liang Lin

Multi-modal Video Object Segmentation (VOS), including RGB-Thermal, RGB-Depth, and RGB-Event, has garnered attention due to its capability to address challenging scenarios where traditional VOS methods struggle, such as extreme…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Pinxue Guo , Wanyun Li , Hao Huang , Lingyi Hong , Xinyu Zhou , Zhaoyu Chen , Jinglun Li , Kaixun Jiang , Wei Zhang , Wenqiang Zhang

RGB-Thermal (RGB-T) semantic segmentation has shown great potential in handling low-light conditions where RGB-based segmentation is hindered by poor RGB imaging quality. The key to RGB-T semantic segmentation is to effectively leverage the…

Computer Vision and Pattern Recognition · Computer Science 2023-08-25 Zikun Zhou , Shukun Wu , Guoqing Zhu , Hongpeng Wang , Zhenyu He

Salient object detection (SOD) is a task that involves identifying and segmenting the most visually prominent object in an image. Existing solutions can accomplish this use a multi-scale feature fusion mechanism to detect the global context…

Computer Vision and Pattern Recognition · Computer Science 2023-03-20 Yongwoo Lee , Minhyeok Lee , Suhwan Cho , Sangyoun Lee

Real-time and precise traffic flow prediction is vital for the efficiency of intelligent transportation systems. Traditional methods often employ graph neural networks (GNNs) with predefined graphs to describe spatial correlations among…

Machine Learning · Computer Science 2024-06-18 Ben-Ao Dai , Bao-Lin Ye , Lingxi Li

In this work we study Weakly Supervised Spatio-Temporal Video Grounding (WSTVG), a challenging task of localizing subjects spatio-temporally in videos using only textual queries and no bounding box supervision. Inspired by recent advances…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Aaryan Garg , Akash Kumar , Yogesh S Rawat

Visual-based perception is the key module for autonomous driving. Among those visual perception tasks, video object detection is a primary yet challenging one because of feature degradation caused by fast motion or multiple poses. Current…

Computer Vision and Pattern Recognition · Computer Science 2024-05-30 Yiming Cui , Cheng Han , Dongfang Liu

Depth can provide useful geographical cues for salient object detection (SOD), and has been proven helpful in recent RGB-D SOD methods. However, existing video salient object detection (VSOD) methods only utilize spatiotemporal information…

Computer Vision and Pattern Recognition · Computer Science 2022-07-12 Yukang Lu , Dingyao Min , Keren Fu , Qijun Zhao

Despite significant progress in semi-supervised learning for image object detection, several key issues are yet to be addressed for video object detection: (1) Achieving good performance for supervised video object detection greatly depends…

Computer Vision and Pattern Recognition · Computer Science 2023-11-14 Tanvir Mahmud , Chun-Hao Liu , Burhaneddin Yaman , Diana Marculescu

Object tracking based on the fusion of visible and thermal im-ages, known as RGB-T tracking, has gained increasing atten-tion from researchers in recent years. How to achieve a more comprehensive fusion of information from the two…

Computer Vision and Pattern Recognition · Computer Science 2023-09-01 Yang Luo , Xiqing Guo , Hui Feng , Lei Ao

Salient object detection (SOD) in RGB-D images is an essential task in computer vision, enabling applications in scene understanding, robotics, and augmented reality. However, existing methods struggle to capture global dependency across…

Computer Vision and Pattern Recognition · Computer Science 2025-03-05 Gargi Panda , Soumitra Kundu , Saumik Bhattacharya , Aurobinda Routray