English
Related papers

Related papers: A Heterogeneous Two-Stream Framework for Video Act…

200 papers

Human action recognition in videos is a critical task with significant implications for numerous applications, including surveillance, sports analytics, and healthcare. The challenge lies in creating models that are both precise in their…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Yufei Xie

Conventionally, spatiotemporal modeling network and its complexity are the two most concentrated research topics in video action recognition. Existing state-of-the-art methods have achieved excellent accuracy regardless of the complexity…

Computer Vision and Pattern Recognition · Computer Science 2021-01-06 Wenhao Wu , Dongliang He , Tianwei Lin , Fu Li , Chuang Gan , Errui Ding

The use of hand gestures can be a useful tool for many applications in the human-computer interaction community. In a broad range of areas hand gesture techniques can be applied specifically in sign language recognition, robotic surgery,…

Computer Vision and Pattern Recognition · Computer Science 2020-07-20 Debajit Sarma , V. Kavyasree , M. K. Bhuyan

Action segmentation is a challenging yet active research area that involves identifying when and where specific actions occur in continuous video streams. Most existing work has focused on single-stream approaches that model the…

Computer Vision and Pattern Recognition · Computer Science 2025-10-10 Harshala Gammulle , Clinton Fookes , Sridha Sridharan , Simon Denman

Recognizing human actions in videos requires spatial and temporal understanding. Most existing action recognition models lack a balanced spatio-temporal understanding of videos. In this work, we propose a novel two-stream architecture,…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Dongho Lee , Jongseo Lee , Jinwoo Choi

Existing event stream-based pattern recognition models usually represent the event stream as the point cloud, voxel, image, etc., and design various deep neural networks to learn their features. Although considerable results can be achieved…

Computer Vision and Pattern Recognition · Computer Science 2024-06-28 Lan Chen , Dong Li , Xiao Wang , Pengpeng Shao , Wei Zhang , Yaowei Wang , Yonghong Tian , Jin Tang

Applying salient object detection (SOD) to RGB-D videos is an emerging task called RGB-D VSOD and has recently gained increasing interest, due to considerable performance gains of incorporating motion and depth and that RGB-D videos can be…

Computer Vision and Pattern Recognition · Computer Science 2025-07-30 Jiahao He , Daerji Suolang , Keren Fu , Qijun Zhao

Recently, neural network for scene flow estimation show impressive results on automotive data such as the KITTI benchmark. However, despite of using sophisticated rigidity assumptions and parametrizations, such networks are typically…

Computer Vision and Pattern Recognition · Computer Science 2022-10-31 Lukas Mehl , Azin Jahedi , Jenny Schmalfuss , Andrés Bruhn

In this paper, we introduce Coarse-Fine Networks, a two-stream architecture which benefits from different abstractions of temporal resolution to learn better video representations for long-term motion. Traditional Video models process…

Computer Vision and Pattern Recognition · Computer Science 2021-04-02 Kumara Kahatapitiya , Michael S. Ryoo

Pattern recognition through the fusion of RGB frames and Event streams has emerged as a novel research area in recent years. Current methods typically employ backbone networks to individually extract the features of RGB frames and event…

Computer Vision and Pattern Recognition · Computer Science 2023-12-01 Dong Li , Jiandong Jin , Yuhao Zhang , Yanlin Zhong , Yaoyang Wu , Lan Chen , Xiao Wang , Bin Luo

Continuous video monitoring in surveillance, robotics, and wearable systems faces a fundamental power constraint: conventional RGB cameras consume substantial energy through fixed-rate capture. Event cameras offer sparse, motion-driven…

Computer Vision and Pattern Recognition · Computer Science 2025-12-08 Dmitrii Torbunov , Onur Okuducu , Yi Huang , Odera Dim , Rebecca Coles , Yonggang Cui , Yihui Ren

Fluid motion can be considered as a point cloud transformation when using the SPH method. Compared to traditional numerical analysis methods, using machine learning techniques to learn physics simulations can achieve near-accurate results,…

Computer Vision and Pattern Recognition · Computer Science 2024-04-19 Yu Chen , Shuai Zheng , Menglong Jin , Yan Chang , Nianyi Wang

The video and action classification have extremely evolved by deep neural networks specially with two stream CNN using RGB and optical flow as inputs and they present outstanding performance in terms of video analysis. One of the…

Computer Vision and Pattern Recognition · Computer Science 2016-09-05 Ali Diba , Ali Mohammad Pazandeh , Luc Van Gool

Spatial and temporal stream model has gained great success in video action recognition. Most existing works pay more attention to designing effective features fusion methods, which train the two-stream model in a separate way. However, it's…

Computer Vision and Pattern Recognition · Computer Science 2019-08-28 Jingran Zhang , Fumin Shen , Xing Xu , Heng Tao Shen

The data-driven approach that learns an optimal representation of vision features like skeleton frames or RGB videos is currently a dominant paradigm for activity recognition. While great improvements have been achieved from existing single…

Computer Vision and Pattern Recognition · Computer Science 2020-04-30 Bruce X. B. Yu , Yan Liu , Keith C. C. Chan

Automatically detecting violence from surveillance footage is a subset of activity recognition that deserves special attention because of its wide applicability in unmanned security monitoring systems, internet video filtration, etc. In…

Computer Vision and Pattern Recognition · Computer Science 2021-10-08 Zahidul Islam , Mohammad Rukonuzzaman , Raiyan Ahmed , Md. Hasanul Kabir , Moshiur Farazi

Recent applications of Convolutional Neural Networks (ConvNets) for human action recognition in videos have proposed different solutions for incorporating the appearance and motion information. We study a number of ways of fusing ConvNet…

Computer Vision and Pattern Recognition · Computer Science 2016-09-27 Christoph Feichtenhofer , Axel Pinz , Andrew Zisserman

Dual-arm robots have great application prospects in intelligent manufacturing due to their human-like structure when deployed with advanced intelligence algorithm. However, the previous visuomotor policy suffers from perception deficiencies…

Robotics · Computer Science 2024-04-30 Jian Shen , Jiaxin Huang , Zhigong Song

Visible images offer rich texture details, while infrared images emphasize salient targets. Fusing these complementary modalities enhances scene understanding, particularly for advanced vision tasks under challenging conditions. Recently,…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Beining Xu , Junxian Li

Multi-Focus Image Fusion seeks to improve the quality of an acquired burst of images with different focus planes. For solving the task, an activity level measurement and a fusion rule are typically established to select and fuse the most…

Computer Vision and Pattern Recognition · Computer Science 2019-08-30 Fidel Alejandro Guerrero Peña , Pedro Diamel Marrero Fernández , Tsang Ing Ren , Germano Crispim Vasconcelos , Alexandre Cunha