English
Related papers

Related papers: Learning Gating ConvNet for Two-Stream based Metho…

200 papers

Current methods for video analysis often extract frame-level features using pre-trained convolutional neural networks (CNNs). Such features are then aggregated over time e.g., by simple temporal averaging or more sophisticated recurrent…

Computer Vision and Pattern Recognition · Computer Science 2018-03-06 Antoine Miech , Ivan Laptev , Josef Sivic

While deep learning has achieved phenomenal successes in many AI applications, its enormous model size and intensive computation requirements pose a formidable challenge to the deployment in resource-limited nodes. There has recently been…

Machine Learning · Computer Science 2020-12-01 Sen Lin , Li Yang , Zhezhi He , Deliang Fan , Junshan Zhang

In classic video action recognition, labels may not contain enough information about the diverse video appearance and dynamics, thus, existing models that are trained under the standard supervised learning paradigm may extract less…

Computer Vision and Pattern Recognition · Computer Science 2020-04-14 Zhiyu Yao , Yunbo Wang , Mingsheng Long , Jianmin Wang , Philip S Yu , Jiaguang Sun

Two-stream Convolutional Networks (ConvNets) have shown strong performance for human action recognition in videos. Recently, Residual Networks (ResNets) have arisen as a new technique to train extremely deep architectures. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2016-11-08 Christoph Feichtenhofer , Axel Pinz , Richard P. Wildes

In this paper we address the problem of human action recognition from video sequences. Inspired by the exemplary results obtained via automatic feature learning and deep learning approaches in computer vision, we focus our attention towards…

Computer Vision and Pattern Recognition · Computer Science 2017-04-06 Harshala Gammulle , Simon Denman , Sridha Sridharan , Clinton Fookes

Recently, the applications of person re-identification in visual surveillance and human-computer interaction are sharply increasing, which signifies the critical role of such a problem. In this paper, we propose a two-stream convolutional…

Information Retrieval · Computer Science 2019-05-29 Peixian Chen , Pingyang Dai , Qiong Wu , Yuyu Huang

Sensor fusion is a key technology that integrates various sensory inputs to allow for robust decision making in many applications such as autonomous driving and robot control. Deep neural networks have been adopted for sensor fusion in a…

Machine Learning · Computer Science 2018-10-11 Myung Seok Shim , Peng Li

Human action recognition is one of the challenging tasks in computer vision. The current action recognition methods use computationally expensive models for learning spatio-temporal dependencies of the action. Models utilizing RGB channels…

Computer Vision and Pattern Recognition · Computer Science 2022-06-07 Labina Shrestha , Shikha Dubey , Farrukh Olimov , Muhammad Aasim Rafique , Moongu Jeon

In a distributed mixture-of-experts (MoE) system, a server collaborates with multiple specialized expert clients to perform inference. The server extracts features from input data and dynamically selects experts based on their areas of…

Machine Learning · Computer Science 2025-04-02 Qiuchen Song , Shusen Jing , Shuai Zhang , Songyang Zhang , Chuan Huang

The goal of this paper is to detect the spatio-temporal extent of an action. The two-stream detection network based on RGB and flow provides state-of-the-art accuracy at the expense of a large model-size and heavy computation. We propose to…

Computer Vision and Pattern Recognition · Computer Science 2019-06-12 Jiaojiao Zhao , Cees G. M. Snoek

The paper presents a novel two-stream network architecture for enhancing scene understanding in computer vision. This architecture utilizes a graph feature stream and an image feature stream, aiming to merge the strengths of both modalities…

Computer Vision and Pattern Recognition · Computer Science 2023-11-14 Wenkai Yang , Wenyuan Sun , Runxaing Huang

Human action recognition in videos is a critical task with significant implications for numerous applications, including surveillance, sports analytics, and healthcare. The challenge lies in creating models that are both precise in their…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Yufei Xie

With the rapid advancements in deep learning, computer vision tasks have seen significant improvements, making two-stream neural networks a popular focus for video based action recognition. Traditional models using RGB and optical flow…

Computer Vision and Pattern Recognition · Computer Science 2024-11-28 Song-Jiang Lai , Tsun-Hin Cheung , Ka-Chun Fung , Tian-Shan Liu , Kin-Man Lam

Multi-task learning is commonly used in autonomous driving for solving various visual perception tasks. It offers significant benefits in terms of both performance and computational complexity. Current work on multi-task learning networks…

Computer Vision and Pattern Recognition · Computer Science 2019-04-23 Sumanth Chennupati , Ganesh Sistu , Senthil Yogamani , Samir A Rawashdeh

With the recent advancements of deep learning technologies, the performance of voice conversion (VC) in terms of quality and similarity has been significantly improved. However, heavy computations are generally required for…

Sound · Computer Science 2019-12-30 Yu-Tao Chang , Yuan-Hong Yang , Yu-Huai Peng , Syu-Siang Wang , Tai-Shih Chi , Yu Tsao , Hsin-Min Wang

Action segmentation is a challenging yet active research area that involves identifying when and where specific actions occur in continuous video streams. Most existing work has focused on single-stream approaches that model the…

Computer Vision and Pattern Recognition · Computer Science 2025-10-10 Harshala Gammulle , Clinton Fookes , Sridha Sridharan , Simon Denman

Automatically detecting violence from surveillance footage is a subset of activity recognition that deserves special attention because of its wide applicability in unmanned security monitoring systems, internet video filtration, etc. In…

Computer Vision and Pattern Recognition · Computer Science 2021-10-08 Zahidul Islam , Mohammad Rukonuzzaman , Raiyan Ahmed , Md. Hasanul Kabir , Moshiur Farazi

The traditional methods of action recognition are not specific for the operator, thus results are easy to be disturbed when other actions are operated in videos. The network based on mixed convolutional resnet and RPN is proposed in this…

Computer Vision and Pattern Recognition · Computer Science 2020-01-08 Mingjie Li , Youqian Feng , Zhonghai Yin , Cheng Zhou , Fanghao Dong , Yuan Lin , Yuhao Dong

Deep convolutional neural networks (ConvNets) have been recently shown to attain state-of-the-art performance for action recognition on standard-resolution videos. However, less attention has been paid to recognition performance at…

Computer Vision and Pattern Recognition · Computer Science 2018-10-09 Jiawei Chen , Jonathan Wu , Janusz Konrad , Prakash Ishwar

The goal of convective storm nowcasting is local prediction of severe and imminent convective storms. Here, we consider the convective storm nowcasting problem from the perspective of machine learning. First, we use a pixel-wise sampling…

Computer Vision and Pattern Recognition · Computer Science 2021-07-02 W. Zhang , H. Liu , P. Li , L. Han