English
Related papers

Related papers: Coarse Temporal Attention Network (CTA-Net) for Dr…

200 papers

Existing multimodal-based human action recognition approaches are computationally intensive, limiting their deployment in real-time applications. In this work, we present a novel and efficient pose-driven attention-guided multimodal network…

Computer Vision and Pattern Recognition · Computer Science 2025-03-21 Ahmed Abdelkawy , Asem Ali , Aly Farag

Temporal modeling is crucial for various video learning tasks. Most recent approaches employ either factorized (2D+1D) or joint (3D) spatial-temporal operations to extract temporal contexts from the input frames. While the former is more…

Computer Vision and Pattern Recognition · Computer Science 2023-01-03 Yizhou Zhao , Zhenyang Li , Xun Guo , Yan Lu

Weakly-supervised temporal action localization aims to identify and localize the action instances in the untrimmed videos with only video-level action labels. When humans watch videos, we can adapt our abstract-level knowledge about actions…

Computer Vision and Pattern Recognition · Computer Science 2023-12-27 Xijun Wang , Aggelos K. Katsaggelos

Many road accidents occur due to distracted drivers. Today, driver monitoring is essential even for the latest autonomous vehicles to alert distracted drivers in order to take over control of the vehicle in case of emergency. In this paper,…

Computer Vision and Pattern Recognition · Computer Science 2019-07-19 Neslihan Kose , Okan Kopuklu , Alexander Unnervik , Gerhard Rigoll

A key aspect of driving a road vehicle is to interact with other road users, assess their intentions and make risk-aware tactical decisions. An intuitive approach to enabling an intelligent automated driving system would be incorporating…

Computer Vision and Pattern Recognition · Computer Science 2023-08-08 Videsh Suman , Phu Pham , Aniket Bera

Street scene change detection continues to capture researchers' interests in the computer vision community. It aims to identify the changed regions of the paired street-view images captured at different times. The state-of-the-art network…

Computer Vision and Pattern Recognition · Computer Science 2021-05-31 Shuo Chen , Kailun Yang , Rainer Stiefelhagen

Despite the success of deep learning for static image understanding, it remains unclear what are the most effective network architectures for the spatial-temporal modeling in videos. In this paper, in contrast to the existing CNN+RNN or…

Computer Vision and Pattern Recognition · Computer Science 2018-12-12 Dongliang He , Zhichao Zhou , Chuang Gan , Fu Li , Xiao Liu , Yandong Li , Limin Wang , Shilei Wen

Human actions captured in video sequences contain two crucial factors for action recognition, i.e., visual appearance and motion dynamics. To model these two aspects, Convolutional and Recurrent Neural Networks (CNNs and RNNs) are adopted…

Computer Vision and Pattern Recognition · Computer Science 2019-05-01 Yuan Yuan , Dong Wang , Qi Wang

Understanding temporal information and how the visual world changes over time is a fundamental ability of intelligent systems. In video understanding, temporal information is at the core of many current challenges, including compression,…

Computer Vision and Pattern Recognition · Computer Science 2019-10-31 Laura Sevilla-Lara , Shengxin Zha , Zhicheng Yan , Vedanuj Goswami , Matt Feiszli , Lorenzo Torresani

In many computer vision tasks, the relevant information to solve the problem at hand is mixed to irrelevant, distracting information. This has motivated researchers to design attentional models that can dynamically focus on parts of images…

Computer Vision and Pattern Recognition · Computer Science 2017-02-14 Loris Bazzani , Hugo Larochelle , Lorenzo Torresani

Recognizing human actions in videos requires spatial and temporal understanding. Most existing action recognition models lack a balanced spatio-temporal understanding of videos. In this work, we propose a novel two-stream architecture,…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Dongho Lee , Jongseo Lee , Jinwoo Choi

Temporal object detection has attracted significant attention, but most popular detection methods cannot leverage rich temporal information in videos. Very recently, many algorithms have been developed for video detection task, yet very few…

Computer Vision and Pattern Recognition · Computer Science 2020-03-26 Xingyu Chen , Junzhi Yu , Zhengxing Wu

Human actions captured in video sequences are three-dimensional signals characterizing visual appearance and motion dynamics. To learn action patterns, existing methods adopt Convolutional and/or Recurrent Neural Networks (CNNs and RNNs).…

Computer Vision and Pattern Recognition · Computer Science 2017-08-15 Lin Sun , Kui Jia , Kevin Chen , Dit Yan Yeung , Bertram E. Shi , Silvio Savarese

Deep convolutional networks have achieved great success for visual recognition in still images. However, for action recognition in videos, the advantage over traditional methods is not so evident. This paper aims to discover the principles…

Computer Vision and Pattern Recognition · Computer Science 2016-08-03 Limin Wang , Yuanjun Xiong , Zhe Wang , Yu Qiao , Dahua Lin , Xiaoou Tang , Luc Van Gool

Video activity recognition by deep neural networks is impressive for many classes. However, it falls short of human performance, especially for challenging to discriminate activities. Humans differentiate these complex activities by…

Computer Vision and Pattern Recognition · Computer Science 2022-01-12 Joseph Chrol-Cannon , Andrew Gilbert , Ranko Lazic , Adithya Madhusoodanan , Frank Guerin

Advanced driver assistance and automated driving systems rely on risk estimation modules to predict and avoid dangerous situations. Current methods use expensive sensor setups and complex processing pipeline, limiting their availability and…

Computer Vision and Pattern Recognition · Computer Science 2020-02-04 Ekim Yurtsever , Yongkang Liu , Jacob Lambert , Chiyomi Miyajima , Eijiro Takeuchi , Kazuya Takeda , John H. L. Hansen

Lane detection is a crucial perception task for all levels of automated vehicles (AVs) and Advanced Driver Assistance Systems, particularly in mixed-traffic environments where AVs must interact with human-driven vehicles (HDVs) and…

Computer Vision and Pattern Recognition · Computer Science 2026-02-04 Sandeep Patil , Yongqi Dong , Haneen Farah , Hans Hellendoorn

Recently, many attention-based deep neural networks have emerged and achieved state-of-the-art performance in environmental sound classification. The essence of attention mechanism is assigning contribution weights on different parts of…

Audio and Speech Processing · Electrical Eng. & Systems 2020-11-06 You Wang , Chuyao Feng , David V. Anderson

Video semantic segmentation requires to utilize the complex temporal relations between frames of the video sequence. Previous works usually exploit accurate optical flow to leverage the temporal relations, which suffer much from heavy…

Computer Vision and Pattern Recognition · Computer Science 2021-09-14 Hao Wang , Weining Wang , Jing Liu

Driver attention prediction is becoming an essential research problem in human-like driving systems. This work makes an attempt to predict the driver attention in driving accident scenarios (DADA). However, challenges tread on the heels of…

Computer Vision and Pattern Recognition · Computer Science 2023-01-06 Jianwu Fang , Dingxin Yan , Jiahuan Qiao , Jianru Xue , Hongkai Yu