English
Related papers

Related papers: Temporal Segment Networks for Action Recognition i…

200 papers

This paper presents a deep learning framework for medical video segmentation. Convolution neural network (CNN) and transformer-based methods have achieved great milestones in medical image segmentation tasks due to their incredible semantic…

Computer Vision and Pattern Recognition · Computer Science 2024-02-13 Chengxi Zeng , Xinyu Yang , David Smithard , Majid Mirmehdi , Alberto M Gambaruto , Tilo Burghardt

This thesis explore different approaches using Convolutional and Recurrent Neural Networks to classify and temporally localize activities on videos, furthermore an implementation to achieve it has been proposed. As the first step, features…

Computer Vision and Pattern Recognition · Computer Science 2017-03-06 Alberto Montes , Amaia Salvador , Santiago Pascual , Xavier Giro-i-Nieto

We present a novel framework, Action Progression Network (APN), for temporal action detection (TAD) in videos. The framework locates actions in videos by detecting the action evolution process. To encode the action evolution, we quantify a…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Chongkai Lu , Man-Wai Mak , Ruimin Li , Zheru Chi , Hong Fu

Temporal action segmentation is a topic of increasing interest, however, annotating each frame in a video is cumbersome and costly. Weakly supervised approaches therefore aim at learning temporal action segmentation from videos that are…

Computer Vision and Pattern Recognition · Computer Science 2020-04-01 Mohsen Fayyaz , Juergen Gall

Recent two-stream deep Convolutional Neural Networks (ConvNets) have made significant progress in recognizing human actions in videos. Despite their success, methods extending the basic two-stream ConvNet have not systematically explored…

Computer Vision and Pattern Recognition · Computer Science 2017-04-03 Chih-Yao Ma , Min-Hung Chen , Zsolt Kira , Ghassan AlRegib

Most work on temporal action detection is formulated as an offline problem, in which the start and end times of actions are determined after the entire video is fully observed. However, important real-time applications including…

Computer Vision and Pattern Recognition · Computer Science 2019-03-26 Mingze Xu , Mingfei Gao , Yi-Ting Chen , Larry S. Davis , David J. Crandall

Video classification has advanced tremendously over the recent years. A large part of the improvements in video classification had to do with the work done by the image classification community and the use of deep convolutional networks…

Computer Vision and Pattern Recognition · Computer Science 2015-05-26 Balakrishnan Varadarajan , George Toderici , Sudheendra Vijayanarasimhan , Apostol Natsev

We present a Temporal Context Network (TCN) for precise temporal localization of human activities. Similar to the Faster-RCNN architecture, proposals are placed at equal intervals in a video which span multiple temporal scales. We propose a…

Computer Vision and Pattern Recognition · Computer Science 2017-08-09 Xiyang Dai , Bharat Singh , Guyue Zhang , Larry S. Davis , Yan Qiu Chen

The video based CNN works have focused on effective ways to fuse appearance and motion networks, but they typically lack utilizing temporal information over video frames. In this work, we present a novel spatio-temporal fusion network…

Computer Vision and Pattern Recognition · Computer Science 2019-06-18 Sangwoo Cho , Hassan Foroosh

Temporal action localization is an important task of computer vision. Though a variety of methods have been proposed, it still remains an open question how to predict the temporal boundaries of action segments precisely. Most works use…

Computer Vision and Pattern Recognition · Computer Science 2017-09-12 Ke Yang , Peng Qiao , Dongsheng Li , Shaohe Lv , Yong Dou

Automatic surgical phase recognition is one of the key technologies to support Video-Based Assessment (VBA) systems for surgical education. Utilizing temporal information is crucial for surgical phase recognition, hence various recent…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Bokai Zhang , Mohammad Hasan Sarhan , Bharti Goel , Svetlana Petculescu , Amer Ghanem

Temporal action detection aims at not only recognizing action category but also detecting start time and end time for each action instance in an untrimmed video. The key challenge of this task is to accurately classify the action and…

Computer Vision and Pattern Recognition · Computer Science 2018-10-22 Wen Wang , Yongjian Wu , Haijun Liu , Shiguang Wang , Jian Cheng

There has been huge progress on video action recognition in recent years. However, many works focus on tweaking existing 2D backbones due to the reliance of ImageNet pretraining, which restrains the models from achieving higher efficiency…

Computer Vision and Pattern Recognition · Computer Science 2025-03-05 Zhe Wang , Xulei Yang

We address temporal action localization in untrimmed long videos. This is important because videos in real applications are usually unconstrained and contain multiple action instances plus video content of background scenes or other…

Computer Vision and Pattern Recognition · Computer Science 2016-04-25 Zheng Shou , Dongang Wang , Shih-Fu Chang

This paper presents a novel method to involve both spatial and temporal features for semantic video segmentation. Current work on convolutional neural networks(CNNs) has shown that CNNs provide advanced spatial features supporting a very…

Computer Vision and Pattern Recognition · Computer Science 2016-09-05 Mohsen Fayyaz , Mohammad Hajizadeh Saffar , Mohammad Sabokrou , Mahmood Fathy , Reinhard Klette , Fay Huang

Temporal action localization is a recently-emerging task, aiming to localize video segments from untrimmed videos that contain specific actions. Despite the remarkable recent progress, most two-stage action localization methods still suffer…

Computer Vision and Pattern Recognition · Computer Science 2019-08-05 Guoqiang Gong , Liangfeng Zheng , Kun Bai , Yadong Mu

We propose a soft attention based model for the task of action recognition in videos. We use multi-layered Recurrent Neural Networks (RNNs) with Long Short-Term Memory (LSTM) units which are deep both spatially and temporally. Our model…

Machine Learning · Computer Science 2016-02-16 Shikhar Sharma , Ryan Kiros , Ruslan Salakhutdinov

With the success of deep learning in classifying short trimmed videos, more attention has been focused on temporally segmenting and classifying activities in long untrimmed videos. State-of-the-art approaches for action segmentation utilize…

Computer Vision and Pattern Recognition · Computer Science 2020-09-04 Shijie Li , Yazan Abu Farha , Yun Liu , Ming-Ming Cheng , Juergen Gall

Motivated by the previous success of Two-Dimensional Convolutional Neural Network (2D CNN) on image recognition, researchers endeavor to leverage it to characterize videos. However, one limitation of applying 2D CNN to analyze videos is…

Computer Vision and Pattern Recognition · Computer Science 2020-07-16 Junwu Weng , Donghao Luo , Yabiao Wang , Ying Tai , Chengjie Wang , Jilin Li , Feiyue Huang , Xudong Jiang , Junsong Yuan

Visual tempo characterizes the dynamics and the temporal scale of an action. Modeling such visual tempos of different actions facilitates their recognition. Previous works often capture the visual tempo through sampling raw videos at…

Computer Vision and Pattern Recognition · Computer Science 2020-06-16 Ceyuan Yang , Yinghao Xu , Jianping Shi , Bo Dai , Bolei Zhou