English
Related papers

Related papers: Action Unit Memory Network for Weakly Supervised T…

200 papers

Temporal action proposal generation is an essential and challenging task that aims at localizing temporal intervals containing human actions in untrimmed videos. Most of existing approaches are unable to follow the human cognitive process…

Computer Vision and Pattern Recognition · Computer Science 2022-03-18 Viet-Khoa Vo-Ho , Ngan Le , Kashu Yamazaki , Akihiro Sugimoto , Minh-Triet Tran

We propose a soft attention based model for the task of action recognition in videos. We use multi-layered Recurrent Neural Networks (RNNs) with Long Short-Term Memory (LSTM) units which are deep both spatially and temporally. Our model…

Machine Learning · Computer Science 2016-02-16 Shikhar Sharma , Ryan Kiros , Ruslan Salakhutdinov

Attention mechanism has recently attracted increasing attentions in the field of facial action unit (AU) detection. By finding the region of interest of each AU with the attention mechanism, AU-related local features can be captured. Most…

Computer Vision and Pattern Recognition · Computer Science 2019-10-21 Zhiwen Shao , Zhilei Liu , Jianfei Cai , Yunsheng Wu , Lizhuang Ma

Weakly-supervised temporal action localization aims to localize and recognize actions in untrimmed videos with only video-level category labels during training. Without instance-level annotations, most existing methods follow the…

Computer Vision and Pattern Recognition · Computer Science 2023-05-30 Huan Ren , Wenfei Yang , Tianzhu Zhang , Yongdong Zhang

Monitoring the progression of an action towards completion offers fine grained insight into the actor's behaviour. In this work, we target detecting the completion moment of actions, that is the moment when the action's goal has been…

Computer Vision and Pattern Recognition · Computer Science 2019-10-23 Farnoosh Heidarivincheh , Majid Mirmehdi , Dima Damen

Temporal action localization has recently attracted significant interest in the Computer Vision community. However, despite the great progress, it is hard to identify which aspects of the proposed methods contribute most to the increase in…

Computer Vision and Pattern Recognition · Computer Science 2019-05-30 Tingting Xie , Xiaoshan Yang , Tianzhu Zhang , Changsheng Xu , Ioannis Patras

This paper presents the first-rank solution for the Multi-Modal Action Recognition Challenge, part of the Multi-Modal Visual Pattern Recognition Workshop at the \acl{ICPR} 2024. The competition aimed to recognize human actions using a…

Computer Vision and Pattern Recognition · Computer Science 2025-02-11 Anh-Kiet Duong , Petra Gomez-Krämer

Diagnostic and intervention methodologies for skill assessment of autism typically requires a clinician repetitively initiating several stimuli and recording the child's response. In this paper, we propose to automate the response…

Computer Vision and Pattern Recognition · Computer Science 2020-01-30 Prashant Pandey , Prathosh AP , Manu Kohli , Josh Pritchard

We propose action-agnostic point-level (AAPL) supervision for temporal action detection to achieve accurate action instance detection with a lightly annotated dataset. In the proposed scheme, a small portion of video frames is sampled in an…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 Shuhei M. Yoshida , Takashi Shibata , Makoto Terao , Takayuki Okatani , Masashi Sugiyama

Temporal action detection (TAD) aims to locate and recognize the actions in an untrimmed video. Anchor-free methods have made remarkable progress which mainly formulate TAD into two tasks: classification and localization using two separate…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Junshan Hu , Chaoxu guo , Liansheng Zhuang , Biao Wang , Tiezheng Ge , Yuning Jiang , Houqiang Li

State of the art architectures for untrimmed video Temporal Action Localization (TAL) have only considered RGB and Flow modalities, leaving the information-rich audio modality totally unexploited. Audio fusion has been explored for the…

Computer Vision and Pattern Recognition · Computer Science 2021-10-19 Anurag Bagchi , Jazib Mahmood , Dolton Fernandes , Ravi Kiran Sarvadevabhatla

In the task of temporal action localization of ActivityNet-1.3 datasets, we propose to locate the temporal boundaries of each action and predict action class in untrimmed videos. We first apply VideoSwinTransformer as feature extractor to…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Shimin Chen , Wei Li , Jianyang Gu , Chen Chen , Yandong Guo

Few-shot action recognition aims to recognize novel action classes (query) using just a few samples (support). The majority of current approaches follow the metric learning paradigm, which learns to compare the similarity between videos.…

Computer Vision and Pattern Recognition · Computer Science 2022-12-23 Shuyuan Li , Huabin Liu , Rui Qian , Yuxi Li , John See , Mengjuan Fei , Xiaoyuan Yu , Weiyao Lin

This paper focuses on weakly-supervised action alignment, where only the ordered sequence of video-level actions is available for training. We propose a novel Duration Network, which captures a short temporal window of the video and learns…

Computer Vision and Pattern Recognition · Computer Science 2020-11-23 Reza Ghoddoosian , Saif Sayed , Vassilis Athitsos

We address the problem of temporal action localization in videos. We pose action localization as a structured prediction over arbitrary-length temporal windows, where each window is scored as the sum of frame-wise classification scores.…

Computer Vision and Pattern Recognition · Computer Science 2017-04-18 Zehuan Yuan , Jonathan C. Stroud , Tong Lu , Jia Deng

Video anomaly detection is to determine whether there are any abnormal events, behaviors or objects in a given video, which enables effective and intelligent public safety management. As video anomaly labeling is both time-consuming and…

Computer Vision and Pattern Recognition · Computer Science 2024-07-08 Yang Wang , Jiaogen Zhou , Jihong Guan

We propose a novel domain adaptive action detection approach and a new adaptation protocol that leverages the recent advancements in image-level unsupervised domain adaptation (UDA) techniques and handle vagaries of instance-level video…

Computer Vision and Pattern Recognition · Computer Science 2022-10-07 Yifan Lu , Gurkirt Singh , Suman Saha , Luc Van Gool

When a deep neural network is trained on data with only image-level labeling, the regions activated in each image tend to identify only a small region of the target object. We propose a method of using videos automatically harvested from…

Computer Vision and Pattern Recognition · Computer Science 2019-08-14 Jungbeom Lee , Eunji Kim , Sungmin Lee , Jangho Lee , Sungroh Yoon

Nowadays, the interaction between humans and robots is constantly expanding, requiring more and more human motion recognition applications to operate in real time. However, most works on temporal action detection and recognition perform…

Computer Vision and Pattern Recognition · Computer Science 2021-06-29 Vasiliki I. Vasileiou , Nikolaos Kardaris , Petros Maragos

Understanding the structure of complex activities in untrimmed videos is a challenging task in the area of action recognition. One problem here is that this task usually requires a large amount of hand-annotated minute- or even hour-long…

Computer Vision and Pattern Recognition · Computer Science 2020-10-01 Rosaura G. VidalMata , Walter J. Scheirer , Anna Kukleva , David Cox , Hilde Kuehne