English
Related papers

Related papers: Foreground-Action Consistency Network for Weakly S…

200 papers

Although deep learning based methods have achieved great progress in unsupervised video object segmentation, difficult scenarios (e.g., visual similarity, occlusions, and appearance changing) are still not well-handled. To alleviate these…

Computer Vision and Pattern Recognition · Computer Science 2020-12-07 Daizong Liu , Dongdong Yu , Changhu Wang , Pan Zhou

Weakly-supervised action localization aims to recognize and localize action instancese in untrimmed videos with only video-level labels. Most existing models rely on multiple instance learning(MIL), where the predictions of unlabeled…

Computer Vision and Pattern Recognition · Computer Science 2023-09-27 Guiqin Wang , Peng Zhao , Cong Zhao , Shusen Yang , Jie Cheng , Luziwei Leng , Jianxing Liao , Qinghai Guo

This paper presents a simple yet effective approach for the poorly investigated task of global action segmentation, aiming at grouping frames capturing the same action across videos of different activities. Unlike the case of videos…

Computer Vision and Pattern Recognition · Computer Science 2024-12-18 Elena Bueno-Benito , Mariella Dimiccoli

Weakly supervised temporal action localization (WS-TAL) is a challenging task that aims to localize action instances in the given video with video-level categorical supervision. Both appearance and motion features are used in previous…

Computer Vision and Pattern Recognition · Computer Science 2021-07-28 Fa-Ting Hong , Jia-Chang Feng , Dan Xu , Ying Shan , Wei-Shi Zheng

Action recognition has become a rapidly developing research field within the last decade. But with the increasing demand for large scale data, the need of hand annotated data for the training becomes more and more impractical. One way to…

Computer Vision and Pattern Recognition · Computer Science 2019-06-05 Hilde Kuehne , Alexander Richard , Juergen Gall

With the knowledge of action moments (i.e., trimmed video clips that each contains an action instance), humans could routinely localize an action temporally in an untrimmed video. Nevertheless, most practical methods still require all…

Computer Vision and Pattern Recognition · Computer Science 2020-09-01 Fuchen Long , Ting Yao , Zhaofan Qiu , Xinmei Tian , Jiebo Luo , Tao Mei

In this paper a pure-attention bottom-up approach, called ViGAT, that utilizes an object detector together with a Vision Transformer (ViT) backbone network to derive object and frame features, and a head network to process these features…

Computer Vision and Pattern Recognition · Computer Science 2022-11-01 Nikolaos Gkalelis , Dimitrios Daskalakis , Vasileios Mezaris

Localizing actions in video is a core task in computer vision. The weakly supervised temporal localization problem investigates whether this task can be adequately solved with only video-level labels, significantly reducing the amount of…

Computer Vision and Pattern Recognition · Computer Science 2021-05-07 Junwei Ma , Satya Krishna Gorti , Maksims Volkovs , Guangwei Yu

Temporal action localization is an important and challenging task that aims to locate temporal regions in real-world untrimmed videos where actions occur and recognize their classes. It is widely acknowledged that video context is a…

Computer Vision and Pattern Recognition · Computer Science 2021-03-10 Xin Qin , Hanbin Zhao , Guangchen Lin , Hao Zeng , Songcen Xu , Xi Li

Temporal action localization plays an important role in video analysis, which aims to localize and classify actions in untrimmed videos. The previous methods often predict actions on a feature space of a single-temporal scale. However, the…

Computer Vision and Pattern Recognition · Computer Science 2022-08-17 Zan Gao , Xinglei Cui , Tao Zhuo , Zhiyong Cheng , An-An Liu , Meng Wang , Shenyong Chen

This work proposes a weakly-supervised temporal action localization framework, called D2-Net, which strives to temporally localize actions using video-level supervision. Our main contribution is the introduction of a novel loss formulation,…

Computer Vision and Pattern Recognition · Computer Science 2021-08-24 Sanath Narayan , Hisham Cholakkal , Munawar Hayat , Fahad Shahbaz Khan , Ming-Hsuan Yang , Ling Shao

Action recognition in videos has attracted a lot of attention in the past decade. In order to learn robust models, previous methods usually assume videos are trimmed as short sequences and require ground-truth annotations of each video…

Computer Vision and Pattern Recognition · Computer Science 2019-02-21 Xiao-Yu Zhang , Haichao Shi , Changsheng Li , Kai Zheng , Xiaobin Zhu , Lixin Duan

We present an approach for weakly supervised learning of human actions. Given a set of videos and an ordered list of the occurring actions, the goal is to infer start and end frames of the related action classes within the video and to…

Computer Vision and Pattern Recognition · Computer Science 2017-10-10 Alexander Richard , Hilde Kuehne , Juergen Gall

Current state-of-the-art approaches for spatio-temporal action detection have achieved impressive results but remain unsatisfactory for temporal extent detection. The main reason comes from that, there are some ambiguous states similar to…

Computer Vision and Pattern Recognition · Computer Science 2019-06-03 Lin Song , Shiwei Zhang , Gang Yu , Hongbin Sun

3D Convolutional Neural Network (3D CNN) captures spatial and temporal information on 3D data such as video sequences. However, due to the convolution and pooling mechanism, the information loss seems unavoidable. To improve the visual…

Computer Vision and Pattern Recognition · Computer Science 2022-08-17 Novanto Yudistira , Muthu Subash Kavitha , Takio Kurita

Recent works on two-stage cross-domain detection have widely explored the local feature patterns to achieve more accurate adaptation results. These methods heavily rely on the region proposal mechanisms and ROI-based instance-level features…

Computer Vision and Pattern Recognition · Computer Science 2021-03-31 Chaoqi Chen , Zebiao Zheng , Yue Huang , Xinghao Ding , Yizhou Yu

It is challenging for weakly supervised object detection network to precisely predict the positions of the objects, since there are no instance-level category annotations. Most existing methods tend to solve this problem by using a…

Computer Vision and Pattern Recognition · Computer Science 2019-11-28 Ke Yang , Dongsheng Li , Yong Dou

The main challenge of Temporal Action Localization is to retrieve subtle human actions from various co-occurring ingredients, e.g., context and background, in an untrimmed video. While prior approaches have achieved substantial progress…

Computer Vision and Pattern Recognition · Computer Science 2022-06-24 Kun Xia , Le Wang , Sanping Zhou , Nanning Zheng , Wei Tang

Weakly-supervised temporal action localization (WTAL) intends to detect action instances with only weak supervision, e.g., video-level labels. The current~\textit{de facto} pipeline locates action instances by thresholding and grouping…

Computer Vision and Pattern Recognition · Computer Science 2024-05-06 Qinying Liu , Zilei Wang , Ruoxi Chen , Zhilin Li

In this report, we present our solution for the task of temporal action localization (detection) (task 1) in ActivityNet Challenge 2020. The purpose of this task is to temporally localize intervals where actions of interest occur and…

Computer Vision and Pattern Recognition · Computer Science 2020-06-25 Xiang Wang , Baiteng Ma , Zhiwu Qing , Yongpeng Sang , Changxin Gao , Shiwei Zhang , Nong Sang