English
Related papers

Related papers: Action Graphs: Weakly-supervised Action Localizati…

200 papers

We propose a concise representation of videos that encode perceptually meaningful features into graphs. With this representation, we aim to leverage the large amount of redundancies in videos and save computations. First, we construct…

Computer Vision and Pattern Recognition · Computer Science 2022-07-21 Eitan Kosman , Dotan Di Castro

In this paper, we focus on video relocalization task, which uses a query video clip as input to retrieve a semantic relative video clip in another untrimmed long video. we find that in video relocalization datasets, there exists a…

Computer Vision and Pattern Recognition · Computer Science 2022-01-27 Yuan Zhou , Mingfei Wang , Ruolin Wang , Shuwei Huo

Video action segmentation have been widely applied in many fields. Most previous studies employed video-based vision models for this purpose. However, they often rely on a large receptive field, LSTM or Transformer methods to capture…

Computer Vision and Pattern Recognition · Computer Science 2024-02-07 Junbin Zhang , Pei-Hsuan Tsai , Meng-Hsun Tsai

The object of Weakly-supervised Temporal Action Localization (WS-TAL) is to localize all action instances in an untrimmed video with only video-level supervision. Due to the lack of frame-level annotations during training, current WS-TAL…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Ziyi Liu , Le Wang , Qilin Zhang , Wei Tang , Junsong Yuan , Nanning Zheng , Gang Hua

In this paper, we propose a method for activity recognition from videos based on sparse local features and hypergraph matching. We benefit from special properties of the temporal domain in the data to derive a sequential and fast graph…

Computer Vision and Pattern Recognition · Computer Science 2015-05-05 Eric Lombardi , Christian Wolf , Oya Celiktutan , Bülent Sankur

Manual spatio-temporal annotation of human action in videos is laborious, requires several annotators and contains human biases. In this paper, we present a weakly supervised approach to automatically obtain spatio-temporal annotations of…

Computer Vision and Pattern Recognition · Computer Science 2016-05-27 Waqas Sultani , Mubarak Shah

Temporal action segmentation approaches have been very successful recently. However, annotating videos with frame-wise labels to train such models is very expensive and time consuming. While weakly supervised methods trained using only…

Computer Vision and Pattern Recognition · Computer Science 2021-03-29 Zhe Li , Yazan Abu Farha , Juergen Gall

Temporal action localization is an important yet challenging research topic due to its various applications. Since the frame-level or segment-level annotations of untrimmed videos require amounts of labor expenditure, studies on the…

Computer Vision and Pattern Recognition · Computer Science 2019-08-08 Chengwei Zhang , Yunlu Xu , Zhanzhan Cheng , Yi Niu , Shiliang Pu , Fei Wu , Futai Zou

Developing end-to-end action recognition models on long videos is fundamental and crucial for long-video action understanding. Due to the unaffordable cost of end-to-end training on the whole long videos, existing works generally train…

Computer Vision and Pattern Recognition · Computer Science 2024-05-27 Jiaming Zhou , Hanjun Li , Kun-Yu Lin , Junwei Liang

Video action recognition, a critical problem in video understanding, has been gaining increasing attention. To identify actions induced by complex object-object interactions, we need to consider not only spatial relations among objects in a…

Computer Vision and Pattern Recognition · Computer Science 2019-05-08 Hao Huang , Luowei Zhou , Wei Zhang , Jason J. Corso , Chenliang Xu

We propose an efficient approach for activity detection in video that unifies activity categorization with space-time localization. The main idea is to pose activity detection as a maximum-weight connected subgraph problem. Offline, we…

Computer Vision and Pattern Recognition · Computer Science 2016-07-12 Chao-Yeh Chen , Kristen Grauman

In this paper, we address the challenging problem of spatial and temporal action detection in videos. We first develop an effective approach to localize frame-level action regions through integrating static and kinematic information by the…

Computer Vision and Pattern Recognition · Computer Science 2018-11-30 Yuancheng Ye , Xiaodong Yang , Yingli Tian

We introduce the task of weakly supervised learning for detecting human and object interactions in videos. Our task poses unique challenges as a system does not know what types of human-object interactions are present in a video or the…

Computer Vision and Pattern Recognition · Computer Science 2021-10-08 Shuang Li , Yilun Du , Antonio Torralba , Josef Sivic , Bryan Russell

Developing a technique for the automatic analysis of surveillance videos in order to identify the presence of violence is of broad interest. In this work, we propose a deep neural network for the purpose of recognizing violent videos. A…

Computer Vision and Pattern Recognition · Computer Science 2017-09-20 Swathikiran Sudhakaran , Oswald Lanz

Recently, Weakly-supervised Temporal Action Localization (WTAL) has been densely studied but there is still a large gap between weakly-supervised models and fully-supervised models. It is practical and intuitive to annotate temporal…

Computer Vision and Pattern Recognition · Computer Science 2020-03-24 Xudong Lin , Zheng Shou , Shih-Fu Chang

This thesis explore different approaches using Convolutional and Recurrent Neural Networks to classify and temporally localize activities on videos, furthermore an implementation to achieve it has been proposed. As the first step, features…

Computer Vision and Pattern Recognition · Computer Science 2017-03-06 Alberto Montes , Amaia Salvador , Santiago Pascual , Xavier Giro-i-Nieto

Weakly-supervised temporal action localization aims to localize action instances in untrimmed videos with only video-level supervision. We witness that different actions record common phases, e.g., the run-up in the HighJump and LongJump.…

Computer Vision and Pattern Recognition · Computer Science 2023-03-31 Yifu Liu , Xiaoxia Li , Zhiling Luo , Wei Zhou

A key element of computer-assisted surgery systems is phase recognition of surgical videos. Existing phase recognition algorithms require frame-wise annotation of a large number of videos, which is time and money consuming. In this work we…

Computer Vision and Pattern Recognition · Computer Science 2023-10-27 Roy Hirsch , Regev Cohen , Mathilde Caron , Tomer Golany , Daniel Freedman , Ehud Rivlin

The goal of this paper is to determine the spatio-temporal location of actions in video. Where training from hard to obtain box annotations is the norm, we propose an intuitive and effective algorithm that localizes actions from their class…

Computer Vision and Pattern Recognition · Computer Science 2017-12-14 Pascal Mettes , Cees G. M. Snoek , Shih-Fu Chang

Temporal action localization aims to identify the boundaries and categories of actions in videos, such as scoring a goal in a football match. Single-frame supervision has emerged as a labor-efficient way to train action localizers as it…

Human-Computer Interaction · Computer Science 2023-12-11 Changjian Chen , Jiashu Chen , Weikai Yang , Haoze Wang , Johannes Knittel , Xibin Zhao , Steffen Koch , Thomas Ertl , Shixia Liu