English
Related papers

Related papers: Attentive Action and Context Factorization

200 papers

This work strives for the classification and localization of human actions in videos, without the need for any labeled video training examples. Where existing work relies on transferring global attribute or object information from seen to…

Computer Vision and Pattern Recognition · Computer Science 2021-04-13 Pascal Mettes , William Thong , Cees G. M. Snoek

In this paper, we propose an approach that spatially localizes the activities in a video frame where each person can perform multiple activities at the same time. Our approach takes the temporal scene context as well as the relations of the…

Computer Vision and Pattern Recognition · Computer Science 2021-01-22 Sovan Biswas , Yaser Souri , Juergen Gall

Machine learning models of visual action recognition are typically trained and tested on data from specific situations where actions are associated with certain objects. It is an open question how action-object associations in the training…

Computer Vision and Pattern Recognition · Computer Science 2022-08-16 Satoshi Tsutsui , Xizi Wang , Guangyuan Weng , Yayun Zhang , David Crandall , Chen Yu

Weakly-supervised temporal action localization aims to identify and localize the action instances in the untrimmed videos with only video-level action labels. When humans watch videos, we can adapt our abstract-level knowledge about actions…

Computer Vision and Pattern Recognition · Computer Science 2023-12-27 Xijun Wang , Aggelos K. Katsaggelos

The goal of this work is spatio-temporal action localization in videos, using only the supervision from video-level class labels. The state-of-the-art casts this weakly-supervised action localization regime as a Multiple Instance Learning…

Computer Vision and Pattern Recognition · Computer Science 2018-11-26 Pascal Mettes , Cees G. M. Snoek

Few-shot action recognition aims to address the high cost and impracticality of manually labeling complex and variable video data in action recognition. It requires accurately classifying human actions in videos using only a few labeled…

Computer Vision and Pattern Recognition · Computer Science 2025-03-31 Yuyang Wanyan , Xiaoshan Yang , Weiming Dong , Changsheng Xu

In recent years, video action recognition, as a fundamental task in the field of video understanding, has been deeply explored by numerous researchers.Most traditional video action recognition methods typically involve converting videos…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Junlin Chen , Chengcheng Xu , Yangfan Xu , Jian Yang , Jun Li , Zhiping Shi

Action recognition, which is formulated as a task to identify various human actions in a video, has attracted increasing interest from computer vision researchers due to its importance in various applications. Recently, appearance-based…

Computer Vision and Pattern Recognition · Computer Science 2020-11-26 Jack Humphreys , Zhe Chen , Dacheng Tao

Research on video activity detection has primarily focused on identifying well-defined human activities in short video segments. The majority of the research on video activity recognition is focused on the development of large parameter…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Venkatesh Jatla , Sravani Teeparthi , Ugesh Egala , Sylvia Celedon Pattichis , Marios S. Patticis

What is the right way to reason about human activities? What directions forward are most promising? In this work, we analyze the current state of human activity understanding in videos. The goal of this paper is to examine datasets,…

Computer Vision and Pattern Recognition · Computer Science 2017-08-10 Gunnar A. Sigurdsson , Olga Russakovsky , Abhinav Gupta

Human-object interaction detection is an important and relatively new class of visual relationship detection tasks, essential for deeper scene understanding. Most existing approaches decompose the problem into object localization and…

Computer Vision and Pattern Recognition · Computer Science 2019-10-18 Tiancai Wang , Rao Muhammad Anwer , Muhammad Haris Khan , Fahad Shahbaz Khan , Yanwei Pang , Ling Shao , Jorma Laaksonen

Human-centred systems require an understanding of human actions in the physical world. Temporally extended sequences of actions are intentional and structured, yet existing methods for recognising what actions are performed often do not…

Artificial Intelligence · Computer Science 2026-04-21 Rimvydas Rubavicius , Manisha Dubey , N. Siddharth , Subramanian Ramamoorthy

In video understanding, action spotting consists in temporally localizing human-induced events annotated with single timestamps. In this paper, we propose a novel loss function that specifically considers the temporal context naturally…

Computer Vision and Pattern Recognition · Computer Science 2020-03-31 Anthony Cioppa , Adrien Deliège , Silvio Giancola , Bernard Ghanem , Marc Van Droogenbroeck , Rikke Gade , Thomas B. Moeslund

Recognising human activities from streaming videos poses unique challenges to learning algorithms: predictive models need to be scalable, incrementally trainable, and must remain bounded in size even when the data stream is arbitrarily…

Machine Learning · Statistics 2016-10-06 Rocco De Rosa , Ilaria Gori , Fabio Cuzzolin , Barbara Caputo , Nicolò Cesa-Bianchi

Real-world videos contain many complex actions with inherent relationships between action classes. In this work, we propose an attention-based architecture that models these action relationships for the task of temporal action localization…

Computer Vision and Pattern Recognition · Computer Science 2021-06-01 Praveen Tirupattur , Kevin Duarte , Yogesh Rawat , Mubarak Shah

We propose a self-supervised learning method to jointly reason about spatial and temporal context for video recognition. Recent self-supervised approaches have used spatial context [9, 34] as well as temporal coherency [32] but a…

Computer Vision and Pattern Recognition · Computer Science 2018-08-24 Unaiza Ahsan , Rishi Madhok , Irfan Essa

Understanding what makes a video memorable has important applications in advertising or education technology. Towards this goal, we investigate spatio-temporal attention mechanisms underlying video memorability. Different from previous…

Computer Vision and Pattern Recognition · Computer Science 2024-11-06 Prajneya Kumar , Eshika Khandelwal , Makarand Tapaswi , Vishnu Sreekumar

We consider the problem of video-based person re-identification. The goal is to identify a person from videos captured under different cameras. In this paper, we propose an efficient spatial-temporal attention based model for person…

Computer Vision and Pattern Recognition · Computer Science 2018-10-29 Shivansh Rao , Tanzila Rahman , Mrigank Rochan , Yang Wang

First-person action recognition is a challenging task in video understanding. Because of strong ego-motion and a limited field of view, many backgrounds or noisy frames in a first-person video can distract an action recognition model during…

Computer Vision and Pattern Recognition · Computer Science 2021-12-03 Lijin Yang , Yifei Huang , Yusuke Sugano , Yoichi Sato

In egocentric videos, actions occur in quick succession. We capitalise on the action's temporal context and propose a method that learns to attend to surrounding actions in order to improve recognition performance. To incorporate the…

Computer Vision and Pattern Recognition · Computer Science 2021-11-02 Evangelos Kazakos , Jaesung Huh , Arsha Nagrani , Andrew Zisserman , Dima Damen