English
Related papers

Related papers: Localizing Unseen Activities in Video via Image Qu…

200 papers

Multi-label multi-view action recognition aims to recognize multiple concurrent or sequential actions from untrimmed videos captured by multiple cameras. Existing work has focused on multi-view action recognition in a narrow area with…

Computer Vision and Pattern Recognition · Computer Science 2024-10-21 Trung Thanh Nguyen , Yasutomo Kawanishi , Takahiro Komamizu , Ichiro Ide

Wearable sensor based human activity recognition is a challenging problem due to difficulty in modeling spatial and temporal dependencies of sensor signals. Recognition models in closed-set assumption are forced to yield members of known…

Computer Vision and Pattern Recognition · Computer Science 2024-04-24 M Tanjid Hasan Tonmoy , Saif Mahmud , A K M Mahbubur Rahman , M Ashraful Amin , Amin Ahsan Ali

Weakly-supervised Temporal Action Localization (WS-TAL) methods learn to localize temporal starts and ends of action instances in a video under only video-level supervision. Existing WS-TAL methods rely on deep features learned for action…

Computer Vision and Pattern Recognition · Computer Science 2021-03-31 Ziyi Liu , Le Wang , Wei Tang , Junsong Yuan , Nanning Zheng , Gang Hua

In this paper we address the problem of automatically discovering atomic actions in unsupervised manner from instructional videos, which are rarely annotated with atomic actions. We present an unsupervised approach to learn atomic actions…

Computer Vision and Pattern Recognition · Computer Science 2021-06-08 AJ Piergiovanni , Anelia Angelova , Michael S. Ryoo , Irfan Essa

Unsupervised segmentation of action segments in egocentric videos is a desirable feature in tasks such as activity recognition and content-based video retrieval. Reducing the search space into a finite set of action segments facilitates a…

Computer Vision and Pattern Recognition · Computer Science 2021-06-24 I. Hipiny , H. Ujir , J. L. Minoi , S. F. Samson Juan , M. A. Khairuddin , M. S. Sunar

Our objective in this work is fine-grained classification of actions in untrimmed videos, where the actions may be temporally extended or may span only a few frames of the video. We cast this into a query-response mechanism, where each…

Computer Vision and Pattern Recognition · Computer Science 2021-04-20 Chuhan Zhang , Ankush Gupta , Andrew Zisserman

This paper focuses on activity retrieval from a video query in an imbalanced scenario. In current query-by-activity-video literature, a common assumption is that all activities have sufficient labelled examples when learning an embedding.…

Computer Vision and Pattern Recognition · Computer Science 2023-11-27 Tao Hu , William Thong , Pascal Mettes , Cees G. M. Snoek

In this paper, we show that recent advances in video representation learning and pre-trained vision-language models allow for substantial improvements in self-supervised video object localization. We propose a method that first localizes…

Temporal action localization aims to identify the boundaries and categories of actions in videos, such as scoring a goal in a football match. Single-frame supervision has emerged as a labor-efficient way to train action localizers as it…

Human-Computer Interaction · Computer Science 2023-12-11 Changjian Chen , Jiashu Chen , Weikai Yang , Haoze Wang , Johannes Knittel , Xibin Zhao , Steffen Koch , Thomas Ertl , Shixia Liu

Detecting firearms and accurately localizing individuals carrying them in images or videos is of paramount importance in security, surveillance, and content customization. However, this task presents significant challenges in complex…

Computer Vision and Pattern Recognition · Computer Science 2023-09-19 Arif Mahmood , Abdul Basit , M. Akhtar Munir , Mohsen Ali

Untrimmed videos on social media or those captured by robots and surveillance cameras are of varied aspect ratios. However, 3D CNNs usually require as input a square-shaped video, whose spatial dimension is smaller than the original.…

Computer Vision and Pattern Recognition · Computer Science 2021-11-23 Prithwish Jana , Swarnabja Bhaumik , Partha Pratim Mohanta

In this work, we focus on label efficient learning for video action detection. We develop a novel semi-supervised active learning approach which utilizes both labeled as well as unlabeled data along with informative sample selection for…

Computer Vision and Pattern Recognition · Computer Science 2024-04-04 Ayush Singh , Aayush J Rana , Akash Kumar , Shruti Vyas , Yogesh Singh Rawat

This paper studies the task of temporal moment localization in a long untrimmed video using natural language query. Given a query sentence, the goal is to determine the start and end of the relevant segment within the video. Our key…

Computer Vision and Pattern Recognition · Computer Science 2020-10-14 Cristian Rodriguez-Opazo , Edison Marrese-Taylor , Basura Fernando , Hongdong Li , Stephen Gould

In this paper we address the problem of unsupervised localization of objects in single images. Compared to previous state-of-the-art method our method is fully unsupervised in the sense that there is no prior instance level or category…

Computer Vision and Pattern Recognition · Computer Science 2018-04-12 Hakan Karaoguz , Patric Jensfelt

Visual localization determines an agent's precise position and orientation within an environment using visual data. It has become a critical task in the field of robotics, particularly in applications such as autonomous navigation. This is…

Computer Vision and Pattern Recognition · Computer Science 2025-02-25 Nanda Febri Istighfarin , HyungGi Jo

Recognizing group activities is challenging due to the difficulties in isolating individual entities, finding the respective roles played by the individuals and representing the complex interactions among the participants. Individual…

Computer Vision and Pattern Recognition · Computer Science 2015-03-20 Qiang Qiu , Rama Chellappa

In the task of temporal action localization of ActivityNet-1.3 datasets, we propose to locate the temporal boundaries of each action and predict action class in untrimmed videos. We first apply VideoSwinTransformer as feature extractor to…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Shimin Chen , Wei Li , Jianyang Gu , Chen Chen , Yandong Guo

In this paper, we propose an end-to-end capsule network for pixel level localization of actors and actions present in a video. The localization is performed based on a natural language query through which an actor and action are specified.…

Computer Vision and Pattern Recognition · Computer Science 2018-12-04 Bruce McIntosh , Kevin Duarte , Yogesh S Rawat , Mubarak Shah

We propose a soft attention based model for the task of action recognition in videos. We use multi-layered Recurrent Neural Networks (RNNs) with Long Short-Term Memory (LSTM) units which are deep both spatially and temporally. Our model…

Machine Learning · Computer Science 2016-02-16 Shikhar Sharma , Ryan Kiros , Ruslan Salakhutdinov

This paper summarizes the TinyAction challenge which was organized in ActivityNet workshop at CVPR 2021. This challenge focuses on recognizing real-world low-resolution activities present in videos. Action recognition task is currently…

Computer Vision and Pattern Recognition · Computer Science 2021-07-27 Praveen Tirupattur , Aayush J Rana , Tushar Sangam , Shruti Vyas , Yogesh S Rawat , Mubarak Shah