English
Related papers

Related papers: FMI-TAL: Few-shot Multiple Instances Temporal Acti…

200 papers

Current state-of-the-art human activity recognition is focused on the classification of temporally trimmed videos in which only one action occurs per frame. We propose a simple, yet effective, method for the temporal detection of activities…

Computer Vision and Pattern Recognition · Computer Science 2016-07-14 Gurkirt Singh , Fabio Cuzzolin

Significant progress has been made recently in developing few-shot object segmentation methods. Learning is shown to be successful in few-shot segmentation settings, using pixel-level, scribbles and bounding box supervision. This paper…

Computer Vision and Pattern Recognition · Computer Science 2020-05-19 Mennatullah Siam , Naren Doraiswamy , Boris N. Oreshkin , Hengshuai Yao , Martin Jagersand

In this work, we propose an approach to the spatiotemporal localisation (detection) and classification of multiple concurrent actions within temporally untrimmed videos. Our framework is composed of three stages. In stage 1, appearance and…

Computer Vision and Pattern Recognition · Computer Science 2016-08-05 Suman Saha , Gurkirt Singh , Michael Sapienza , Philip H. S. Torr , Fabio Cuzzolin

The goal of this paper is to determine the spatio-temporal location of actions in video. Where training from hard to obtain box annotations is the norm, we propose an intuitive and effective algorithm that localizes actions from their class…

Computer Vision and Pattern Recognition · Computer Science 2017-12-14 Pascal Mettes , Cees G. M. Snoek , Shih-Fu Chang

With video-level labels, weakly supervised temporal action localization (WTAL) applies a localization-by-classification paradigm to detect and classify the action in untrimmed videos. Due to the characteristic of classification,…

Computer Vision and Pattern Recognition · Computer Science 2022-07-15 Ziqiang Li , Yongxin Ge , Jiaruo Yu , Zhongming Chen

We address temporal localization of events in large-scale video data, in the context of the Youtube-8M Segments dataset. This emerging field within video recognition can enable applications to identify the precise time a specified event…

Computer Vision and Pattern Recognition · Computer Science 2019-10-28 Mikel Bober-Irizar , Miha Skalic , David Austin

Temporal action localization (TAL) is a prevailing task due to its great application potential. Existing works in this field mainly suffer from two weaknesses: (1) They often neglect the multi-label case and only focus on temporal modeling.…

Computer Vision and Pattern Recognition · Computer Science 2023-03-16 Congqi Cao , Yizhe Wang , Yue Lu , Xin Zhang , Yanning Zhang

Recently, few-shot video classification has received an increasing interest. Current approaches mostly focus on effectively exploiting the temporal dimension in videos to improve learning under low data regimes. However, most works have…

Computer Vision and Pattern Recognition · Computer Science 2021-12-16 Andrés Villa , Juan-Manuel Perez-Rua , Victor Escorcia , Vladimir Araujo , Juan Carlos Niebles , Alvaro Soto

Weakly-Supervised Temporal Action Localization (WSTAL) aims to localize actions in untrimmed videos with only video-level labels. Currently, most state-of-the-art WSTAL methods follow a Multi-Instance Learning (MIL) pipeline: producing…

Computer Vision and Pattern Recognition · Computer Science 2022-08-24 Meng Cao , Can Zhang , Long Chen , Mike Zheng Shou , Yuexian Zou

We address the problem of language-based temporal localization of moments in untrimmed videos. Compared to temporal localization with fixed categories, this problem is more challenging as the language-based queries have no predefined…

Computer Vision and Pattern Recognition · Computer Science 2020-06-19 Madhawa Vidanapathirana , Supriya Pandhre , Sonia Raychaudhuri , Anjali Khurana

Temporal action localization (TAL), which involves recognizing and locating action instances, is a challenging task in video understanding. Most existing approaches directly predict action classes and regress offsets to boundaries, while…

Computer Vision and Pattern Recognition · Computer Science 2023-09-14 Jiayi Shao , Xiaohan Wang , Ruijie Quan , Junjun Zheng , Jiang Yang , Yi Yang

Weakly supervised video object localization (WSVOL) allows locating object in videos using only global video tags such as object class. State-of-art methods rely on multiple independent stages, where initial spatio-temporal proposals are…

Computer Vision and Pattern Recognition · Computer Science 2022-10-25 Soufiane Belharbi , Ismail Ben Ayed , Luke McCaffrey , Eric Granger

Temporal action detection aims at not only recognizing action category but also detecting start time and end time for each action instance in an untrimmed video. The key challenge of this task is to accurately classify the action and…

Computer Vision and Pattern Recognition · Computer Science 2018-10-22 Wen Wang , Yongjian Wu , Haijun Liu , Shiguang Wang , Jian Cheng

Weakly-supervised Temporal Action Localization (WSTAL) aims to localize actions in untrimmed videos using only video-level supervision. Latest WSTAL methods introduce pseudo label learning framework to bridge the gap between…

Computer Vision and Pattern Recognition · Computer Science 2024-07-15 Qianhan Feng , Wenshuo Li , Tong Lin , Xinghao Chen

We study a multiclass multiple instance learning (MIL) problem where the labels only suggest whether any instance of a class exists or does not exist in a training sample or example. No further information, e.g., the number of instances of…

Machine Learning · Statistics 2019-03-15 Xi-Lin Li

Existing methods for instance segmentation in videos typically involve multi-stage pipelines that follow the tracking-by-detection paradigm and model a video clip as a sequence of images. Multiple networks are used to detect objects in…

Computer Vision and Pattern Recognition · Computer Science 2023-09-04 Ali Athar , Sabarinath Mahadevan , Aljoša Ošep , Laura Leal-Taixé , Bastian Leibe

In this paper, we study an intermediate form of supervision, i.e., single-frame supervision, for temporal action localization (TAL). To obtain the single-frame supervision, the annotators are asked to identify only a single frame within the…

Computer Vision and Pattern Recognition · Computer Science 2020-08-18 Fan Ma , Linchao Zhu , Yi Yang , Shengxin Zha , Gourab Kundu , Matt Feiszli , Zheng Shou

Weakly-supervised temporal action localization is a problem of learning an action localization model with only video-level action labeling available. The general framework largely relies on the classification activation, which employs an…

Computer Vision and Pattern Recognition · Computer Science 2020-03-31 Baifeng Shi , Qi Dai , Yadong Mu , Jingdong Wang

Temporal Action Localization (TAL) in untrimmed video is important for many applications. But it is very expensive to annotate the segment-level ground truth (action class and temporal boundary). This raises the interest of addressing TAL…

Computer Vision and Pattern Recognition · Computer Science 2018-12-18 Zheng Shou , Hang Gao , Lei Zhang , Kazuyuki Miyazawa , Shih-Fu Chang

We propose a novel approach to few-shot action recognition, finding temporally-corresponding frame tuples between the query and videos in the support set. Distinct from previous few-shot works, we construct class prototypes using the…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Toby Perrett , Alessandro Masullo , Tilo Burghardt , Majid Mirmehdi , Dima Damen