中文
相关论文

相关论文: Temporal Action Localization with Multi-temporal S…

200 篇论文

Accurate temporal action proposals play an important role in detecting actions from untrimmed videos. The existing approaches have difficulties in capturing global contextual information and simultaneously localizing actions with different…

计算机视觉与模式识别 · 计算机科学 2020-03-10 Jialin Gao , Zhixiang Shi , Jiani Li , Guanshuo Wang , Yufeng Yuan , Shiming Ge , Xi Zhou

Localizing actions in video is a core task in computer vision. The weakly supervised temporal localization problem investigates whether this task can be adequately solved with only video-level labels, significantly reducing the amount of…

计算机视觉与模式识别 · 计算机科学 2021-05-07 Junwei Ma , Satya Krishna Gorti , Maksims Volkovs , Guangwei Yu

Weakly supervised temporal action localization is a challenging task as only the video-level annotation is available during the training process. To address this problem, we propose a two-stage approach to fully exploit multi-resolution…

计算机视觉与模式识别 · 计算机科学 2025-06-24 Rui Su , Dong Xu , Luping Zhou , Wanli Ouyang

Inspired by the observation that humans are able to process videos efficiently by only paying attention where and when it is needed, we propose an interpretable and easy plug-in spatial-temporal attention mechanism for video action…

计算机视觉与模式识别 · 计算机科学 2019-06-04 Lili Meng , Bo Zhao , Bo Chang , Gao Huang , Wei Sun , Frederich Tung , Leonid Sigal

Weakly-supervised temporal action localization (WTAL) in untrimmed videos has emerged as a practical but challenging task since only video-level labels are available. Existing approaches typically leverage off-the-shelf segment-level…

计算机视觉与模式识别 · 计算机科学 2021-12-22 Zichen Yang , Jie Qin , Di Huang

Understanding temporal information and how the visual world changes over time is a fundamental ability of intelligent systems. In video understanding, temporal information is at the core of many current challenges, including compression,…

计算机视觉与模式识别 · 计算机科学 2019-10-31 Laura Sevilla-Lara , Shengxin Zha , Zhicheng Yan , Vedanuj Goswami , Matt Feiszli , Lorenzo Torresani

Temporal action localization (TAL) is a task of identifying a set of actions in a video, which involves localizing the start and end frames and classifying each action instance. Existing methods have addressed this task by using predefined…

计算机视觉与模式识别 · 计算机科学 2022-07-22 Tae-Kyung Kang , Gun-Hee Lee , Seong-Whan Lee

The problem of action recognition involves locating the action in the video, both over time and spatially in the image. The dominant current approaches use supervised learning to solve this problem, and require large amounts of annotated…

计算机视觉与模式识别 · 计算机科学 2020-03-30 Sathyanarayanan N. Aakur , Sudeep Sarkar

Temporally localizing activities within untrimmed videos has been extensively studied in recent years. Despite recent advances, existing methods for weakly-supervised temporal activity localization struggle to recognize when an activity is…

计算机视觉与模式识别 · 计算机科学 2020-07-15 Kyle Min , Jason J. Corso

We propose a method for human action recognition, one that can localize the spatiotemporal regions that `define' the actions. This is a challenging task due to the subtlety of human actions in video and the co-occurrence of contextual…

计算机视觉与模式识别 · 计算机科学 2019-04-12 Yang Wang , Vinh Tran , Gedas Bertasius , Lorenzo Torresani , Minh Hoai

Temporal action localization (TAL) aims to detect the boundary and identify the class of each action instance in a long untrimmed video. Current approaches treat video frames homogeneously, and tend to give background and key objects…

计算机视觉与模式识别 · 计算机科学 2022-11-11 Yifan Liu , Youbao Tang , Ning Zhang , Ruei-Sung Lin , Haoqian Wang

Temporal grounding of activities, the identification of specific time intervals of actions within a larger event context, is a critical task in video understanding. Recent advancements in multimodal large language models (LLMs) offer new…

计算机视觉与模式识别 · 计算机科学 2024-07-09 Young Chol Song

In this paper, we introduce Coarse-Fine Networks, a two-stream architecture which benefits from different abstractions of temporal resolution to learn better video representations for long-term motion. Traditional Video models process…

计算机视觉与模式识别 · 计算机科学 2021-04-02 Kumara Kahatapitiya , Michael S. Ryoo

Many interesting events in the real world are rare making preannotated machine learning ready videos a rarity in consequence. Thus, temporal activity detection models that are able to learn from a few examples are desirable. In this paper,…

计算机视觉与模式识别 · 计算机科学 2020-04-02 Huijuan Xu , Ximeng Sun , Eric Tzeng , Abir Das , Kate Saenko , Trevor Darrell

Temporal Action Localization (TAL) aims to predict both action category and temporal boundary of action instances in untrimmed videos, i.e., start and end time. Fully-supervised solutions are usually adopted in most existing works, and…

计算机视觉与模式识别 · 计算机科学 2022-12-02 Ding Li , Xuebing Yang , Yongqiang Tang , Chenyang Zhang , Wensheng Zhang

Understanding the structure of complex activities in untrimmed videos is a challenging task in the area of action recognition. One problem here is that this task usually requires a large amount of hand-annotated minute- or even hour-long…

计算机视觉与模式识别 · 计算机科学 2020-10-01 Rosaura G. VidalMata , Walter J. Scheirer , Anna Kukleva , David Cox , Hilde Kuehne

Video action detectors are usually trained using datasets with fully-supervised temporal annotations. Building such datasets is an expensive task. To alleviate this problem, recent methods have tried to leverage weak labeling, where videos…

计算机视觉与模式识别 · 计算机科学 2020-11-10 Alejandro Pardo , Humam Alwassel , Fabian Caba Heilbron , Ali Thabet , Bernard Ghanem

Effectively tackling the problem of temporal action localization (TAL) necessitates a visual representation that jointly pursues two confounding goals, i.e., fine-grained discrimination for temporal localization and sufficient visual…

计算机视觉与模式识别 · 计算机科学 2021-08-10 Zixin Zhu , Wei Tang , Le Wang , Nanning Zheng , Gang Hua

In temporal action localization, given an input video, the goal is to predict which actions it contains, where they begin, and where they end. Training and testing current state-of-the-art deep learning models requires access to large…

Temporal action localization presents a trade-off between test performance and annotation-time cost. Fully supervised methods achieve good performance with time-consuming boundary annotations. Weakly supervised methods with cheaper…

计算机视觉与模式识别 · 计算机科学 2020-07-06 Xinpeng Ding , Nannan Wang , Xinbo Gao , Jie Li , Xiaoyu Wang , Tongliang Liu