中文
相关论文

相关论文: Tripping through time: Efficient Localization of A…

200 篇论文

While large-scale image-text pretrained models such as CLIP have been used for multiple video-level tasks on trimmed videos, their use for temporal localization in untrimmed videos is still a relatively unexplored task. We design a new…

计算机视觉与模式识别 · 计算机科学 2023-08-23 Shen Yan , Xuehan Xiong , Arsha Nagrani , Anurag Arnab , Zhonghao Wang , Weina Ge , David Ross , Cordelia Schmid

This paper studies the problem of temporal moment localization in a long untrimmed video using natural language as the query. Given an untrimmed video and a sentence as the query, the goal is to determine the starting, and the ending, of…

计算机视觉与模式识别 · 计算机科学 2020-03-13 Cristian Rodriguez-Opazo , Edison Marrese-Taylor , Fatemeh Sadat Saleh , Hongdong Li , Stephen Gould

We address the problem of language-based temporal localization in untrimmed videos. Compared to temporal localization with fixed categories, this problem is more challenging as the language-based queries not only have no pre-defined…

计算机视觉与模式识别 · 计算机科学 2018-11-26 Runzhou Ge , Jiyang Gao , Kan Chen , Ram Nevatia

Long-form video understanding presents significant challenges for interactive retrieval systems, as conventional methods struggle to process extensive video content efficiently. Existing approaches often rely on single models, inefficient…

There is significant progress in recognizing traditional human activities from videos focusing on highly distinctive actions involving discriminative body movements, body-object and/or human-human interactions. Driver's activities are…

计算机视觉与模式识别 · 计算机科学 2021-01-19 Zachary Wharton , Ardhendu Behera , Yonghuai Liu , Nik Bessis

Temporal action localization (TAL) is a task of identifying a set of actions in a video, which involves localizing the start and end frames and classifying each action instance. Existing methods have addressed this task by using predefined…

计算机视觉与模式识别 · 计算机科学 2022-07-22 Tae-Kyung Kang , Gun-Hee Lee , Seong-Whan Lee

In this paper, we newly introduce the concept of temporal attention filters, and describe how they can be used for human activity recognition from videos. Many high-level activities are often composed of multiple temporal parts (e.g.,…

计算机视觉与模式识别 · 计算机科学 2016-12-28 AJ Piergiovanni , Chenyou Fan , Michael S. Ryoo

This paper focuses on temporal localization of actions in untrimmed videos. Existing methods typically train classifiers for a pre-defined list of actions and apply them in a sliding window fashion. However, activities in the wild consist…

计算机视觉与模式识别 · 计算机科学 2017-08-07 Jiyang Gao , Chen Sun , Zhenheng Yang , Ram Nevatia

Temporal action localization is an important and challenging task that aims to locate temporal regions in real-world untrimmed videos where actions occur and recognize their classes. It is widely acknowledged that video context is a…

计算机视觉与模式识别 · 计算机科学 2021-03-10 Xin Qin , Hanbin Zhao , Guangchen Lin , Hao Zeng , Songcen Xu , Xi Li

This paper addresses the problem of text-to-video temporal grounding, which aims to identify the time interval in a video semantically relevant to a text query. We tackle this problem using a novel regression-based model that learns to…

计算机视觉与模式识别 · 计算机科学 2020-04-17 Jonghwan Mun , Minsu Cho , Bohyung Han

Accurate temporal action proposals play an important role in detecting actions from untrimmed videos. The existing approaches have difficulties in capturing global contextual information and simultaneously localizing actions with different…

计算机视觉与模式识别 · 计算机科学 2020-03-10 Jialin Gao , Zhixiang Shi , Jiani Li , Guanshuo Wang , Yufeng Yuan , Shiming Ge , Xi Zhou

In temporal action localization, given an input video, the goal is to predict which actions it contains, where they begin, and where they end. Training and testing current state-of-the-art deep learning models requires access to large…

Video temporal grounding aims to pinpoint a video segment that matches the query description. Despite the recent advance in short-form videos (\textit{e.g.}, in minutes), temporal grounding in long videos (\textit{e.g.}, in hours) is still…

计算机视觉与模式识别 · 计算机科学 2024-02-20 Yulin Pan , Xiangteng He , Biao Gong , Yiliang Lv , Yujun Shen , Yuxin Peng , Deli Zhao

This paper is the first work to perform spatio-temporal mapping of human activity using the visual content of geo-tagged videos. We utilize a recent deep-learning based video analysis framework, termed hidden two-stream networks, to…

计算机视觉与模式识别 · 计算机科学 2017-11-30 Yi Zhu , Sen Liu , Shawn Newsam

In video compression, most of the existing deep learning approaches concentrate on the visual quality of a single frame, while ignoring the useful priors as well as the temporal information of adjacent frames. In this paper, we propose a…

计算机视觉与模式识别 · 计算机科学 2019-01-16 Xiandong Meng , Xuan Deng , Shuyuan Zhu , Shuaicheng Liu , Chuan Wang , Chen Chen , Bing Zeng

Temporal action detection (TAD) aims to detect all action boundaries and their corresponding categories in an untrimmed video. The unclear boundaries of actions in videos often result in imprecise predictions of action boundaries by…

计算机视觉与模式识别 · 计算机科学 2023-09-12 Dingfeng Shi , Qiong Cao , Yujie Zhong , Shan An , Jian Cheng , Haogang Zhu , Dacheng Tao

Weakly-supervised temporal action localization aims to identify and localize the action instances in the untrimmed videos with only video-level action labels. When humans watch videos, we can adapt our abstract-level knowledge about actions…

计算机视觉与模式识别 · 计算机科学 2023-12-27 Xijun Wang , Aggelos K. Katsaggelos

Locating specific moments within long videos (20-120 minutes) presents a significant challenge, akin to finding a needle in a haystack. Adapting existing short video (5-30 seconds) grounding methods to this problem yields poor performance.…

计算机视觉与模式识别 · 计算机科学 2024-07-16 Tanveer Hannan , Md Mohaiminul Islam , Thomas Seidl , Gedas Bertasius

We propose an efficient approach for activity detection in video that unifies activity categorization with space-time localization. The main idea is to pose activity detection as a maximum-weight connected subgraph problem. Offline, we…

计算机视觉与模式识别 · 计算机科学 2016-07-12 Chao-Yeh Chen , Kristen Grauman

We present a neural network TTNet aimed at real-time processing of high-resolution table tennis videos, providing both temporal (events spotting) and spatial (ball detection and semantic segmentation) data. This approach gives core…

计算机视觉与模式识别 · 计算机科学 2020-04-22 Roman Voeikov , Nikolay Falaleev , Ruslan Baikulov