English
Related papers

Related papers: Jointly Localizing and Describing Events for Dense…

200 papers

Dense video captioning is an extremely challenging task since accurate and coherent description of events in a video requires holistic understanding of video contents as well as contextual reasoning of individual events. Most existing…

Computer Vision and Pattern Recognition · Computer Science 2019-04-09 Jonghwan Mun , Linjie Yang , Zhou Ren , Ning Xu , Bohyung Han

Dense video captioning is a task of localizing interesting events from an untrimmed video and producing textual description (captions) for each localized event. Most of the previous works in dense video captioning are solely based on visual…

Computer Vision and Pattern Recognition · Computer Science 2020-05-07 Vladimir Iashin , Esa Rahtu

Dense event captioning aims to detect and describe all events of interest contained in a video. Despite the advanced development in this area, existing methods tackle this task by making use of dense temporal annotations, which is…

Computer Vision and Pattern Recognition · Computer Science 2018-12-11 Xuguang Duan , Wenbing Huang , Chuang Gan , Jingdong Wang , Wenwu Zhu , Junzhou Huang

Most natural videos contain numerous events. For example, in a video of a "man playing a piano", the video might also contain "another man dancing" or "a crowd clapping". We introduce the task of dense-captioning events, which involves both…

Computer Vision and Pattern Recognition · Computer Science 2017-05-03 Ranjay Krishna , Kenji Hata , Frederic Ren , Li Fei-Fei , Juan Carlos Niebles

Dense video captioning is a newly emerging task that aims at both localizing and describing all events in a video. We identify and tackle two challenges on this task, namely, (1) how to utilize both past and future contexts for accurate…

Computer Vision and Pattern Recognition · Computer Science 2018-04-04 Jingwen Wang , Wenhao Jiang , Lin Ma , Wei Liu , Yong Xu

We propose a new task and model for dense video object captioning -- detecting, tracking and captioning trajectories of objects in a video. This task unifies spatial and temporal localization in video, whilst also requiring fine-grained…

Computer Vision and Pattern Recognition · Computer Science 2024-10-16 Xingyi Zhou , Anurag Arnab , Chen Sun , Cordelia Schmid

There has been significant attention to the research on dense video captioning, which aims to automatically localize and caption all events within untrimmed video. Several studies introduce methods by designing dense video captioning as a…

Computer Vision and Pattern Recognition · Computer Science 2024-04-12 Minkuk Kim , Hyeon Bae Kim , Jinyoung Moon , Jinwoo Choi , Seong Tae Kim

Dense video captioning is a fine-grained video understanding task that involves two sub-problems: localizing distinct events in a long video stream, and generating captions for the localized events. We propose the Joint Event Detection and…

Computer Vision and Pattern Recognition · Computer Science 2018-12-27 Huijuan Xu , Boyang Li , Vasili Ramanishka , Leonid Sigal , Kate Saenko

Dense captioning is a newly emerging computer vision topic for understanding images with dense language descriptions. The goal is to densely detect visual concepts (e.g., objects, object parts, and interactions between them) from images,…

Computer Vision and Pattern Recognition · Computer Science 2017-08-09 Linjie Yang , Kevin Tang , Jianchao Yang , Li-Jia Li

Detecting meaningful events in an untrimmed video is essential for dense video captioning. In this work, we propose a novel and simple model for event sequence generation and explore temporal relationships of the event sequence in the…

Computer Vision and Pattern Recognition · Computer Science 2020-06-16 Yuqing Song , Shizhe Chen , Yida Zhao , Qin Jin

Dense video captioning aims to detect and describe all events in untrimmed videos. This paper presents a dense video captioning network called Multi-Concept Cyclic Learning (MCCL), which aims to: (1) detect multiple concepts at the frame…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Zhuyang Xie , Yan Yang , Yankai Yu , Jie Wang , Yongquan Jiang , Xiao Wu

An ideal model for dense video captioning -- predicting captions localized temporally in a video -- should be able to handle long input videos, predict rich, detailed textual descriptions, and be able to produce outputs before processing…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Xingyi Zhou , Anurag Arnab , Shyamal Buch , Shen Yan , Austin Myers , Xuehan Xiong , Arsha Nagrani , Cordelia Schmid

This notebook paper presents our system in the ActivityNet Dense Captioning in Video task (task 3). Temporal proposal generation and caption generation are both important to the dense captioning task. Therefore, we propose a proposal…

Computer Vision and Pattern Recognition · Computer Science 2018-06-26 Shizhe Chen , Yuqing Song , Yida Zhao , Jiarong Qiu , Qin Jin , Alexander Hauptmann

Untrimmed videos have interrelated events, dependencies, context, overlapping events, object-object interactions, domain specificity, and other semantics that are worth highlighting while describing a video in natural language. Owing to…

Computer Vision and Pattern Recognition · Computer Science 2023-11-07 Iqra Qasim , Alexander Horsch , Dilip K. Prasad

Dense video captioning aims to generate corresponding text descriptions for a series of events in the untrimmed video, which can be divided into two sub-tasks, event detection and event captioning. Unlike previous works that tackle the two…

Computer Vision and Pattern Recognition · Computer Science 2023-07-24 Qi Zhang , Yuqing Song , Qin Jin

In this work, we propose a division-and-summarization (DaS) framework for dense video captioning. After partitioning each untrimmed long video as multiple event proposals, where each event proposal consists of a set of short video segments,…

Computer Vision and Pattern Recognition · Computer Science 2025-06-26 Zhiwang Zhang , Dong Xu , Wanli Ouyang , Chuanqi Tan

Dense video captioning, a task of localizing meaningful moments and generating relevant captions for videos, often requires a large, expensive corpus of annotated video segments paired with text. In an effort to minimize the annotation…

Computer Vision and Pattern Recognition · Computer Science 2023-07-13 Yongrae Jo , Seongyun Lee , Aiden SJ Lee , Hyunji Lee , Hanseok Oh , Minjoon Seo

This technical report presents a brief description of our submission to the dense video captioning task of ActivityNet Challenge 2020. Our approach follows a two-stage pipeline: first, we extract a set of temporal event proposals; then we…

Computer Vision and Pattern Recognition · Computer Science 2020-08-13 Teng Wang , Huicheng Zheng , Mingjing Yu

Contextual reasoning is essential to understand events in long untrimmed videos. In this work, we systematically explore different captioning models with various contexts for the dense-captioning events in video task, which aims to generate…

Computer Vision and Pattern Recognition · Computer Science 2019-07-12 Shizhe Chen , Yuqing Song , Yida Zhao , Qin Jin , Zhaoyang Zeng , Bei Liu , Jianlong Fu , Alexander Hauptmann

Dense video captioning aims to generate text descriptions for all events in an untrimmed video. This involves both detecting and describing events. Therefore, all previous methods on dense video captioning tackle this problem by building…

Computer Vision and Pattern Recognition · Computer Science 2018-04-04 Luowei Zhou , Yingbo Zhou , Jason J. Corso , Richard Socher , Caiming Xiong
‹ Prev 1 2 3 10 Next ›