English
Related papers

Related papers: Video Captioning in Compressed Video

200 papers

Dense video captioning aims to localize and describe important events in untrimmed videos. Existing methods mainly tackle this task by exploiting only visual features, while completely neglecting the audio track. Only a few prior works have…

Computer Vision and Pattern Recognition · Computer Science 2020-08-12 Vladimir Iashin , Esa Rahtu

Video captioning aims to describe video contents using natural language format that involves understanding and interpreting scenes, actions and events that occurs simultaneously on the view. Current approaches have mainly concentrated on…

Computer Vision and Pattern Recognition · Computer Science 2024-11-12 Antoine Hanna-Asaad , Decky Aspandi , Titus Zaharia

Video Captioning is considered to be one of the most challenging problems in the field of computer vision. Video Captioning involves the combination of different deep learning models to perform object detection, action detection, and…

Computer Vision and Pattern Recognition · Computer Science 2021-04-08 Soheyla Amirian , Abolfazl Farahani , Hamid R. Arabnia , Khaled Rasheed , Thiab R. Taha

Dense video captioning is an extremely challenging task since accurate and coherent description of events in a video requires holistic understanding of video contents as well as contextual reasoning of individual events. Most existing…

Computer Vision and Pattern Recognition · Computer Science 2019-04-09 Jonghwan Mun , Linjie Yang , Zhou Ren , Ning Xu , Bohyung Han

Automatically describing a video with natural language is regarded as a fundamental challenge in computer vision. The problem nevertheless is not trivial especially when a video contains multiple events to be worthy of mention, which often…

Computer Vision and Pattern Recognition · Computer Science 2018-04-24 Yehao Li , Ting Yao , Yingwei Pan , Hongyang Chao , Tao Mei

In recent years, the task of video prediction-forecasting future video given past video frames-has attracted attention in the research community. In this paper we propose a novel approach to this problem with Vector Quantized Variational…

Computer Vision and Pattern Recognition · Computer Science 2021-03-03 Jacob Walker , Ali Razavi , Aäron van den Oord

Generic event boundary detection aims to localize the generic, taxonomy-free event boundaries that segment videos into chunks. Existing methods typically require video frames to be decoded before feeding into the network, which contains…

Computer Vision and Pattern Recognition · Computer Science 2023-09-28 Libo Zhang , Xin Gu , Congcong Li , Tiejian Luo , Heng Fan

The task of video captioning, that is, the automatic generation of sentences describing a sequence of actions in a video, has attracted an increasing attention recently. The complex and high-dimensional representation of video data makes it…

Computer Vision and Pattern Recognition · Computer Science 2020-10-13 Menatallh Hammad , May Hammad , Mohamed Elshenawy

Video segmentation consists of a frame-by-frame selection process of meaningful areas related to foreground moving objects. Some applications include traffic monitoring, human tracking, action recognition, efficient video surveillance, and…

Computer Vision and Pattern Recognition · Computer Science 2022-12-22 Daniel F. S. Santos , Rafael G. Pires , Danilo Colombo , João P. Papa

Recent advances in vision-language models have led to impressive progress in caption generation for images and short video clips. However, these models remain constrained by their limited temporal receptive fields, making it difficult to…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Sanghyeok Chu , Seonguk Seo , Bohyung Han

Online processing of compressed videos to increase their resolutions attracts increasing and broad attention. Video Super-Resolution (VSR) using recurrent neural network architecture is a promising solution due to its efficient modeling of…

Computer Vision and Pattern Recognition · Computer Science 2022-10-18 Hengsheng Zhang , Xueyi Zou , Jiaming Guo , Youliang Yan , Rong Xie , Li Song

Video compression aims to reconstruct seamless frames by encoding the motion and residual information from existing frames. Previous neural video compression methods necessitate distinct codecs for three types of frames (I-frame, P-frame…

Image and Video Processing · Electrical Eng. & Systems 2024-06-04 Meiqin Liu , Chenming Xu , Yukai Gu , Chao Yao , Yao Zhao

Accelerated by the tremendous increase in Internet bandwidth and storage space, video data has been generated, published and spread explosively, becoming an indispensable part of today's big data. In this paper, we focus on reviewing two…

Computer Vision and Pattern Recognition · Computer Science 2018-02-23 Zuxuan Wu , Ting Yao , Yanwei Fu , Yu-Gang Jiang

In the video coding process, the perceived quality of a compressed video is evaluated by full-reference quality evaluation metrics. However, it is difficult to obtain reference videos with perfect quality. To solve this problem, it is…

Image and Video Processing · Electrical Eng. & Systems 2022-05-10 Liqun Lin , Zheng Wang , Jiachen He , Weiling Chen , Yiwen Xu , Tiesong Zhao

Dense video captioning aims to temporally localize events in video and generate captions for each event. While recent works propose end-to-end models, they suffer from two limitations: (1) applying timestamp supervision only to text while…

Computer Vision and Pattern Recognition · Computer Science 2025-09-08 MinJu Jeon , Si-Woo Kim , Ye-Chan Kim , HyunGee Kim , Dong-Jin Kim

Classical motion-compensated video coding methods have been standardized by MPEG over the years and video codecs have become integral parts of media entertainment applications. Despite the ubiquitous use of video coding techniques, it is…

Information Theory · Computer Science 2014-02-28 Kamesh Namuduri , Gayatri Mehta

Video retrieval is a challenging research topic bridging the vision and language areas and has attracted broad attention in recent years. Previous works have been devoted to representing videos by directly encoding from frame-level…

Computer Vision and Pattern Recognition · Computer Science 2020-06-17 Zerun Feng , Zhimin Zeng , Caili Guo , Zheng Li

Video captioning is an essential technology to understand scenes and describe events in natural language. To apply it to real-time monitoring, a system needs not only to describe events accurately but also to produce the captions as soon as…

Computer Vision and Pattern Recognition · Computer Science 2021-08-05 Chiori Hori , Takaaki Hori , Jonathan Le Roux

Action recognition in videos has attracted a lot of attention in the past decade. In order to learn robust models, previous methods usually assume videos are trimmed as short sequences and require ground-truth annotations of each video…

Computer Vision and Pattern Recognition · Computer Science 2019-02-21 Xiao-Yu Zhang , Haichao Shi , Changsheng Li , Kai Zheng , Xiaobin Zhu , Lixin Duan

Feature coding has been recently considered to facilitate intelligent video analysis for urban computing. Instead of raw videos, extracted features in the front-end are encoded and transmitted to the back-end for further processing. In this…

Multimedia · Computer Science 2020-09-11 Weiyao Lin , Xiaoyi He , Wenrui Dai , John See , Tushar Shinde , Hongkai Xiong , Lingyu Duan