English
Related papers

Related papers: Movie Description

200 papers

Descriptive video service (DVS) provides linguistic descriptions of movies and allows visually impaired people to follow a movie along with their peers. Such descriptions are by design mainly visual and thus naturally form an interesting…

Computer Vision and Pattern Recognition · Computer Science 2015-01-13 Anna Rohrbach , Marcus Rohrbach , Niket Tandon , Bernt Schiele

Audio Descriptions (ADs) aim to provide a narration of a movie in text form, describing non-dialogue-related narratives, such as characters, actions, or scene establishment. Automatic generation of ADs remains challenging due to: i) the…

Computer Vision and Pattern Recognition · Computer Science 2024-11-28 Bo Fang , Wenhao Wu , Qiangqiang Wu , Yuxin Song , Antoni B. Chan

Generating Audio Description (AD) for movies is a challenging task that requires fine-grained visual understanding and an awareness of the characters and their names. Currently, visual language models for AD generation are limited by a lack…

Computer Vision and Pattern Recognition · Computer Science 2024-04-23 Tengda Han , Max Bain , Arsha Nagrani , Gül Varol , Weidi Xie , Andrew Zisserman

Audio Description (AD) is the task of generating descriptions of visual content, at suitable time intervals, for the benefit of visually impaired audiences. For movies, this presents notable challenges -- AD must occur only during existing…

Computer Vision and Pattern Recognition · Computer Science 2023-10-11 Tengda Han , Max Bain , Arsha Nagrani , Gül Varol , Weidi Xie , Andrew Zisserman

The objective of this paper is an automatic Audio Description (AD) model that ingests movies and outputs AD in text form. Generating high-quality movie AD is challenging due to the dependency of the descriptions on context, and the limited…

Computer Vision and Pattern Recognition · Computer Science 2023-03-30 Tengda Han , Max Bain , Arsha Nagrani , Gül Varol , Weidi Xie , Andrew Zisserman

The Audio Description (AD) task aims to generate descriptions of visual elements for visually impaired individuals to help them access long-form video content, like movies. With video feature, text, character bank and context information as…

Computer Vision and Pattern Recognition · Computer Science 2025-04-16 Hanlin Wang , Zhan Tong , Kecheng Zheng , Yujun Shen , Limin Wang

Audio Descriptions (ADs) convey essential on-screen information, allowing visually impaired audiences to follow videos. To be effective, ADs must form a coherent sequence that helps listeners to visualise the unfolding scene, rather than…

Computer Vision and Pattern Recognition · Computer Science 2025-10-30 Eshika Khandelwal , Junyu Xie , Tengda Han , Max Bain , Arsha Nagrani , Andrew Zisserman , Gül Varol , Makarand Tapaswi

The recent and increasing interest in video-language research has driven the development of large-scale datasets that enable data-intensive machine learning techniques. In comparison, limited effort has been made at assessing the fitness of…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Mattia Soldan , Alejandro Pardo , Juan León Alcázar , Fabian Caba Heilbron , Chen Zhao , Silvio Giancola , Bernard Ghanem

Movie screenplay summarization is challenging, as it requires an understanding of long input contexts and various elements unique to movies. Large language models have shown significant advancements in document summarization, but they often…

Computation and Language · Computer Science 2024-08-13 Rohit Saxena , Frank Keller

In this work, we introduce a dataset of video annotated with high quality natural language phrases describing the visual content in a given segment of time. Our dataset is based on the Descriptive Video Service (DVS) that is now encoded on…

Computer Vision and Pattern Recognition · Computer Science 2015-03-04 Atousa Torabi , Christopher Pal , Hugo Larochelle , Aaron Courville

Audio descriptions (ADs) narrate important visual details in movies, enabling Blind and Low Vision (BLV) users to understand narratives and appreciate visual details. Existing works in automatic AD generation mostly focus on few-second…

Computer Vision and Pattern Recognition · Computer Science 2025-10-02 Divy Kala , Eshika Khandelwal , Makarand Tapaswi

Audio Descriptions (AD) are essential for making visual content accessible to individuals with visual impairments. Recent works have shown a promising step towards automating AD, but they have been limited to describing high-quality movie…

Multimedia · Computer Science 2025-11-13 Lipisha Chaudhary , Trisha Mittal , Subhadra Gopalakrishnan , Ifeoma Nwogu , Jaclyn Pytlarz

The development of Audio Description (AD) has been a pivotal step forward in making video content more accessible and inclusive. Traditionally, AD production has demanded a considerable amount of skilled labor, while existing automated…

Computer Vision and Pattern Recognition · Computer Science 2024-05-03 Peng Chu , Jiang Wang , Andre Abrantes

Audio descriptions (AD) make videos accessible for blind and low vision (BLV) users by describing visual elements that cannot be understood from the main audio track. AD created by professionals or novice describers is time-consuming and…

Human-Computer Interaction · Computer Science 2025-05-29 Maryam Cheema , Hasti Seifi , Pooyan Fazli

Audio Description is a narrated commentary designed to aid vision-impaired audiences in perceiving key visual elements in a video. While short-form video understanding has advanced rapidly, a solution for maintaining coherent long-term…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Adrienne Deganutti , Simon Hadfield , Andrew Gilbert

Audio descriptions (ADs) function as acoustic commentaries designed to assist blind persons and persons with visual impairments in accessing digital media content on television and in movies, among other settings. As an accessibility…

Computation and Language · Computer Science 2024-10-14 Yingqiang Gao , Lukas Fischer , Alexa Lintner , Sarah Ebling

Movie Audio Description (AD) aims to narrate visual content during dialogue-free segments, particularly benefiting blind and visually impaired (BVI) audiences. Compared with general video captioning, AD demands plot-relevant narration with…

Computer Vision and Pattern Recognition · Computer Science 2025-05-13 Xiaojun Ye , Chun Wang , Yiren Song , Sheng Zhou , Liangcheng Li , Jiajun Bu

Our objective is the automatic generation of Audio Descriptions (ADs) for edited video material, such as movies and TV series. To achieve this, we propose a two-stage framework that leverages "shots" as the fundamental units of video…

Computer Vision and Pattern Recognition · Computer Science 2025-09-16 Junyu Xie , Tengda Han , Max Bain , Arsha Nagrani , Eshika Khandelwal , Gül Varol , Weidi Xie , Andrew Zisserman

When people observe events, they are able to abstract key information and build concise summaries of what is happening. These summaries include contextual and semantic information describing the important high-level details (what, where,…

Computer Vision and Pattern Recognition · Computer Science 2021-05-11 Mathew Monfort , SouYoung Jin , Alexander Liu , David Harwath , Rogerio Feris , James Glass , Aude Oliva

Video description involves the generation of the natural language description of actions, events, and objects in the video. There are various applications of video description by filling the gap between languages and vision for visually…

Computer Vision and Pattern Recognition · Computer Science 2020-12-01 Alok Singh , Thoudam Doren Singh , Sivaji Bandyopadhyay
‹ Prev 1 2 3 10 Next ›