English
Related papers

Related papers: More than a Moment: Towards Coherent Sequences of …

200 papers

Audio Descriptions (ADs) aim to provide a narration of a movie in text form, describing non-dialogue-related narratives, such as characters, actions, or scene establishment. Automatic generation of ADs remains challenging due to: i) the…

Computer Vision and Pattern Recognition · Computer Science 2024-11-28 Bo Fang , Wenhao Wu , Qiangqiang Wu , Yuxin Song , Antoni B. Chan

The Audio Description (AD) task aims to generate descriptions of visual elements for visually impaired individuals to help them access long-form video content, like movies. With video feature, text, character bank and context information as…

Computer Vision and Pattern Recognition · Computer Science 2025-04-16 Hanlin Wang , Zhan Tong , Kecheng Zheng , Yujun Shen , Limin Wang

Audio Description (AD) is the task of generating descriptions of visual content, at suitable time intervals, for the benefit of visually impaired audiences. For movies, this presents notable challenges -- AD must occur only during existing…

Computer Vision and Pattern Recognition · Computer Science 2023-10-11 Tengda Han , Max Bain , Arsha Nagrani , Gül Varol , Weidi Xie , Andrew Zisserman

Generating Audio Description (AD) for movies is a challenging task that requires fine-grained visual understanding and an awareness of the characters and their names. Currently, visual language models for AD generation are limited by a lack…

Computer Vision and Pattern Recognition · Computer Science 2024-04-23 Tengda Han , Max Bain , Arsha Nagrani , Gül Varol , Weidi Xie , Andrew Zisserman

Audio Descriptions (AD) are essential for making visual content accessible to individuals with visual impairments. Recent works have shown a promising step towards automating AD, but they have been limited to describing high-quality movie…

Multimedia · Computer Science 2025-11-13 Lipisha Chaudhary , Trisha Mittal , Subhadra Gopalakrishnan , Ifeoma Nwogu , Jaclyn Pytlarz

Audio Description (AD) plays a pivotal role as an application system aimed at guaranteeing accessibility in multimedia content, which provides additional narrations at suitable intervals to describe visual elements, catering specifically to…

Computer Vision and Pattern Recognition · Computer Science 2024-12-16 Seon-Ho Lee , Jue Wang , David Fan , Zhikang Zhang , Linda Liu , Xiang Hao , Vimal Bhat , Xinyu Li

The objective of this paper is an automatic Audio Description (AD) model that ingests movies and outputs AD in text form. Generating high-quality movie AD is challenging due to the dependency of the descriptions on context, and the limited…

Computer Vision and Pattern Recognition · Computer Science 2023-03-30 Tengda Han , Max Bain , Arsha Nagrani , Gül Varol , Weidi Xie , Andrew Zisserman

Our objective is the automatic generation of Audio Descriptions (ADs) for edited video material, such as movies and TV series. To achieve this, we propose a two-stage framework that leverages "shots" as the fundamental units of video…

Computer Vision and Pattern Recognition · Computer Science 2025-09-16 Junyu Xie , Tengda Han , Max Bain , Arsha Nagrani , Eshika Khandelwal , Gül Varol , Weidi Xie , Andrew Zisserman

Audio descriptions (ADs) narrate important visual details in movies, enabling Blind and Low Vision (BLV) users to understand narratives and appreciate visual details. Existing works in automatic AD generation mostly focus on few-second…

Computer Vision and Pattern Recognition · Computer Science 2025-10-02 Divy Kala , Eshika Khandelwal , Makarand Tapaswi

Audio Description (AD) provides linguistic descriptions of movies and allows visually impaired people to follow a movie along with their peers. Such descriptions are by design mainly visual and thus naturally form an interesting data source…

Computer Vision and Pattern Recognition · Computer Science 2016-05-13 Anna Rohrbach , Atousa Torabi , Marcus Rohrbach , Niket Tandon , Christopher Pal , Hugo Larochelle , Aaron Courville , Bernt Schiele

Audio Description is a narrated commentary designed to aid vision-impaired audiences in perceiving key visual elements in a video. While short-form video understanding has advanced rapidly, a solution for maintaining coherent long-term…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Adrienne Deganutti , Simon Hadfield , Andrew Gilbert

Humans can easily describe what they see in a coherent way and at varying level of detail. However, existing approaches for automatic video description are mainly focused on single sentence generation and produce descriptions at a fixed…

Computer Vision and Pattern Recognition · Computer Science 2016-09-26 Anna Senina , Marcus Rohrbach , Wei Qiu , Annemarie Friedrich , Sikandar Amin , Mykhaylo Andriluka , Manfred Pinkal , Bernt Schiele

The development of Audio Description (AD) has been a pivotal step forward in making video content more accessible and inclusive. Traditionally, AD production has demanded a considerable amount of skilled labor, while existing automated…

Computer Vision and Pattern Recognition · Computer Science 2024-05-03 Peng Chu , Jiang Wang , Andre Abrantes

Maintaining narrative coherence and visual consistency remains a central challenge in open-domain video generation. Existing text-to-video models often treat each shot independently, resulting in identity drift, scene inconsistency, and…

Computer Vision and Pattern Recognition · Computer Science 2025-12-30 Qinglin Zeng , Kaitong Cai , Ruiqi Chen , Qinhan Lv , Keze Wang

Audio description (AD) makes video content accessible to blind and low-vision (BLV) audiences, but producing high-quality descriptions is resource-intensive. Automated AD offers scalability, and prior studies show human-in-the-loop editing…

Human-Computer Interaction · Computer Science 2026-02-04 Lana Do , Shasta Ihorn , Charity Pitcher-Cooper , Juvenal Francisco Barajas , Gio Jung , Xuan Duy Anh Nguyen , Sanjay Mirani , Ilmi Yoon

Movie Audio Description (AD) aims to narrate visual content during dialogue-free segments, particularly benefiting blind and visually impaired (BVI) audiences. Compared with general video captioning, AD demands plot-relevant narration with…

Computer Vision and Pattern Recognition · Computer Science 2025-05-13 Xiaojun Ye , Chun Wang , Yiren Song , Sheng Zhou , Liangcheng Li , Jiajun Bu

We present an efficient framework that can generate a coherent paragraph to describe a given video. Previous works on video captioning usually focus on video clips. They typically treat an entire video as a whole and generate the caption…

Computer Vision and Pattern Recognition · Computer Science 2018-07-27 Yilei Xiong , Bo Dai , Dahua Lin

Audio descriptions (AD) make videos accessible for blind and low vision (BLV) users by describing visual elements that cannot be understood from the main audio track. AD created by professionals or novice describers is time-consuming and…

Human-Computer Interaction · Computer Science 2025-05-29 Maryam Cheema , Hasti Seifi , Pooyan Fazli

Audio description (AD) narrates visual elements in video for blind and low-vision audiences. Recent work has shown that giving novice describers an AI-generated draft to start from helps produce higher-quality AD and lowers the barrier to…

Human-Computer Interaction · Computer Science 2026-05-08 Lana Do , Shasta Ihorn , Charity M. Pitcher-Cooper , Sanjay Mirani , Gio Jung , Hyunjoo Shim , Zhenzhen Qin , Kien T. Nguyen , Vassilis Athitsos , Ilmi Yoon

Audio descriptions (ADs) function as acoustic commentaries designed to assist blind persons and persons with visual impairments in accessing digital media content on television and in movies, among other settings. As an accessibility…

Computation and Language · Computer Science 2024-10-14 Yingqiang Gao , Lukas Fischer , Alexa Lintner , Sarah Ebling
‹ Prev 1 2 3 10 Next ›