English
Related papers

Related papers: ADx3: A Collaborative Workflow for High-Quality Ac…

200 papers

Audio Description (AD) provides essential access to visual media for blind and low vision (BLV) audiences. Yet current AD production tools remain largely inaccessible to BLV video creators, who possess valuable expertise but face barriers…

Human-Computer Interaction · Computer Science 2026-02-10 Franklin Mingzhe Li , Michael Xieyang Liu , Cynthia L. Bennett , Shaun K. Kane

Audio descriptions (AD) make videos accessible for blind and low vision (BLV) users by describing visual elements that cannot be understood from the main audio track. AD created by professionals or novice describers is time-consuming and…

Human-Computer Interaction · Computer Science 2025-05-29 Maryam Cheema , Hasti Seifi , Pooyan Fazli

Audio description (AD) narrates visual elements in video for blind and low-vision audiences. Recent work has shown that giving novice describers an AI-generated draft to start from helps produce higher-quality AD and lowers the barrier to…

Human-Computer Interaction · Computer Science 2026-05-08 Lana Do , Shasta Ihorn , Charity M. Pitcher-Cooper , Sanjay Mirani , Gio Jung , Hyunjoo Shim , Zhenzhen Qin , Kien T. Nguyen , Vassilis Athitsos , Ilmi Yoon

Audio descriptions (ADs) function as acoustic commentaries designed to assist blind persons and persons with visual impairments in accessing digital media content on television and in movies, among other settings. As an accessibility…

Computation and Language · Computer Science 2024-10-14 Yingqiang Gao , Lukas Fischer , Alexa Lintner , Sarah Ebling

Audio description (AD) makes video content accessible to millions of blind and low vision (BLV) users. However, creating high-quality AD involves a trade-off between the precision of human-crafted descriptions and the efficiency of…

Human-Computer Interaction · Computer Science 2025-08-05 Maryam Cheema , Sina Elahimanesh , Samuel Martin , Pooyan Fazli , Hasti Seifi

The development of Audio Description (AD) has been a pivotal step forward in making video content more accessible and inclusive. Traditionally, AD production has demanded a considerable amount of skilled labor, while existing automated…

Computer Vision and Pattern Recognition · Computer Science 2024-05-03 Peng Chu , Jiang Wang , Andre Abrantes

Digital video is central to communication, education, and entertainment, but without audio description (AD), blind and low-vision users are excluded. While crowdsourced platforms and vision-language models (VLMs) expand AD production,…

Human-Computer Interaction · Computer Science 2026-05-08 Lana Do , Gio Jung , Juvenal Francisco Barajas , Andrew Taylor Scott , Shasta Ihorn , Alexander Mario Blum , Vassilis Athitsos , Ilmi Yoon

Generating Audio Description (AD) for movies is a challenging task that requires fine-grained visual understanding and an awareness of the characters and their names. Currently, visual language models for AD generation are limited by a lack…

Computer Vision and Pattern Recognition · Computer Science 2024-04-23 Tengda Han , Max Bain , Arsha Nagrani , Gül Varol , Weidi Xie , Andrew Zisserman

Audio descriptions (ADs) narrate important visual details in movies, enabling Blind and Low Vision (BLV) users to understand narratives and appreciate visual details. Existing works in automatic AD generation mostly focus on few-second…

Computer Vision and Pattern Recognition · Computer Science 2025-10-02 Divy Kala , Eshika Khandelwal , Makarand Tapaswi

Blind and low-vision (BLV) people use audio descriptions (ADs) to access videos. However, current ADs are unalterable by end users, thus are incapable of supporting BLV individuals' potentially diverse needs and preferences. This research…

Human-Computer Interaction · Computer Science 2024-08-22 Rosiana Natalie , Ruei-Che Chang , Smitha Sheshadri , Anhong Guo , Kotaro Hara

Audio Description (AD) plays a pivotal role as an application system aimed at guaranteeing accessibility in multimedia content, which provides additional narrations at suitable intervals to describe visual elements, catering specifically to…

Computer Vision and Pattern Recognition · Computer Science 2024-12-16 Seon-Ho Lee , Jue Wang , David Fan , Zhikang Zhang , Linda Liu , Xiang Hao , Vimal Bhat , Xinyu Li

The Audio Description (AD) task aims to generate descriptions of visual elements for visually impaired individuals to help them access long-form video content, like movies. With video feature, text, character bank and context information as…

Computer Vision and Pattern Recognition · Computer Science 2025-04-16 Hanlin Wang , Zhan Tong , Kecheng Zheng , Yujun Shen , Limin Wang

Advances in multimodal large language models enable automatic video narration and question answering (VQA), offering scalable alternatives to labor-intensive, human-authored audio descriptions (ADs) for blind and low vision (BLV) viewers.…

Human-Computer Interaction · Computer Science 2026-03-17 Maryam Cheema , Sina Elahimanesh , Pooyan Fazli , Hasti Seifi

While audio description (AD) is the standard approach for making videos accessible to blind and low vision (BLV) people, existing AD guidelines do not consider BLV users' varied preferences across viewing scenarios. These scenarios range…

Human-Computer Interaction · Computer Science 2024-03-19 Lucy Jiang , Crescentia Jung , Mahika Phutane , Abigale Stangl , Shiri Azenkot

Audio Descriptions (ADs) aim to provide a narration of a movie in text form, describing non-dialogue-related narratives, such as characters, actions, or scene establishment. Automatic generation of ADs remains challenging due to: i) the…

Computer Vision and Pattern Recognition · Computer Science 2024-11-28 Bo Fang , Wenhao Wu , Qiangqiang Wu , Yuxin Song , Antoni B. Chan

Our objective is to generate Audio Descriptions (ADs) for both movies and TV series in a training-free manner. We use the power of off-the-shelf Visual-Language Models (VLMs) and Large Language Models (LLMs), and develop visual and text…

Computer Vision and Pattern Recognition · Computer Science 2024-11-25 Junyu Xie , Tengda Han , Max Bain , Arsha Nagrani , Gül Varol , Weidi Xie , Andrew Zisserman

Video descriptions are crucial for blind and low vision (BLV) users to access visual content. However, current artificial intelligence models for generating descriptions often fall short due to limitations in the quality of human…

Computer Vision and Pattern Recognition · Computer Science 2025-03-03 Chaoyu Li , Sid Padmanabhuni , Maryam Cheema , Hasti Seifi , Pooyan Fazli

The objective of this paper is an automatic Audio Description (AD) model that ingests movies and outputs AD in text form. Generating high-quality movie AD is challenging due to the dependency of the descriptions on context, and the limited…

Computer Vision and Pattern Recognition · Computer Science 2023-03-30 Tengda Han , Max Bain , Arsha Nagrani , Gül Varol , Weidi Xie , Andrew Zisserman

Audio Descriptions (ADs) convey essential on-screen information, allowing visually impaired audiences to follow videos. To be effective, ADs must form a coherent sequence that helps listeners to visualise the unfolding scene, rather than…

Computer Vision and Pattern Recognition · Computer Science 2025-10-30 Eshika Khandelwal , Junyu Xie , Tengda Han , Max Bain , Arsha Nagrani , Andrew Zisserman , Gül Varol , Makarand Tapaswi

Audio Description (AD) is the task of generating descriptions of visual content, at suitable time intervals, for the benefit of visually impaired audiences. For movies, this presents notable challenges -- AD must occur only during existing…

Computer Vision and Pattern Recognition · Computer Science 2023-10-11 Tengda Han , Max Bain , Arsha Nagrani , Gül Varol , Weidi Xie , Andrew Zisserman
‹ Prev 1 2 3 10 Next ›