English
Related papers

Related papers: AVscript: Accessible Video Editing with Audio-Visu…

200 papers

Instruction-based video editing aims to modify an input video according to a natural-language instruction while preserving content fidelity and temporal coherence. However, existing diffusion-based approaches are often trained on paired…

Computer Vision and Pattern Recognition · Computer Science 2025-12-19 Xiaoyan Cong , Haotian Yang , Angtian Wang , Yizhi Wang , Yiding Yang , Canyu Zhang , Chongyang Ma

Motivated by the superior performance of image diffusion models, more and more researchers strive to extend these models to the text-based video editing task. Nevertheless, current video editing tasks mainly suffer from the dilemma between…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Yutao Chen , Xingning Dong , Tian Gan , Chunluan Zhou , Ming Yang , Qingpei Guo

Data visualizations are typically not accessible to blind and low-vision (BLV) users. Automatically generating text descriptions offers an enticing mechanism for democratizing access to the information held in complex scientific charts, yet…

Human-Computer Interaction · Computer Science 2025-03-25 Andrew McNutt , Maggie K McCracken , Ishrat Jahan Eliza , Daniel Hajas , Jake Wagoner , Nate Lanza , Jack Wilburn , Sarah Creem-Regehr , Alexander Lex

People watch livestreams to connect with others and learn about their hobbies. Livestreams feature multiple visual streams including the main video, webcams, on-screen overlays, and chat, all of which are inaccessible to livestream viewers…

Human-Computer Interaction · Computer Science 2023-10-12 Daniel Killough , Amy Pavel

Videos make exercise instruction widely available, but they rely on visual demonstrations that blind and low vision (BLV) learners cannot see. While audio descriptions (AD) can make videos accessible, describing movements remains…

Human-Computer Interaction · Computer Science 2026-03-02 Ujjaini Das , Shreya Kappala , Meng Chen , Mina Huh , Amy Pavel

Video-based learning (VBL) has become a dominant method for learning practical skills, yet accessibility guidelines provide limited guidance for users with cognitive differences. In particular, challenges that individuals with Borderline…

Human-Computer Interaction · Computer Science 2026-02-10 Hyehyun Chu , Seungju Kim , Chen Zhou , Yu-Kai Hung , Saelyne Yang , Hyun W. Ka , Juho Kim

Blind or Low-Vision (BLV) users often rely on audio descriptions (AD) to access video content. However, conventional static ADs can leave out detailed information in videos, impose a high mental load, neglect the diverse needs and…

Human-Computer Interaction · Computer Science 2024-02-28 Zheng Ning , Brianna L. Wimer , Kaiwen Jiang , Keyi Chen , Jerrick Ban , Yapeng Tian , Yuhang Zhao , Toby Jia-Jun Li

Despite great progress, text-driven long video editing is still notoriously challenging mainly due to excessive memory overhead. Although recent efforts have simplified this task into a two-step process of keyframe translation and…

Computer Vision and Pattern Recognition · Computer Science 2025-02-11 Shuheng Zhang , Yuqi Liu , Hongbo Zhou , Jun Peng , Yiyi Zhou , Xiaoshuai Sun , Rongrong Ji

The advent of stereoscopic videos has opened new horizons in multimedia, particularly in extended reality (XR) and virtual reality (VR) applications, where immersive content captivates audiences across various platforms. Despite its growing…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Qiao Jin , Xiaodong Chen , Wu Liu , Tao Mei , Yongdong Zhang

360{\deg} videos enable users to freely choose their viewing paths, but blind and low vision (BLV) users are often excluded from this interactive experience. To bridge this gap, we present Branch Explorer, a system that transforms 360{\deg}…

Human-Computer Interaction · Computer Science 2025-07-15 Shuchang Xu , Xiaofu Jin , Wenshuo Zhang , Huamin Qu , Yukang Yan

Automated tools for video editing and assembly have applications ranging from filmmaking and advertisement to content creation for social media. Previous video editing work has mainly focused on either retrieval or user interfaces, leaving…

Computer Vision and Pattern Recognition · Computer Science 2025-09-16 Marcelo Sandoval-Castaneda , Bryan Russell , Josef Sivic , Gregory Shakhnarovich , Fabian Caba Heilbron

The task of describing video content in natural language is commonly referred to as video captioning. Unlike conventional video captions, which are typically brief and widely available, long-form paragraph descriptions in natural language…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Mihai Masala , Marius Leordeanu

Building 3-D models is challenging for blind and low-vision (BLV) users due to the inherent complexity of 3-D models and the lack of support for non-visual interaction in existing tools. To address this issue, we introduce A11yShape, a…

Diffusion models have revolutionized text-driven video editing. However, applying these methods to real-world editing encounters two significant challenges: (1) the rapid increase in GPU memory demand as the number of frames grows, and (2)…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Shuzhou Yang , Chong Mou , Jiwen Yu , Yuhan Wang , Xiandong Meng , Jian Zhang

Background and Motivation: In recent years, the topic of applying videos in requirements engineering has been discussed and its contributions are of interesting potential. In the last 35 years, several researchers proposed approaches for…

Software Engineering · Computer Science 2021-03-01 Oliver Karras , Kurt Schneider

Blind and visually impaired (BVI) computer science students face systematic barriers when learning data structures: current accessibility approaches typically translate diagrams into alternative text, focusing on visual appearance rather…

Human-Computer Interaction · Computer Science 2026-01-28 Brianna L. Wimer , Ritesh Kanchi , Kaija Frierson , Venkatesh Potluri , Ronald Metoyer , Jennifer Mankoff , Miya Natsuhara , Matt X. Wang

Video colour editing is a crucial task for content creation, yet existing solutions either require painstaking frame-by-frame manipulation or produce unrealistic results with temporal artefacts. We present a practical, training-free…

Computer Vision and Pattern Recognition · Computer Science 2024-12-09 Chaitat Utintu , Pinaki Nath Chowdhury , Aneeshan Sain , Subhadeep Koley , Ayan Kumar Bhunia , Yi-Zhe Song

Despite the remarkable progress in text-driven video editing, generating coherent non-rigid deformations remains a critical challenge, often plagued by physical distortion and temporal flicker. To bridge this gap, we propose NRVBench, the…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Bingzheng Qu , Kehai Chen , Xuefeng Bai , Jun Yu , Min Zhang

In this paper, we introduce zero-shot audio-video editing, a novel task that requires transforming original audio-visual content to align with a specified textual prompt without additional model training. To evaluate this task, we curate a…

Computer Vision and Pattern Recognition · Computer Science 2025-03-27 Yan-Bo Lin , Kevin Lin , Zhengyuan Yang , Linjie Li , Jianfeng Wang , Chung-Ching Lin , Xiaofei Wang , Gedas Bertasius , Lijuan Wang

High-fidelity surgical video generation can greatly improve medical training and the development of AI, adapting these generative models for precise video editing remains a formidable challenge. Modifying surgical attributes, such as…

Computer Vision and Pattern Recognition · Computer Science 2026-05-11 Ritul Jangir , Arkya Jyoti Bagchi , Aiman Farooq , Mangalton Okram , Saurabh Seetaram Korgaonkar , Deepak Mishra