English
Related papers

Related papers: AVscript: Accessible Video Editing with Audio-Visu…

200 papers

The exponential growth of short-video content has ignited a surge in the necessity for efficient, automated solutions to video editing, with challenges arising from the need to understand videos and tailor the editing according to user…

Computer Vision and Pattern Recognition · Computer Science 2025-01-13 Dabing Cheng , Haosen Zhan , Xingchen Zhao , Guisheng Liu , Zemin Li , Jinghui Xie , Zhao Song , Weiguo Feng , Bingyue Peng

Video creation has become increasingly popular, yet the expertise and effort required for editing often pose barriers to beginners. In this paper, we explore the integration of large language models (LLMs) into the video editing workflow to…

Human-Computer Interaction · Computer Science 2024-02-29 Bryan Wang , Yuliang Li , Zhaoyang Lv , Haijun Xia , Yan Xu , Raj Sodhi

Video editing tools are widely used nowadays for digital design. Although the demand for these tools is high, the prior knowledge required makes it difficult for novices to get started. Systems that could follow natural language…

Computer Vision and Pattern Recognition · Computer Science 2022-03-22 Tsu-Jui Fu , Xin Eric Wang , Scott T. Grafton , Miguel P. Eckstein , William Yang Wang

Visual dubbing, the synchronization of facial movements with new speech, is crucial for making content accessible across different languages, enabling broader global reach. However, current methods face significant limitations. Existing…

Computer Vision and Pattern Recognition · Computer Science 2025-05-30 Binyamin Manela , Sharon Gannot , Ethan Fetyaya

The rapid advancement of large language models (LLMs) and multimodal learning has transformed digital content creation and manipulation. Traditional visual editing tools require significant expertise, limiting accessibility. Recent strides…

Computer Vision and Pattern Recognition · Computer Science 2024-11-22 Thanh Tam Nguyen , Zhao Ren , Trinh Pham , Thanh Trung Huynh , Phi Le Nguyen , Hongzhi Yin , Quoc Viet Hung Nguyen

In the dynamic field of digital content creation using generative models, state-of-the-art video editing models still do not offer the level of quality and control that users desire. Previous works on video editing either extended from…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Max Ku , Cong Wei , Weiming Ren , Harry Yang , Wenhu Chen

Music has been identified as a promising medium to enhance the accessibility and experience of visual art for people who are blind or have low vision (BLV). However, composing music and designing soundscapes for visual art is a…

Human-Computer Interaction · Computer Science 2024-05-24 Stephen James Krol , Maria Teresa Llano , Matthew Butler , Cagatay Goncu

Our work aims to develop new assistive technologies that enable blind or low vision (BLV) people to explore and analyze data readily. At present, barriers exist for BLV people to explore and analyze data, restricting access to government,…

Human-Computer Interaction · Computer Science 2025-07-01 Samuel Reinders , Munazza Zaib , Matthew Butler , Bongshin Lee , Ingrid Zukerman , Lizhen Qu , Kim Marriott

Comic strips are a popular and expressive form of visual storytelling that can convey humor, emotion, and information. However, they are inaccessible to the BLV (Blind or Low Vision) community, who cannot perceive the images, layouts, and…

Computer Vision and Pattern Recognition · Computer Science 2023-10-03 Reshma Ramaprasad

In the digital landscape, the ubiquity of data visualizations in media underscores the necessity for accessibility to ensure inclusivity for all users, including those with visual impairments. Current visual content often fails to cater to…

Human-Computer Interaction · Computer Science 2024-09-27 Qiang Xu , Thomas Hurtut

We propose MLV-Edit, a training-free, flow-based framework that address the unique challenges of minute-level video editing. While existing techniques excel in short-form video manipulation, scaling them to long-duration videos remains…

Computer Vision and Pattern Recognition · Computer Science 2026-03-04 Yangyi Cao , Yuanhang Li , Lan Chen , Qi Mao

Video accessibility is crucial for blind and low vision users for equitable engagements in education, employment, and entertainment. Despite the availability of professional and amateur services and tools, most human-generated descriptions…

Human-Computer Interaction · Computer Science 2022-01-12 Shasta Ihorn , Yue-Ting Siu , Aditya Bodi , Lothar Narins , Jose M. Castanon , Yash Kant , Abhishek Das , Ilmi Yoon , Pooyan Fazli

Customization is crucial for making visualizations accessible to blind and low-vision (BLV) people with widely-varying needs. But what makes for usable or useful customization? We identify four design goals for how BLV people should be able…

Human-Computer Interaction · Computer Science 2024-03-01 Shuli Jones , Isabella Pedraza Pineros , Daniel Hajas , Jonathan Zong , Arvind Satyanarayan

Among numerous videos shared on the web, well-edited ones always attract more attention. However, it is difficult for inexperienced users to make well-edited videos because it requires professional expertise and immense manual labor. To…

Computer Vision and Pattern Recognition · Computer Science 2023-11-21 Yu Xiong , Fabian Caba Heilbron , Dahua Lin

To make an engaging video, people sequence interesting moments and add visuals such as B-rolls or text. While video editing requires time and effort, AI has recently shown strong potential to make editing easier through suggestions and…

Human-Computer Interaction · Computer Science 2025-02-17 Mina Huh , Dingzeyu Li , Kim Pimmel , Hijung Valentina Shin , Amy Pavel , Mira Dontcheva

Visual editing with diffusion models has made significant progress but often struggles with complex scenarios that textual guidance alone could not adequately describe, highlighting the need for additional non-text editing prompts. In this…

Computer Vision and Pattern Recognition · Computer Science 2025-08-29 Hyeonyu Kim , Seokhoon Jeong , Seonghee Han , Chanhyuk Choi , Taehwan Kim

We focus on the weakly-supervised audio-visual video parsing task (AVVP), which aims to identify and locate all the events in audio/visual modalities. Previous works only concentrate on video-level overall label denoising across modalities,…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Yingying Fan , Yu Wu , Bo Du , Yutian Lin

Background: Software engineering requires both technical skills and creative problem-solving. Blind and low-vision software professionals (BLVSPs) encounter numerous workplace challenges, including inaccessible tools and collaboration…

Software Engineering · Computer Science 2025-02-03 Karina Kohl , Yoonha Cha , Victoria Jackson , Stacy Branham , André van der Hoek , Rafael Prikladnicki

Large Language Models (LLMs) and Vision-Language Models (VLMs) have demonstrated remarkable reasoning and generalization capabilities in video understanding; however, their application in video editing remains largely underexplored. This…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Yuzhi Li , Haojun Xu , Feng Tian

Blind and low vision (BLV) users often rely on alt text to understand what a digital image is showing. However, recent research has investigated how touch-based image exploration on touchscreens can supplement alt text. Touchscreen-based…

Human-Computer Interaction · Computer Science 2023-02-21 Vishnu Nair , Hanxiu 'Hazel' Zhu , Brian A. Smith