English
Related papers

Related papers: Facilitating Visual Media Exploration for Blind an…

200 papers

Audio Description (AD) provides essential access to visual media for blind and low vision (BLV) audiences. Yet current AD production tools remain largely inaccessible to BLV video creators, who possess valuable expertise but face barriers…

Human-Computer Interaction · Computer Science 2026-02-10 Franklin Mingzhe Li , Michael Xieyang Liu , Cynthia L. Bennett , Shaun K. Kane

Analyzing literature involves tracking interactions between characters, locations, and themes. Visualization has the potential to facilitate the mapping and analysis of these complex relationships, but capturing structured information from…

Human-Computer Interaction · Computer Science 2025-08-12 Catherine Yeh , Tara Menon , Robin Singh Arya , Helen He , Moira Weigel , Fernanda Viégas , Martin Wattenberg

Blind and low-vision (BLV) users remain largely excluded from three-dimensional (3D) surface and point data visualizations due to the reliance on visual interaction. Existing approaches inadequately support non-visual access, especially in…

Human-Computer Interaction · Computer Science 2025-08-13 Sanchita S. Kamath , Aziz N. Zeidieh , JooYoung Seo

LLM-based Interactive Drama is a novel AI-based dialogue scenario, where the user (i.e. the player) plays the role of a character in the story, has conversations with characters played by LLM agents, and experiences an unfolding story. This…

Computation and Language · Computer Science 2025-06-04 Hongqiu Wu , Weiqi Wu , Tianyang Xu , Jiameng Zhang , Hai Zhao

Natural language descriptions sometimes accompany visualizations to better communicate and contextualize their insights, and to improve their accessibility for readers with disabilities. However, it is difficult to evaluate the usefulness…

Human-Computer Interaction · Computer Science 2021-10-12 Alan Lundgard , Arvind Satyanarayan

Video accessibility is crucial for blind and low vision users for equitable engagements in education, employment, and entertainment. Despite the availability of professional and amateur services and tools, most human-generated descriptions…

Human-Computer Interaction · Computer Science 2022-01-12 Shasta Ihorn , Yue-Ting Siu , Aditya Bodi , Lothar Narins , Jose M. Castanon , Yash Kant , Abhishek Das , Ilmi Yoon , Pooyan Fazli

Recent advances in AI-driven storytelling have enhanced video generation and story visualization. However, translating dialogue-centric scripts into coherent storyboards remains a significant challenge due to limited script detail,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 Min Zhang , Zilin Wang , Liyan Chen , Kunhong Liu , Juncong Lin

Recent advancements in the field of AI agents have impacted the way we work, enabling greater automation and collaboration between humans and agents. In the data visualization field, multi-agent systems can be useful for employing agents…

Artificial Intelligence · Computer Science 2025-09-03 Anton Wolter , Georgios Vidalakis , Michael Yu , Ankit Grover , Vaishali Dhanoa

Interactive storytelling is vital for preschooler development. While children's interactive partners have traditionally been their parents and teachers, recent advances in artificial intelligence (AI) have sparked a surge of AI-based…

Human-Computer Interaction · Computer Science 2024-09-04 Yuling Sun , Jiaju Chen , Bingsheng Yao , Jiali Liu , Dakuo Wang , Xiaojuan Ma , Yuxuan Lu , Ying Xu , Liang He

Video-based learning (VBL) has become a dominant method for learning practical skills, yet accessibility guidelines provide limited guidance for users with cognitive differences. In particular, challenges that individuals with Borderline…

Human-Computer Interaction · Computer Science 2026-02-10 Hyehyun Chu , Seungju Kim , Chen Zhou , Yu-Kai Hung , Saelyne Yang , Hyun W. Ka , Juho Kim

Storyline visualizations are an effective means to present the evolution of plots and reveal the scenic interactions among characters. However, the design of storyline visualizations is a difficult task as users need to balance between…

Human-Computer Interaction · Computer Science 2020-09-02 Tan Tang , Renzhong Li , Xinke Wu , Shuhan Liu , Johannes Knittel , Steffen Koch , Thomas Ertl , Lingyun Yu , Peiran Ren , Yingcai Wu

We introduce ArtInsight, a novel AI-powered system to facilitate deeper engagement with child-created artwork in mixed visual-ability families. ArtInsight leverages large language models (LLMs) to craft a respectful and thorough initial…

Human-Computer Interaction · Computer Science 2025-03-11 Arnavi Chheda-Kothary , Ritesh Kanchi , Chris Sanders , Kevin Xiao , Aditya Sengupta , Melanie Kneitmix , Jacob O. Wobbrock , Jon E. Froehlich

Online writers and journalism media are increasingly combining visualization (and other multimedia content) with narrative text to create narrative visualizations. Often, however, the two elements are presented independently of one another.…

Human-Computer Interaction · Computer Science 2018-01-09 Ronald Metoyer , Qiyu Zhi , Bart Janczuk , Walter Scheirer

Inter-generational communication is essential for bridging generational gaps and fostering mutual understanding. However, maintaining it is complex due to cultural, communicative, and geographical differences. Recent research indicated that…

Human-Computer Interaction · Computer Science 2024-10-24 Qiuxin Du , Xiaoying Wei , Jiawei Li , Emily Kuang , Jie Hao , Dongdong Weng , Mingming Fan

People who are blind or have low vision (BLV) may hesitate to travel independently in unfamiliar environments due to uncertainty about the physical landscape. While most tools focus on in-situ navigation, those exploring pre-travel…

Human-Computer Interaction · Computer Science 2025-04-15 Gaurav Jain , Leah Findlater , Cole Gleason

Visual blends combine elements from two distinct visual concepts into a single, integrated image, with the goal of conveying ideas through imaginative and often thought-provoking visuals. Communicating abstract concepts through visual…

Human-Computer Interaction · Computer Science 2025-02-25 Zhida Sun , Zhenyao Zhang , Yue Zhang , Min Lu , Dani Lischinski , Daniel Cohen-Or , Hui Huang

Interactive narrative (IN) authors craft spaces of divergent narrative possibilities for players to explore, with the player's input determining which narrative possibilities they actually experience. Generative AI can enable new forms of…

Human-Computer Interaction · Computer Science 2026-01-23 Yi Wang , John Joon Young Chung , Melissa Roemmele , Yuqian Sun , Tiffany Wang , Shm Garanganao Almeda , Brett A. Halperin , Yuwen Lu , Max Kreminski

This paper introduces VIVRA (Voice Interactive Virtual Reality Annotation), a VR application combining multimodal interaction with large language models (LLMs) to transform users' ideas into interactive 3D visualizations. VIVRA converts…

Human-Computer Interaction · Computer Science 2024-09-24 Yunhao Xing , Jerrick Ban , Timothy D. Hubbard , Michael Villano , Diego Gomez-Zara

Visual impairment affects the ability of people to live a life like normal people. Such people face challenges in performing activities of daily living, such as reading, writing, traveling and participating in social gatherings. Many…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 Mirza Samad Ahmed Baig , Syeda Anshrah Gillani , Shahid Munir Shah , Mahmoud Aljawarneh , Abdul Akbar Khan , Muhammad Hamzah Siddiqui

We define "visual story-writing" as using visual representations of story elements to support writing and revising narrative texts. To demonstrate this approach, we developed a text editor that automatically visualizes a graph of entity…

Human-Computer Interaction · Computer Science 2025-08-01 Damien Masson , Zixin Zhao , Fanny Chevalier