English
Related papers

Related papers: When Refreshable Tactile Displays Meet Conversatio…

200 papers

Current web accessibility guidelines ask visualization designers to support screen readers via basic non-visual alternatives like textual descriptions and access to raw data tables. But charts do more than summarize data or reproduce…

Human-Computer Interaction · Computer Science 2022-05-11 Jonathan Zong , Crystal Lee , Alan Lundgard , JiWoong Jang , Daniel Hajas , Arvind Satyanarayan

Large Language Models (LLMs) have become a popular interface for human-AI interaction, supporting information seeking and task assistance through natural, multi-turn dialogue. To respond to users within multi-turn dialogues, the…

Computation and Language · Computer Science 2026-04-16 Fengran Mo , Yifan Gao , Sha Li , Hansi Zeng , Xin Liu , Zhaoxuan Tan , Xian Li , Jianshu Chen , Dakuo Wang , Meng Jiang

Virtual assistants (VAs) have become ubiquitous in daily life, integrated into smartphones and smart devices, sparking interest in AI companions that enhance user experiences and foster emotional connections. However, existing companions…

Human-Computer Interaction · Computer Science 2025-09-03 Xuetong Wang , Ching Christie Pang , Pan Hui

Sensory substitution has influenced the design of many tactile visual substitution systems with the aim of offering visual aids for the blind. This paper focuses on whether a novel electromagnetic vibrotactile display, a four by four…

Human-Computer Interaction · Computer Science 2021-05-28 Michael J. Proulx , Theodoros Eracleous , Ben Spencer , Anna Passfield , Alexandra de Sousa , Ali Mohammadi

As the healthcare sector is facing major challenges, such as aging populations, staff shortages, and common chronic diseases, delivering high-quality care to individuals has become very difficult. Conversational agents have shown to be a…

Computation and Language · Computer Science 2023-03-28 Phillip Schneider , Nils Rehtanz , Kristiina Jokinen , Florian Matthes

AI is promising in assisting UX evaluators with analyzing usability tests, but its judgments are typically presented as non-interactive visualizations. Evaluators may have questions about test recordings, but have no way of asking them.…

Human-Computer Interaction · Computer Science 2023-03-08 Emily Kuang , Ehsan Jahangirzadeh Soure , Mingming Fan , Jian Zhao , Kristen Shinohara

Often, the needs and visual abilities differ between the annotator group and the end user group. Generating detailed diagram descriptions for blind and low-vision (BLV) users is one such challenging domain. Sighted annotators could describe…

Artificial Intelligence · Computer Science 2025-03-18 Wan Ju Kang , Eunki Kim , Na Min An , Sangryul Kim , Haemin Choi , Ki Hoon Kwak , James Thorne

Tactile charts are essential for conveying data to blind and low vision (BLV) readers but are difficult for designers to construct. Non-expert designers face barriers to entry due to complex guidelines, while experts struggle with…

Human-Computer Interaction · Computer Science 2025-03-05 Mengzhu Katie Chen , Isabella Pedraza Pineros , Arvind Satyanarayan , Jonathan Zong

Tactile perception is essential for embodied agents to understand physical attributes of objects that cannot be determined through visual inspection alone. While existing approaches have made progress in visual and language modalities for…

Computer Vision and Pattern Recognition · Computer Science 2025-05-29 Yifan Xie , Mingyang Li , Shoujie Li , Xingting Li , Guangyu Chen , Fei Ma , Fei Richard Yu , Wenbo Ding

The integration of Large Language Models (LLMs) into autonomous driving systems demonstrates strong common sense and reasoning abilities, effectively addressing the pitfalls of purely data-driven methods. Current LLM-based agents require…

Robotics · Computer Science 2024-10-22 Sihao Wu , Jiaxu Liu , Xiangyu Yin , Guangliang Cheng , Xingyu Zhao , Meng Fang , Xinping Yi , Xiaowei Huang

While audio description (AD) is the standard approach for making videos accessible to blind and low vision (BLV) people, existing AD guidelines do not consider BLV users' varied preferences across viewing scenarios. These scenarios range…

Human-Computer Interaction · Computer Science 2024-03-19 Lucy Jiang , Crescentia Jung , Mahika Phutane , Abigale Stangl , Shiri Azenkot

This paper is a collaborative piece between two worlds of expertise in the field of data visualization: accessibility and bias. In particular, the rise of generative models playing a role in accessibility is a worrying trend for data…

Human-Computer Interaction · Computer Science 2025-08-19 Frank Elavsky , Cindy Xiong Bearfield

Conversational systems must be robust to user interactions that naturally exhibit diverse conversational traits. Capturing and simulating these diverse traits coherently and efficiently presents a complex challenge. This paper introduces…

Computation and Language · Computer Science 2024-10-29 Rafael Ferreira , David Semedo , João Magalhães

Through a natural language interface (NLI) for exploratory visual analysis, users can directly "ask" analytical questions about the given tabular data. This process greatly improves user experience and lowers the technical barriers of data…

Human-Computer Interaction · Computer Science 2023-05-17 Yi Guo , Danqing Shi , Mingjuan Guo , Yanqiu Wu , Qing Chen , Nan Cao

Our previous interview study explores the needs and uses of diagrammatic information by the Blind and Low Vision (BLV) community, resulting in a framework called the Ladder of Diagram Access. The framework outlines five levels of…

Human-Computer Interaction · Computer Science 2024-04-02 Yichun Zhao , Miguel A. Nacenta

Data-driven stories seek to inform and persuade audiences through the use of data visualisations and engaging narratives. These stories have now been highly optimised to be viewed on desktop and mobile computers. In contrast, while…

Human-Computer Interaction · Computer Science 2023-08-28 Xiaoyan Zhou , Yalong Yang , Francisco Ortega , Anil Ufuk Batmaz , Benjamin Lee

Making the interaction with embodied conversational agents accessible in a ubiquitous and natural manner is not only a question of the underlying software but also brings challenges in terms of the technical system that is used to display…

Human-Computer Interaction · Computer Science 2024-08-13 Carolin Schindler , Daiki Mayumi , Yuki Matsuda , Niklas Rach , Keiichi Yasumoto , Wolfgang Minker

Visuo-tactile perception aims to understand an object's tactile properties, such as texture, softness, and rigidity. However, the field remains underexplored because collecting tactile data is costly and labor-intensive. We observe that…

Computer Vision and Pattern Recognition · Computer Science 2025-05-21 Yoorhim Cho , Hongyeob Kim , Semin Kim , Youjia Zhang , Yunseok Choi , Sungeun Hong

Vision-language agents have achieved remarkable progress in a variety of multimodal reasoning tasks; however, their learning remains constrained by the limitations of human-annotated supervision. Recent self-rewarding approaches attempt to…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Jiaqi Liu , Kaiwen Xiong , Peng Xia , Yiyang Zhou , Haonian Ji , Lu Feng , Siwei Han , Mingyu Ding , Huaxiu Yao

We propose two novel interaction techniques for visualization-assisted exploration of urban data: Layer Toggling and Visibility-Preserving Lenses. Layer Toggling mitigates visual overload by organizing information into separate layers while…

Human-Computer Interaction · Computer Science 2025-10-22 Karelia Salinas , Luis Gustavo Nonato , Jean-Daniel Fekete , Fernanda Bartolo dos Santos Saran