English
Related papers

Related papers: Insight: Enhancing Mobile Accessibility for Blind …

200 papers

The growing popularity and widespread adoption of large language models (LLMs) necessitates the development of tools that enhance the effectiveness of user interactions with these models. Understanding the structures and functions of these…

Human-Computer Interaction · Computer Science 2025-03-03 Divya Perumal , Swaroop Panda

Multimodal Large Language Models (MLLMs) hold immense promise as assistive technologies for the blind and visually impaired (BVI) community. However, we identify a critical failure mode that undermines their trustworthiness in real-world…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Xiantao Zhang

Assistive agents for Blind and Visually Impaired (BVI) users require accessibility alignment as a first-class design objective. Despite rapid progress in agentic AI, most systems are designed and evaluated under assumptions of sighted…

Artificial Intelligence · Computer Science 2026-05-14 Jie Hu , Changyuan Yan , Yu Zheng , Ziqian Wang , Jiaming Zhang

Usability describes quality attributes of application user interfaces that determine how effectively users can interact with them. Traditional usability evaluation methods require considerable expertise and resources, which can be…

Software Engineering · Computer Science 2026-04-29 Sebastian Lubos , Alexander Felfernig , Damian Garber , Viet-Man Le , Manuel Henrich

Explainable Artificial Intelligence (XAI) is critical for ensuring trust and accountability, yet its development remains predominantly visual. For blind and low-vision (BLV) users, the lack of accessible explanations creates a fundamental…

Human-Computer Interaction · Computer Science 2026-05-05 Abu Noman Md Sakib , Protik Dey , Zijie Zhang , Taslima Akter

To enhance productivity and to streamline workflows, there is a growing trend to embed large language model (LLM) functionality into applications, from browser-based web apps to native apps that run on personal computers. Here, we introduce…

Human-Computer Interaction · Computer Science 2024-08-01 Lukas Teufelberger , Xintong Liu , Zhipeng Li , Max Moebus , Christian Holz

As large language models (LLMs) become increasingly prevalent, understanding human-LLM interactions is emerging as a central priority in psychological research. Online experiments offer an efficient means to study human-LLM interactions,…

Human-Computer Interaction · Computer Science 2025-11-27 R. Bermudez Schettino , A. Dasmeh , L. Brinkmann

Advances in large language models (LLMs) and real-time speech recognition now make it possible to issue any graphical user interface (GUI) action through natural language and receive the corresponding system response directly through the…

Human-Computer Interaction · Computer Science 2025-10-10 Hans G. W. van Dam

The widespread availability of Large Language Models (LLMs) within Integrated Development Environments (IDEs) has led to their speedy adoption. Conversational interactions with LLMs enable programmers to obtain natural language explanations…

Human-Computer Interaction · Computer Science 2024-02-12 Bhavya Chopra , Yasharth Bajpai , Param Biyani , Gustavo Soares , Arjun Radhakrishna , Chris Parnin , Sumit Gulwani

Large Language Models (LLMs) have the potential to transform the way a dynamic curriculum can be delivered. However, educators face significant challenges in interacting with these models, particularly due to complex prompt engineering and…

Computers and Society · Computer Science 2025-06-16 Abdolali Faraji , Mohammadreza Tavakoli , Mohammad Moein , Mohammadreza Molavi , Gábor Kismihók

In this study, we propose a solution based on a multi-agent LLM architecture and a voice user interface (VUI) designed to update the knowledge base of a digital assistant. Its usability is evaluated in comparison to a more traditional…

Human-Computer Interaction · Computer Science 2025-05-29 Grzegorz Wolny , Michał Szczerbak

Effective time management during presentations is challenging, particularly for Blind and Low-Vision (BLV) individuals, as existing tools often lack accessibility and multimodal feedback. To address this gap, we developed vashTimer: a free,…

Human-Computer Interaction · Computer Science 2025-09-25 Aziz N Zeidieh , Sanchita S. Kamath , JooYoung Seo

Ensuring usability is crucial for the success of mobile apps. Usability issues can compromise user experience and negatively impact the perceived app quality. This paper presents UX-LLM, a novel tool powered by a Large Vision-Language Model…

Software Engineering · Computer Science 2026-01-14 Ali Ebrahimi Pourasad , Walid Maalej

Personal health monitoring via IoT in LMICs is limited by affordability, low digital literacy, and limited health data comprehension. We present Guardian Angel, a low-cost, screenless wearable paired with a WhatsApp-based LLM agent that…

Seniors represent a growing user base for mobile applications; however, many apps fail to adequately address their accessibility challenges and usability preferences. To investigate this issue, we conducted an exploratory focus group study…

Software Engineering · Computer Science 2025-04-18 Shavindra Wickramathilaka , John Grundy , Kashumi Madampe , Omar Haggag

Predicting a user's next search query from recent interaction behaviors is a critical problem in modern e-commerce systems, particularly in scenarios where user intent evolves rapidly. Large Language Models (LLMs) offer strong semantic…

Information Retrieval · Computer Science 2026-05-07 Bin Zhang , Weipeng Huang , Dimin Wang , Jialin Zhu , Yuning Jiang , Zhaode Wang , Chengfei Lv , Jian Wang , Qichao Ma , Li Chen , Junqing Wu , Yipeng Yu

Artificial Intelligence (AI) is revolutionizing assistive technologies. It offers innovative solutions to enhance the quality of life for individuals with visual impairments. This review examines the development, applications, and impact of…

Human-Computer Interaction · Computer Science 2025-03-21 Prudhvi Naayini , Praveen Kumar Myakala , Chiranjeevi Bura , Anil Kumar Jonnalagadda , Srikanth Kamatala

With the increasing integration of Artificial Intelligence (AI) in academic problem solving, university students frequently alternate between traditional search engines like Google and large language models (LLMs) for information retrieval.…

Human-Computer Interaction · Computer Science 2025-10-21 Md. Faiyaz Abdullah Sayeedi , Md. Sadman Haque , Zobaer Ibn Razzaque , Robiul Awoul Robin , Sabila Nawshin

Blind and low-vision (BLV) people face many challenges when venturing into public environments, often wishing it were easier to get help from people nearby. Ironically, while many sighted individuals are willing to help, such interactions…

Human-Computer Interaction · Computer Science 2024-03-14 Yuanyang Teng , Connor Courtien , David Angel Rios , Yves M. Tseng , Jacqueline Gibson , Maryam Aziz , Avery Reyna , Rajan Vaish , Brian A. Smith

With mobile apps rapidly permeating all aspects of daily living with use by all segments of the population, it is crucial to support the evaluation of app usability for specific impaired users to improve app accessibility. In this work, we…

Human-Computer Interaction · Computer Science 2025-03-18 Kenny Tsu Wei Choo , Rajesh Krishna Balan , Youngki Lee