English
Related papers

Related papers: WhatsAI: Transforming Meta Ray-Bans into an Extens…

200 papers

People with visual impairments perceive their environment non-visually and often use AI-powered assistive tools to obtain textual descriptions of visual information. Recent large vision-language model-based AI-powered tools like Be My AI…

Human-Computer Interaction · Computer Science 2024-07-15 Jingyi Xie , Rui Yu , He Zhang , Sooyeon Lee , Syed Masum Billah , John M. Carroll

In an increasingly visual world, people with blindness and low vision (pBLV) face substantial challenges in navigating their surroundings and interpreting visual information. From our previous work, VIS4ION is a smart wearable that helps…

Systems and Control · Electrical Eng. & Systems 2023-11-27 Tommy Azzino , Marco Mezzavilla , Sundeep Rangan , Yao Wang , John-Ross Rizzo

Artificial Intelligence (AI) systems, especially generative AI technologies are becoming more relevant in our society. Tools like ChatGPT are being used by members of the disabled community e.g., Autistic people may use it to help compose…

Human-Computer Interaction · Computer Science 2023-09-27 Deepak Giri , Erin Brady

Visually impaired people face significant challenges when attempting to interact with and understand complex environments, and traditional assistive technologies often struggle to quickly provide necessary contextual understanding and…

Human-Computer Interaction · Computer Science 2025-05-02 Bhanuja Ainary

Artificial intelligence-driven adaptive learning systems are reshaping education through data-driven adaptation of learning experiences. Yet many of these systems lack transparency, offering limited insight into how decisions are made. Most…

Artificial Intelligence · Computer Science 2025-08-04 Maryam Mosleh , Marie Devlin , Ellis Solaiman

Generative AI (GenAI) is both promising and challenging in supporting people with disabilities (PwDs) in creating stories about disability. GenAI can reduce barriers to media production and inspire the creativity of PwDs, but it may also…

Human-Computer Interaction · Computer Science 2026-01-21 Shuo Niu , Dylan Clements , Hyungsin Kim

The rapid growth of virtual reality (VR) has led to increased use of social VR platforms for interaction. However, these platforms lack adequate features to support blind and low vision (BLV) users, posing significant challenges in…

Human-Computer Interaction · Computer Science 2026-03-31 Jazmin Collins , Kaylah Myranda Nicholson , Yusuf Khadir , Andrea Stevenson Won , Shiri Azenkot

Assistive technologies for the visually impaired have evolved to facilitate interaction with a complex and dynamic world. In this paper, we introduce AIris, an AI-powered wearable device that provides environmental awareness and interaction…

Human-Computer Interaction · Computer Science 2024-08-13 Dionysia Danai Brilli , Evangelos Georgaras , Stefania Tsilivaki , Nikos Melanitis , Konstantina Nikita

Accessibility forums and, more recently, generative AI tools have become vital resources for blind users seeking solutions to computer-interaction issues and learning about new assistive technologies, screen reader features, tutorials, and…

Human-Computer Interaction · Computer Science 2026-02-24 Satwik Ram Kodandaram , Jiawei Zhou , Xiaojun Bi , IV Ramakrishnan , Vikas Ashok

Blind and Visually Impaired (BVI) Individuals face significant challenges in science due to the discipline's reliance on visual elements such as graphs, diagrams, and laboratory work. Traditional learning materials, such as Braille and…

Physics Education · Physics 2025-11-25 Ludovic Petitdemange , Salomé Nashed

Recent advancements in large multimodal models have provided blind or visually impaired (BVI) individuals with new capabilities to interpret and engage with the real world through interactive systems that utilize live video feeds. However,…

Human-Computer Interaction · Computer Science 2025-08-06 Ruei-Che Chang , Rosiana Natalie , Wenqian Xu , Jovan Zheng Feng Yap , Anhong Guo

In this paper, we introduce FairSense-AI: a multimodal framework designed to detect and mitigate bias in both text and images. By leveraging Large Language Models (LLMs) and Vision-Language Models (VLMs), FairSense-AI uncovers subtle forms…

Computation and Language · Computer Science 2025-03-06 Shaina Raza , Mukund Sayeeganesh Chettiar , Matin Yousefabadi , Tahniat Khan , Marcelo Lotif

Recent advances in generative AI have brought incredible breakthroughs in several areas, including medical imaging. These generative models have tremendous potential not only to help safely share medical data via synthetic datasets but also…

The analysis of the current integration attempts of some modes and use cases of user-machine interaction is presented. The new concept of the user-driven intelligent interface is proposed on the basis of multimodal augmented reality and…

Human-Computer Interaction · Computer Science 2018-12-11 S. Stirenko , Yu. Gordienko , T. Shemsedinov , O. Alienin , Yu. Kochura , N. Gordienko , A. Rojbi , J. R. López Benito , E. Artetxe González

People with visual impairments often face significant challenges in locating and retrieving objects in their surroundings. Existing assistive technologies present a trade-off: systems that offer precise guidance typically require…

We argue that there is a need for Accessibility to be represented in several important domains: - Capitalize on the new capabilities AI provides - Support for open source development of AI, which can allow disabled and disability focused…

Computers and Society · Computer Science 2025-03-20 Jennifer Mankoff , Janice Light , James Coughlan , Christian Vogler , Abraham Glasser , Gregg Vanderheiden , Laura Rice

This paper is a collaborative piece between two worlds of expertise in the field of data visualization: accessibility and bias. In particular, the rise of generative models playing a role in accessibility is a worrying trend for data…

Human-Computer Interaction · Computer Science 2025-08-19 Frank Elavsky , Cindy Xiong Bearfield

Empowering people who are blind or visually impaired (BVI) to enhance their orientation and mobility skills is critical to equalizing their access to social and economic opportunities. To manage this crucial challenge, we employed a novel…

Human-Computer Interaction · Computer Science 2025-05-09 Daeun Joyce Chung , Muya Guoji , Nina Mindel , Alexis Malkin , Fernando Albertorio , Shane Lowe , Chris McNally , Casandra Xavier , Paul Ruvolo

We envision the "virtual eye" as a next-generation, AI-powered platform that uses interconnected foundation models to simulate the eye's intricate structure and biological function across all scales. Advances in AI, imaging, and multiomics…

Tissues and Organs · Quantitative Biology 2025-05-12 Yue Wu , Yibo Guo , Yulong Yan , Jiancheng Yang , Xin Zhou , Ching-Yu Cheng , Danli Shi , Mingguang He

Assistive agents for Blind and Visually Impaired (BVI) users require accessibility alignment as a first-class design objective. Despite rapid progress in agentic AI, most systems are designed and evaluated under assumptions of sighted…

Artificial Intelligence · Computer Science 2026-05-14 Jie Hu , Changyuan Yan , Yu Zheng , Ziqian Wang , Jiaming Zhang