English
Related papers

Related papers: Emerging Practices for Large Multimodal Model (LMM…

200 papers

The growing adoption of augmented and virtual reality (AR and VR) technologies in industrial training and on-the-job assistance has created new opportunities for intelligent, context-aware support systems. As workers perform complex tasks…

Human-Computer Interaction · Computer Science 2025-11-18 Mahya Qorbani , Kamran Paynabar , Mohsen Moghaddam

In the rapidly evolving landscape of AI-mediated communication (AIMC), tools powered by Large Language Models (LLMs) are becoming integral to interpersonal communication. Employing a mixed-methods approach, we conducted a one-week diary and…

Human-Computer Interaction · Computer Science 2024-03-12 Yue Fu , Sami Foell , Xuhai Xu , Alexis Hiniker

Designers of digital solutions increasingly consult Large Language Models (LLMs) for their work. However, it remains unclear how this may affect the user experiences they produce and there are no established practices. We investigate how…

Human-Computer Interaction · Computer Science 2026-05-19 Eduard Kuric , Peter Demcak , Matus Krajcovic

It is estimated that 285 million people globally are visually impaired. A majority of these people live in developing countries and are among the elderly population. One of the most difficult tasks faced by the visually impaired is…

Computers and Society · Computer Science 2015-06-04 Shonal Chaudhry , Rohitash Chandra

AI-supported tools can help learners overcome challenges in programming education by providing adaptive assistance. However, existing research often focuses on individual tools rather than deriving broader design recommendations. A key…

Human-Computer Interaction · Computer Science 2025-03-04 Zihan Wu , Yicheng Tang , Barbara Ericson

Large Multimodal Models (LMMs) have shown strong potential for assisting users in tasks, such as programming, content creation, and information access, yet their interaction remains largely limited to traditional interfaces such as desktops…

Human-Computer Interaction · Computer Science 2026-02-12 Liuchuan Yu , Yongqi Zhang , Lap-Fai Yu

With the recent focus in the accessibility field, researchers from academia and industry have been very active in developing innovative techniques and tools for assistive technology. Especially with handheld devices getting ever powerful…

Computers and Society · Computer Science 2017-09-27 Cynthia Chen , Peter Fay

With the growing deployment of Vision-Language Models (VLMs), pre-trained on large image-text and video-text datasets, it is critical to equip users with the tools to discern when to trust these systems. However, examining how user trust in…

Human-Computer Interaction · Computer Science 2025-11-18 Agnese Chiatti , Lara Piccolo , Sara Bernardini , Matteo Matteucci , Viola Schiaffonati

Shopping plays a significant role in shaping consumer identity and social integration. However, for individuals with visual impairments, navigating in supermarkets and identifying products can be an overwhelming and challenging experience.…

Human-Computer Interaction · Computer Science 2025-09-03 Larissa R. de S. Shibata , Ankit A. Ravankar , Jose Victorio Salazar Luces , Yasuhisa Hirata

Augmented Reality (AR) technologies hold immense potential for revolutionizing the way individuals with disabilities interact with the world. AR systems can provide real-time assistance and support by overlaying digital information over the…

Human-Computer Interaction · Computer Science 2025-08-12 Riju Marwah , Jyotin Singh Thakur , Pranav Tanwar

Autistic individuals often experience negative self-talk (NST), leading to increased anxiety and depression. While therapy is recommended, it presents challenges for many autistic individuals. Meanwhile, a growing number are turning to…

Human-Computer Interaction · Computer Science 2025-03-25 Buse Carik , Victoria Izaac , Xiaohan Ding , Angela Scarpa , Eugenia Rho

Recent advancements in large multimodal models have provided blind or visually impaired (BVI) individuals with new capabilities to interpret and engage with the real world through interactive systems that utilize live video feeds. However,…

Human-Computer Interaction · Computer Science 2025-08-06 Ruei-Che Chang , Rosiana Natalie , Wenqian Xu , Jovan Zheng Feng Yap , Anhong Guo

Blind and low-vision (BLV) people face many challenges when venturing into public environments, often wishing it were easier to get help from people nearby. Ironically, while many sighted individuals are willing to help, such interactions…

Human-Computer Interaction · Computer Science 2024-03-14 Yuanyang Teng , Connor Courtien , David Angel Rios , Yves M. Tseng , Jacqueline Gibson , Maryam Aziz , Avery Reyna , Rajan Vaish , Brian A. Smith

Recent advances in AI combine large language models (LLMs) with vision encoders that bring forward unprecedented technical capabilities to leverage for a wide range of healthcare applications. Focusing on the domain of radiology,…

Artificial intelligence systems are widely used by people with sensory disabilities, like loss of vision or hearing, to help perceive or navigate the world around them. This includes tasks like describing an image or object they cannot…

Human-Computer Interaction · Computer Science 2026-03-04 Shadab H. Choudhury

Recent advancements in language and vision assistants have showcased impressive capabilities but suffer from a lack of transparency, limiting broader research and reproducibility. While open-source models handle general image tasks…

Computer Vision and Pattern Recognition · Computer Science 2024-10-08 Geewook Kim , Minjoon Seo

Assistive technologies for people with visual impairments (PVI) have made significant advancements, particularly with the integration of artificial intelligence (AI) and real-time sensor technologies. However, current solutions often…

Human-Computer Interaction · Computer Science 2024-10-08 He Zhang , Nicholas J. Falletta , Jingyi Xie , Rui Yu , Sooyeon Lee , Syed Masum Billah , John M. Carroll

AI-assisted decision making becomes increasingly prevalent, yet individuals often fail to utilize AI-based decision aids appropriately especially when the AI explanations are absent, potentially as they do not %understand reflect on AI's…

Human-Computer Interaction · Computer Science 2025-02-18 Zhuoyan Li , Hangxiao Zhu , Zhuoran Lu , Ziang Xiao , Ming Yin

Access to accurate and actionable harm reduction information can directly impact the health outcomes of People Who Use Drugs (PWUD), yet existing online channels often fail to meet their diverse and dynamic needs due to limitations in…

Human-Computer Interaction · Computer Science 2025-07-15 Kaixuan Wang , Jason T. Jacques , Chenxin Diao , Carl-Cyril J Dreue

Approximately 200 million individuals around the world suffer from varying degrees of visual impairment, making it crucial to leverage AI technology to offer walking assistance for these people. With the recent progress of vision-language…

Computer Vision and Pattern Recognition · Computer Science 2025-03-05 Zhiqiang Yuan , Ting Zhang , Ying Deng , Jiapei Zhang , Yeshuang Zhu , Zexi Jia , Jie Zhou , Jinchao Zhang