English
Related papers

Related papers: From Vision to Touch: Bridging Visual and Tactile …

200 papers

Equipping multi-fingered robots with tactile sensing is crucial for achieving the precise, contact-rich, and dexterous manipulation that humans excel at. However, relying solely on tactile sensing fails to provide adequate cues for…

Robotics · Computer Science 2023-09-22 Irmak Guzey , Yinlong Dai , Ben Evans , Soumith Chintala , Lerrel Pinto

We address the problem of tactile localization, where the goal is to identify image regions that share the same material properties as a tactile input. Existing visuo-tactile methods rely on global alignment and thus fail to capture the…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Seongyu Kim , Seungwoo Lee , Hyeonggon Ryu , Joon Son Chung , Arda Senocak

Tactile perception is essential for embodied agents to understand physical attributes of objects that cannot be determined through visual inspection alone. While existing approaches have made progress in visual and language modalities for…

Computer Vision and Pattern Recognition · Computer Science 2025-05-29 Yifan Xie , Mingyang Li , Shoujie Li , Xingting Li , Guangyu Chen , Fei Ma , Fei Richard Yu , Wenbo Ding

Screen readers are audio-based software that Blind and Low Vision (BLV) people use to interact with computing devices, such as tablets and smartphones. Although this technology has significantly improved the accessibility of touchscreen…

Human-Computer Interaction · Computer Science 2025-10-20 Ricardo Gonzalez , Fannie Liu , Blair MacIntyre , David Saffo

This paper investigates new data exploration experiences that enable blind users to interact with statistical data visualizations$-$bar plots, heat maps, box plots, and scatter plots$-$leveraging multimodal data representations. In addition…

Human-Computer Interaction · Computer Science 2024-03-04 JooYoung Seo , Yilin Xia , Bongshin Lee , Sean McCurry , Yu Jun Yam

For individuals who are blind or have low vision, tactile maps provide essential spatial information but are limited in the amount of data they can convey. Digitally augmented tactile maps enhance these capabilities with audio feedback,…

Human-Computer Interaction · Computer Science 2025-10-20 Matteo Manzoni , Sergio Mascetti , Dragan Ahmetovic , Ryan Crabb , James M. Coughlan

This paper is a collaborative piece between two worlds of expertise in the field of data visualization: accessibility and bias. In particular, the rise of generative models playing a role in accessibility is a worrying trend for data…

Human-Computer Interaction · Computer Science 2025-08-19 Frank Elavsky , Cindy Xiong Bearfield

Blind and low vision (BLV) users often rely on alt text to understand what a digital image is showing. However, recent research has investigated how touch-based image exploration on touchscreens can supplement alt text. Touchscreen-based…

Human-Computer Interaction · Computer Science 2023-02-21 Vishnu Nair , Hanxiu 'Hazel' Zhu , Brian A. Smith

Robots which interact with the physical world will benefit from a fine-grained tactile understanding of objects and surfaces. Additionally, for certain tasks, robots may need to know the haptic properties of an object before touching it. To…

Robotics · Computer Science 2016-04-13 Yang Gao , Lisa Anne Hendricks , Katherine J. Kuchenbecker , Trevor Darrell

People who are blind or have low vision (BLV) encounter numerous challenges in their daily lives and work. To support them, various haptic assistive tools have been developed. Despite these advancements, the effective utilization of these…

Human-Computer Interaction · Computer Science 2024-12-30 Chutian Jiang , Emily Kuang , Mingming Fan

The investigation of tangible user interfaces commenced approximately thirty years ago. Questions on its commercial potential become more pressing as the field becomes mature. To take the field one step further -- as the emergence of…

Human-Computer Interaction · Computer Science 2026-01-01 Guillaume Riviere

Blind and low-vision (BLV) employees in mixed-visual ability teams often encounter information (e.g., PDFs, diagrams) in inaccessible formats. To enable teamwork, teams must transform these representations by modifying or re-creating them…

Human-Computer Interaction · Computer Science 2026-01-30 Yichun Zhao , Miguel A. Nacenta , Mahadeo A. Sukhai , Sowmya Somanath

Three-dimensional (3D) data visualizations, such as surface plots, are vital in STEM fields from biomedical imaging to spectroscopy, yet remain largely inaccessible to blind and low-vision (BLV) people. To address this gap, we conducted an…

Human-Computer Interaction · Computer Science 2026-04-13 Sanchita S. Kamath , Aziz N Zeidieh , Venkatesh Potluri , Sile O'Modhrain , Kenneth Perry , JooYoung Seo

As blind and low-vision (BLV) players engage more deeply with games, accessibility features have become essential. While some research has explored tools and strategies to enhance game accessibility, the specific experiences of these…

Human-Computer Interaction · Computer Science 2025-02-17 Zihe Ran , Xiyu Li , Qing Xiao , Xianzhe Fan , Franklin Mingzhe Li , Yanyun Wang , Zhicong Lu

This paper presents an algorithm that transforms color visual images, like photographs or paintings, into tactile graphics. In the algorithm, the edges of objects are detected and colors of the objects are estimated. Then, the edges and the…

Graphics · Computer Science 2007-05-23 Artur Rataj

Touch is an important sensing modality for humans, but it has not yet been incorporated into a multimodal generative language model. This is partially due to the difficulty of obtaining natural language labels for tactile data and the…

Computer Vision and Pattern Recognition · Computer Science 2024-02-21 Letian Fu , Gaurav Datta , Huang Huang , William Chung-Ho Panitch , Jaimyn Drake , Joseph Ortiz , Mustafa Mukadam , Mike Lambeta , Roberto Calandra , Ken Goldberg

Visuo-tactile perception aims to understand an object's tactile properties, such as texture, softness, and rigidity. However, the field remains underexplored because collecting tactile data is costly and labor-intensive. We observe that…

Computer Vision and Pattern Recognition · Computer Science 2025-05-21 Yoorhim Cho , Hongyeob Kim , Semin Kim , Youjia Zhang , Yunseok Choi , Sungeun Hong

Inclusion and accessibility in visualization research have gained increasing attention in recent years. However, many challenges still remain to be solved on the road toward a more inclusive, shared-experience-driven visualization design…

Human-Computer Interaction · Computer Science 2022-09-13 Katrin Angerbauer , Michael Sedlmair

While visualizations are an effective way to represent insights about information, they rarely stand alone. When designing a visualization, text is often added to provide additional context and guidance for the reader. However, there is…

Human-Computer Interaction · Computer Science 2022-09-23 Chase Stokes , Vidya Setlur , Bridget Cogley , Arvind Satyanarayan , Marti Hearst

Visual arts play an important role in cultural life and provide access to social heritage and self-enrichment, but most visual arts are inaccessible to blind people. Researchers have explored different ways to enhance blind people's access…

Human-Computer Interaction · Computer Science 2023-01-31 Franklin Mingzhe Li , Lotus Zhang , Maryam Bandukda , Abigale Stangl , Kristen Shinohara , Leah Findlater , Patrick Carrington