English
Related papers

Related papers: Text to Blind Motion

200 papers

Safely navigating street intersections is a complex challenge for blind and low-vision individuals, as it requires a nuanced understanding of the surrounding context - a task heavily reliant on visual cues. Traditional methods for assisting…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Hochul Hwang , Sunjae Kwon , Yekyung Kim , Donghyun Kim

Current research on pedestrian behavior understanding focuses on the dynamics of pedestrians and makes strong assumptions about their perceptual abilities. For instance, it is often presumed that pedestrians have omnidirectional view of the…

Artificial Intelligence · Computer Science 2023-02-09 Iuliia Kotseruba , Amir Rasouli

The ability of intelligent systems to predict human behaviors is crucial, particularly in fields such as autonomous vehicle navigation and social robotics. However, the complexity of human motion have prevented the development of a…

Computer Vision and Pattern Recognition · Computer Science 2024-11-06 Yang Gao , Po-Chien Luan , Alexandre Alahi

This paper introduces our methodology to estimate sidewalk accessibilities from wheelchair behavior via a triaxial accelerometer in a smartphone installed under a wheelchair seat. Our method recognizes sidewalk accessibilities from…

Machine Learning · Computer Science 2021-01-12 Takumi Watanabe , Hiroki Takahashi , Goh Sato , Yusuke Iwasawa , Yutaka Matsuo , Ikuko Eguchi Yairi

Prediction of human motions is key for safe navigation of autonomous robots among humans. In cluttered environments, several motion hypotheses may exist for a pedestrian, due to its interactions with the environment and other pedestrians.…

Robotics · Computer Science 2020-11-17 Bruno Brito , Hai Zhu , Wei Pan , Javier Alonso-Mora

Safety is still the main issue of autonomous driving, and in order to be globally deployed, they need to predict pedestrians' motions sufficiently in advance. While there is a lot of research on coarse-grained (human center prediction) and…

Computer Vision and Pattern Recognition · Computer Science 2022-06-29 Saeed Saadatnejad , Yi Zhou Ju , Alexandre Alahi

Current studies on human locomotion focus mainly on solid ground walking conditions. In this paper, we present a biomechanic comparison of human walking locomotion on solid ground and sand. A novel dataset containing 3-dimensional motion…

Robotics · Computer Science 2024-07-02 Chunchu Zhu , Xunjie Chen , Jingang Yi

The difficulty and consequent fear of travel is one of the most disabling consequences of blindness and severe vision impairment, affecting confidence and quality of life. Traditional tactile graphics are vital in the Orientation and…

Human-Computer Interaction · Computer Science 2025-01-17 Leona Holloway , Kim Marriott , Matthew Butler , Samuel Reinders

The integration of Light Detection and Ranging (LiDAR) and Internet of Things (IoT) technologies offers transformative opportunities for public health informatics in urban safety and pedestrian well-being. This paper proposes a novel…

Computer Vision and Pattern Recognition · Computer Science 2024-04-18 Nawfal Guefrachi , Jian Shi , Hakim Ghazzai , Ahmad Alsharoa

We present a novel method for populating 3D indoor scenes with virtual humans that can navigate in the environment and interact with objects in a realistic manner. Existing approaches rely on training sequences that contain captured human…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Kaifeng Zhao , Yan Zhang , Shaofei Wang , Thabo Beeler , Siyu Tang

Forecasting pedestrians' future motions is essential for autonomous driving systems to safely navigate in urban areas. However, existing prediction algorithms often overly rely on past observed trajectories and tend to fail around abrupt…

Computer Vision and Pattern Recognition · Computer Science 2022-03-07 Dongxu Guo , Taylor Mordan , Alexandre Alahi

The contribution of this paper is twofold. The first is a novel dataset for studying behaviors of traffic participants while crossing. Our dataset contains more than 650 samples of pedestrian behaviors in various street configurations and…

Robotics · Computer Science 2017-02-14 Amir Rasouli , Iuliia Kotseruba , John K. Tsotsos

Teleportation is one of the most common locomotion techniques in virtual reality, yet its perceptual properties remain underexplored. While redirected walking research has shown that users' movements can be subtly manipulated without…

Human-Computer Interaction · Computer Science 2026-01-15 Rose Connolly , Victor Zordan , Rachel McDonnell

Predicting the behavior of road users, particularly pedestrians, is vital for safe motion planning in the context of autonomous driving systems. Traditionally, pedestrian behavior prediction has been realized in terms of forecasting future…

Computer Vision and Pattern Recognition · Computer Science 2020-12-15 Amir Rasouli , Tiffany Yau , Peter Lakner , Saber Malekmohammadi , Mohsen Rohani , Jun Luo

Text input on mobile devices without physical keys can be challenging for people who are blind or low-vision. We interview 12 blind adults about their experiences with current mobile text input to provide insights into what sorts of…

Human-Computer Interaction · Computer Science 2025-10-03 Dylan Gaines , Keith Vertanen

Humanoid robots can, in principle, use their legs to go almost anywhere. Developing controllers capable of traversing diverse terrains, however, remains a considerable challenge. Classical controllers are hard to generalize broadly while…

Robotics · Computer Science 2024-10-07 Ilija Radosavovic , Sarthak Kamat , Trevor Darrell , Jitendra Malik

Multimodal Large Language Models (MLLMs) hold immense promise as assistive technologies for the blind and visually impaired (BVI) community. However, we identify a critical failure mode that undermines their trustworthiness in real-world…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Xiantao Zhang

As we move through the world, the pattern of light projected on our eyes is complex and dynamic, yet we are still able to distinguish between moving and stationary objects. We propose that humans accomplish this by exploiting constraints…

Neurons and Cognition · Quantitative Biology 2025-05-14 Hope Lutwak , Bas Rokers , Eero P. Simoncelli

As humans we possess an intuitive ability for navigation which we master through years of practice; however existing approaches to model this trait for diverse tasks including monitoring pedestrian flow and detecting abnormal events have…

Computer Vision and Pattern Recognition · Computer Science 2017-02-21 Tharindu Fernando , Simon Denman , Sridha Sridharan , Clinton Fookes

We use an immersive virtual reality environment to explore the intricate social cues that underlie non-verbal communication involved in a pedestrian's crossing decision. We "hack" non-verbal communication between pedestrian and vehicle by…

Human-Computer Interaction · Computer Science 2019-04-04 Henri Schmidt , Jack Terwilliger , Dina AlAdawy , Lex Fridman