English
Related papers

Related papers: Incorporating Gaze into Social Navigation

200 papers

We present a novel human-aware navigation approach, where the robot learns to mimic humans to navigate safely in crowds. The presented model, referred to as DeepMoTIon, is trained with pedestrian surveillance data to predict human velocity…

Robotics · Computer Science 2019-08-05 Mahmoud Hamandi , Mike D'Arcy , Pooyan Fazli

The distance at which a mobile robot reacts to a person strongly impacts various qualities of the human-robot interaction. In this paper, we focus on the navigation of a mobile delivery robot platform in a residential indoor hallway…

Robotics · Computer Science 2026-05-27 Akira Shiba , Marina Obata , Nathan Kau , Zoltan Beck , Rishi Shah , Michael Sudano , Sabrina Lee

This work presents a next-generation human-robot interface that can infer and realize the user's manipulation intention via sight only. Specifically, we develop a system that integrates near-eye-tracking and robotic manipulation to enable…

Robotics · Computer Science 2023-05-16 Shaochen Wang , Wei Zhang , Zhangli Zhou , Jiaxi Cao , Ziyang Chen , Kang Chen , Bin Li , Zhen Kan

Despite the advent of autonomous cars, it's likely - at least in the near future - that human attention will still maintain a central role as a guarantee in terms of legal responsibility during the driving task. In this paper we study the…

Computer Vision and Pattern Recognition · Computer Science 2017-05-10 Andrea Palazzi , Francesco Solera , Simone Calderara , Stefano Alletto , Rita Cucchiara

This paper addresses a new problem of understanding human gaze communication in social videos from both atomic-level and event-level, which is significant for studying human social interactions. To tackle this novel and challenging problem,…

Computer Vision and Pattern Recognition · Computer Science 2019-09-06 Lifeng Fan , Wenguan Wang , Siyuan Huang , Xinyu Tang , Song-Chun Zhu

This work proposes a biologically inspired approach that focuses on attention systems that are able to inhibit or constrain what is relevant at any one moment. We propose a radically new approach to making progress in human-robot joint…

Robotics · Computer Science 2016-06-09 Nick DePalma , Cynthia Breazeal

The study of rodent social behavior has shifted in the last years from relying on direct human observation to more nuanced approaches integrating computational methods in artificial intelligence (AI) and machine learning. While conventional…

Computer Vision and Pattern Recognition · Computer Science 2025-08-07 Giuseppe Chindemi , Camilla Bellone , Benoit Girard

Prediction of human motions is key for safe navigation of autonomous robots among humans. In cluttered environments, several motion hypotheses may exist for a pedestrian, due to its interactions with the environment and other pedestrians.…

Robotics · Computer Science 2020-11-17 Bruno Brito , Hai Zhu , Wei Pan , Javier Alonso-Mora

The eyes play an important role in human collaboration. Mutual and shared gaze help communicate visual attention to each other or to a specific object of interest. Shared gaze was typically investigated for pair collaborations in remote…

Mobile telepresence robots (MTRs) have become increasingly popular in the expanding world of remote work, providing new avenues for people to actively participate in activities at a distance. However, humans operating MTRs often have…

Robotics · Computer Science 2022-10-19 Kenechukwu C. Mbanisi , Michael A. Gennert

Analyzing and forecasting trajectories of agents like pedestrians and cars in complex scenes has become more and more significant in many intelligent systems and applications. The diversity and uncertainty in socially interactive behaviors…

Computer Vision and Pattern Recognition · Computer Science 2024-03-27 Conghao Wong , Beihao Xia , Ziqian Zou , Yulong Wang , Xinge You

It is important for socially assistive robots to be able to recognize when a user needs and wants help. Such robots need to be able to recognize human needs in a real-time manner so that they can provide timely assistance. We propose an…

Robotics · Computer Science 2021-10-22 Jason R. Wilson , Phyo Thuta Aung , Isabelle Boucher

Service robots that work alongside humans in a shared environment need a navigation system that takes into account not only physical safety but also social norms for mutual cooperation. In this paper, we introduce a motion planning system…

Eye gaze analysis is an important research problem in the field of Computer Vision and Human-Computer Interaction. Even with notable progress in the last 10 years, automatic gaze analysis still remains challenging due to the uniqueness of…

Computer Vision and Pattern Recognition · Computer Science 2022-07-22 Shreya Ghosh , Abhinav Dhall , Munawar Hayat , Jarrod Knibbe , Qiang Ji

Attention (and distraction) recognition is a key factor in improving human-robot collaboration. We present an assembly scenario where a human operator and a cobot collaborate equally to piece together a gearbox. The setup provides multiple…

Human-Computer Interaction · Computer Science 2023-04-03 Pooja Prajod , Matteo Lavit Nicora , Matteo Malosio , Elisabeth André

Pedestrian trajectory prediction for surveillance video is one of the important research topics in the field of computer vision and a key technology of intelligent surveillance systems. Social relationship among pedestrians is a key factor…

Computer Vision and Pattern Recognition · Computer Science 2021-04-01 Yusheng Peng , Gaofeng Zhang , Jun Shi , Benzhu Xu , Liping Zheng

Moving groups are routinely faced with a choice of different routes as part of their daily lives, such as choosing between exits from a building. Differences in moving speeds and environmental constraints often lead to individuals being…

Physics and Society · Physics 2025-12-16 Anna Sigalou , Yunhe Tong , Charlie Pilgrim , Richard P. Mann , Nikolai W. F. Bode

Robots are increasingly being deployed in public spaces such as shopping malls, sidewalks, and hospitals, where safe and socially aware navigation depends on anticipating how pedestrians respond to their presence. However, existing datasets…

Human-Computer Interaction · Computer Science 2026-03-06 Subham Agrawal , Nico Ostermann-Myrau , Nils Dengler , Maren Bennewitz

Recently, research in human-robot interaction began to consider a robot's influence at the group level. Despite the recent growth in research investigating the effects of robots within groups of people, our overall understanding of what…

Human-Computer Interaction · Computer Science 2023-12-22 Tung Nguyen , Eric Nichols , Randy Gomez

We present our current research on the implementation of gaze as an efficient and usable pointing modality supplementary to speech, for interacting with augmented objects in our daily environment or large displays, especially immersive…

Human-Computer Interaction · Computer Science 2007-08-28 Daniel Gepner , Jérôme Simonin , Noëlle Carbonell