English
Related papers

Related papers: Gaze-Aware Task Progression Detection Framework fo…

200 papers

Human gaze is known to be a strong indicator of underlying human intentions and goals during manipulation tasks. This work studies gaze patterns of human teachers demonstrating tasks to robots and proposes ways in which such patterns can be…

Robotics · Computer Science 2021-11-30 Akanksha Saran , Elaine Schaertl Short , Andrea Thomaz , Scott Niekum

Gaze-tracking is a novel way of interacting with computers which allows new scenarios, such as enabling people with motor-neuron disabilities to control their computers or doctors to interact with patient information without touching screen…

Artificial Intelligence · Computer Science 2020-10-13 Jatin Sharma , Jon Campbell , Pete Ansell , Jay Beavers , Christopher O'Dowd

Recent progress in robot autonomy and safety has significantly improved human-robot interactions, enabling robots to work alongside humans on various tasks. However, complex assembly tasks still present significant challenges due to…

Robotics · Computer Science 2025-07-28 Asad Ali Shahid , Angelo Moroncelli , Drazen Brscic , Takayuki Kanda , Loris Roveda

Appearance-based gaze estimation methods that only require an off-the-shelf camera have significantly improved but they are still not yet widely used in the human-computer interaction (HCI) community. This is partly because it remains…

Human-Computer Interaction · Computer Science 2019-01-31 Xucong Zhang , Yusuke Sugano , Andreas Bulling

When humans work together to complete a joint task, each person builds an internal model of the situation and how it will evolve. Efficient collaboration is dependent on how these individual models overlap to form a shared mental model…

Robotics · Computer Science 2022-08-26 Wesley P. Chan , Morgan Crouch , Khoa Hoang , Charlie Chen , Nicole Robinson , Elizabeth Croft

Service robots in public spaces require real-time understanding of human behavioral intentions for natural interaction. We present a practical multimodal framework for frame-accurate human-robot interaction intent detection that fuses…

Robotics · Computer Science 2025-12-23 Farida Mohsen , Ali Safa

In the evolving landscape of human-autonomy teaming (HAT), fostering effective collaboration and trust between human and autonomous agents is increasingly important. To explore this, we used the game Overcooked AI to create dynamic teaming…

Human-Computer Interaction · Computer Science 2025-06-18 Anthony J. Ries , Stéphane Aroca-Ouellette , Alessandro Roncone , Ewart J. de Visser

Eye gaze can provide rich information on human psychological activities, and has garnered significant attention in the field of Human-Robot Interaction (HRI). However, existing gaze estimation methods merely predict either the gaze…

Computer Vision and Pattern Recognition · Computer Science 2025-05-23 Haoming Huang , Musen Zhang , Jianxin Yang , Zhen Li , Jinkai Li , Yao Guo

Collaborative robots (cobots) are widely used in industrial applications, yet extensive research is still needed to enhance human-robot collaborations and operator experience. A potential approach to improve the collaboration experience…

This study presents a framework for capturing human attention in the spatio-temporal domain using eye-tracking glasses. Attention mapping is a key technology for human perceptual activity analysis or Human-Robot Interaction (HRI) to support…

Robotics · Computer Science 2021-07-09 Shuji Oishi , Kenji Koide , Masashi Yokozuka , Atsuhiko Banno

With the advancements in human-robot interaction (HRI), robots are now capable of operating in close proximity and engaging in physical interactions with humans (pHRI). Likewise, contact-based pHRI is becoming increasingly common as robots…

Robotics · Computer Science 2024-07-31 Mohammad Farajtabar , Marie Charbonneau

As human eyes serve as conduits of rich information, unveiling emotions, intentions, and even aspects of an individual's health and overall well-being, gaze tracking also enables various human-computer interaction applications, as well as…

Computer Vision and Pattern Recognition · Computer Science 2024-12-16 Sikai Yang , Wan Du

Effective error detection is crucial to prevent task disruption and maintain user trust. Traditional methods often rely on task-specific models or user reporting, which can be inflexible or slow. Recent research suggests social signals,…

Robotics · Computer Science 2025-01-14 Maia Stiber , Russell Taylor , Chien-Ming Huang

Online recognition of gestures is critical for intuitive human-robot interaction (HRI) and further push collaborative robotics into the market, making robots accessible to more people. The problem is that it is difficult to achieve accurate…

Robotics · Computer Science 2023-04-17 M. A. Simão , O. Gibaru , P. Neto

Detecting robot failures during collaborative tasks is crucial for maintaining trust in human-robot interactions. This study investigates user gaze behaviour as an indicator of robot failures, utilising machine learning models to…

Human-Computer Interaction · Computer Science 2025-03-12 Ramtin Tabatabaei , Vassilis Kostakos , Wafa Johal

Individuals with upper limb mobility impairments often require assistive technologies to perform activities of daily living. While gaze-tracking has emerged as a promising method for robotic assistance, existing solutions lack sufficient…

Robotics · Computer Science 2025-05-08 Rafael R. Baptista , Nina R. Gerszberg , Ricardo V. Godoy , Gustavo J. G. Lahr

Robot facial expressions and gaze are important factors for enhancing human-robot interaction (HRI), but their effects on human collaboration and perception are not well understood, for instance, in collaborative game scenarios. In this…

Robotics · Computer Science 2023-03-28 Di Fu , Fares Abawi , Stefan Wermter

Human-robot interaction (HRI) has become a crucial enabler in houses and industries for facilitating operational flexibility. When it comes to mobile collaborative robots, this flexibility can be further increased due to the autonomous…

Human eye gaze plays an important role in delivering information, communicating intent, and understanding others' mental states. Previous research shows that a robot's gaze can also affect humans' decision-making and strategy during an…

Robotics · Computer Science 2022-08-26 Di Fu , Fares Abawi , Erik Strahl , Stefan Wermter

Natural Human-Robot Interaction (HRI) is one of the key components for service robots to be able to work in human-centric environments. In such dynamic environments, the robot needs to understand the intention of the user to accomplish a…

Computer Vision and Pattern Recognition · Computer Science 2021-04-01 Giorgos Tziafas , Hamidreza Kasaei