English
Related papers

Related papers: MIHRaGe: A Mixed-Reality Interface for Human-Robot…

200 papers

Gaze-tracking is a novel way of interacting with computers which allows new scenarios, such as enabling people with motor-neuron disabilities to control their computers or doctors to interact with patient information without touching screen…

Artificial Intelligence · Computer Science 2020-10-13 Jatin Sharma , Jon Campbell , Pete Ansell , Jay Beavers , Christopher O'Dowd

A promising effective human-robot interaction in assistive robotic systems is gaze-based control. However, current gaze-based assistive systems mainly help users with basic grasping actions, offering limited support. Moreover, the…

Robotics · Computer Science 2025-08-20 Zejia Zhang , Bo Yang , Xinxing Chen , Weizhuang Shi , Haoyuan Wang , Wei Luo , Jian Huang

This study presents a novel framework for 3D gaze tracking tailored for mixed-reality settings, aimed at enhancing joint attention and collaborative efforts in team-based scenarios. Conventional gaze tracking, often limited by monocular…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Eduardo Davalos , Yike Zhang , Ashwin T. S. , Joyce H. Fonteles , Umesh Timalsina , Guatam Biswas

Extended Reality (XR) interfaces impose both ergonomic and cognitive demands, yet current systems often force a binary choice between hand-based input, which can produce fatigue, and gaze-based input, which is vulnerable to the Midas Touch…

Human-Computer Interaction · Computer Science 2026-03-18 Mohammad Dastgheib , Fatemeh Pourmahdian

The human gaze is an important cue to signal intention, attention, distraction, and the regions of interest in the immediate surroundings. Gaze tracking can transform how robots perceive, understand, and react to people, enabling new modes…

Robotics · Computer Science 2024-06-11 Tim Schreiter , Andrey Rudenko , Martin Magnusson , Achim J. Lilienthal

Mobile gaze tracking faces a fundamental challenge: maintaining accuracy as users naturally change their postures and device orientations. Traditional calibration approaches, like one-off, fail to adapt to these dynamic conditions, leading…

Human-Computer Interaction · Computer Science 2025-06-06 Yaxiong Lei , Mingyue Zhao , Yuheng Wang , Shijing He , Yusuke Sugano , Mohamed Khamis , Juan Ye

Gaze tracking is a useful human-to-computer interface, which plays an increasingly important role in a range of mobile applications. Gaze calibration is an indispensable component of gaze tracking, which transforms the eye coordinates to…

Human-Computer Interaction · Computer Science 2022-10-03 Songzhou Yang , Meng Jin , Yuan He

Robotics has shown significant potential in assisting people with disabilities to enhance their independence and involvement in daily activities. Indeed, a societal long-term impact is expected in home-care assistance with the deployment of…

Robotics · Computer Science 2025-03-21 Davide Torielli , Liana Bertoni , Luca Muratore , Nikos Tsagarakis

As head-mounted displays (HMDs) with eye-tracking become increasingly accessible, the need for effective gaze-based interfaces in virtual reality (VR) grows. Traditional gaze- or hand-based navigation often limits user precision or impairs…

Human-Computer Interaction · Computer Science 2025-04-03 Mona Zavichi , André Santos , Catarina Moreira , Anderson Maciel , Joaquim Jorge

Ophthalmic surgical robots offer superior stability and precision by reducing the natural hand tremors of human surgeons, enabling delicate operations in confined surgical spaces. Despite the advancements in developing vision- and…

Robotics · Computer Science 2025-07-02 Tinghe Hong , Shenlin Cai , Boyang Li , Kai Huang

Shared control improves Human-Robot Interaction by reducing the user's workload and increasing the robot's autonomy. It allows robots to perform tasks under the user's supervision. Current eye-tracking-driven approaches face several…

Robotics · Computer Science 2026-01-27 Anke Fischer-Janzen , Thomas M. Wendt , Kristof Van Laerhoven

The gaze of a person tends to reflect their interest. This work explores what happens when this statement is taken literally and applied to robots. Here we present a robot system that employs a moving robot head with a screen-based eye…

Robotics · Computer Science 2025-11-05 Matti Krüger , Daniel Tanneberg , Chao Wang , Stephan Hasler , Michael Gienger

Social robots must adjust to human proxemic norms to ensure user comfort and engagement. While prior research demonstrates that eye-tracking features reliably estimate comfort in human-human interactions, their applicability to interactions…

Robotics · Computer Science 2025-12-11 Nadezhda Kushina , Ko Watanabe , Aarthi Kannan , Ashita Ashok , Andreas Dengel , Karsten Berns

This study evaluates the performance and usability of Mixed Reality (MR), Virtual Reality (VR), and camera stream interfaces for remote error resolution tasks, such as correcting warehouse packaging errors. Specifically, we consider a…

Robotics · Computer Science 2025-04-22 Advay Kumar , Stephanie Simangunsong , Pamela Carreno-Medrano , Akansel Cosgun

Leveraging auditory and visual feedback for attention reorientation is essential for natural gaze shifts in social interaction. However, enabling humanoid robots to perform natural and context-appropriate gaze shifts in unconstrained…

Robotics · Computer Science 2026-02-26 Jingchao Wei , Jingkai Qin , Yuxiao Cao , Jingcheng Huang , Xiangrui Zeng , Min Li , Zhouping Yin

Work environments are often inadequate and lack inclusivity for individuals with upper-body disabilities. This paper presents a novel online framework for adaptive human-robot interaction (HRI) that accommodates users' arm mobility…

Robotics · Computer Science 2025-10-08 Marta Lagomarsino , Francesco Tassi

Human gaze is known to be a strong indicator of underlying human intentions and goals during manipulation tasks. This work studies gaze patterns of human teachers demonstrating tasks to robots and proposes ways in which such patterns can be…

Robotics · Computer Science 2021-11-30 Akanksha Saran , Elaine Schaertl Short , Andrea Thomaz , Scott Niekum

Mobile gaze tracking involves inferring a user's gaze point or direction on a mobile device's screen from facial images captured by the device's front camera. While this technology inspires an increasing number of gaze-interaction…

Human-Computer Interaction · Computer Science 2025-05-30 Yaxiong Lei , Yuheng Wang , Fergus Buchanan , Mingyue Zhao , Yusuke Sugano , Shijing He , Mohamed Khamis , Juan Ye

The growing use of robots in urban environments has raised concerns about potential safety hazards, especially in public spaces where humans and robots may interact. In this paper, we present a system for safe human-robot interaction that…

Tactile sensing is critical to fine-grained, contact-rich manipulation tasks, such as insertion and assembly. Prior research has shown the possibility of learning tactile-guided policy from teleoperated demonstration data. However, to…

Robotics · Computer Science 2025-02-07 Kelin Yu , Yunhai Han , Qixian Wang , Vaibhav Saxena , Danfei Xu , Ye Zhao