English
Related papers

Related papers: Gaze-based Attention Recognition for Human-Robot C…

200 papers

Inspired by the human cognitive system, attention is a mechanism that imitates the human cognitive awareness about specific information, amplifying critical details to focus more on the essential aspects of data. Deep learning has employed…

Computer Vision and Pattern Recognition · Computer Science 2024-05-07 Mohammed Hassanin , Saeed Anwar , Ibrahim Radwan , Fahad S Khan , Ajmal Mian

Despite the advent of autonomous cars, it's likely - at least in the near future - that human attention will still maintain a central role as a guarantee in terms of legal responsibility during the driving task. In this paper we study the…

Computer Vision and Pattern Recognition · Computer Science 2017-05-10 Andrea Palazzi , Francesco Solera , Simone Calderara , Stefano Alletto , Rita Cucchiara

Learning generalizable skills in robotic manipulation has long been challenging due to real-world sized observation and action spaces. One method for addressing this problem is attention focus -- the robot learns where to attend its sensors…

Robotics · Computer Science 2020-03-05 Marcus Gualtieri , Robert Platt

It is well known that human gaze carries significant information about visual attention. However, there are three main difficulties in incorporating the gaze data in an attention mechanism of deep neural networks: 1) the gaze fixation…

Computer Vision and Pattern Recognition · Computer Science 2020-11-10 Kyle Min , Jason J. Corso

Driver gaze plays an important role in different gaze-based applications such as driver attentiveness detection, visual distraction detection, gaze behavior understanding, and building driver assistance system. The main objective of this…

Computer Vision and Pattern Recognition · Computer Science 2024-02-22 Pavan Kumar Sharma , Pranamesh Chakraborty

Eye-tracking has potential to provide rich behavioral data about human cognition in ecologically valid environments. However, analyzing this rich data is often challenging. Most automated analyses are specific to simplistic artificial…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Karan Uppal , Jaeah Kim , Shashank Singh

Predicting driver attention is a critical problem for developing explainable autonomous driving systems and understanding driver behavior in mixed human-autonomous vehicle traffic scenarios. Although significant progress has been made…

Computer Vision and Pattern Recognition · Computer Science 2026-03-06 Shreedhar Govil , Didier Stricker , Jason Rambach

This paper addresses the challenging problem of estimating the general visual attention of people in images. Our proposed method is designed to work across multiple naturalistic social scenarios and provides a full picture of the subject's…

Computer Vision and Pattern Recognition · Computer Science 2018-07-30 Eunji Chong , Nataniel Ruiz , Yongxin Wang , Yun Zhang , Agata Rozga , James Rehg

Employing skin-like tactile sensors on robots enhances both the safety and usability of collaborative robots by adding the capability to detect human contact. Unfortunately, simple binary tactile sensors alone cannot determine the context…

Robotics · Computer Science 2023-04-20 Christopher Yee Wong , Lucas Vergez , Wael Suleiman

The primary objective of the dataset is to provide a better understanding of the coupling between human actions and gaze in a shared working environment with a cobot, with the aim of signifcantly enhancing the effciency and safety of…

Robotics · Computer Science 2025-03-17 Maxence Grand , Damien Pellier , Francis Jambon

Human safety has always been the main priority when working near an industrial robot. With the rise of Human-Robot Collaborative environments, physical barriers to avoiding collisions have been disappearing, increasing the risk of accidents…

Imitation learning for acquiring generalizable policies often requires a large volume of demonstration data, making the process significantly costly. One promising strategy to address this challenge is to leverage the cognitive and…

Robotics · Computer Science 2025-06-09 Yutaro Ishida , Takamitsu Matsubara , Takayuki Kanai , Kazuhiro Shintani , Hiroshi Bito

Human-robot collaborative assembly systems enhance the efficiency and productivity of the workplace but may increase the workers' cognitive demand. This paper proposes an online and quantitative framework to assess the cognitive workload…

Robotics · Computer Science 2022-07-11 Marta Lagomarsino , Marta Lorenzini , Pietro Balatti , Elena De Momi , Arash Ajoudani

Driver inattention assessment has become a very active field in intelligent transportation systems. Based on active sensor Kinect and computer vision tools, we have built an efficient module for detecting driver distraction and recognizing…

Computer Vision and Pattern Recognition · Computer Science 2015-02-03 Céline Craye , Fakhri Karray

Recurrent neural networks with differentiable attention mechanisms have had success in generative and classification tasks. We show that the classification performance of such models can be enhanced by guiding a randomly initialized model…

Machine Learning · Computer Science 2017-12-18 Jack Lindsey

The advent of autonomous driving systems promises to transform transportation by enhancing safety, efficiency, and comfort. As these technologies evolve toward higher levels of autonomy, the need for integrated systems that seamlessly…

Robotics · Computer Science 2025-08-19 Yousra Shleibik , Jordan Sinclair , Kerstin Haring

The way humans attend to, process and classify a given image has the potential to vastly benefit the performance of deep learning models. Exploiting where humans are focusing can rectify models when they are deviating from essential…

Computer Vision and Pattern Recognition · Computer Science 2021-11-03 Yao Rong , Wenjia Xu , Zeynep Akata , Enkelejda Kasneci

In imitation learning for robotic manipulation, decomposing object manipulation tasks into sub-tasks enables the reuse of learned skills and the combination of learned behaviors to perform novel tasks, rather than simply replicating…

Robotics · Computer Science 2025-02-28 Ryo Takizawa , Yoshiyuki Ohmura , Yasuo Kuniyoshi

Robotic manipulation in complex open-world scenarios requires both reliable physical manipulation skills and effective and generalizable perception. In this paper, we propose a method where general purpose pretrained visual models serve as…

Robotics · Computer Science 2017-09-27 Coline Devin , Pieter Abbeel , Trevor Darrell , Sergey Levine

Previous studies have illustrated the potential of analysing gaze behaviours in collaborative learning to provide educationally meaningful information for students to reflect on their learning. Over the past decades, machine learning…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Junyuan Liang , Qi Zhou , Sahan Bulathwela , Mutlu Cukurova