English
Related papers

Related papers: Modeling User Behaviors in Machine Operation Tasks…

200 papers

In practical applications, computer vision tasks often need to be addressed simultaneously. Multitask learning typically achieves this by jointly training a single deep neural network to learn shared representations, providing efficiency…

Computer Vision and Pattern Recognition · Computer Science 2025-05-26 Konstantinos Spathis , Nikolaos Kardaris , Petros Maragos

Adaptive control for real-time manipulation requires quick estimation and prediction of object properties. While robot learning in this area primarily focuses on using vision, many tasks cannot rely on vision due to object occlusion. Here,…

Robotics · Computer Science 2021-10-12 Ahalya Prabhakar , Stanislas Furrer , Lorenzo Panchetti , Maxence Perret , Aude Billard

Human motion prediction is non-trivial in modern industrial settings. Accurate prediction of human motion can not only improve efficiency in human robot collaboration, but also enhance human safety in close proximity to robots. Among…

Robotics · Computer Science 2020-01-28 Weiye Zhao , Liting Sun , Changliu Liu , Masayoshi Tomizuka

We advance a novel computational model of multi-agent, cooperative joint actions that is grounded in the cognitive framework of active inference. The model assumes that to solve a joint task, such as pressing together a red or blue button,…

Artificial Intelligence · Computer Science 2024-02-27 Domenico Maisto , Francesco Donnarumma , Giovanni Pezzulo

Understanding human activities and object affordances are two very important skills, especially for personal robots which operate in human environments. In this work, we consider the problem of extracting a descriptive labeling of the…

Robotics · Computer Science 2013-05-07 Hema Swetha Koppula , Rudhir Gupta , Ashutosh Saxena

Open, or non-laparoscopic surgery, represents the vast majority of all operating room procedures, but few tools exist to objectively evaluate these techniques at scale. Current efforts involve human expert-based visual assessment. We…

Computer Vision and Pattern Recognition · Computer Science 2020-12-15 Michael Zhang , Xiaotian Cheng , Daniel Copeland , Arjun Desai , Melody Y. Guan , Gabriel A. Brat , Serena Yeung

Human activity recognition (HAR) is essential for effective Human-Robot Collaboration (HRC), enabling robots to interpret and respond to human actions. This study evaluates the ability of a vision-based tactile sensor to classify 15…

This work aims to tackle the intent recognition problem in Human-Robot Collaborative assembly scenarios. Precisely, we consider an interactive assembly of a wooden stool where the robot fetches the pieces in the correct order and the human…

Tool use is essential for enabling robots to perform complex real-world tasks, but learning such skills requires extensive datasets. While teleoperation is widely used, it is slow, delay-sensitive, and poorly suited for dynamic tasks. In…

Robotics · Computer Science 2025-09-16 Haonan Chen , Cheng Zhu , Shuijing Liu , Yunzhu Li , Katherine Driggs-Campbell

Modelling interactions between humans and objects in natural environments is central to many applications including gaming, virtual and mixed reality, as well as human behavior analysis and human-robot collaboration. This challenging…

Computer Vision and Pattern Recognition · Computer Science 2022-04-15 Bharat Lal Bhatnagar , Xianghui Xie , Ilya A. Petrov , Cristian Sminchisescu , Christian Theobalt , Gerard Pons-Moll

We present a survey of recent research studies of the implementation of adaptive user models in human-computer interaction. A classification of research directions on adaptive user interfaces is first proposed; it takes account of the user…

Human-Computer Interaction · Computer Science 2007-08-29 Jérôme Simonin , Noëlle Carbonell

The anticipation of human behavior is a crucial capability for robots to interact with humans safely and efficiently. We employ a smart edge sensor network to provide global observations, future predictions, and goal information to…

Robotics · Computer Science 2025-09-16 Simon Bultmann , Raphael Memmesheimer , Jan Nogga , Julian Hau , Sven Behnke

Human activity recognition based on wearable sensor data has been an attractive research topic due to its application in areas such as healthcare and smart environments. In this context, many works have presented remarkable results using…

Computer Vision and Pattern Recognition · Computer Science 2019-02-04 Artur Jordao , Antonio C. Nazare , Jessica Sena , William Robson Schwartz

This work presents a methodology for modeling and predicting human behavior in settings with N humans interacting in highly multimodal scenarios (i.e. where there are many possible highly-distinct futures). A motivating example includes…

Robotics · Computer Science 2018-07-27 Boris Ivanovic , Edward Schmerling , Karen Leung , Marco Pavone

Assistive machines endow people with limited mobility the opportunity to live more independently. However, operating these machines poses risks to the safety of the human operator as well as the surrounding environment. Thus, proper user…

Human-Computer Interaction · Computer Science 2022-05-19 Mahdieh Nejati Javaremi , Sisilia Sinaga , Yuming Jin , Matthew L. Elwin , Brenna Argall

The problem of human activity recognition is central for understanding and predicting the human behavior, in particular in a prospective of assistive services to humans, such as health monitoring, well being, security, etc. There is…

Machine Learning · Statistics 2013-12-30 Faicel Chamroukhi , Samer Mohammed , Dorra Trabelsi , Latifa Oukhellou , Yacine Amirat

Objective: We examine how human operators adjust their trust in automation as a result of their moment-to-moment interaction with automation. Background: Most existing studies measured trust by administering questionnaires at the end of an…

Human-Computer Interaction · Computer Science 2021-07-16 X. Jessie Yang , Christopher Schemanske , Christine Searle

In real-world scene perception human observers generate sequences of fixations to move image patches into the high-acuity center of the visual field. Models of visual attention developed over the last 25 years aim to predict two-dimensional…

Neurons and Cognition · Quantitative Biology 2022-08-15 Lisa Schwetlick , Daniel Backhaus , Ralf Engbert

Adaptive task planning is fundamental to ensuring effective and seamless human-robot collaboration. This paper introduces a robot task planning framework that takes into account both human leading/following preferences and performance,…

Robotics · Computer Science 2025-07-22 Ali Noormohammadi-Asl , Stephen L. Smith , Kerstin Dautenhahn

Users of shared control systems change their behavior in the presence of assistance, which conflicts with assumpts about user behavior that some assistance methods make. In this paper, we propose an analysis technique to evaluate the user's…

Robotics · Computer Science 2024-08-23 Reuben M. Aronson , Elaine Schaertl Short