English
Related papers

Related papers: "Why the face?": Exploring Robot Error Detection U…

200 papers

Humans make complex inferences on faces, ranging from objective properties (gender, ethnicity, expression, age, identity, etc) to subjective judgments (facial attractiveness, trustworthiness, sociability, friendliness, etc). While the…

Computer Vision and Pattern Recognition · Computer Science 2017-05-12 Amanda Song , Linjie Li , Chad Atalla , Garrison Cottrell

As social service robots become commonplace, it is essential for them to effectively interpret human signals, such as verbal, gesture, and eye gaze, when people need to focus on their primary tasks to minimize interruptions and…

Human-Computer Interaction · Computer Science 2025-04-09 Hanfang Lyu , Xiaoyu Wang , Nandi Zhang , Shuai Ma , Qian Zhu , Yuhan Luo , Fugee Tsung , Xiaojuan Ma

People interacting with voice assistants are often frustrated by voice assistants' frequent errors and inability to respond to backchannel cues. We introduce an open-source video dataset of 21 participants' interactions with a voice…

Human-Computer Interaction · Computer Science 2021-04-16 Andrea Cuadra , Hansol Lee , Jason Cho , Wendy Ju

Social interactions often emerge from subtle, fine-grained cues such as facial expressions, gaze, and gestures. However, existing methods for social interaction detection overlook such nuanced cues and primarily rely on holistic…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Dongkeun Kim , Minsu Cho , Suha Kwak

Machine learning applications in high-stakes scenarios should always operate under human oversight. Developing an optimal combination of human and machine intelligence requires an understanding of their complementarities, particularly…

Human-Computer Interaction · Computer Science 2025-02-18 Marina Estévez-Almenzar , Ricardo Baeza-Yates , Carlos Castillo

Equipping social and service robots with the ability to perceive human emotional intensities during an interaction is in increasing demand. Most of existing work focuses on determining which emotion(s) participants are expressing from…

Human-Computer Interaction · Computer Science 2019-04-23 Mingfei Sun , Yiqing Mou , Hongwen Xie , Meng Xia , Michelle Wong , Xiaojuan Ma

How do children respond to repeated robot errors? While prior research has examined adult reactions to successive robot errors, children's responses remain largely unexplored. In this study, we explore children's reactions to robot social…

Robotics · Computer Science 2026-01-05 Maria Teresa Parreira , Isabel Neto , Filipa Rocha , Wendy Ju

Our work focuses on the social reasoning capabilities of foundation models for real-world human-robot interactions. We introduce the Social Human Robot Embodied Conversation (SHREC) Dataset, a benchmark of $\sim$400 real-world human-robot…

Human-Computer Interaction · Computer Science 2026-05-13 Dong Won Lee , Yubin Kim , Denison Guvenoz , Sooyeon Jeong , Parker Malachowsky , Louis-Philippe Morency , Cynthia Breazeal , Hae Won Park

As robots enter human environments, they will be expected to accomplish a tremendous range of tasks. It is not feasible for robot designers to pre-program these behaviors or know them in advance, so one way to address this is through…

Robotics · Computer Science 2017-04-12 Cory J. Hayes , Maryam Moosaei , Laurel D. Riek

Automatic face recognition is a research area with high popularity. Many different face recognition algorithms have been proposed in the last thirty years of intensive research in the field. With the popularity of deep learning and its…

Computer Vision and Pattern Recognition · Computer Science 2022-08-10 Tiago de Freitas Pereira , Dominic Schmidli , Yu Linghu , Xinyi Zhang , Sébastien Marcel , Manuel Günther

To better interact with users, a social robot should understand the users' behavior, infer the intention, and respond appropriately. Machine learning is one way of implementing robot intelligence. It provides the ability to automatically…

Robotics · Computer Science 2022-11-01 Woo-Ri Ko , Minsu Jang , Jaeyeon Lee , Jaehong Kim

In the quest towards general artificial intelligence (AI), researchers have explored developing loss functions that act as intrinsic motivators in the absence of external rewards. This paper argues that such research has overlooked an…

Machine Learning · Computer Science 2018-08-29 Natasha Jaques , Jennifer McCleary , Jesse Engel , David Ha , Fred Bertsch , Rosalind Picard , Douglas Eck

The raise of collaborative robotics has led to wide range of sensor technologies to detect human-machine interactions: at short distances, proximity sensors detect nontactile gestures virtually occlusion-free, while at medium distances,…

Computer Vision and Pattern Recognition · Computer Science 2019-10-17 Christoph Heindl , Markus Ikeda , Gernot Stübl , Andreas Pichler , Josef Scharinger

To have a robot actively supporting a human during a collaborative task, it is crucial that robots are able to identify the current action in order to predict the next one. Common approaches make use of high-level knowledge, such as object…

Robotics · Computer Science 2017-03-08 Markus Eich , Sareh Shirazi , Gordon Wyeth

In human-robot collaboration (HRC), human trust in the robot is the human expectation that a robot executes tasks with desired performance. A higher-level trust increases the willingness of a human operator to assign tasks, share plans, and…

Robotics · Computer Science 2021-06-30 Ruijiao Luo , Chao Huang , Yuntao Peng , Boyi Song , Rui Liu

Purpose of Review: The field of humanoid robotics, perception plays a fundamental role in enabling robots to interact seamlessly with humans and their surroundings, leading to improved safety, efficiency, and user experience. This…

Robotics · Computer Science 2023-09-28 Arindam Roychoudhury , Shahram Khorshidi , Subham Agrawal , Maren Bennewitz

This research report explores the role of eye gaze in human-robot interactions and proposes a learning system for detecting objects gazed at by humans using solely visual feedback. The system leverages face detection, human attention…

Robotics · Computer Science 2025-09-16 Shiva Hanifi , Elisa Maiettini , Maria Lombardi , Lorenzo Natale

Online users often post facial images of themselves and other people on online social networks (OSNs) and other Web 2.0 platforms, which can lead to potential privacy leakage of people whose faces are included in such images. There is…

Human-Computer Interaction · Computer Science 2025-01-22 Yuqi Niu , Weidong Qiu , Peng Tang , Lifan Wang , Shuo Chen , Shujun Li , Nadin Kokciyan , Ben Niu

In the real world, robots frequently make errors, yet little is known about people's social responses to errors outside of lab settings. Prior work has shown that social signals are reliable and useful for error management in constrained…

Robotics · Computer Science 2026-02-06 Maia Stiber , Sameer Khan , Russell Taylor , Chien-Ming Huang

For robots to be accommodated in human spaces and in humans daily activities, robots should be able to understand messages from the human conversation partner. In the same light, humans must also understand the messages that are being…

Robotics · Computer Science 2013-01-01 John-John Cabibihan , Wing-Chee So , Soumo Pramanik