English
Related papers

Related papers: Emotional Storytelling using Virtual and Robotic A…

200 papers

To foster effective human-agent interactions, designers must understand how vocal cues influence the perception of agent personality and the role of user-agent alignment in shaping these perceptions. In this work, we examine whether users…

This article provides the first survey of computational models of emotion in reinforcement learning (RL) agents. The survey focuses on agent/robot emotions, and mostly ignores human user emotions. Emotions are recognized as functional in…

Machine Learning · Computer Science 2017-11-30 Thomas M. Moerland , Joost Broekens , Catholijn M. Jonker

Recognition of social signals, from human facial expressions or prosody of speech, is a popular research topic in human-robot interaction studies. There is also a long line of research in the spoken dialogue community that investigates user…

Robotics · Computer Science 2017-06-12 Jekaterina Novikova , Christian Dondrup , Ioannis Papaioannou , Oliver Lemon

Conversational practice, while crucial for all language learners, can be challenging to get enough of and very expensive. Chatbots are computer programs developed to engage in conversations with humans. They are designed as software avatars…

Human-Computer Interaction · Computer Science 2020-11-17 Jasna Petrovic , Mladjan Jovanovic

AI is promising in assisting UX evaluators with analyzing usability tests, but its judgments are typically presented as non-interactive visualizations. Evaluators may have questions about test recordings, but have no way of asking them.…

Human-Computer Interaction · Computer Science 2023-03-08 Emily Kuang , Ehsan Jahangirzadeh Soure , Mingming Fan , Jian Zhao , Kristen Shinohara

Conversational agents (CAs) are revolutionizing human-computer interaction by evolving from text-based chatbots to empathetic digital humans (DHs) capable of rich emotional expressions. This paper explores the integration of neural and…

Human-Computer Interaction · Computer Science 2025-08-11 Nastaran Saffaryazdi , Tamil Selvan Gunasekaran , Kate Laveys , Elizabeth Broadbent , Mark Billinghurst

Driven by ongoing improvements in machine learning, chatbots have increasingly grown from experimental interface prototypes to reliable and robust tools for process automation. Building on these advances, companies have identified various…

Human-Computer Interaction · Computer Science 2023-02-02 Alessandro Casadei , Stephan Schlögl , Markus Bergmann

A common vision from science fiction is that robots will one day inhabit our physical spaces, sense the world as we do, assist our physical labours, and communicate with us through natural language. Here we study how to design artificial…

When engaging in conversations, dialogue agents in a virtual simulation environment may exhibit their own emotional states that are unrelated to the immediate conversational context, a phenomenon known as self-emotion. This study explores…

Multiagent Systems · Computer Science 2024-08-06 Qiang Zhang , Jason Naradowsky , Yusuke Miyao

Conversational agents have made significant progress since ELIZA, expanding their role across various domains, including healthcare, education, and customer service. As these agents become increasingly integrated into daily human…

Human-Computer Interaction · Computer Science 2025-07-04 Paulo Ricardo Knob , Leonardo Scholler , Juliano Rigatti , Soraia Raupp Musse

To cooperate with humans effectively, virtual agents need to be able to understand and execute language instructions. A typical setup to achieve this is with a scripted teacher which guides a virtual agent using language instructions.…

Computation and Language · Computer Science 2019-08-15 Mathijs Mul , Diane Bouchacourt , Elia Bruni

Equipping robotic faces with singing capabilities is crucial for empathetic Human-Robot Interaction. However, existing robotic face driving research primarily focuses on conversations or mimicking static expressions, struggling to meet the…

Robotics · Computer Science 2026-01-06 Zhuoxiong Xu , Xuanchen Li , Yuhao Cheng , Fei Xu , Yichao Yan , Xiaokang Yang

The mental models that humans form of other agents---encapsulating human beliefs about agent goals, intentions, capabilities, and more---create an underlying basis for interaction. These mental models have the potential to affect both the…

Robotics · Computer Science 2020-01-07 Connor Brooks , Daniel Szafir

This paper describes an experimental evaluation aimed at detecting the users' perception of the robot's empathic abilities during a conversation. The results have been then analyzed to search for a possible relationship between the…

Robotics · Computer Science 2024-05-03 Alberto Lillo , Alessandro Saracco , Elena Siletto , Claudio Mattutino , Cristina Gena

Traditional visual storytelling is complex, requiring specialized knowledge and substantial resources, yet often constrained by human creativity and creation precision. While Large Language Models (LLMs) enhance visual storytelling, current…

Computer Vision and Pattern Recognition · Computer Science 2024-08-22 Yuzhou Huang , Yiran Qin , Shunlin Lu , Xintao Wang , Rui Huang , Ying Shan , Ruimao Zhang

A good dialogue agent should have the ability to interact with users by both responding to questions and by asking questions, and importantly to learn from both types of interaction. In this work, we explore this direction by designing a…

Computation and Language · Computer Science 2017-02-14 Jiwei Li , Alexander H. Miller , Sumit Chopra , Marc'Aurelio Ranzato , Jason Weston

In general, self help systems are being increasingly deployed by service based industries because they are capable of delivering better customer service and increasingly the switch is to voice based self help systems because they provide a…

Computation and Language · Computer Science 2015-04-08 Sunil Kumar Kopparapu

One of the main challenges with embodying a conversational agent is annotating how and when motions can be played and composed together in real-time, without any visual artifact. The inherent problem is to do so---for a large amount of…

Human-Computer Interaction · Computer Science 2019-03-14 Dominik Borer , Dominik Lutz , Martin Guay

As robotic arms become prevalent in industry it is crucial to improve levels of trust from human collaborators. Low levels of trust in human-robot interaction can reduce overall performance and prevent full robot utilization. We…

Robotics · Computer Science 2020-09-22 Richard Savery , Lisa Zahray , Gil Weinberg

Creativity is increasingly recognized as an important skill in education, and storytelling can enhance motivation and engagement among students. However, conventional storytelling methods often lack the interactive elements necessary to…

Human-Computer Interaction · Computer Science 2026-01-06 Ka Yan Fung , Tze Leung Rick Lui , Yuxing Tao , Kuen Fung Sin