English
Related papers

Related papers: Nonverbal Social Behavior Generation for Social Ro…

200 papers

Given a swarm of limited-capability robots, we seek to automatically discover the set of possible emergent behaviors. Prior approaches to behavior discovery rely on human feedback or hand-crafted behavior metrics to represent and evolve…

Robotics · Computer Science 2025-02-25 Connor Mattson , Varun Raveendra , Ricardo Vega , Cameron Nowzari , Daniel S. Drew , Daniel S. Brown

We propose a promising neural network model with which to acquire a grounded representation of robot actions and the linguistic descriptions thereof. Properly responding to various linguistic expressions, including polysemous words, is an…

Robotics · Computer Science 2021-04-20 Minori Toyoda , Kanata Suzuki , Hiroki Mori , Yoshihiko Hayashi , Tetsuya Ogata

Flexible and natural nonverbal reactions to human behavior remain a challenge for socially interactive agents (SIAs) that are predominantly animated using hand-crafted rules. While recently proposed machine learning based approaches to…

Human-Computer Interaction · Computer Science 2024-02-14 Daksitha Withanage Don , Philipp Müller , Fabrizio Nunnari , Elisabeth André , Patrick Gebhard

End-to-end neural models for intelligent dialogue systems suffer from the problem of generating uninformative responses. Various methods were proposed to generate more informative responses by leveraging external knowledge. However, few…

Computation and Language · Computer Science 2019-05-22 Rongzhong Lian , Min Xie , Fan Wang , Jinhua Peng , Hua Wu

Automatically reasoning about future human behaviors is a difficult problem but has significant practical applications to assistive systems. Part of this difficulty stems from learning systems' inability to represent all kinds of behaviors.…

Computer Vision and Pattern Recognition · Computer Science 2020-04-07 Jiaqi Guan , Ye Yuan , Kris M. Kitani , Nicholas Rhinehart

In this paper, we extended the method proposed in [21] to enable humans to interact naturally with autonomous agents through vocal and textual conversations. Our extended method exploits the inherent capabilities of pre-trained large…

Robotics · Computer Science 2024-12-31 Linus Nwankwo , Elmar Rueckert

In this work, we attempt to answer a critical question: whether there exists some input sequence that will cause a well-trained discrete-space neural network sequence-to-sequence (seq2seq) model to generate egregious outputs (aggressive,…

Artificial Intelligence · Computer Science 2018-10-04 Tianxing He , James Glass

Automatic gesture generation from speech generally relies on implicit modelling of the nondeterministic speech-gesture relationship and can result in averaged motion lacking defined form. Here, we propose a database-driven approach of…

Human-Computer Interaction · Computer Science 2021-03-05 Ylva Ferstl , Michael Neff , Rachel McDonnell

As robotic systems become more and more capable of assisting humans in their everyday lives, we must consider the opportunities for these artificial agents to make their human collaborators feel unsafe or to treat them unfairly. Robots can…

Robotics · Computer Science 2022-02-08 Laura Londoño , Adrian Röfer , Tim Welschehold , Abhinav Valada

To enhance human-robot social interaction, it is essential for robots to process multiple social cues in a complex real-world environment. However, incongruency of input information across modalities is inevitable and could be challenging…

Robotics · Computer Science 2023-03-14 Di Fu , Fares Abawi , Hugo Carneiro , Matthias Kerzel , Ziwei Chen , Erik Strahl , Xun Liu , Stefan Wermter

Deep reinforcement learning has recently been widely applied in robotics to study tasks such as locomotion and grasping, but its application to social human-robot interaction (HRI) remains a challenge. In this paper, we present a deep…

Robotics · Computer Science 2019-08-13 Yuan Gao , Fangkai Yang , Martin Frisk , Daniel Hernandez , Christopher Peters , Ginevra Castellano

Language generation models' democratization benefits many domains, from answering health-related questions to enhancing education by providing AI-driven tutoring services. However, language generation models' democratization also makes it…

Computation and Language · Computer Science 2021-06-03 Paras Bhatt , Anthony Rios

Social robots are expected to be a human labor support technology, and one application of them is an advertising medium in public spaces. When social robots provide information, such as recommended shops, adaptive communication according to…

Robotics · Computer Science 2022-06-07 Taichi Sakaguchi , Yuki Okafuji , Kohei Matsumura , Jun Baba , Junya Nakanishi

Conventional behavior cloning (BC) models often struggle to replicate the subtleties of human actions. Previous studies have attempted to address this issue through the development of a new BC technique: Implicit Behavior Cloning (IBC).…

Robotics · Computer Science 2025-01-22 Antonio Lech Martin-Ozimek , Isuru Jayarathne , Su Larb Mon , Jouhyeong Chew

Effective human-robot interaction requires robots to identify human intentions and generate expressive, socially appropriate motions in real-time. Existing approaches often rely on fixed motion libraries or computationally expensive…

Robotics · Computer Science 2025-09-30 Lingfan Bao , Yan Pan , Tianhu Peng , Dimitrios Kanoulas , Chengxu Zhou

In this paper, we discuss the formalized approach for generating and estimating symbols (and alphabets), which can be communicated by the wide range of non-verbal means based on specific user requirements (medium, priorities, type of…

Human-Computer Interaction · Computer Science 2017-12-13 Serhii Hamotskyi , Sergii Stirenko , Yuri Gordienko , Anis Rojbi

Neural question generation (NQG) is the task of generating a question from a given passage with deep neural networks. Previous NQG models suffer from a problem that a significant proportion of the generated questions include words in the…

Computation and Language · Computer Science 2018-11-20 Yanghoon Kim , Hwanhee Lee , Joongbo Shin , Kyomin Jung

Robot swarms often exhibit emergent behaviors that are fascinating to observe; however, it is often difficult to predict what swarm behaviors can emerge under a given set of agent capabilities. We seek to efficiently leverage human input to…

Multiagent Systems · Computer Science 2023-07-18 Connor Mattson , Daniel S. Brown

The performance of adversarial dialogue generation models relies on the quality of the reward signal produced by the discriminator. The reward signal from a poor discriminator can be very sparse and unstable, which may lead the generator to…

Computation and Language · Computer Science 2018-12-11 Ziming Li , Julia Kiseleva , Maarten de Rijke

Subjective self-disclosure is an important feature of human social interaction. While much has been done in the social and behavioural literature to characterise the features and consequences of subjective self-disclosure, little work has…

Robotics · Computer Science 2025-08-15 Henry Powell , Guy Laban , Emily S. Cross