English
Related papers

Related papers: Beyond Words: Infusing Conversational Agents with …

200 papers

Advances in machine intelligence have enabled conversational interfaces that have the potential to radically change the way humans interact with machines. However, even with the progress in the abilities of these agents, there remain…

Human-Computer Interaction · Computer Science 2019-10-17 Deepali Aneja , Rens Hoegen , Daniel McDuff , Mary Czerwinski

Goal-oriented conversational agents are becoming prevalent in our daily lives. For these systems to engage users and achieve their goals, they need to exhibit appropriate social behavior as well as provide informative replies that guide…

Computation and Language · Computer Science 2021-01-01 Yi-Chia Wang , Alexandros Papangelis , Runze Wang , Zhaleh Feizollahi , Gokhan Tur , Robert Kraut

Designing and evaluating personalized and proactive assistant agents remains challenging due to the time, cost, and ethical concerns associated with human-in-the-loop experimentation. Existing Human-Computer Interaction (HCI) methods often…

Human-Computer Interaction · Computer Science 2025-11-25 Ziyi Xuan , Yiwen Wu , Xuhai Xu , Vinod Namboodiri , Mooi Choo Chuah , Yu Yang

Embodied agents designed to assist users with tasks must engage in natural language interactions, interpret instructions, execute actions, and communicate effectively to resolve issues. However, collecting large-scale, diverse datasets of…

Computation and Language · Computer Science 2024-11-01 Daniel Philipov , Vardhan Dongre , Gokhan Tur , Dilek Hakkani-Tür

Surveys and interviews are widely used for collecting insights on emerging or hypothetical scenarios. Traditional human-led methods often face challenges related to cost, scalability, and consistency. Recently, various domains have begun to…

Human-Computer Interaction · Computer Science 2025-03-05 Jiangbo Yu , Jinhua Zhao , Luis Miranda-Moreno , Matthew Korp

AI alignment is about ensuring AI systems only pursue goals and activities that are beneficial to humans. Most of the current approach to AI alignment is to learn what humans value from their behavioural data. This paper proposes a…

Artificial Intelligence · Computer Science 2023-10-06 Pei-Yu Chen , Myrthe L. Tielman , Dirk K. J. Heylen , Catholijn M. Jonker , M. Birna van Riemsdijk

Large Language Models based on transformer algorithms have revolutionized Artificial Intelligence by enabling verbal interaction with machines akin to human conversation. These AI agents have surpassed the Turing Test, achieving confusion…

In this paper, we present a methodology for the development of embodied conversational agents for social virtual worlds. The agents provide multimodal communication with their users in which speech interaction is included. Our proposal…

Audio and Speech Processing · Electrical Eng. & Systems 2025-01-29 D. Griol , A. Sanchis , J. M. Molina , Z. Callejas

The increasing capability of Large Language Models to act as human-like social agents raises two important questions in the area of opinion dynamics. First, whether these agents can generate effective arguments that could be injected into…

Computers and Society · Computer Science 2023-12-27 Simon Martin Breum , Daniel Vædele Egdal , Victor Gram Mortensen , Anders Giovanni Møller , Luca Maria Aiello

Believable proxies of human behavior can empower interactive applications ranging from immersive environments to rehearsal spaces for interpersonal communication to prototyping tools. In this paper, we introduce generative…

Human-Computer Interaction · Computer Science 2023-08-08 Joon Sung Park , Joseph C. O'Brien , Carrie J. Cai , Meredith Ringel Morris , Percy Liang , Michael S. Bernstein

With the advent of generative AI and large language models, embodied conversational agents are becoming synonymous with online interactions. These agents possess vast amounts of knowledge but suffer from exhibiting limited emotional…

Human-Computer Interaction · Computer Science 2026-02-27 Abhishek Kulkarni , Alexander Barquero , Pavitra Lahari , Aryaan Shaikh , Sarah Brown

AI systems have long been expected to interact with users, answering questions, generating content, and continuing (social) conversations. Agentic AI, however, breaks from this expectation, as its primary objective is workflow execution on…

Human-Computer Interaction · Computer Science 2026-05-05 Eunchae Jang , S. Shyam Sundar

Sharing ideas through communication with peers is the primary mode of human interaction. Consequently, extensive research has been conducted in the area of conversational AI, leading to an increase in the availability and diversity of…

Computation and Language · Computer Science 2024-05-24 Shivani Kumar , Sumit Bhatia , Milan Aggarwal , Tanmoy Chakraborty

AI design characteristics and human personality traits each impact the quality and outcomes of human-AI interactions. However, their relative and joint impacts are underexplored in imperfectly cooperative scenarios, where people and AI only…

Computation and Language · Computer Science 2026-04-20 Myke C. Cohen , Mingqian Zheng , Neel Bhandari , Hsien-Te Kao , Xuhui Zhou , Daniel Nguyen , Laura Cassani , Maarten Sap , Svitlana Volkova

Human conversation involves language, speech, and visual cues, with each medium providing complementary information. For instance, speech conveys a vibe or tone not fully captured by text alone. While multimodal LLMs focus on generating…

Human-Computer Interaction · Computer Science 2025-09-19 Taesoo Kim , Yongsik Jo , Hyunmin Song , Taehwan Kim

We consider the problem of designing an artificial agent capable of interacting with humans in collaborative dialogue to produce creative, engaging narratives. In this task, the goal is to establish universe details, and to collaborate on…

Human-Computer Interaction · Computer Science 2019-02-01 Kory W. Mathewson , Pablo Samuel Castro , Colin Cherry , George Foster , Marc G. Bellemare

Domain specific chatbot applications often involve multi step interactions, such as refining search filters, selecting multiple items, or performing comparisons. Traditional graphical user interfaces (GUIs) handle these workflows by…

Human-Computer Interaction · Computer Science 2025-07-03 Sanjay Krishna Anbalagan , Xinrui Nie , Umesh Mohan , Vijay Kumar Kanamarlapudi , Anughna Kommalapati , Xiaodan Zhao

A common vision from science fiction is that robots will one day inhabit our physical spaces, sense the world as we do, assist our physical labours, and communicate with us through natural language. Here we study how to design artificial…

By utilizing different communication channels, such as verbal language, gestures or facial expressions, virtually embodied interactive humans hold a unique potential to bridge the gap between human-computer interaction and actual interhuman…

Human-Computer Interaction · Computer Science 2017-05-19 Kevin K. Bowden , Tommy Nilsson , Christine P. Spencer , Kubra Cengiz , Alexandru Ghitulescu , Jelte B. van Waterschoot

Human communication is increasingly intermixed with language generated by AI. Across chat, email, and social media, AI systems suggest words, complete sentences, or produce entire conversations. AI-generated language is often not identified…

Computation and Language · Computer Science 2023-03-15 Maurice Jakesch , Jeffrey Hancock , Mor Naaman