English
Related papers

Related papers: Dyadic: A Scalable Platform for Human-Human and Hu…

200 papers

Natural language interaction with sensing systems is crucial for addressing users' personal concerns and providing health-related insights into their daily lives. When a user asks a question, the system automatically analyzes the full…

Artificial Intelligence · Computer Science 2025-07-22 Xiaofan Yu , Lanxiang Hu , Benjamin Reichman , Dylan Chu , Rushil Chandrupatla , Xiyuan Zhang , Larry Heck , Tajana Rosing

To facilitate the research on intelligent and human-like chatbots with multi-modal context, we introduce a new video-based multi-modal dialogue dataset, called TikTalk. We collect 38K videos from a popular video-sharing platform, along with…

Computation and Language · Computer Science 2023-09-11 Hongpeng Lin , Ludan Ruan , Wenke Xia , Peiyu Liu , Jingyuan Wen , Yixin Xu , Di Hu , Ruihua Song , Wayne Xin Zhao , Qin Jin , Zhiwu Lu

Conversation agents, commonly referred to as chatbots, are increasingly deployed in many domains to allow people to have a natural interaction while trying to solve a specific problem. Given their widespread use, it is important to provide…

Social and Information Networks · Computer Science 2020-10-13 Biplav Srivastava , Francesca Rossi , Sheema Usmani , and Mariana Bernagozzi

Recent advancements in AI-driven conversational agents have exhibited immense potential of AI applications. Effective response generation is crucial to the success of these agents. While extensive research has focused on leveraging multiple…

Computation and Language · Computer Science 2025-03-26 Junfeng Liu , Christopher T. Symons , Ranga Raju Vatsavai

We propose a new task of conversational recommendation over multi-type dialogs, where the bots can proactively and naturally lead a conversation from a non-recommendation dialog (e.g., QA) to a recommendation dialog, taking into account…

Computation and Language · Computer Science 2020-05-25 Zeming Liu , Haifeng Wang , Zheng-Yu Niu , Hua Wu , Wanxiang Che , Ting Liu

The concept of a Human-AI team has gained increasing attention in recent years. For effective collaboration between humans and AI teammates, proactivity is crucial for close coordination and effective communication. However, the design of…

Artificial Intelligence · Computer Science 2023-06-21 Matthias Kraus , Ron Riekenbrauck , Wolfgang Minker

In recent research on dialogue systems and corpora, there has been a significant focus on two distinct categories: task-oriented (TOD) and open-domain (chit-chat) dialogues. TOD systems aim to satisfy specific user goals, such as finding a…

Computation and Language · Computer Science 2023-08-29 Wen-Yu Chang , Yun-Nung Chen

In this work, we present ARDIAS, a web-based application that aims to provide researchers with a full suite of discovery and collaboration tools. ARDIAS currently allows searching for authors and articles by name and gaining insights into…

Computation and Language · Computer Science 2023-01-26 Debayan Banerjee , Seid Muhie Yimam , Sushil Awale , Chris Biemann

A well-designed interactive human-like dialogue system is expected to take actions (e.g. smiling) and respond in a pattern similar to humans. However, due to the limitation of single-modality (only speech) or small volume of currently…

Human-Computer Interaction · Computer Science 2022-12-13 Zhiling Luo , Qiankun Shi , Sha Zhao , Wei Zhou , Haiqing Chen , Yuankai Ma , Haitao Leng

The increasingly collaborative decision-making process between humans and agents demands a comprehensive, continuous, and unobtrusive measure of trust in agents. The gold standard format for measuring trust, a Likert-style survey, suffers…

Human-Computer Interaction · Computer Science 2020-10-13 Mengyao Li , Areen Alsaid , Sofia I. Noejovich , Ernest V. Cross , John D. Lee

As chatbots continue to evolve toward human-like, real-world, interactions, multimodality remains an active area of research and exploration. So far, efforts to integrate multimodality into chatbots have primarily focused on image-centric…

Computation and Language · Computer Science 2025-06-03 Jihyoung Jang , Minwook Bae , Minji Kim , Dilek Hakkani-Tur , Hyounghun Kim

Recently emerged intelligent assistants on smartphones and home electronics (e.g., Siri and Alexa) can be seen as novel hybrids of domain-specific task-oriented spoken dialogue systems and open-domain non-task-oriented ones. To realize such…

Computation and Language · Computer Science 2018-07-25 Satoshi Akasaki , Nobuhiro Kaji

Advances in artificial intelligence (AI) are enabling systems that augment and collaborate with humans to perform simple, mechanistic tasks like scheduling meetings and grammar-checking text. However, such Human-AI collaboration poses…

Computation and Language · Computer Science 2022-03-30 Ashish Sharma , Inna W. Lin , Adam S. Miner , David C. Atkins , Tim Althoff

Human intelligence's adaptability is remarkable, allowing us to adjust to new tasks and multi-modal environments swiftly. This skill is evident from a young age as we acquire new abilities and solve problems by imitating others or following…

Artificial Intelligence · Computer Science 2023-05-19 Shrestha Mohanty , Negar Arabzadeh , Julia Kiseleva , Artem Zholus , Milagro Teruel , Ahmed Awadallah , Yuxuan Sun , Kavya Srinet , Arthur Szlam

The use of chatbots has spread, generating great interest in the industry for the possibility of automating tasks within the execution of their processes. The implementation of chatbots, however simple, is a complex endeavor that involves…

Software Engineering · Computer Science 2021-09-03 Bedilia Estrada-Torres , Adela del-Río-Ortega , Manuel Resinas

The rise of increasingly more powerful chatbots offers a new way to collect information through conversational surveys, where a chatbot asks open-ended questions, interprets a user's free-text responses, and probes answers whenever needed.…

Human-Computer Interaction · Computer Science 2020-03-24 Ziang Xiao , Michelle X. Zhou , Q. Vera Liao , Gloria Mark , Changyan Chi , Wenxi Chen , Huahai Yang

This paper introduces CORAE, a novel web-based open-source tool for COntinuous Retrospective Affect Evaluation, designed to capture continuous affect data about interpersonal perceptions in dyadic interactions. Grounded in behavioral…

Human-Computer Interaction · Computer Science 2023-06-30 Michael J. Sack , Maria Teresa Parreira , Jenny Fu , Asher Lipman , Hifza Javed , Nawid Jamali , Malte Jung

Full-duplex interaction, where speakers and listeners converse simultaneously, is a key element of human communication often missing from traditional spoken dialogue systems. These systems, based on rigid turn-taking paradigms, struggle to…

Audio and Speech Processing · Electrical Eng. & Systems 2026-04-27 Chengyou Wang , Hongfei Xue , Guojian Li , Zhixian Zhao , Shuiyuan Wang , Shuai Wang , Xin Xu , Hui Bu , Lei Xie

"Human-aware" has become a popular keyword used to describe a particular class of AI systems that are designed to work and interact with humans. While there exists a surprising level of consistency among the works that use the label…

Robotics · Computer Science 2024-07-16 Silvia Tulli , Stylianos Loukas Vasileiou , Sarath Sreedharan

This paper investigates the impact of a group-adaptive conversation design in two socially interactive agents (SIAs) through two real-world studies. Both SIAs - Furhat, a social robot, and MetaHuman, a virtual agent - were equipped with a…

Robotics · Computer Science 2025-06-13 Ana Müller , Sabina Jeschke , Anja Richert