English
Related papers

Related papers: SocialDial: A Benchmark for Socially-Aware Dialogu…

200 papers

Chatbots are designed to carry out human-like conversations across different domains, such as general chit-chat, knowledge exchange, and persona-grounded conversations. To measure the quality of such conversational agents, a dialogue…

Computation and Language · Computer Science 2022-01-19 Chen Zhang , Luis Fernando D'Haro , Thomas Friedrichs , Haizhou Li

As large language models (LLMs) develop anthropomorphic abilities, they are increasingly being deployed as autonomous agents to interact with humans. However, evaluating their performance in realistic and complex social interactions remains…

Computation and Language · Computer Science 2025-10-28 Shuai Huang , Wenxuan Zhao , Jun Gao

With the availability of massive general-domain dialogue data, pre-trained dialogue generation appears to be super appealing to transfer knowledge from the general domain to downstream applications. In most existing work, such transferable…

Computation and Language · Computer Science 2022-10-25 Xueliang Zhao , Lemao Liu , Tingchen Fu , Shuming Shi , Dongyan Zhao , Rui Yan

There is a resurgent interest in developing intelligent open-domain dialog systems due to the availability of large amounts of conversational data and the recent progress on neural approaches to conversational AI. Unlike traditional…

Computation and Language · Computer Science 2020-03-02 Minlie Huang , Xiaoyan Zhu , Jianfeng Gao

We examine a large dialog corpus obtained from the conversation history of a single individual with 104 conversation partners. The corpus consists of half a million instant messages, across several messaging platforms. We focus our analyses…

Computation and Language · Computer Science 2019-04-29 Charles Welch , Verónica Pérez-Rosas , Jonathan K. Kummerfeld , Rada Mihalcea

Smooth and effective communication requires the ability to perform latent or explicit commonsense inference. Prior commonsense reasoning benchmarks (such as SocialIQA and CommonsenseQA) mainly focus on the discriminative task of choosing…

Computation and Language · Computer Science 2021-09-23 Pei Zhou , Karthik Gopalakrishnan , Behnam Hedayatnia , Seokhwan Kim , Jay Pujara , Xiang Ren , Yang Liu , Dilek Hakkani-Tur

Accurate prediction of conversation topics can be a valuable signal for creating coherent and engaging dialog systems. In this work, we focus on context-aware topic classification methods for identifying topics in free-form human-chatbot…

Computation and Language · Computer Science 2018-10-22 Chandra Khatri , Rahul Goel , Behnam Hedayatnia , Angeliki Metanillou , Anushree Venkatesh , Raefer Gabriel , Arindam Mandal

This paper presents Dialogos, a real-time system for human-machine spoken dialogue on the telephone in task-oriented domains. The system has been tested in a large trial with inexperienced users and it has proved robust enough to allow…

From the invention of writing and the printing press, to television and social media, human history is punctuated by major innovations in communication technology, which fundamentally altered how ideas spread and reshaped our culture.…

Computers and Society · Computer Science 2025-07-09 Hiromu Yakura , Ezequiel Lopez-Lopez , Levin Brinkmann , Ignacio Serna , Prateek Gupta , Ivan Soraperra , Iyad Rahwan

Holistically measuring societal biases of large language models is crucial for detecting and reducing ethical risks in highly capable AI models. In this work, we present a Chinese Bias Benchmark dataset that consists of over 100K questions…

Computation and Language · Computer Science 2023-06-29 Yufei Huang , Deyi Xiong

A long-standing goal of task-oriented dialogue research is the ability to flexibly adapt dialogue models to new domains. To progress research in this direction, we introduce DialoGLUE (Dialogue Language Understanding Evaluation), a public…

Computation and Language · Computer Science 2020-10-02 Shikib Mehri , Mihail Eric , Dilek Hakkani-Tur

Maintaining persona consistency is paramount in the application of open-domain dialogue systems, as exemplified by models like ChatGPT. Despite significant advancements, the limited scale and diversity of current persona dialogue datasets…

Computation and Language · Computer Science 2025-02-20 Mengze Hong , Chen Jason Zhang , Chaotao Chen , Rongzhong Lian , Di Jiang

Spoken dialogue is essential for human-AI interactions, providing expressive capabilities beyond text. Developing effective spoken dialogue systems (SDSs) requires large-scale, high-quality, and diverse spoken dialogue corpora. However,…

Computation and Language · Computer Science 2026-04-03 Wataru Nakata , Kentaro Seki , Hitomi Yanaka , Yuki Saito , Shinnosuke Takamichi , Hiroshi Saruwatari

Text representation models are prone to exhibit a range of societal biases, reflecting the non-controlled and biased nature of the underlying pretraining data, which consequently leads to severe ethical issues and even bias amplification.…

Computation and Language · Computer Science 2021-06-08 Soumya Barikeri , Anne Lauscher , Ivan Vulić , Goran Glavaš

Evaluation of open-domain dialogue systems is highly challenging and development of better techniques is highlighted time and again as desperately needed. Despite substantial efforts to carry out reliable live evaluation of systems in…

Computation and Language · Computer Science 2022-03-14 Tianbo Ji , Yvette Graham , Gareth J. F. Jones , Chenyang Lyu , Qun Liu

We study conversational dialog in which there are many possible responses to a given history. We present the MultiTalk Dataset, a corpus of over 320,000 sentences of written conversational dialog that balances a high branching factor (10)…

Computation and Language · Computer Science 2021-02-03 Yao Dou , Maxwell Forbes , Ari Holtzman , Yejin Choi

Designing systems that can reason across cultures requires that they are grounded in the norms of the contexts in which they operate. However, current research on developing computational models of social norms has primarily focused on…

Computation and Language · Computer Science 2023-10-24 Sky CH-Wang , Arkadiy Saakyan , Oliver Li , Zhou Yu , Smaranda Muresan

We present a large, tunable neural conversational response generation model, DialoGPT (dialogue generative pre-trained transformer). Trained on 147M conversation-like exchanges extracted from Reddit comment chains over a period spanning…

Computation and Language · Computer Science 2020-05-05 Yizhe Zhang , Siqi Sun , Michel Galley , Yen-Chun Chen , Chris Brockett , Xiang Gao , Jianfeng Gao , Jingjing Liu , Bill Dolan

In the realm of human-AI dialogue, the facilitation of empathetic responses is important. Validation is one of the key communication techniques in psychology, which entails recognizing, understanding, and acknowledging others' emotional…

Computation and Language · Computer Science 2024-02-21 Zi Haur Pang , Yahui Fu , Divesh Lala , Keiko Ochi , Koji Inoue , Tatsuya Kawahara

Recent efforts in Spoken Dialogue Modeling aim to synthesize spoken dialogue without the need for direct transcription, thereby preserving the wealth of non-textual information inherent in speech. However, this approach faces a challenge…

Computation and Language · Computer Science 2024-07-03 Yu-Kuan Fu , Cheng-Kuang Lee , Hsiu-Hsuan Wang , Hung-yi Lee