English
Related papers

Related papers: TicketTalk: Toward human-level performance with en…

200 papers

As conversational AI-based dialogue management has increasingly become a trending topic, the need for a standardized and reliable evaluation procedure grows even more pressing. The current state of affairs suggests various evaluation…

Computation and Language · Computer Science 2020-06-12 Sarah E. Finch , Jinho D. Choi

Fully data driven Chatbots for non-goal oriented dialogues are known to suffer from inconsistent behaviour across their turns, stemming from a general difficulty in controlling parameters like their assumed background personality and…

Computation and Language · Computer Science 2020-03-31 Fabian Galetzka , Chukwuemeka U. Eneh , David Schlangen

As dialogue systems and chatbots increasingly integrate into everyday interactions, the need for efficient and accurate evaluation methods becomes paramount. This study explores the comparative performance of human and AI assessments across…

Computation and Language · Computer Science 2024-09-11 Ike Ebubechukwu , Johane Takeuchi , Antonello Ceravola , Frank Joublin

Recent advances in conversational AI have demonstrated impressive capabilities in single-turn responses, yet multi-turn dialogues remain challenging for even the most sophisticated language models. Current dialogue datasets are limited in…

Computation and Language · Computer Science 2025-05-27 Alkis Koudounas , Moreno La Quatra , Elena Baralis

Tool-Augmented Language Models (TALMs) leverage external APIs to answer user queries across various domains. However, existing benchmark datasets for TALM research often feature simplistic dialogues that do not reflect real-world scenarios,…

Computation and Language · Computer Science 2025-03-04 Jeonghoon Shim , Gyuhyeon Seo , Cheongsu Lim , Yohan Jo

Embodied agents need to be able to interact in natural language understanding task descriptions and asking appropriate follow up questions to obtain necessary information to be effective at successfully accomplishing tasks for a wide range…

Computation and Language · Computer Science 2022-09-28 Spandana Gella , Aishwarya Padmakumar , Patrick Lange , Dilek Hakkani-Tur

This paper addresses the gap in predicting turn-taking and backchannel actions in human-machine conversations using multi-modal signals (linguistic, acoustic, and visual). To overcome the limitation of existing datasets, we propose an…

Computation and Language · Computer Science 2025-05-21 Yuxin Lin , Yinglin Zheng , Ming Zeng , Wangzheng Shi

Long-term, open-domain dialogue capabilities are essential for chatbots aiming to recall past interactions and demonstrate emotional intelligence (EI). Yet, most existing research relies on synthetic, LLM-generated data, leaving open…

Computation and Language · Computer Science 2025-02-20 Dong-Ho Lee , Adyasha Maharana , Jay Pujara , Xiang Ren , Francesco Barbieri

Large Language Models (LLMs) are increasingly employed in multi-turn conversational tasks, yet their pre-training data predominantly consists of continuous prose, creating a potential mismatch between required capabilities and training…

Computation and Language · Computer Science 2025-07-09 Jing Yang Lee , Hamed Bonab , Nasser Zalmout , Ming Zeng , Sanket Lokegaonkar , Colin Lockard , Binxuan Huang , Ritesh Sarkhel , Haodong Wang

One challenge for dialogue agents is recognizing feelings in the conversation partner and replying accordingly, a key communicative skill. While it is straightforward for humans to recognize and acknowledge others' feelings in a…

Computation and Language · Computer Science 2019-08-30 Hannah Rashkin , Eric Michael Smith , Margaret Li , Y-Lan Boureau

End-to-end training of neural networks is a promising approach to automatic construction of dialog systems using a human-to-human dialog corpus. Recently, Vinyals et al. tested neural conversation models using OpenSubtitles. Lowe et al.…

Computation and Language · Computer Science 2018-01-31 Chiori Hori , Takaaki Hori

We develop a high-quality multi-turn dialog dataset, DailyDialog, which is intriguing in several aspects. The language is human-written and less noisy. The dialogues in the dataset reflect our daily communication way and cover various…

Computation and Language · Computer Science 2017-10-12 Yanran Li , Hui Su , Xiaoyu Shen , Wenjie Li , Ziqiang Cao , Shuzi Niu

In multi-modal dialogue systems, it is important to allow the use of images as part of a multi-turn conversation. Training such dialogue systems generally requires a large-scale dataset consisting of multi-turn dialogues that involve…

Computation and Language · Computer Science 2021-07-20 Nyoungwoo Lee , Suwon Shin , Jaegul Choo , Ho-Jin Choi , Sung-Hyun Myaeng

While densely annotated image captions significantly facilitate the learning of robust vision-language alignment, methodologies for systematically optimizing human annotation efforts remain underexplored. We introduce Chain-of-Talkers…

Computation and Language · Computer Science 2025-06-03 Yijun Shen , Delong Chen , Fan Liu , Xingyu Wang , Chuanyi Zhang , Liang Yao , Yuhui Zheng

Building a socially intelligent agent involves many challenges, one of which is to teach the agent to speak guided by its value like a human. However, value-driven chatbots are still understudied in the area of dialogue systems. Most…

Computation and Language · Computer Science 2022-07-25 Liang Qiu , Yizhou Zhao , Jinchao Li , Pan Lu , Baolin Peng , Jianfeng Gao , Song-Chun Zhu

We present a novel end-to-end trainable neural network model for task-oriented dialog systems. The model is able to track dialog state, issue API calls to knowledge base (KB), and incorporate structured KB query results into system…

Computation and Language · Computer Science 2017-08-22 Bing Liu , Ian Lane

Evaluation of open-domain dialogue systems is highly challenging and development of better techniques is highlighted time and again as desperately needed. Despite substantial efforts to carry out reliable live evaluation of systems in…

Computation and Language · Computer Science 2022-03-14 Tianbo Ji , Yvette Graham , Gareth J. F. Jones , Chenyang Lyu , Qun Liu

Much of human dialogue occurs in semi-cooperative settings, where agents with different goals attempt to agree on common decisions. Negotiations require complex communication and reasoning skills, but success is easy to measure, making this…

Artificial Intelligence · Computer Science 2017-06-19 Mike Lewis , Denis Yarats , Yann N. Dauphin , Devi Parikh , Dhruv Batra

Machine Learning (ML) models are increasingly used to make critical decisions in real-world applications, yet they have become more complex, making them harder to understand. To this end, researchers have proposed several techniques to…

Machine Learning · Computer Science 2023-03-07 Dylan Slack , Satyapriya Krishna , Himabindu Lakkaraju , Sameer Singh

A significant barrier to progress in data-driven approaches to building dialog systems is the lack of high quality, goal-oriented conversational data. To help satisfy this elementary requirement, we introduce the initial release of the…