English
Related papers

Related papers: Turn-level Dialog Evaluation with Dialog-level Wea…

200 papers

Traditionally, industry solutions for building a task-oriented dialog system have relied on helping dialog authors define rule-based dialog managers, represented as dialog flows. While dialog flows are intuitively interpretable and good for…

Computation and Language · Computer Science 2020-05-05 Swadheen Shukla , Lars Liden , Shahin Shayandeh , Eslam Kamal , Jinchao Li , Matt Mazzola , Thomas Park , Baolin Peng , Jianfeng Gao

In natural human-to-human conversations, participants often receive feedback signals from one another based on their follow-up reactions. These reactions can include verbal responses, facial expressions, changes in emotional state, and…

Computation and Language · Computer Science 2025-02-25 Chen Zhang , Dading Chong , Feng Jiang , Chengguang Tang , Anningzhe Gao , Guohua Tang , Haizhou Li

This study addresses the challenges of dynamics and complexity in intelligent human-computer interaction and proposes a reinforcement learning-based optimization framework to improve long-term returns and overall experience. Human-computer…

Human-Computer Interaction · Computer Science 2025-11-03 Rui Liu , Yifan Zhuang , Runsheng Zhang

AI agents negotiate and transact in natural language with unfamiliar counterparts: a buyer bot facing an unknown seller, or a procurement assistant negotiating with a supplier. In such interactions, the counterpart's LLM, prompts, control…

Machine Learning · Computer Science 2026-05-13 Eilam Shapira , Moshe Tennenholtz , Roi Reichart

The emergence of pretrained large language models has led to the deployment of a range of social chatbots for chitchat. Although these chatbots demonstrate language ability and fluency, they are not guaranteed to be engaging and can…

Learning a shared dialog structure from a set of task-oriented dialogs is an important challenge in computational linguistics. The learned dialog structure can shed light on how to analyze human dialogs, and more importantly contribute to…

Computation and Language · Computer Science 2019-06-26 Weiyan Shi , Tiancheng Zhao , Zhou Yu

The development of chatbots requires collecting a large number of human-chatbot dialogues to reflect the breadth of users' sociodemographic backgrounds and conversational goals. However, the resource requirements to conduct the respective…

Computation and Language · Computer Science 2024-10-15 Hovhannes Tamoyan , Hendrik Schuff , Iryna Gurevych

Training chatbots using the reinforcement learning paradigm is challenging due to high-dimensional states, infinite action spaces and the difficulty in specifying the reward function. We address such problems using clustered actions instead…

Artificial Intelligence · Computer Science 2019-08-28 Heriberto Cuayáhuitl , Donghyeon Lee , Seonghan Ryu , Sungja Choi , Inchul Hwang , Jihie Kim

We present an optimised multi-modal dialogue agent for interactive learning of visually grounded word meanings from a human tutor, trained on real human-human tutoring data. Within a life-long interactive learning period, the agent, trained…

Computation and Language · Computer Science 2017-10-02 Yanchao Yu , Arash Eshghi , Oliver Lemon

Conversational Tree Search (V\"ath et al., 2023) is a recent approach to controllable dialog systems, where domain experts shape the behavior of a Reinforcement Learning agent through a dialog tree. The agent learns to efficiently navigate…

Computation and Language · Computer Science 2024-03-27 Dirk Väth , Lindsey Vanderlyn , Ngoc Thang Vu

Evaluation of open-domain dialogue systems is highly challenging and development of better techniques is highlighted time and again as desperately needed. Despite substantial efforts to carry out reliable live evaluation of systems in…

Computation and Language · Computer Science 2022-03-14 Tianbo Ji , Yvette Graham , Gareth J. F. Jones , Chenyang Lyu , Qun Liu

Though generative dialogue modeling is widely seen as a language modeling task, the task demands an agent to have a complex natural language understanding of its input text to carry a meaningful interaction with an user. The automatic…

Computation and Language · Computer Science 2020-08-25 Prasanna Parthasarathi , Joelle Pineau , Sarath Chandar

Despite tremendous advancements in dialogue systems, stable evaluation still requires human judgments producing notoriously high-variance metrics due to their inherent subjectivity. Moreover, methods and labels in dialogue evaluation are…

Computation and Language · Computer Science 2023-08-01 Sarah E. Finch , James D. Finch , Jinho D. Choi

Open-domain dialog generation is a challenging problem; maximum likelihood training can lead to repetitive outputs, models have difficulty tracking long-term conversational goals, and training on standard movie or online datasets may lead…

Machine Learning · Computer Science 2020-01-03 Abdelrhman Saleh , Natasha Jaques , Asma Ghandeharioun , Judy Hanwen Shen , Rosalind Picard

We propose a reinforcement learning-based approach to optimize conversational strategies for product recommendation across diverse industries. As organizations increasingly adopt intelligent agents to support sales and service operations,…

Information Retrieval · Computer Science 2025-07-03 Kang Liu

Evaluating the quality of a dialogue interaction between two agents is a difficult task, especially in open-domain chit-chat style dialogue. There have been recent efforts to develop automatic dialogue evaluation metrics, but most of them…

Computation and Language · Computer Science 2020-05-05 Koustuv Sinha , Prasanna Parthasarathi , Jasmine Wang , Ryan Lowe , William L. Hamilton , Joelle Pineau

In this paper, we extended the method proposed in [21] to enable humans to interact naturally with autonomous agents through vocal and textual conversations. Our extended method exploits the inherent capabilities of pre-trained large…

Robotics · Computer Science 2024-12-31 Linus Nwankwo , Elmar Rueckert

Sales dialogues require multi-turn, goal-directed persuasion under asymmetric incentives, which makes them a challenging setting for large language models (LLMs). Yet existing dialogue benchmarks rarely measure deal progression and…

Computation and Language · Computer Science 2026-04-10 Xuanbo Su , Wenhao Hu , Haibo Su , Yunzhang Chen , Le Zhan , Yanqi Yang , Leo Huang

Any organization needs to improve their products, services, and processes. In this context, engaging with customers and understanding their journey is essential. Organizations have leveraged various techniques and technologies to support…

Computation and Language · Computer Science 2022-12-08 Sahar Moradizeyveh

Agents that negotiate with humans find broad applications in pedagogy and conversational AI. Most efforts in human-agent negotiations rely on restrictive menu-driven interfaces for communication. To advance the research in language-based…

Computation and Language · Computer Science 2021-03-01 Kushal Chawla , Gale Lucas , Jonathan May , Jonathan Gratch