English
Related papers

Related papers: TaskDiff: A Similarity Metric for Task-Oriented Co…

200 papers

Online news platforms commonly employ personalized news recommendation methods to assist users in discovering interesting articles, and many previous works have utilized language model techniques to capture user interests and understand…

Information Retrieval · Computer Science 2023-06-21 Xinyi Li , Yongfeng Zhang , Edward C. Malthouse

User Satisfaction Estimation is an important task and increasingly being applied in goal-oriented dialogue systems to estimate whether the user is satisfied with the service. It is observed that whether the user's needs are met often…

Computation and Language · Computer Science 2024-10-15 Kaisong Song , Yangyang Kang , Jiawei Liu , Xurui Li , Changlong Sun , Xiaozhong Liu

Evaluating the quality of a dialogue interaction between two agents is a difficult task, especially in open-domain chit-chat style dialogue. There have been recent efforts to develop automatic dialogue evaluation metrics, but most of them…

Computation and Language · Computer Science 2020-05-05 Koustuv Sinha , Prasanna Parthasarathi , Jasmine Wang , Ryan Lowe , William L. Hamilton , Joelle Pineau

Dialogue segmentation is a crucial task for dialogue systems allowing a better understanding of conversational texts. Despite recent progress in unsupervised dialogue segmentation methods, their performances are limited by the lack of…

Computation and Language · Computer Science 2023-10-17 Junfeng Jiang , Chengzhang Dong , Sadao Kurohashi , Akiko Aizawa

The role of conversational assistants has become more prevalent in helping people increase their productivity. Document-centered assistance, for example to help an individual quickly review a document, has seen less significant progress,…

Computation and Language · Computer Science 2020-02-04 Maartje ter Hoeve , Robert Sim , Elnaz Nouri , Adam Fourney , Maarten de Rijke , Ryen W. White

Large language models (LLMs) have achieved remarkable breakthroughs in new dialogue capabilities by leveraging instruction tuning, which refreshes human impressions of dialogue systems. The long-standing goal of dialogue systems is to be…

Computation and Language · Computer Science 2024-04-01 Jiao Ou , Junda Lu , Che Liu , Yihong Tang , Fuzheng Zhang , Di Zhang , Kun Gai

Task-oriented dialogue (TOD) systems are experiencing a revolution driven by Large Language Models (LLMs), yet the evaluation methodologies for these systems remain insufficient for their growing sophistication. While traditional automatic…

Computation and Language · Computer Science 2025-07-17 Emre Can Acikgoz , Carl Guo , Suvodip Dey , Akul Datta , Takyoung Kim , Gokhan Tur , Dilek Hakkani-Tür

Conversation is ubiquitous in social life, but the empirical study of this interactive process has been thwarted by tools that are insufficiently modular and unadaptive to researcher needs. To relieve many constraints in conversation…

Human-Computer Interaction · Computer Science 2026-03-24 David M. Markowitz

Chatbots can serve as a viable tool for preliminary depression diagnosis via interactive conversations with potential patients. Nevertheless, the blend of task-oriented and chit-chat in diagnosis-related dialogues necessitates professional…

Artificial Intelligence · Computer Science 2024-04-09 Kunyao Lan , Cong Ming , Binwei Yao , Lu Chen , Mengyue Wu

In this paper, we investigate the use of large language models (LLMs) like ChatGPT for document-grounded response generation in the context of information-seeking dialogues. For evaluation, we use the MultiDoc2Dial corpus of task-oriented…

Computation and Language · Computer Science 2023-09-22 Norbert Braunschweiler , Rama Doddipatla , Simon Keizer , Svetlana Stoyanchev

This paper proposes using ChatGPT, an innovative technology with various applications, as an assistant for psychotherapy. ChatGPT can serve as a patient information collector, a companion for patients in between therapy sessions, and an…

Human-Computer Interaction · Computer Science 2023-04-21 Mahshid Eshghie , Mojtaba Eshghie

Evaluation of Text to Speech (TTS) systems is challenging and resource-intensive. Subjective metrics such as Mean Opinion Score (MOS) are not easily comparable between works. Objective metrics are frequently used, but rarely validated…

Sound · Computer Science 2026-03-03 Christoph Minixhofer , Ondrej Klejch , Peter Bell

Increasingly, critical decisions in public policy, governance, and business strategy rely on a deeper understanding of the needs and opinions of constituent members (e.g. citizens, shareholders). While it has become easier to collect a…

Computation and Language · Computer Science 2020-01-28 Saket Gurukar , Deepak Ajwani , Sourav Dutta , Juho Lauri , Srinivasan Parthasarathy , Alessandra Sala

Language models, such as GPT-3.5 and ChatGPT, demonstrate remarkable abilities to follow diverse human instructions and perform a wide range of tasks. However, when probing language models using a range of basic table-understanding tasks,…

Computation and Language · Computer Science 2023-10-16 Peng Li , Yeye He , Dror Yashar , Weiwei Cui , Song Ge , Haidong Zhang , Danielle Rifinski Fainman , Dongmei Zhang , Surajit Chaudhuri

The recent development of language models has shown promising results by achieving state-of-the-art performance on various natural language tasks by fine-tuning pretrained models. In task-oriented dialogue (ToD) systems, language models can…

Computation and Language · Computer Science 2022-01-24 Vinsen Marselino Andreas , Genta Indra Winata , Ayu Purwarianti

Existing goal-oriented dialogue datasets focus mainly on identifying slots and values. However, customer support interactions in reality often involve agents following multi-step procedures derived from explicitly-defined company policies…

Computation and Language · Computer Science 2021-04-05 Derek Chen , Howard Chen , Yi Yang , Alex Lin , Zhou Yu

Context: Online collaborative creation of models is becoming commonplace. Collaborative modeling using chatbots and natural language may lower the barriers to modeling for users from different domains. Objective: We compare the perceived…

Human-Computer Interaction · Computer Science 2024-08-27 Ranci Ren , John W. Castro , Santiago R. Acuña , Oscar Dieste , Silvia T. Acuña

Task-oriented dialogue systems in industry settings need to have high conversational capability, be easily adaptable to changing situations and conform to business constraints. This paper describes a 3-step procedure to develop a…

Computation and Language · Computer Science 2022-10-27 Lahari Poddar , György Szarvas , Cheng Wang , Jorge Balazs , Pavel Danchenko , Patrick Ernst

Automatic tuning of reverberation algorithms relies on the optimization of a cost function. While general audio similarity metrics are useful, they are not optimized for the specific statistical properties of reverberation in rooms. This…

Audio and Speech Processing · Electrical Eng. & Systems 2025-12-19 Gloria Dal Santo , Karolina Prawda , Sebastian J. Schlecht , Vesa Välimäki

With the development of pre-trained language models, remarkable success has been witnessed in dialogue understanding (DU). However, current DU approaches usually employ independent models for each distinct DU task without considering shared…

Computation and Language · Computer Science 2022-07-26 Zhi Chen , Lu Chen , Bei Chen , Libo Qin , Yuncong Liu , Su Zhu , Jian-Guang Lou , Kai Yu