English
Related papers

Related papers: JMultiWOZ: A Large-Scale Japanese Multi-Domain Tas…

200 papers

Recent developments in Japanese large language models (LLMs) primarily focus on general domains, with fewer advancements in Japanese biomedical LLMs. One obstacle is the absence of a comprehensive, large-scale benchmark for comparison.…

Computation and Language · Computer Science 2024-09-23 Junfeng Jiang , Jiahao Huang , Akiko Aizawa

Generating psychological counseling responses with language models relies heavily on high-quality datasets. Crowdsourced data collection methods require strict worker training, and data from real-world counseling environments may raise…

Computation and Language · Computer Science 2025-06-03 Zhiyang Qi , Takumasa Kaneko , Keiko Takamizo , Mariko Ukiyo , Michimasa Inaba

Popular dialog datasets such as MultiWOZ are created by providing crowd workers an instruction, expressed in natural language, that describes the task to be accomplished. Crowd workers play the role of a user and an agent to generate…

Computation and Language · Computer Science 2021-10-22 Biswesh Mohapatra , Gaurav Pandey , Danish Contractor , Sachindra Joshi

Attention-based pre-trained language models such as GPT-2 brought considerable progress to end-to-end dialogue modelling. However, they also present considerable risks for task-oriented dialogue, such as lack of knowledge grounding or…

Computation and Language · Computer Science 2022-01-17 Jonáš Kulhánek , Vojtěch Hudeček , Tomáš Nekvinda , Ondřej Dušek

Multimodal large language models (MLLMs), built on large-scale pre-trained vision towers and language models, have shown great capabilities in multimodal understanding. However, most existing MLLMs are trained on single-turn vision…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Jiazheng Liu , Sipeng Zheng , Börje F. Karlsson , Zongqing Lu

Task-oriented dialogue (TOD) systems have been widely deployed in many industries as they deliver more efficient customer support. These systems are typically constructed for a single domain or language and do not generalise well beyond…

Computation and Language · Computer Science 2023-06-21 Nikita Moghe , Evgeniia Razumovskaia , Liane Guillou , Ivan Vulić , Anna Korhonen , Alexandra Birch

Tracking dialogue states to better interpret user goals and feed downstream policy learning is a bottleneck in dialogue management. Common practice has been to treat it as a problem of classifying dialogue content into a set of pre-defined…

Artificial Intelligence · Computer Science 2020-06-04 Lizi Liao , Yunshan Ma , Wenqiang Lei , Tat-Seng Chua

Task-oriented dialogue is often decomposed into three tasks: understanding user input, deciding actions, and generating a response. While such decomposition might suggest a dedicated model for each sub-task, we find a simple, unified…

Computation and Language · Computer Science 2022-04-14 Ehsan Hosseini-Asl , Bryan McCann , Chien-Sheng Wu , Semih Yavuz , Richard Socher

This review gives an extensive overview of evaluation methods for task-oriented dialogue systems, paying special attention to practical applications of dialogue systems, for example for customer service. The review (1) provides an overview…

Computation and Language · Computer Science 2024-04-09 Anouck Braggaar , Christine Liebrecht , Emiel van Miltenburg , Emiel Krahmer

Dialogue generation is an important NLP task fraught with many challenges. The challenges become more daunting for low-resource African languages. To enable the creation of dialogue agents for African languages, we contribute the first…

We present DIALIGHT, a toolkit for developing and evaluating multilingual Task-Oriented Dialogue (ToD) systems which facilitates systematic evaluations and comparisons between ToD systems using fine-tuning of Pretrained Language Models…

Computation and Language · Computer Science 2024-01-05 Songbo Hu , Xiaobin Wang , Zhangdie Yuan , Anna Korhonen , Ivan Vulić

We demonstrate task-oriented dialogue generation within the dataflow dialogue paradigm. We show an example of agenda driven dialogue generation for the MultiWOZ domain, and an example of generation without an agenda for the SMCalFlow…

Computation and Language · Computer Science 2023-08-07 Joram Meron , Victor Guimarães

A long-standing goal of task-oriented dialogue research is the ability to flexibly adapt dialogue models to new domains. To progress research in this direction, we introduce DialoGLUE (Dialogue Language Understanding Evaluation), a public…

Computation and Language · Computer Science 2020-10-02 Shikib Mehri , Mihail Eric , Dilek Hakkani-Tur

One of the major impediments to the development of new task-oriented dialogue (TOD) systems is the need for human evaluation at multiple stages and iterations of the development process. In an effort to move toward automated evaluation of…

Computation and Language · Computer Science 2023-09-26 Sam Davidson , Salvatore Romeo , Raphael Shu , James Gung , Arshit Gupta , Saab Mansour , Yi Zhang

Language models pre-trained on general text have achieved impressive results in diverse fields. Yet, the distinct linguistic characteristics of task-oriented dialogues (TOD) compared to general text limit the practical utility of existing…

Computation and Language · Computer Science 2024-04-02 Weihao Zeng , Dayuan Fu , Keqing He , Yejie Wang , Yukai Xu , Weiran Xu

Recent advances in conversational AI have demonstrated impressive capabilities in single-turn responses, yet multi-turn dialogues remain challenging for even the most sophisticated language models. Current dialogue datasets are limited in…

Computation and Language · Computer Science 2025-05-27 Alkis Koudounas , Moreno La Quatra , Elena Baralis

The rapid progress of Large Language Models (LLMs) has empowered omni models to act as voice assistants capable of understanding spoken dialogues. These models can process multimodal inputs beyond text, such as speech and visual data,…

Task-oriented dialogue systems based on Large Language Models (LLMs) have gained increasing attention across various industries and achieved significant results. Current approaches condense complex procedural workflows into a single agent…

Multiagent Systems · Computer Science 2025-05-21 Zihao Feng , Xiaoxue Wang , Bowen Wu , Weihong Zhong , Zhen Xu , Hailong Cao , Tiejun Zhao , Ying Li , Baoxun Wang

Sentence-level (SL) machine translation (MT) has reached acceptable quality for many high-resourced languages, but not document-level (DL) MT, which is difficult to 1) train with little amount of DL data; and 2) evaluate, as the main…

Computation and Language · Computer Science 2020-12-14 Matīss Rikters , Ryokan Ri , Tong Li , Toshiaki Nakazawa

To address the critical scarcity of high-quality, publicly available counseling dialogue datasets, we created Multilingual KokoroChat by translating KokoroChat, a large-scale manually authored Japanese counseling corpus, into both English…

Computation and Language · Computer Science 2026-04-07 Ryoma Suzuki , Zhiyang Qi , Michimasa Inaba