English
Related papers

Related papers: Towards Generalized Models for Task-oriented Dialo…

200 papers

This paper investigates pre-trained language models to find out which model intrinsically carries the most informative representation for task-oriented dialogue tasks. We approach the problem from two aspects: supervised classifier probe…

Computation and Language · Computer Science 2020-10-28 Chien-Sheng Wu , Caiming Xiong

Large Language Models (LLMs) demonstrate strong conversational abilities. In this Working Paper, we study them in the context of debating in two ways: their ability to perform in a structured debate along with a dataset of arguments to use…

Information Retrieval · Computer Science 2025-07-15 Anthony Miyaguchi , Conor Johnston , Aaryan Potdar

Most research on task oriented dialog modeling is based on written text input. However, users interact with practical dialog systems often using speech as input. Typically, systems convert speech into text using an Automatic Speech…

Artificial Intelligence · Computer Science 2022-12-20 Hagen Soltau , Izhak Shafran , Mingqiu Wang , Abhinav Rastogi , Jeffrey Zhao , Ye Jia , Wei Han , Yuan Cao , Aramys Miranda

Spoken dialogue generation is crucial for applications like podcasts, dynamic commentary, and entertainment content, but poses significant challenges compared to single-utterance text-to-speech (TTS). Key requirements include accurate…

Task-oriented dialogue systems have become overwhelmingly popular in recent researches. Dialogue understanding is widely used to comprehend users' intent, emotion and dialogue state in task-oriented dialogue systems. Most previous works on…

Computation and Language · Computer Science 2022-03-08 Nan Su , Yuchi Zhang , Chao Liu , Bingzhu Du , Yongliang Wang

The recent development of language models has shown promising results by achieving state-of-the-art performance on various natural language tasks by fine-tuning pretrained models. In task-oriented dialogue (ToD) systems, language models can…

Computation and Language · Computer Science 2022-01-24 Vinsen Marselino Andreas , Genta Indra Winata , Ayu Purwarianti

Large Language Models (LLMs) are increasingly employed in multi-turn conversational tasks, yet their pre-training data predominantly consists of continuous prose, creating a potential mismatch between required capabilities and training…

Computation and Language · Computer Science 2025-07-09 Jing Yang Lee , Hamed Bonab , Nasser Zalmout , Ming Zeng , Sanket Lokegaonkar , Colin Lockard , Binxuan Huang , Ritesh Sarkhel , Haodong Wang

Pre-trained models have proved to be powerful in enhancing task-oriented dialog systems. However, current pre-training methods mainly focus on enhancing dialog understanding and generation tasks while neglecting the exploitation of dialog…

Computation and Language · Computer Science 2022-03-30 Wanwei He , Yinpei Dai , Yinhe Zheng , Yuchuan Wu , Zheng Cao , Dermot Liu , Peng Jiang , Min Yang , Fei Huang , Luo Si , Jian Sun , Yongbin Li

Linguistic entrainment, or alignment, represents a phenomenon where linguistic patterns employed by conversational participants converge to one another. While entrainment has been shown to produce a more natural user experience, most…

Computation and Language · Computer Science 2024-04-05 Nalin Kumar , Ondřej Dušek

We study the problem of imposing conversational goals/keywords on open-domain conversational agents, where the agent is required to lead the conversation to a target keyword smoothly and fast. Solving this problem enables the application of…

Computation and Language · Computer Science 2021-03-02 Peixiang Zhong , Yong Liu , Hao Wang , Chunyan Miao

Conventional approaches to personalized dialogue generation typically require a large corpus, as well as predefined persona information. However, in a real-world setting, neither a large corpus of training data nor persona information are…

Computation and Language · Computer Science 2021-10-06 Jing Yang Lee , Kong Aik Lee , Woon Seng Gan

Large-scale pretrained language models have achieved outstanding performance on natural language understanding tasks. However, it is still under investigating how to apply them to dialogue generation tasks, especially those with responses…

Computation and Language · Computer Science 2020-10-16 Yu Cao , Wei Bi , Meng Fang , Dacheng Tao

The NOESIS II challenge, as the Track 2 of the 8th Dialogue System Technology Challenges (DSTC 8), is the extension of DSTC 7. This track incorporates new elements that are vital for the creation of a deployed task-oriented dialogue system.…

Computation and Language · Computer Science 2020-04-07 Jia-Chen Gu , Tianda Li , Quan Liu , Xiaodan Zhu , Zhen-Hua Ling , Yu-Ping Ruan

End-to-end acoustic-to-word speech recognition models have recently gained popularity because they are easy to train, scale well to large amounts of training data, and do not require a lexicon. In addition, word models may also be easier to…

Computation and Language · Computer Science 2019-02-20 Shruti Palaskar , Vikas Raunak , Florian Metze

Autoregressive models used to generate responses in open-domain dialogue systems often struggle to take long-term context into account and to maintain consistency over a dialogue. Previous research in open-domain dialogue generation has…

Computation and Language · Computer Science 2023-04-18 Mehrdad Farahani , Richard Johansson

ChatGPT is one of the most popular language models which achieve amazing performance on various natural language tasks. Consequently, there is also an urgent need to detect the texts generated ChatGPT from human written. One of the…

Computation and Language · Computer Science 2023-10-04 Han Xu , Jie Ren , Pengfei He , Shenglai Zeng , Yingqian Cui , Amy Liu , Hui Liu , Jiliang Tang

Large language models (LLMs) are increasingly expected to function as collaborative partners, engaging in back-and-forth dialogue to solve complex, ambiguous problems. However, current LLMs often falter in real-world settings, defaulting to…

Artificial Intelligence · Computer Science 2025-07-30 Tenghao Huang , Sihao Chen , Muhao Chen , Jonathan May , Longqi Yang , Mengting Wan , Pei Zhou

Dialogue generation has been successfully learned from scratch by neural networks, but tends to produce the same general response, e.g., "what are you talking about?", in many conversations. To reduce this homogeneity, external knowledge…

Computation and Language · Computer Science 2021-04-07 Yi-Lin Tuan , Wei Wei , William Yang Wang

Developing language model-based dialogue agents requires effective data to train models that can follow specific task logic. However, most existing data simulation methods focus on increasing diversity in language, topics, or dialogue acts…

Computation and Language · Computer Science 2025-03-04 Wanyu Du , Song Feng , James Gung , Lijia Sun , Yi Zhang , Saab Mansour , Yanjun Qi

Multi-role dialogue understanding comprises a wide range of diverse tasks such as question answering, act classification, dialogue summarization etc. While dialogue corpora are abundantly available, labeled data, for specific learning…

Computation and Language · Computer Science 2020-03-12 Tianyi Wang , Yating Zhang , Xiaozhong Liu , Changlong Sun , Qiong Zhang