English
Related papers

Related papers: DialogLM: Pre-trained Model for Long Dialogue Unde…

200 papers

Pre-trained conversation models (PCMs) have demonstrated remarkable results in task-oriented dialogue (TOD) systems. Many PCMs focus predominantly on dialogue management tasks like dialogue state tracking, dialogue generation tasks like…

Computation and Language · Computer Science 2023-12-29 Mingtao Yang , See-Kiong Ng , Jinlan Fu

Recently abstractive spoken language summarization raises emerging research interest, and neural sequence-to-sequence approaches have brought significant performance improvement. However, summarizing long meeting transcripts remains…

Computation and Language · Computer Science 2021-09-01 Zhengyuan Liu , Nancy F. Chen

Dialogues are a predominant mode of communication for humans, and it is immensely helpful to have automatically generated summaries of them (e.g., to revise key points discussed in a meeting, to review conversations between customer agents…

Recent advancements in Large Language Models (LLMs) have significantly enhanced conversational agents, making them applicable to various fields (e.g., education, entertainment). Despite their progress, the evaluation of the agents often…

Computation and Language · Computer Science 2025-09-29 Jiho Kim , Woosog Chay , Hyeonji Hwang , Daeun Kyung , Hyunseung Chung , Eunbyeol Cho , Yeonsu Kwon , Yohan Jo , Edward Choi

In this work, we introduce a framework for speech summarization that leverages the processing and reasoning capabilities of large language models (LLMs). We propose an end-to-end system that combines an instruction-tuned LLM with an audio…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-16 Wonjune Kang , Deb Roy

In second language learning, scenario-based conversation practice is important for language learners to achieve fluency in speaking, but students often lack sufficient opportunities to practice their conversational skills with qualified…

Computation and Language · Computer Science 2024-04-01 Shuyao Xu , Long Qin , Tianyang Chen , Zhenzhou Zha , Bingxue Qiu , Weizhi Wang

Large language models (LLMs) often struggle to learn from corrective feedback within a conversational context. They are rarely proactive in soliciting this feedback, even when faced with ambiguity, which can make their dialogues feel…

Computation and Language · Computer Science 2026-02-19 Jonathan Cook , Diego Antognini , Martin Klissarov , Claudiu Musat , Edward Grefenstette

Longitudinal Dialogues (LD) are the most challenging type of conversation for human-machine dialogue systems. LDs include the recollections of events, personal thoughts, and emotions specific to each individual in a sparse sequence of…

Computation and Language · Computer Science 2023-11-01 Seyed Mahed Mousavi , Simone Caldarella , Giuseppe Riccardi

With the availability of massive general-domain dialogue data, pre-trained dialogue generation appears to be super appealing to transfer knowledge from the general domain to downstream applications. In most existing work, such transferable…

Computation and Language · Computer Science 2022-10-25 Xueliang Zhao , Lemao Liu , Tingchen Fu , Shuming Shi , Dongyan Zhao , Rui Yan

Standard Large Language Models (LLMs) struggle with handling dialogues with long contexts due to efficiency and consistency issues. According to our observation, dialogue contexts are highly structured, and the special token of…

Computation and Language · Computer Science 2024-11-05 Jia-Nan Li , Quan Tu , Cunli Mao , Zhengtao Yu , Ji-Rong Wen , Rui Yan

Existing works on long-term open-domain dialogues focus on evaluating model responses within contexts spanning no more than five chat sessions. Despite advancements in long-context large language models (LLMs) and retrieval augmented…

Computation and Language · Computer Science 2024-02-28 Adyasha Maharana , Dong-Ho Lee , Sergey Tulyakov , Mohit Bansal , Francesco Barbieri , Yuwei Fang

This paper explores the potential of constructing an AI spoken dialogue system that "thinks how to respond" and "thinks how to speak" simultaneously, which more closely aligns with the human speech production process compared to the current…

Computation and Language · Computer Science 2023-09-21 Xinyu Zhou , Delong Chen , Yudong Chen

We present GLM-Dialog, a large-scale language model (LLM) with 10B parameters capable of knowledge-grounded conversation in Chinese using a search engine to access the Internet knowledge. GLM-Dialog offers a series of applicable techniques…

Computation and Language · Computer Science 2023-03-01 Jing Zhang , Xiaokang Zhang , Daniel Zhang-Li , Jifan Yu , Zijun Yao , Zeyao Ma , Yiqi Xu , Haohua Wang , Xiaohan Zhang , Nianyi Lin , Sunrui Lu , Juanzi Li , Jie Tang

Therapeutic dialogue is not a sequence of isolated responses: client goals, motivation, resistance, and therapeutic alliance evolve over time. Yet current LLM-based mental health dialogue systems often lack explicit mechanisms for tracking…

Large language models (LLMs) enabled dialogue systems have become one of the central modes in human-machine interaction, which bring about vast amounts of conversation logs and increasing demand for dialogue generation. The dialogue's…

Computation and Language · Computer Science 2025-06-02 Minzheng Wang , Xinghua Zhang , Kun Chen , Nan Xu , Haiyang Yu , Fei Huang , Wenji Mao , Yongbin Li

LLMs (Large Language Models) usually interact with users in the form of dialogue and generate responses following their instructions, which naturally require dialogue comprehension abilities. However, dialogue comprehension is a general…

Computation and Language · Computer Science 2024-04-02 Shuaijie She , Shujian Huang , Xingyun Wang , Yanke Zhou , Jiajun Chen

Few-shot dialogue state tracking (DST) with Large Language Models (LLM) relies on an effective and efficient conversation retriever to find similar in-context examples for prompt learning. Previous works use raw dialogue context as search…

Computation and Language · Computer Science 2024-04-04 Seanie Lee , Jianpeng Cheng , Joris Driesen , Alexandru Coca , Anders Johannsen

Empowering LLMs with the ability to precisely understand long contexts is crucial for many downstream applications. However, handling long contexts with conventional transformer architecture requires substantial training and inference…

Computation and Language · Computer Science 2024-12-24 Zhenyu Li , Yike Zhang , Tengyu Pan , Yutao Sun , Zhichao Duan , Junjie Fang , Rong Han , Zixuan Wang , Jianyong Wang

Developing language model-based dialogue agents requires effective data to train models that can follow specific task logic. However, most existing data simulation methods focus on increasing diversity in language, topics, or dialogue acts…

Computation and Language · Computer Science 2025-03-04 Wanyu Du , Song Feng , James Gung , Lijia Sun , Yi Zhang , Saab Mansour , Yanjun Qi

Comprehending a dialogue requires a model to capture diverse kinds of key information in the utterances, which are either scattered around or implicitly implied in different turns of conversations. Therefore, dialogue comprehension requires…

Computation and Language · Computer Science 2022-03-22 Chao Zhao , Wenlin Yao , Dian Yu , Kaiqiang Song , Dong Yu , Jianshu Chen