English
Related papers

Related papers: DialogLM: Pre-trained Model for Long Dialogue Unde…

200 papers

Existing dialog system models require extensive human annotations and are difficult to generalize to different tasks. The recent success of large pre-trained language models such as BERT and GPT-2 (Devlin et al., 2019; Radford et al., 2019)…

Computation and Language · Computer Science 2021-04-28 Qingyang Wu , Yichi Zhang , Yu Li , Zhou Yu

Dialogue summarization task involves summarizing long conversations while preserving the most salient information. Real-life dialogues often involve naturally occurring variations (e.g., repetitions, hesitations) and existing dialogue…

Computation and Language · Computer Science 2023-11-16 Ankita Gupta , Chulaka Gunasekara , Hui Wan , Jatin Ganhotra , Sachindra Joshi , Marina Danilevsky

Large language models (LLMs) excel at processing and generating both text and code. However, LLMs have had limited applicability in grounded task-oriented dialogue as they are difficult to steer toward task objectives and fail to handle…

Computation and Language · Computer Science 2023-10-27 Justin T. Chiu , Wenting Zhao , Derek Chen , Saujas Vaduguru , Alexander M. Rush , Daniel Fried

Utilizing Large Language Models (LLMs) facilitates the creation of flexible and natural dialogues, a task that has been challenging with traditional rule-based dialogue systems. However, LLMs also have the potential to produce unexpected…

We propose a novel framework for comprehending the reasoning capabilities of large language models (LLMs) through the perspective of meta-learning. By conceptualizing reasoning trajectories as pseudo-gradient descent updates to the LLM's…

Computation and Language · Computer Science 2025-05-27 Junnan Liu , Hongwei Liu , Linchen Xiao , Shudong Liu , Taolin Zhang , Zihan Ma , Songyang Zhang , Kai Chen

Text summarization has a wide range of applications in many scenarios. The evaluation of the quality of the generated text is a complex problem. A big challenge to language evaluation is that there is a clear divergence between existing…

Computation and Language · Computer Science 2023-09-20 Ning Wu , Ming Gong , Linjun Shou , Shining Liang , Daxin Jiang

Studying and building datasets for dialogue tasks is both expensive and time-consuming due to the need to recruit, train, and collect data from study participants. In response, much recent work has sought to use large language models (LLMs)…

Emphasis is a crucial component in human communication, which indicates the speaker's intention and implication beyond pure text in dialogue. While Large Language Models (LLMs) have revolutionized natural language processing, their ability…

Computation and Language · Computer Science 2024-10-01 Guan-Ting Lin , Hung-yi Lee

Designing dialog tutors has been challenging as it involves modeling the diverse and complex pedagogical strategies employed by human tutors. Although there have been significant recent advances in neural conversational systems using large…

Computation and Language · Computer Science 2023-03-29 Jakub Macina , Nico Daheim , Lingzhi Wang , Tanmay Sinha , Manu Kapur , Iryna Gurevych , Mrinmaya Sachan

User simulation has long played a vital role in computer science due to its potential to support a wide range of applications. Language, as the primary medium of human communication, forms the foundation of social interaction and behavior.…

Dialog management (DM) is a crucial component in a task-oriented dialog system. Given the dialog history, DM predicts the dialog state and decides the next action that the dialog agent should take. Recently, dialog policy learning has been…

Computation and Language · Computer Science 2021-10-26 Yinpei Dai , Huihua Yu , Yixuan Jiang , Chengguang Tang , Yongbin Li , Jian Sun

Making theory-of-mind inferences from human dialogue is a strong indicator of a model's underlying social abilities, which are fundamental for adept AI assistants. However, large language and reasoning models struggle to understand…

Computation and Language · Computer Science 2025-10-08 Akhil Deo , Kate Sanders , Benjamin Van Durme

Goal-oriented dialog systems enable users to complete specific goals like requesting information about a movie or booking a ticket. Typically the dialog system pipeline contains multiple ML models, including natural language understanding,…

Word clouds are a common way to summarize qualitative interviews, yet traditional frequency-based methods often fail in conversational contexts: they surface filler words, ignore paraphrase, and fragment semantically related ideas. This…

Computation and Language · Computer Science 2025-08-12 Joseph T. Colonel , Baihan Lin

The scarcity of domain-specific dialogue datasets limits the development of dialogue systems across applications. Existing research is constrained by general or niche datasets that lack sufficient scale for training dialogue systems. To…

Computation and Language · Computer Science 2025-02-11 Sathya Krishnan Suresh , Wu Mengjun , Tushar Pranav , Eng Siong Chng

This paper explores whether enhancing temporal reasoning capabilities in Large Language Models (LLMs) can improve the quality of timeline summarisation, the task of summarising long texts containing sequences of events, such as social media…

Computation and Language · Computer Science 2025-07-21 Jiayu Song , Mahmud Elahi Akhter , Dana Atzil Slonim , Maria Liakata

Meeting summarization has become a critical task since digital encounters have become a common practice. Large language models (LLMs) show great potential in summarization, offering enhanced coherence and context understanding compared to…

Computation and Language · Computer Science 2025-02-19 Frederic Kirstein , Terry Ruas , Bela Gipp

The capabilities and limitations of Large Language Models have been sketched out in great detail in recent years, providing an intriguing yet conflicting picture. On the one hand, LLMs demonstrate a general ability to solve problems. On the…

Large Language Models (LLMs) are rapidly transforming education by enabling rich conversational learning experiences. This article provides a comprehensive review of how LLM-based conversational agents are being used in higher education,…

Computation and Language · Computer Science 2025-06-25 Russell Beale

Building robust and general dialogue models for spoken conversations is challenging due to the gap in distributions of spoken and written data. This paper presents our approach to build generalized models for the Knowledge-grounded…

Computation and Language · Computer Science 2022-03-09 Ruijie Yan , Shuang Peng , Haitao Mi , Liang Jiang , Shihui Yang , Yuchi Zhang , Jiajun Li , Liangrui Peng , Yongliang Wang , Zujie Wen