English
Related papers

Related papers: Evaluating Temporal Consistency in Multi-Turn Lang…

200 papers

Detecting dialogue breakdown in real time is critical for conversational AI systems, because it enables taking corrective action to successfully complete a task. In spoken dialog systems, this breakdown can be caused by a variety of…

Computation and Language · Computer Science 2024-04-15 Md Messal Monem Miah , Ulie Schnaithmann , Arushi Raghuvanshi , Youngseo Son

In a conversation, a helpful assistant must reliably follow user directives, even as they refine, modify, or contradict earlier requests. Yet most instruction-following benchmarks focus on single-turn or short multi-turn scenarios, leaving…

Computation and Language · Computer Science 2026-05-11 Beatriz Canaverde , Duarte M. Alves , José Pombal , Giuseppe Attanasio , André F. T. Martins

Multi-turn conversations are a common and critical mode of language model interaction. However, current open training and evaluation data focus on single-turn settings, failing to capture the additional dimension of these longer…

Computation and Language · Computer Science 2026-03-18 Victoria Graf , Valentina Pyatkin , Nouha Dziri , Nathan Lambert , Hannaneh Hajishirzi

Recent advancements in audio generation have enabled the creation of high-fidelity audio clips from free-form textual descriptions. However, temporal relationships, a critical feature for audio content, are currently underrepresented in…

Sound · Computer Science 2024-07-04 Zeyu Xie , Xuenan Xu , Zhizheng Wu , Mengyue Wu

Recent advances in Large Language Models (LLMs) have enabled conversational AI agents to engage in extended multi-turn interactions spanning weeks or months. However, existing memory systems struggle to reason over temporally grounded facts…

Computation and Language · Computer Science 2026-03-18 Sahil Sen , Elias Lumer , Anmol Gulati , Vamse Kumar Subbiah

Large language models (LLMs) exhibit remarkable capabilities in question answering and reasoning thanks to their extensive parametric memory. However, their knowledge is inherently limited by the scope of their pre-training data, while…

Computation and Language · Computer Science 2025-06-10 Atahan Özer , Çağatay Yıldız

We present a sequential model for temporal relation classification between intra-sentence events. The key observation is that the overall syntactic structure and compositional meanings of the multi-word context between events are important…

Computation and Language · Computer Science 2017-07-25 Prafulla Kumar Choubey , Ruihong Huang

Multi-modal Large Language Models (MLLMs) have achieved remarkable performance across a wide range of visual reasoning tasks, yet their vulnerability to safety risks remains a pressing concern. While prior research primarily focuses on…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Ce Zhang , Jinxi He , Junyi He , Katia Sycara , Yaqi Xie

This study investigates the challenges posed by the dynamic nature of legal multi-label text classification tasks, where legal concepts evolve over time. Existing models often overlook the temporal dimension in their training process,…

Computation and Language · Computer Science 2024-05-24 T. Y. S. S Santosh , Tuan-Quang Vuong , Matthias Grabmair

Adapting large language models to full document translation remains challenging due to the difficulty of capturing long-range dependencies and preserving discourse coherence throughout extended texts. While recent agentic machine…

Computation and Language · Computer Science 2025-11-11 Viet-Thanh Pham , Minghan Wang , Hao-Han Liao , Thuy-Trang Vu

Large language models perform well on static medical examinations, yet clinical diagnosis often requires iterative evidence gathering under uncertainty. Building on prior interactive evaluation efforts, we introduce an OSCE-inspired…

Artificial Intelligence · Computer Science 2026-05-22 Chen Zhan , Xihe Qiu , Xiaoyu Tan , Xibing Zhuang , Gengchen Ma , Yue Zhang , Shuo Li , Peifeng Liu , Xiaoxiao Ge , Liang Liu , Lu Gan

While confidence estimation is a promising direction for mitigating hallucinations in Large Language Models (LLMs), current research overwhelmingly focuses on single-turn settings. The dynamics of model confidence in multi-turn…

Computation and Language · Computer Science 2026-05-15 Caiqi Zhang , Ruihan Yang , Xiaochen Zhu , Chengzu Li , Tiancheng Hu , Yijiang River Dong , Deqing Yang , Nigel Collier

Multimodal intent recognition poses significant challenges, requiring the incorporation of non-verbal modalities from real-world contexts to enhance the comprehension of human intentions. Existing benchmark datasets are limited in scale and…

Multimedia · Computer Science 2024-07-01 Hanlei Zhang , Xin Wang , Hua Xu , Qianrui Zhou , Kai Gao , Jianhua Su , jinyue Zhao , Wenrui Li , Yanting Chen

For spoken dialog systems to conduct fluid conversational interactions with users, the systems must be sensitive to turn-taking cues produced by a user. Models should be designed so that effective decisions can be made as to when it is…

Computation and Language · Computer Science 2018-07-02 Matthew Roddy , Gabriel Skantze , Naomi Harte

Current instruction data synthesis methods primarily focus on single-turn instructions and often neglect cross-turn coherence, resulting in context drift and reduced task completion rates in extended conversations. To address this…

Computation and Language · Computer Science 2025-09-26 Jiawei Chen , Xinyan Guan , Qianhao Yuan , Guozhao Mo , Weixiang Zhou , Yaojie Lu , Hongyu Lin , Ben He , Le Sun , Xianpei Han

Large Language Models (LLMs) encapsulate a surprising amount of factual world knowledge. However, their performance on temporal questions and historical knowledge is limited because they often cannot understand temporal scope and…

Computation and Language · Computer Science 2025-03-24 Jonas Wallat , Abdelrahman Abdallah , Adam Jatowt , Avishek Anand

Automated fact verification plays an essential role in fostering trust in the digital space. Despite the growing interest, the verification of temporal facts has not received much attention in the community. Temporal fact verification…

Information Retrieval · Computer Science 2024-08-20 Anab Maulana Barik , Wynne Hsu , Mong Li Lee

Topic modelling in Natural Language Processing uncovers hidden topics in large, unlabelled text datasets. It is widely applied in fields such as information retrieval, content summarisation, and trend analysis across various disciplines.…

Computation and Language · Computer Science 2025-11-18 Saranzaya Magsarjav , Melissa Humphries , Jonathan Tuke , Lewis Mitchell

Long-horizon interactions require language models to manage accumulating information: when to update their state, when to preserve their state, and what to ignore. We study this challenge as \textbf{Contextual Belief Management (CBM)}:…

Artificial Intelligence · Computer Science 2026-05-29 Haoming Xu , Weihong Xu , Zongrui Li , Mengru Wang , Yunzhi Yao , Chiyu Wu , Jin Shang , Yu Gong , Shumin Deng

Safety alignment in large language models is typically evaluated under isolated queries, yet real-world use is inherently multi-turn. Although multi-turn jailbreaks are empirically effective, the structure of conversational safety failure…

Cryptography and Security · Computer Science 2026-03-18 Pengcheng Li , Jie Zhang , Tianwei Zhang , Han Qiu , Zhang kejun , Weiming Zhang , Nenghai Yu , Wenbo Zhou