English
Related papers

Related papers: RASTeR: Robust, Agentic, and Structured Temporal R…

200 papers

Large language models (LLMs) excel at many language understanding tasks but struggle to reason over knowledge that evolves. To address this, recent work has explored augmenting LLMs with knowledge graphs (KGs) to provide structured,…

Machine Learning · Computer Science 2025-09-22 Junhong Lin , Song Wang , Xiaojie Guo , Julian Shun , Yada Zhu

Large language models (LLMs) have demonstrated remarkable advances in reasoning capabilities. However, their performance remains constrained by limited access to explicit and structured domain knowledge. Retrieval-Augmented Generation (RAG)…

Computation and Language · Computer Science 2025-10-20 Junlin Wu , Xianrui Zhong , Jiashuo Sun , Bolian Li , Bowen Jin , Jiawei Han , Qingkai Zeng

Pretrained large Language Models (LLMs) are able to answer questions that are unlikely to have been encountered during training. However a diversity of potential applications exist in the broad domain of reasoning systems and considerations…

Computation and Language · Computer Science 2024-11-27 Tim Hartill

Large language models face challenges in long-context question answering, where key evidence of a query may be dispersed across millions of tokens. Existing works equip large language models with a memory buffer that is dynamically updated…

Computation and Language · Computer Science 2026-03-03 Yaorui Shi , Yuxin Chen , Siyuan Wang , Sihang Li , Hengxing Cai , Qi Gu , Xiang Wang , An Zhang

Large Language Models (LLMs) exhibit high reasoning capacity in medical question-answering, but their tendency to produce hallucinations and outdated knowledge poses critical risks in healthcare fields. While Retrieval-Augmented Generation…

Computation and Language · Computer Science 2026-03-25 Wenhao Wu , Zhentao Tang , Yafu Li , Shixiong Kai , Mingxuan Yuan , Chunlin Chen , Zhi Wang

Large language models (LLMs) often rely on outdated knowledge when answering time-sensitive questions, leading to confident yet incorrect responses. Without explicit signals indicating whether up-to-date information is required, models…

Computation and Language · Computer Science 2026-03-18 Bhawna Piryani , Zehra Mert , Adam Jatowt

Large Language Models (LLMs) have achieved impressive reasoning abilities, but struggle with temporal understanding, especially when questions involve multiple entities, compound operators, and evolving event sequences. Temporal Knowledge…

Computation and Language · Computer Science 2026-02-24 Xingyu Tan , Xiaoyang Wang , Qing Liu , Xiwei Xu , Xin Yuan , Liming Zhu , Wenjie Zhang

Recent advances in reasoning models and agentic AI systems have led to an increased reliance on diverse external information. However, this shift introduces input contexts that are inherently noisy, a reality that current sanitized…

Artificial Intelligence · Computer Science 2026-01-13 Seongyun Lee , Yongrae Jo , Minju Seo , Moontae Lee , Minjoon Seo

Access to the right evidence does not guarantee that large language models (LLMs) will reason with it correctly. This gap between retrieval and reasoning is especially concerning in clinical settings, where outputs must align with…

Artificial Intelligence · Computer Science 2025-11-21 Deepthi Potluri , Aby Mammen Mathew , Jeffrey B DeWitt , Alexander L. Rasgon , Yide Hao , Junyuan Hong , Ying Ding

While Large Language Models (LLMs) achieve high performance on standard mathematical benchmarks, their problem-solving abilities depend on the context and textual formatting. We introduce the Robust Reasoning Benchmark (RRB), a pipeline of…

Machine Learning · Computer Science 2026-05-22 Pavel Golikov , Evgenii Opryshko , Gennady Pekhimenko , Mark C. Jeffrey

Retrieval-Augmented Generation (RAG) has demonstrated considerable effectiveness in open-domain question answering. However, when applied to heterogeneous documents, comprising both textual and tabular components, existing RAG approaches…

Computation and Language · Computer Science 2025-10-01 Xiaohan Yu , Pu Jian , Chong Chen

Retrieval Augmented Generation (RAG), a paradigm that integrates external contextual information with large language models (LLMs) to enhance factual accuracy and relevance, has emerged as a pivotal area in generative AI. The LLMs used in…

Computation and Language · Computer Science 2024-09-17 Xuan-Phi Nguyen , Shrey Pandit , Senthil Purushwalkam , Austin Xu , Hailin Chen , Yifei Ming , Zixuan Ke , Silvio Savarese , Caiming Xong , Shafiq Joty

Understanding events necessitates grasping their temporal context, which is often not explicitly stated in natural language. For example, it is not a trivial task for a machine to infer that a museum tour may last for a few hours, but can…

Computation and Language · Computer Science 2025-08-22 Lekshmi R Nair , Arun Sankar , Koninika Pal

Reasoning about time is essential for understanding the nuances of events described in natural language. Previous research on this topic has been limited in scope, characterized by a lack of standardized benchmarks that would allow for…

Computation and Language · Computer Science 2024-06-03 Yuqing Wang , Yun Zhao

Retrieval-augmented generation (RAG) often falls short when retrieved context includes confusing semi-relevant passages, or when answering questions require deep contextual understanding and reasoning. We propose an efficient fine-tuning…

Computation and Language · Computer Science 2025-07-28 Mohammad Kachuee , Teja Gollapudi , Minseok Kim , Yin Huang , Kai Sun , Xiao Yang , Jiaqi Wang , Nirav Shah , Yue Liu , Aaron Colak , Anuj Kumar , Wen-tau Yih , Xin Luna Dong

Large Language Models (LLMs) often struggle to maintain their original performance when faced with semantically coherent but task-irrelevant contextual information. Although prior studies have explored this issue using fixed-template or…

Computation and Language · Computer Science 2025-09-23 Yanbo Wang , Zixiang Xu , Yue Huang , Chujie Gao , Siyuan Wu , Jiayi Ye , Pin-Yu Chen , Xiuying Chen , Xiangliang Zhang

Despite its real-world significance, model performance on tabular data remains underexplored, leaving uncertainty about which model to rely on and which prompt configuration to adopt. To address this gap, we create ToRR, a benchmark for…

While Retrieval-Augmented Generation (RAG) excels at injecting static, factual knowledge into Large Language Models (LLMs), it exhibits a critical deficit in handling longitudinal queries that require tracking entities and phenomena across…

Computation and Language · Computer Science 2025-08-01 Kwun Hang Lau , Ruiyuan Zhang , Weijie Shi , Xiaofang Zhou , Xiaojun Cheng

The reasoning abilities of large language models (LLMs) have improved with chain-of-thought (CoT) prompting, allowing models to solve complex tasks stepwise. However, training CoT capabilities requires detailed reasoning data, which is…

Artificial Intelligence · Computer Science 2025-04-11 Fu-Chieh Chang , Yu-Ting Lee , Hui-Ying Shih , Yi Hsuan Tseng , Pei-Yuan Wu

Multi-hop retrieval-augmented generation (RAG) is a promising strategy for complex reasoning, yet existing iterative prompting approaches remain inefficient. They often regenerate predictable token sequences at every step and rely on…

Computation and Language · Computer Science 2025-10-23 Jihwan Bang , Juntae Lee , Seunghan Yang , Sungha Choi