English
Related papers

Related papers: Memorization vs. Reasoning: Updating LLMs with New…

200 papers

While fine-tuning is the standard for injecting factual knowledge into large language models (LLMs), the mechanisms enabling reliable fact recall via unseen queries remain poorly understood. Common two-stage training strategies, which…

Computation and Language · Computer Science 2026-05-29 Ying Zhang , Benjamin Heinzerling , Dongyuan Li , Kentaro Inui

Large Language Models (LLMs) serve as repositories of extensive world knowledge, enabling them to perform tasks such as question-answering and fact-checking. However, this knowledge can become obsolete as global contexts change. In this…

Computation and Language · Computer Science 2023-11-17 Yuhao Wu , Tongjun Shi , Karthick Sharma , Chun Wei Seah , Shuhao Zhang

Large language models (LLMs) enable in-context learning (ICL) by conditioning on a few labeled training examples as a text-based prompt, eliminating the need for parameter updates and achieving competitive performance. In this paper, we…

Computation and Language · Computer Science 2024-04-02 Jianing Wang , Chengyu Wang , Chuanqi Tan , Jun Huang , Ming Gao

Large Language Models (LLMs) have achieved exceptional capabilities in open generation across various domains, yet they encounter difficulties with tasks that require intensive knowledge. To address these challenges, methods for integrating…

Computation and Language · Computer Science 2024-12-17 Fali Wang , Runxue Bao , Suhang Wang , Wenchao Yu , Yanchi Liu , Wei Cheng , Haifeng Chen

Recurrent LLM architectures have emerged as a promising approach for improving reasoning, as they enable multi-step computation in the embedding space without generating intermediate tokens. Models such as Ouro perform reasoning by…

Despite exceptional capabilities in knowledge-intensive tasks, Large Language Models (LLMs) face a critical gap in understanding how they internalize new knowledge, particularly how to structurally embed acquired knowledge in their neural…

Machine Learning · Computer Science 2025-06-03 Yixin Ou , Yunzhi Yao , Ningyu Zhang , Hui Jin , Jiacheng Sun , Shumin Deng , Zhenguo Li , Huajun Chen

Large Language Models (LLMs) excel in natural language processing by encoding extensive human knowledge, but their utility relies on timely updates as knowledge evolves. Updating LLMs involves two key tasks simultaneously: unlearning to…

Computation and Language · Computer Science 2025-02-04 Binchi Zhang , Zhengzhang Chen , Zaiyi Zheng , Jundong Li , Haifeng Chen

Humankind's understanding of the world is fundamentally linked to our perception and cognition, with \emph{human languages} serving as one of the major carriers of \emph{world knowledge}. In this vein, \emph{Large Language Models} (LLMs)…

Artificial Intelligence · Computer Science 2024-06-27 Huajun Chen

Large language models (LLMs) have achieved impressive results in natural language processing but are prone to memorizing portions of their training data, which can compromise evaluation metrics, raise privacy concerns, and limit…

Machine Learning · Computer Science 2024-12-03 Eduardo Slonski

Large language models (LLMs) have achieved impressive performance across various natural language benchmarks, prompting a continual need to curate more difficult datasets for larger LLMs, which is costly and time-consuming. In this paper,…

Computation and Language · Computer Science 2024-06-07 Jiahao Ying , Yixin Cao , Yushi Bai , Qianru Sun , Bo Wang , Wei Tang , Zhaojun Ding , Yizhe Yang , Xuanjing Huang , Shuicheng Yan

Large Language Models (LLMs) have demonstrated impressive performance in natural language processing tasks by leveraging chain of thought (CoT) that enables step-by-step thinking. Extending LLMs with multimodal capabilities is the recent…

Computation and Language · Computer Science 2024-01-24 Debjyoti Mondal , Suraj Modi , Subhadarshi Panda , Rituraj Singh , Godawari Sudhakar Rao

Large Language Models (LLMs) have demonstrated strong performance across a wide range of NLP tasks. However, they often exhibit suboptimal behaviors and inconsistencies when exposed to unfamiliar external information, underscoring their…

Computation and Language · Computer Science 2026-01-28 Zhipeng Xu , Zhenghao Liu , Yukun Yan , Shuo Wang , Shi Yu , Zheni Zeng , Chaojun Xiao , Zhiyuan Liu , Ge Yu , Chenyan Xiong

Large Language Models (LLMs) assist in specialized tasks but struggle to align with evolving domain knowledge without costly fine-tuning. Domain knowledge consists of: Knowledge: Immutable facts (e.g., 'A stone is solid') and generally…

Artificial Intelligence · Computer Science 2025-05-09 Anish Ganguli , Prabal Deb , Debleena Banerjee

Problem-solving has been a fundamental driver of human progress in numerous domains. With advancements in artificial intelligence, Large Language Models (LLMs) have emerged as powerful tools capable of tackling complex problems across…

Machine Learning · Computer Science 2025-05-07 Da Zheng , Lun Du , Junwei Su , Yuchen Tian , Yuqi Zhu , Jintian Zhang , Lanning Wei , Ningyu Zhang , Huajun Chen

By design, large language models (LLMs) are static general-purpose models, expensive to retrain or update frequently. As they are increasingly adopted for knowledge-intensive tasks, it becomes evident that these design choices lead to…

Computation and Language · Computer Science 2024-03-25 Shangbin Feng , Weijia Shi , Yuyang Bai , Vidhisha Balachandran , Tianxing He , Yulia Tsvetkov

Current LLM post-training methods optimize complete reasoning trajectories through Supervised Fine-Tuning (SFT) followed by outcome-based Reinforcement Learning (RL). While effective, a closer examination reveals a fundamental gap: this…

Artificial Intelligence · Computer Science 2026-05-29 Shaojie Wang , Liang Zhang

While comments are essential for enhancing code readability and maintainability in modern software projects, developers are often motivated to update code but not comments, leading to outdated or inconsistent documentation that hinders…

Software Engineering · Computer Science 2025-07-14 Hua Ge , Juan Zhai , Minxue Pan , Fusen He , Ziyue Tan

As the knowledge of large language models (LLMs) becomes outdated over time, there is a growing need for efficient methods to update them, especially when injecting proprietary information. Our study reveals that comprehension-intensive…

Computation and Language · Computer Science 2025-05-26 Essa Jan , Moiz Ali , Muhammad Saram Hassan , Fareed Zaffar , Yasir Zaki

We evaluate the ability of Large Language Models (LLMs) to discern and express their internal knowledge state, a key factor in countering factual hallucination and ensuring reliable application of LLMs. We observe a robust self-awareness of…

Computation and Language · Computer Science 2024-01-30 Yuxin Liang , Zhuoyang Song , Hao Wang , Jiaxing Zhang

Large Language Models (LLMs) struggle with dynamic knowledge updates, especially when new information conflicts with deeply embedded facts. Such conflicting factual edits often lead to two critical issues: resistance to adopting the new…

Machine Learning · Computer Science 2025-08-12 Stanley Ngugi