English
Related papers

Related papers: Believe It or Not: How Deeply do LLMs Believe Impl…

200 papers

Knowledge editing has emerged as an efficient approach for updating factual knowledge in large language models (LLMs). It typically locates knowledge storage modules and then modifies their parameters. However, most existing methods focus…

Computation and Language · Computer Science 2025-11-03 Jiahao Liu , Zijian Wang , Kuo Zhao , Dong Hu

Large language models (LLMs) are capable of generating plausible explanations of how they arrived at an answer to a question. However, these explanations can misrepresent the model's "reasoning" process, i.e., they can be unfaithful. This,…

Computation and Language · Computer Science 2025-05-21 Katie Matton , Robert Osazuwa Ness , John Guttag , Emre Kıcıman

Knowledge editing methods (KEs) can update language models' obsolete or inaccurate knowledge learned from pre-training. However, KEs can be used for malicious applications, e.g., inserting misinformation and toxic content. Knowing whether a…

Computation and Language · Computer Science 2025-02-11 Paul Youssef , Zhixue Zhao , Christin Seifert , Jörg Schlötterer

Knowledge editing has been proposed as an effective method for updating and correcting the internal knowledge of Large Language Models (LLMs). However, existing editing methods often struggle with complex tasks, such as multi-hop reasoning.…

Computation and Language · Computer Science 2025-06-18 Mengqi Zhang , Xiaotian Ye , Qiang Liu , Pengjie Ren , Shu Wu , Zhumin Chen

Large language models (LLMs) encapsulate a vast amount of factual information within their pre-trained weights, as evidenced by their ability to answer diverse questions across different domains. However, this knowledge is inherently…

Artificial Intelligence · Computer Science 2024-01-31 Oded Ovadia , Menachem Brief , Moshik Mishaeli , Oren Elisha

Large Audio-Language Models (LALMs) have shown strong performance in speech understanding, making speech a natural interface for accessing factual information. Yet they are trained on static corpora and may encode incorrect facts. Existing…

Machine Learning · Computer Science 2026-03-17 Sung Kyun Chung , Jiaheng Dong , Qiuchi Hu , Gongping Huang , Hong Jia , Ting Dang

LLMs are known to store vast amounts of knowledge in their parametric memory. However, learning and recalling facts from this memory is known to be unreliable, depending largely on the prevalence of particular facts in the training data and…

Computation and Language · Computer Science 2025-08-14 Jessy Lin , Vincent-Pierre Berges , Xilun Chen , Wen-Tau Yih , Gargi Ghosh , Barlas Oğuz

The capability to reason from text is crucial for real-world NLP applications. Real-world scenarios often involve incomplete or evolving data. In response, individuals update their beliefs and understandings accordingly. However, most…

Computation and Language · Computer Science 2024-10-18 Bryan Wilie , Samuel Cahyawijaya , Etsuko Ishii , Junxian He , Pascale Fung

Large Language Models (LLMs) have made significant advances in natural language processing, but their underlying mechanisms are often misunderstood. Despite exhibiting coherent answers and apparent reasoning behaviors, LLMs rely on…

Computation and Language · Computer Science 2024-08-05 Bo Zhou , Daniel Geißler , Paul Lukowicz

Previous studies have shown that large language models (LLMs) like GPTs store massive factual knowledge in their parameters. However, the stored knowledge could be false or out-dated. Traditional knowledge editing methods refine LLMs via…

Computation and Language · Computer Science 2023-05-23 Ce Zheng , Lei Li , Qingxiu Dong , Yuxuan Fan , Zhiyong Wu , Jingjing Xu , Baobao Chang

This paper presents an extensive examination of Parameter-Efficient Fine-Tuning (PEFT) for embedding domain specific facts into Large Language Models (LLMs), focusing on improving the fine-tuning process by categorizing question-answer (QA)…

Computation and Language · Computer Science 2025-10-28 Shivam Ratnakar , Abhiroop Talasila , Raghav Chamadiya , Nikhil Agarwal , Vinayak K Doifode

Trustworthiness is a core research challenge for agentic AI systems built on Large Language Models (LLMs). To enhance trust, natural language claims from diverse sources, including human-written text, web content, and model outputs, are…

With the growing popularity of general-purpose Large Language Models (LLMs), comes a need for more global explanations of model behaviors. Concept-based explanations arise as a promising avenue for explaining high-level patterns learned by…

Artificial Intelligence · Computer Science 2024-10-07 Meng Li , Haoran Jin , Ruixuan Huang , Zhihao Xu , Defu Lian , Zijia Lin , Di Zhang , Xiting Wang

Large language models (LLMs) have made remarkable progress in various natural language processing tasks as a benefit of their capability to comprehend and reason with factual knowledge. However, a significant amount of factual knowledge is…

Computation and Language · Computer Science 2024-08-23 Sirui Huang , Yanggan Gu , Xuming Hu , Zhonghao Li , Qing Li , Guandong Xu

Fact verification is essential for ensuring the reliability of LLM applications. In this study, we evaluate 12 pre-trained LLMs and one specialized fact-verifier, including frontier LLMs and open-weight reasoning LLMs, using a collection of…

Artificial Intelligence · Computer Science 2026-02-06 Wooseok Seo , Seungju Han , Jaehun Jung , Benjamin Newman , Seungwon Lim , Seungbeen Lee , Ximing Lu , Yejin Choi , Youngjae Yu

While large language models (LLMs) have demonstrated impressive capabilities across various natural language processing tasks by acquiring rich factual knowledge from their broad training data, their ability to synthesize and logically…

Computation and Language · Computer Science 2024-07-31 Tianshi Zheng , Jiaxin Bai , Yicheng Wang , Tianqing Fang , Yue Guo , Yauwai Yim , Yangqiu Song

The success of large language models (LLMs) can be attributed in part to their ability to efficiently store factual knowledge as key-value mappings within their MLP parameters. Recent work has proposed explicit weight constructions to build…

Machine Learning · Computer Science 2025-12-02 Owen Dugan , Roberto Garcia , Ronny Junkins , Jerry Liu , Dylan Zinsley , Sabri Eyuboglu , Atri Rudra , Chris Ré

In large language model (LLM) agents, reasoning trajectories are treated as reliable internal beliefs for guiding actions and updating memory. However, coherent reasoning can still violate logical or evidential constraints, allowing…

Artificial Intelligence · Computer Science 2026-04-10 Wenhao Yuan , Chenchen Lin , Jian Chen , Jinfeng Xu , Xuehe Wang , Edith Cheuk Han Ngai

Communication among humans relies on conversational grounding, allowing interlocutors to reach mutual understanding even when they do not have perfect knowledge and must resolve discrepancies in each other's beliefs. This paper investigates…

Computation and Language · Computer Science 2025-06-12 Clara Lachenmaier , Judith Sieker , Sina Zarrieß

As LLMs become embedded in research workflows and organizational decision processes, their effect on analytical reliability remains uncertain. We distinguish two dimensions of analytical reliability -- intelligence (the capacity to reach…

General Economics · Economics 2026-02-26 Ryan Allen , Aticus Peterson