English
Related papers

Related papers: Decoding by Contrasting Knowledge: Enhancing LLMs'…

200 papers

Collaborative learning of large language models (LLMs) has emerged as a new paradigm for utilizing private data from different parties to guarantee efficiency and privacy. Meanwhile, Knowledge Editing (KE) for LLMs has also garnered…

Computation and Language · Computer Science 2025-02-25 Jiamu Zheng , Jinghuai Zhang , Tianyu Du , Xuhong Zhang , Jianwei Yin , Tao Lin

Knowledge editing has been proposed as an effective method for updating and correcting the internal knowledge of Large Language Models (LLMs). However, existing editing methods often struggle with complex tasks, such as multi-hop reasoning.…

Computation and Language · Computer Science 2025-06-18 Mengqi Zhang , Xiaotian Ye , Qiang Liu , Pengjie Ren , Shu Wu , Zhumin Chen

Large Language Models (LLMs) store an extensive amount of factual knowledge obtained from vast collections of text. To effectively utilize these models for downstream tasks, it is crucial to have reliable methods for measuring their…

Computation and Language · Computer Science 2023-06-13 Pouya Pezeshkpour

Evaluating long-form answers in high-stakes domains such as law or medicine remains a fundamental challenge. Standard metrics like BLEU and ROUGE fail to capture semantic correctness, and current LLM-based evaluators often reduce nuanced…

Computation and Language · Computer Science 2025-11-04 Fangyi Yu , Nabeel Seedat , Dasha Herrmannova , Frank Schilder , Jonathan Richard Schwarz

Knowledge distillation typically involves transferring knowledge from a Large Language Model (LLM) to a Smaller Language Model (SLM). However, in tasks such as text matching, fine-tuned smaller models often yield more effective…

Computation and Language · Computer Science 2025-07-09 Mingzhe Li , Jing Xiang , Qishen Zhang , Kaiyang Wan , Xiuying Chen

Recently, Knowledge Editing has received increasing attention, since it could update the specific knowledge from outdated ones in pretrained models without re-training. However, as pointed out by recent studies, existing related methods…

Computation and Language · Computer Science 2024-06-18 Zengkui Sun , Yijin Liu , Jiaan Wang , Fandong Meng , Jinan Xu , Yufeng Chen , Jie Zhou

While Knowledge Editing (KE) has been widely explored in English, its behavior in morphologically rich languages like Arabic remains underexamined. In this work, we present the first study of Arabic KE. We evaluate four methods (ROME,…

Computation and Language · Computer Science 2025-11-04 Basel Mousi , Nadir Durrani , Fahim Dalvi

Knowledge Editing has emerged as a promising solution for efficiently updating embedded knowledge in large language models (LLMs). While existing approaches demonstrate effectiveness in integrating new knowledge and preserving the original…

Computation and Language · Computer Science 2026-03-26 Mengqi Zhang , Zisheng Zhou , Xiaotian Ye , Qiang Liu , Zhaochun Ren , Zhumin Chen , Pengjie Ren

Knowledge represented in Large Language Models (LLMs) is quite often incorrect and can also become obsolete over time. Updating knowledge via fine-tuning is computationally resource-hungry and not reliable, and so knowledge editing (KE) has…

Computation and Language · Computer Science 2023-12-21 Weixuan Wang , Barry Haddow , Alexandra Birch

Owing to their powerful semantic reasoning capabilities, Large Language Models (LLMs) have been effectively utilized as recommenders, achieving impressive performance. However, the high inference latency of LLMs significantly restricts…

Information Retrieval · Computer Science 2024-08-21 Yu Cui , Feng Liu , Pengbo Wang , Bohao Wang , Heng Tang , Yi Wan , Jun Wang , Jiawei Chen

Large language models are often expected to constantly adapt to new sources of knowledge and knowledge editing techniques aim to efficiently patch the outdated model knowledge, with minimal modification. Most prior works focus on…

Computation and Language · Computer Science 2025-02-18 Aditi Khandelwal , Harman Singh , Hengrui Gu , Tianlong Chen , Kaixiong Zhou

Self-consistency decoding enhances LLMs' performance on reasoning tasks by sampling diverse reasoning paths and selecting the most frequent answer. However, it is computationally expensive, as sampling many of these (lengthy) paths is…

Computation and Language · Computer Science 2025-09-30 Amir Taubenfeld , Tom Sheffer , Eran Ofek , Amir Feder , Ariel Goldstein , Zorik Gekhman , Gal Yona

Large Language Models (LLMs) excel in tasks such as retrieval and question answering but require updates to incorporate new knowledge and reduce inaccuracies and hallucinations. Traditional updating methods, like fine-tuning and incremental…

Computation and Language · Computer Science 2025-04-30 Yifan Wei , Xiaoyan Yu , Ran Song , Hao Peng , Angsheng Li

Large Language Models (LLMs) are increasingly being used in real-world applications. However, concerns about the reliability of the content they generate persist, as it frequently deviates from factual correctness or exhibits deficiencies…

Computation and Language · Computer Science 2025-03-05 Yunzhen He , Yusuke Takase , Yoichi Ishibashi , Hidetoshi Shimodaira

Knowledge editing aims to update the embedded knowledge within Large Language Models (LLMs). However, existing approaches, whether through parameter modification or external memory integration, often suffer from inconsistent evaluation…

Computation and Language · Computer Science 2025-05-27 Guoxiu He , Xin Song , Futing Wang , Aixin Sun

Large language models (LLMs) exhibit impressive natural language capabilities but suffer from hallucination -- generating content ungrounded in the realities of training data. Recent work has focused on decoding techniques to improve…

Computation and Language · Computer Science 2024-04-16 Souvik Das , Lifeng Jin , Linfeng Song , Haitao Mi , Baolin Peng , Dong Yu

Large language models (LLMs) face challenges with internal knowledge inaccuracies and outdated information. Knowledge editing has emerged as a pivotal approach to mitigate these issues. Although current knowledge editing techniques exhibit…

Computation and Language · Computer Science 2024-08-23 Mengqi Zhang , Bowen Fang , Qiang Liu , Pengjie Ren , Shu Wu , Zhumin Chen , Liang Wang

Using responses generated by high-performing large language models (LLMs) for instruction tuning has become a widely adopted approach. However, the existing literature overlooks a property of LLM-generated responses: they conflate world…

Computation and Language · Computer Science 2026-04-16 Tatsuya Ichinose , Youmi Ma , Masanari Oi , Ryuto Koike , Naoaki Okazaki

Despite the impressive performance of large language models (LLMs) pretrained on vast knowledge corpora, advancing their knowledge manipulation-the ability to effectively recall, reason, and transfer relevant knowledge-remains challenging.…

Computation and Language · Computer Science 2026-01-13 Qitan Lv , Tianyu Liu , Qiaosheng Zhang , Xingcheng Xu , Chaochao Lu

Pre-trained language models (LMs) have been shown to memorize a substantial amount of knowledge from the pre-training corpora; however, they are still limited in recalling factually correct knowledge given a certain context. Hence, they…

Computation and Language · Computer Science 2022-04-08 Ruibo Liu , Guoqing Zheng , Shashank Gupta , Radhika Gaonkar , Chongyang Gao , Soroush Vosoughi , Milad Shokouhi , Ahmed Hassan Awadallah