English
Related papers

Related papers: Editing Conceptual Knowledge for Large Language Mo…

200 papers

Large Language Models (LLMs) store an extensive amount of factual knowledge obtained from vast collections of text. To effectively utilize these models for downstream tasks, it is crucial to have reliable methods for measuring their…

Computation and Language · Computer Science 2023-06-13 Pouya Pezeshkpour

Efficiently updating multilingual knowledge in large language models (LLMs), while preserving consistent factual representations across languages, remains a long-standing and unresolved challenge. While deploying separate editing systems…

Computation and Language · Computer Science 2025-06-13 Wei Sun , Tingyu Qu , Mingxiao Li , Jesse Davis , Marie-Francine Moens

A significant amount of research is focused on developing and evaluating large language models for a variety of code synthesis tasks. These include synthesizing code from natural language, synthesizing tests from code, and synthesizing…

This paper introduces ConceptMath, a bilingual (English and Chinese), fine-grained benchmark that evaluates concept-wise mathematical reasoning of Large Language Models (LLMs). Unlike traditional benchmarks that evaluate general…

Computation and Language · Computer Science 2024-02-26 Yanan Wu , Jie Liu , Xingyuan Bu , Jiaheng Liu , Zhanhui Zhou , Yuanxing Zhang , Chenchen Zhang , Zhiqi Bai , Haibin Chen , Tiezheng Ge , Wanli Ouyang , Wenbo Su , Bo Zheng

Multimodal large language models (MLLMs) are prone to non-factual or outdated knowledge issues, which can manifest as misreading and misrecognition errors due to the complexity of multimodal knowledge. Previous benchmarks have not…

Computer Vision and Pattern Recognition · Computer Science 2024-10-31 Junzhe Zhang , Huixuan Zhang , Xunjian Yin , Baizhou Huang , Xu Zhang , Xinyu Hu , Xiaojun Wan

Large multimodal language models (MLLMs) have revolutionized natural language processing and visual understanding, but often contain outdated or inaccurate information. Current multimodal knowledge editing evaluations are limited in scope…

Computer Vision and Pattern Recognition · Computer Science 2024-12-18 Yaohui Ma , Xiaopeng Hong , Shizhou Zhang , Huiyun Li , Zhilin Zhu , Wei Luo , Zhiheng Ma

Recent advances in AI-generated content (AIGC) have significantly accelerated image editing techniques, driving increasing demand for diverse and fine-grained edits. Despite these advances, existing image editing methods still face…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Shuyu Wang , Weiqi Li , Qian Wang , Shijie Zhao , Jian Zhang

How to edit the knowledge in multi-step reasoning has become the major challenge in the knowledge editing (KE) of large language models (LLMs). The difficulty arises because the hallucinations of LLMs during multi-step reasoning often lead…

Computation and Language · Computer Science 2024-11-12 Yiwei Wang , Muhao Chen , Nanyun Peng , Kai-Wei Chang

The swift advancement in Multimodal LLMs (MLLMs) also presents significant challenges for effective knowledge editing. Current methods, including intrinsic knowledge editing and external knowledge resorting, each possess strengths and…

Computer Vision and Pattern Recognition · Computer Science 2024-11-01 Kaihang Pan , Zhaoyu Fan , Juncheng Li , Qifan Yu , Hao Fei , Siliang Tang , Richang Hong , Hanwang Zhang , Qianru Sun

Knowledge editing has emerged as an efficient approach for updating factual knowledge in large language models (LLMs). It typically locates knowledge storage modules and then modifies their parameters. However, most existing methods focus…

Computation and Language · Computer Science 2025-11-03 Jiahao Liu , Zijian Wang , Kuo Zhao , Dong Hu

The widespread adoption of Large Language Models (LLMs) and publicly available ChatGPT have marked a significant turning point in the integration of Artificial Intelligence (AI) into people's everyday lives. This study examines the ability…

Computation and Language · Computer Science 2025-10-28 Sandeep Kumar , Tirthankar Ghosal , Vinayak Goyal , Asif Ekbal

Classification is a core NLP task architecture with many potential applications. While large language models (LLMs) have brought substantial advancements in text generation, their potential for enhancing classification tasks remains…

Computation and Language · Computer Science 2026-01-30 Qian Ruan , Ilia Kuznetsov , Iryna Gurevych

The extensive utilization of large language models (LLMs) underscores the crucial necessity for precise and contemporary knowledge embedded within their intrinsic parameters. Existing research on knowledge editing primarily concentrates on…

Computation and Language · Computer Science 2025-02-20 Zihao Wei , Jingcheng Deng , Liang Pang , Hanxing Ding , Huawei Shen , Xueqi Cheng

Large language models (LLMs) are deployed on mobile devices to power killer applications such as intelligent assistants. LLMs pre-trained on general corpora often hallucinate when handling personalized or unseen queries, leading to…

Machine Learning · Computer Science 2025-06-18 Zhenyan Lu , Daliang Xu , Dongqi Cai , Zexi Li , Wei Liu , Fangming Liu , Shangguang Wang , Mengwei Xu

Knowledge editing aims to update outdated or incorrect knowledge in large language models (LLMs). However, current knowledge editing methods have limited scalability for lifelong editing. This study explores the fundamental reason why…

Computation and Language · Computer Science 2025-02-27 Chenhui Hu , Pengfei Cao , Yubo Chen , Kang Liu , Jun Zhao

Large Language Models (LLMs) have demonstrated impressive capability in different tasks and are bringing transformative changes to many domains. However, keeping the knowledge in LLMs up-to-date remains a challenge once pretraining is…

Computation and Language · Computer Science 2024-07-24 Xiou Ge , Ali Mousavi , Edouard Grave , Armand Joulin , Kun Qian , Benjamin Han , Mostafa Arefiyan , Yunyao Li

Large language models (LLMs) have shown remarkable performances across a wide range of tasks. However, the mechanisms by which these models encode tasks of varying complexities remain poorly understood. In this paper, we explore the…

Computation and Language · Computer Science 2025-02-06 Mingyu Jin , Qinkai Yu , Jingyuan Huang , Qingcheng Zeng , Zhenting Wang , Wenyue Hua , Haiyan Zhao , Kai Mei , Yanda Meng , Kaize Ding , Fan Yang , Mengnan Du , Yongfeng Zhang

This work explores sequential model editing in large language models (LLMs), a critical task that involves modifying internal knowledge within LLMs continuously through multi-round editing, each incorporating updates or corrections to…

Computation and Language · Computer Science 2024-10-08 Houcheng Jiang , Junfeng Fang , Tianyu Zhang , An Zhang , Ruipeng Wang , Tao Liang , Xiang Wang

Knowledge Editing (KE) for modifying factual knowledge in Large Language Models (LLMs) has been receiving increasing attention. However, existing knowledge editing methods are entity-centric, and it is unclear whether this approach is…

Computation and Language · Computer Science 2023-11-16 Yifan Wei , Xiaoyan Yu , Huanhuan Ma , Fangyu Lei , Yixuan Weng , Ran Song , Kang Liu

Despite their success at many natural language processing (NLP) tasks, large language models still struggle to effectively leverage knowledge for knowledge-intensive tasks, manifesting limitations such as generating incomplete, non-factual,…

Computation and Language · Computer Science 2024-10-03 Yougang Lyu , Lingyong Yan , Shuaiqiang Wang , Haibo Shi , Dawei Yin , Pengjie Ren , Zhumin Chen , Maarten de Rijke , Zhaochun Ren