English
Related papers

Related papers: Should We Really Edit Language Models? On the Eval…

200 papers

The rapid advancement of large language models (LLMs) and multimodal learning has transformed digital content creation and manipulation. Traditional visual editing tools require significant expertise, limiting accessibility. Recent strides…

Computer Vision and Pattern Recognition · Computer Science 2024-11-22 Thanh Tam Nguyen , Zhao Ren , Trinh Pham , Thanh Trung Huynh , Phi Le Nguyen , Hongzhi Yin , Quoc Viet Hung Nguyen

As the modern tool of choice for question answering, large language models (LLMs) are expected to deliver answers with up-to-date knowledge. To achieve such ideal question-answering systems, locating and then editing outdated knowledge in…

Computation and Language · Computer Science 2024-09-17 Baolong Bi , Shenghua Liu , Yiwei Wang , Lingrui Mei , Hongcheng Gao , Junfeng Fang , Xueqi Cheng

Large language models (LLMs) are gaining increasing popularity in both academia and industry, owing to their unprecedented performance in various applications. As LLMs continue to play a vital role in both research and daily use, their…

Computation and Language · Computer Science 2024-01-01 Yupeng Chang , Xu Wang , Jindong Wang , Yuan Wu , Linyi Yang , Kaijie Zhu , Hao Chen , Xiaoyuan Yi , Cunxiang Wang , Yidong Wang , Wei Ye , Yue Zhang , Yi Chang , Philip S. Yu , Qiang Yang , Xing Xie

Large language models (LLMs) can make predictions using parametric knowledge--knowledge encoded in the model weights--or contextual knowledge--knowledge presented in the context. In many scenarios, a desirable behavior is that LLMs give…

Computation and Language · Computer Science 2024-03-27 Yingfa Chen , Zhengyan Zhang , Xu Han , Chaojun Xiao , Zhiyuan Liu , Chen Chen , Kuai Li , Tao Yang , Maosong Sun

Multilingual large language models are designed, claimed, and expected to cater to speakers of varied languages. We hypothesise that the current practices of fine-tuning and evaluating these models may not perfectly align with this…

Computation and Language · Computer Science 2024-09-27 Pinzhen Chen , Simon Yu , Zhicheng Guo , Barry Haddow

Language models, characterized by their black-box nature, often hallucinate and display sensitivity to input perturbations, causing concerns about trust. To enhance trust, it is imperative to gain a comprehensive understanding of the…

Computation and Language · Computer Science 2025-01-03 Vatsal Gupta , Pranshu Pandya , Tushar Kataria , Vivek Gupta , Dan Roth

Efficiently updating multilingual knowledge in large language models (LLMs), while preserving consistent factual representations across languages, remains a long-standing and unresolved challenge. While deploying separate editing systems…

Computation and Language · Computer Science 2025-06-13 Wei Sun , Tingyu Qu , Mingxiao Li , Jesse Davis , Marie-Francine Moens

As Large Language Models (LLMs) receive increasing attention and are being deployed across various domains, their potential risks, including generating harmful or biased content, producing unsupported claims, and exhibiting vulnerabilities…

Computation and Language · Computer Science 2026-04-20 Wai Man Si , Mingjie Li , Michael Backes , Yang Zhang

Large language models (LLMs) often exhibit hallucinations due to incorrect or outdated knowledge. Hence, model editing methods have emerged to enable targeted knowledge updates. To achieve this, a prevailing paradigm is the…

Computation and Language · Computer Science 2025-04-23 Junfeng Fang , Houcheng Jiang , Kun Wang , Yunshan Ma , Shi Jie , Xiang Wang , Xiangnan He , Tat-seng Chua

Large Language Models (LLMs) have been shown to achieve breakthrough performance on complex logical reasoning tasks. Nevertheless, most existing research focuses on employing formal language to guide LLMs to derive reliable reasoning paths,…

Computation and Language · Computer Science 2025-05-23 Jin Jiang , Jianing Wang , Yuchen Yan , Yang Liu , Jianhua Zhu , Mengdi Zhang , Xunliang Cai , Liangcai Gao

To continuously improve quality and reflect changes in data, machine learning applications have to regularly retrain and update their core models. We show that a differential analysis of language model snapshots before and after an update…

Mainstream backdoor attack methods typically demand substantial tuning data for poisoning, limiting their practicality and potentially degrading the overall performance when applied to Large Language Models (LLMs). To address these issues,…

Cryptography and Security · Computer Science 2024-03-21 Yanzhou Li , Tianlin Li , Kangjie Chen , Jian Zhang , Shangqing Liu , Wenhan Wang , Tianwei Zhang , Yang Liu

Software, while beneficial, poses potential cybersecurity risks due to inherent vulnerabilities. Detecting these vulnerabilities is crucial, and deep learning has shown promise as an effective tool for this task due to its ability to…

Software Engineering · Computer Science 2024-01-17 Imam Nur Bani Yusuf , Lingxiao Jiang

Large Language Models (LLMs) have recently revolutionized the NLP field, while they still fall short in some specific down-stream tasks. In the work, we focus on utilizing LLMs to perform machine translation, where we observe that two…

Computation and Language · Computer Science 2024-10-10 Weichuan Wang , Zhaoyi Li , Defu Lian , Chen Ma , Linqi Song , Ying Wei

Neural language models (LMs) have been extensively trained on vast corpora to store factual knowledge about various aspects of the world described in texts. Current technologies typically employ knowledge editing methods or specific prompts…

Computation and Language · Computer Science 2024-05-14 Yuchen Cai , Ding Cao , Rongxi Guo , Yaqin Wen , Guiquan Liu , Enhong Chen

Adapting general-purpose language models to new skills is currently an expensive process that must be repeated as new instruction datasets targeting new skills are created, or can cause the models to forget older skills. In this work, we…

Computation and Language · Computer Science 2024-10-18 Jacob Morrison , Noah A. Smith , Hannaneh Hajishirzi , Pang Wei Koh , Jesse Dodge , Pradeep Dasigi

This study investigates the impact of localized updates to large language models (LLMs), specifically in the context of knowledge editing - a task aimed at incorporating or modifying specific facts without altering broader model…

Computation and Language · Computer Science 2025-02-27 Akshat Gupta , Christine Fang , Atahan Ozdemir , Maochuan Lu , Ahmed Alaa , Thomas Hartvigsen , Gopala Anumanchipalli

This work suggests fundamentally rethinking the current practice of pruning large language models (LLMs). The way it is done is by divide and conquer: split the model into submodels, sequentially prune them, and reconstruct predictions of…

Computation and Language · Computer Science 2024-10-14 Sungbin Shin , Wonpyo Park , Jaeho Lee , Namhoon Lee

This work explores sequential model editing in large language models (LLMs), a critical task that involves modifying internal knowledge within LLMs continuously through multi-round editing, each incorporating updates or corrections to…

Computation and Language · Computer Science 2024-10-08 Houcheng Jiang , Junfeng Fang , Tianyu Zhang , An Zhang , Ruipeng Wang , Tao Liang , Xiang Wang

Despite their exceptional capabilities, large language models (LLMs) are prone to generating unintended text due to false or outdated knowledge. Given the resource-intensive nature of retraining LLMs, there has been a notable increase in…

Computation and Language · Computer Science 2024-05-28 Jun-Yu Ma , Zhen-Hua Ling , Ningyu Zhang , Jia-Chen Gu