English
Related papers

Related papers: Everything is Editable: Extend Knowledge Editing t…

200 papers

As real-world knowledge evolves, the information embedded within large language models (LLMs) can become outdated, inadequate, or erroneous. Model editing has emerged as a prominent approach for updating LLMs' knowledge with minimal…

Computation and Language · Computer Science 2025-03-10 Guoxiu He , Xin Song , Aixin Sun

Large language models show impressive abilities in memorizing world knowledge, which leads to concerns regarding memorization of private information, toxic or sensitive knowledge, and copyrighted content. We introduce the problem of Large…

Computation and Language · Computer Science 2025-02-18 Yu Wang , Ruihan Wu , Zexue He , Xiusi Chen , Julian McAuley

Mainstream knowledge management researchers generally agree that knowledge extracted from unstructured data and semi-structured data have become imperative for organizational strategic decision making. In this research, we develop a…

Information Retrieval · Computer Science 2020-07-15 Gerald Onwujekwe , Kweku-Muata Osei-Bryson , Nnatubemugo Ngwum

Developing inherently interpretable models for prediction has gained prominence in recent years. A subclass of these models, wherein the interpretable network relies on learning high-level concepts, are valued because of closeness of…

Computer Vision and Pattern Recognition · Computer Science 2025-03-20 Jayneel Parekh , Quentin Bouniot , Pavlo Mozharovskyi , Alasdair Newson , Florence d'Alché-Buc

Efficiently editing knowledge stored in large language models (LLMs) enables model updates without large-scale training. One possible solution is Locate-and-Edit (L\&E), allowing simultaneous modifications of a massive number of facts.…

Computation and Language · Computer Science 2025-07-25 Weizhi Fei , Hao Shi , Jing Xu , Jingchen Peng , Jiazheng Li , Jingzhao Zhang , Bo Bai , Wei Han , Zhenyuan Chen , Xueyan Niu

Unified Structured Knowledge Reasoning (USKR) aims to answer natural language questions (NLQs) by using structured sources such as tables, databases, and knowledge graphs in a unified way. Existing USKR methods either rely on employing…

Computation and Language · Computer Science 2025-09-24 Yongrui Chen , Junhao He , Linbo Fu , Shenyu Zhang , Rihui Jin , Xinbang Dai , Jiaqi Li , Dehai Min , Nan Hu , Yuxin Zhang , Guilin Qi , Yi Huang , Tongtong Wu

Unlearning knowledge is a pressing and challenging task in Large Language Models (LLMs) because of their unprecedented capability to memorize and digest training data at scale, raising more significant issues regarding safety, privacy, and…

Computation and Language · Computer Science 2026-05-12 Chahana Dahal , Ashutosh Balasubramaniam , Zuobin Xiong

Machine unlearning has emerged as a critical capability for addressing privacy, safety, and regulatory concerns in large language models (LLMs). Existing methods operate at the sequence level, applying uniform updates across all tokens…

Computation and Language · Computer Science 2026-05-07 Jiawei Wu , Doudou Zhou

Large language models (LLMs) often produce incorrect or outdated content after being employed. Efficient and accurate knowledge updates without costly retraining are a major challenge. This problem is particularly challenging in lifelong…

Artificial Intelligence · Computer Science 2026-04-17 Xuyuan Liu , Shengyu Chen , Xinshuai Dong , Yanchi Liu , Xujiang Zhao , Haoyu Wang , Yujun Yan , Haifeng Chen , Zhengzhang Chen

With the rise of generative paradigms, generative recommendation has garnered increasing attention. The core component is the item code, generally derived by quantizing collaborative or semantic representations to serve as candidate items…

Information Retrieval · Computer Science 2025-12-16 Longtao Xiao , Haozhao Wang , Cheng Wang , Linfei Ji , Yifan Wang , Jieming Zhu , Zhenhua Dong , Rui Zhang , Ruixuan Li

Federated Learning is a promising paradigm for privacy-preserving collaborative model training. In practice, it is essential not only to continuously train the model to acquire new knowledge but also to guarantee old knowledge the right to…

Machine Learning · Computer Science 2025-03-03 Zhengyi Zhong , Weidong Bao , Ji Wang , Shuai Zhang , Jingxuan Zhou , Lingjuan Lyu , Wei Yang Bryan Lim

This work explores sequential model editing in large language models (LLMs), a critical task that involves modifying internal knowledge within LLMs continuously through multi-round editing, each incorporating updates or corrections to…

Computation and Language · Computer Science 2024-10-08 Houcheng Jiang , Junfeng Fang , Tianyu Zhang , An Zhang , Ruipeng Wang , Tao Liang , Xiang Wang

Knowledge editing technology is crucial for maintaining the accuracy and timeliness of large language models (LLMs) . However, the setting of this task overlooks a significant portion of commonsense knowledge based on free-text in the real…

Computation and Language · Computer Science 2024-11-01 Xiusheng Huang , Yequan Wang , Jun Zhao , Kang Liu

The information stored in large language models (LLMs) falls out of date quickly, and retraining from scratch is often not an option. This has recently given rise to a range of techniques for injecting new facts through updating model…

Computation and Language · Computer Science 2024-09-10 Zexuan Zhong , Zhengxuan Wu , Christopher D. Manning , Christopher Potts , Danqi Chen

Large Language Models (LLMs) have demonstrated remarkable performance across various domains, including healthcare. However, their ability to effectively represent structured non-textual data, such as the alphanumeric medical codes used in…

The locate-then-edit paradigm has shown significant promise for knowledge editing (KE) in Large Language Models (LLMs). While previous methods perform well on single-hop fact recall tasks, they consistently struggle with multi-hop factual…

Computation and Language · Computer Science 2025-02-04 Zhuoran Zhang , Yongxiang Li , Zijian Kan , Keyuan Cheng , Lijie Hu , Di Wang

The evolution of AI systems toward agentic operation and context-aware retrieval necessitates transforming unstructured text into structured formats like tables, knowledge graphs, and charts. While such conversions enable critical…

Computation and Language · Computer Science 2025-08-19 Zheye Deng , Chunkit Chan , Tianshi Zheng , Wei Fan , Weiqi Wang , Yangqiu Song

Machine learning and data systems increasingly function as infrastructures of memory: they ingest, store, and operationalize traces of personal, political, and cultural life. Yet contemporary governance demands credible forms of forgetting,…

Computers and Society · Computer Science 2026-02-25 Viktoriia Makovska , George Fletcher , Julia Stoyanovich , Tetiana Zakharchenko

Large language models inevitably retain sensitive information, defined as inputs that may induce harmful generations, due to training on massive web corpora, raising concerns for privacy and safety. Existing machine unlearning methods…

Machine Learning · Computer Science 2026-05-21 Yujie Lin , Chengyi Yang , Zhishang Xiang , Yiping Song , Jinsong Su

Lifelong model editing (LME) aims to sequentially rectify outdated or inaccurate knowledge in deployed LLMs while minimizing side effects on unrelated inputs. However, existing approaches typically apply parameter perturbations to a static…

Computation and Language · Computer Science 2026-04-14 Yangfan Wang , Tianyang Sun , Chen Tang , Jie Liu , Wei Cai , Jingchi Jiang