English
Related papers

Related papers: EtCon: Edit-then-Consolidate for Reliable Knowledg…

200 papers

In-context knowledge editing (IKE) enables efficient modification of large language model (LLM) outputs without parameter changes and at zero-cost. However, it can be misused to manipulate responses opaquely, e.g., insert misinformation or…

Computation and Language · Computer Science 2025-04-11 Paul Youssef , Zhixue Zhao , Jörg Schlötterer , Christin Seifert

Lifelong knowledge editing enables continuous, precise updates to outdated knowledge in large language models (LLMs) without computationally expensive full retraining. However, existing methods often accumulate errors throughout the editing…

Machine Learning · Computer Science 2025-10-28 Jinzhe Liu , Junshu Sun , Shufan Shen , Chenxue Yang , Shuhui Wang

Knowledge represented in Large Language Models (LLMs) is quite often incorrect and can also become obsolete over time. Updating knowledge via fine-tuning is computationally resource-hungry and not reliable, and so knowledge editing (KE) has…

Computation and Language · Computer Science 2023-12-21 Weixuan Wang , Barry Haddow , Alexandra Birch

Pretrained Language Models (PLMs) store extensive knowledge within their weights, enabling them to recall vast amount of information. However, relying on this parametric knowledge brings some limitations such as outdated information or gaps…

Computation and Language · Computer Science 2024-06-18 Alessio Galatolo , Meriem Beloucif , Katie Winkle

Enabling artificial intelligence systems, particularly large language models, to integrate new knowledge and flexibly apply it during reasoning remains a central challenge. Existing knowledge editing approaches emphasize atomic facts,…

Artificial Intelligence · Computer Science 2026-02-03 Ya Gao , Kalle Kujanpää , Pekka Marttinen , Harri Valpola , Alexander Ilin

Early weakly supervised video grounding (WSVG) methods often struggle with incomplete boundary detection due to the absence of temporal boundary annotations. To bridge the gap between video-level and boundary-level annotation,…

Computer Vision and Pattern Recognition · Computer Science 2024-03-07 Guozhang Li , Xinpeng Ding , De Cheng , Jie Li , Nannan Wang , Xinbo Gao

Knowledge retrieval with multi-modal queries plays a crucial role in supporting knowledge-intensive multi-modal applications. However, existing methods face challenges in terms of their effectiveness and training efficiency, especially when…

Information Retrieval · Computer Science 2024-01-17 Xinwei Long , Jiali Zeng , Fandong Meng , Zhiyuan Ma , Kaiyan Zhang , Bowen Zhou , Jie Zhou

Large language models (LLMs) often retain outdated or incorrect information from pre-training, which undermines their reliability. While model editing methods have been developed to address such errors without full re-training, they…

Computation and Language · Computer Science 2025-02-25 Dahyun Jung , Jaehyung Seo , Jaewook Lee , Chanjun Park , Heuiseok Lim

Keeping large language models factually up-to-date is crucial for deployment, yet costly retraining remains a challenge. Knowledge editing offers a promising alternative, but methods are only tested on small-scale or synthetic edit…

Computation and Language · Computer Science 2025-09-23 Lukas Thede , Karsten Roth , Matthias Bethge , Zeynep Akata , Tom Hartvigsen

Achieving precise word-level typography control within generated images remains a persistent challenge. To address it, we newly construct a word-level controlled scene text dataset and introduce the Text-Image Alignment (TIA) framework.…

Computer Vision and Pattern Recognition · Computer Science 2025-06-27 Wenda Shi , Yiren Song , Zihan Rao , Dengming Zhang , Jiaming Liu , Xingxing Zou

Automated fact-checking has been a challenging task for the research community. Prior work has explored various strategies, such as end-to-end training, retrieval-augmented generation, and prompt engineering, to build robust fact-checking…

Computation and Language · Computer Science 2026-02-23 Gaurav Kumar , Ayush Garg , Debajyoti Mazumder , Aditya Kishore , Babu kumar , Jasabanta Patro

Self-improvement through post-training methods such as iterative preference learning has been acclaimed for enhancing the problem-solving capabilities (e.g., mathematical reasoning) of Large Language Models (LLMs) without human…

Computation and Language · Computer Science 2024-07-09 Ting Wu , Xuefeng Li , Pengfei Liu

Large Language Models (LLMs) present massive inherent knowledge and superior semantic comprehension capability, which have revolutionized various tasks in natural language processing. Despite their success, a critical gap remains in…

Computation and Language · Computer Science 2025-02-11 Ben Liu , Jihai Zhang , Fangquan Lin , Cheng Yang , Min Peng

Large language models (LLMs) sometimes demonstrate poor performance on knowledge-intensive tasks, commonsense reasoning is one of them. Researchers typically address these issues by retrieving related knowledge from knowledge graphs or…

Computation and Language · Computer Science 2024-10-15 Jiachun Li , Pengfei Cao , Chenhao Wang , Zhuoran Jin , Yubo Chen , Kang Liu , Xiaojian Jiang , Jiexin Xu , Jun Zhao

Safety aligned Large Language Models (LLMs) are vulnerable to harmful fine-tuning attacks -- a few harmful data mixed in the fine-tuning dataset can break the LLMs's safety alignment. While several defenses have been proposed, our…

Artificial Intelligence · Computer Science 2025-09-08 Tiansheng Huang , Gautam Bhattacharya , Pratik Joshi , Josh Kimball , Ling Liu

Retouching is an essential task in post-manipulation of raw photographs. Generative editing, guided by text or strokes, provides a new tool accessible to users but can easily change the identity of the original objects in unacceptable and…

Graphics · Computer Science 2025-05-12 Niladri Shekhar Dutt , Duygu Ceylan , Niloy J. Mitra

In the age of artificial intelligence, the role of large language models (LLMs) is becoming increasingly central. Despite their growing prevalence, their capacity to consolidate knowledge from different training documents - a crucial…

Computation and Language · Computer Science 2024-02-26 Gabriele Prato , Jerry Huang , Prasannna Parthasarathi , Shagun Sodhani , Sarath Chandar

Fine-tuning-based unlearning methods prevail for preventing targeted harmful, sensitive, or copyrighted information within large language models while preserving overall capabilities. However, the true effectiveness of these methods is…

Computation and Language · Computer Science 2024-10-16 Yihuai Hong , Yuelin Zou , Lijie Hu , Ziqian Zeng , Di Wang , Haiqin Yang

The constitutional framework of alignment aims to align large language models (LLMs) with value-laden principles written in natural language (such as to avoid using biased language). Prior work has focused on parameter fine-tuning…

Computation and Language · Computer Science 2026-01-27 Henry Bell , Caroline Zhang , Mohammed Mobasserul Haque , Dhaval Potdar , Samia Zaman , Brandon Fain

As the cost associated with fine-tuning Large Language Models (LLMs) continues to rise, recent research efforts have pivoted towards developing methodologies to edit implicit knowledge embedded within LLMs. Yet, there's still a dark cloud…

Computation and Language · Computer Science 2024-05-14 Zhoubo Li , Ningyu Zhang , Yunzhi Yao , Mengru Wang , Xi Chen , Huajun Chen