English
Related papers

Related papers: Generalizable Multimodal Large Language Model Edit…

200 papers

Large Language Models (LLMs) have become indispensable tools in science, technology, and society, enabling transformative advances across diverse fields. However, errors or outdated information within these models can undermine their…

Computation and Language · Computer Science 2025-12-19 Qizhou Chen , Chengyu Wang , Taolin Zhang , Xiaofeng He

This paper investigates using knowledge editing techniques to detoxify Large Language Models (LLMs). We construct a benchmark, SafeEdit, which covers nine unsafe categories with various powerful attack prompts and equips comprehensive…

Computation and Language · Computer Science 2024-05-29 Mengru Wang , Ningyu Zhang , Ziwen Xu , Zekun Xi , Shumin Deng , Yunzhi Yao , Qishen Zhang , Linyi Yang , Jindong Wang , Huajun Chen

Large multi-modal models inevitably decay over time as facts update and previously learned information becomes outdated. Traditional approaches such as fine-tuning are often impractical for updating these models due to their size and…

Artificial Intelligence · Computer Science 2025-06-11 Dongliang Guo , Mengxuan Hu , Zihan Guan , Thomas Hartvigsen , Sheng Li

Model editing is a technique that edits the large language models (LLMs) with updated knowledge to alleviate hallucinations without resource-intensive retraining. While current model editing methods can effectively modify a model's behavior…

Computation and Language · Computer Science 2024-10-08 Jia-Chen Gu , Hao-Xiang Xu , Jun-Yu Ma , Pan Lu , Zhen-Hua Ling , Kai-Wei Chang , Nanyun Peng

Out-of-distribution (OOD) detection identifies test samples that differ from the training data, which is critical to ensuring the safety and reliability of machine learning (ML) systems. While a plethora of methods have been developed to…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Viet Duong , Qiong Wu , Zhengyi Zhou , Eric Zavesky , Jiahe Chen , Xiangzhou Liu , Wen-Ling Hsu , Huajie Shao

Large Language Models (LLMs) have been found to struggle with systematic reasoning. Even on tasks where they appear to perform well, their performance often depends on shortcuts, rather than on genuine reasoning abilities, leading them to…

Artificial Intelligence · Computer Science 2025-06-03 Irtaza Khalid , Amir Masoud Nourollah , Steven Schockaert

Omni-modal language models (OLMs) aim to integrate and reason over diverse input modalities--such as text, images, video, and audio--while maintaining strong language capabilities. Despite recent advancements, existing models, especially…

Computation and Language · Computer Science 2025-06-03 Tinghui Zhu , Kai Zhang , Muhao Chen , Yu Su

Although vision models such as Contrastive Language-Image Pre-Training (CLIP) show impressive generalization performance, their zero-shot robustness is still limited under Out-of-Distribution (OOD) scenarios without fine-tuning. Instead of…

Computer Vision and Pattern Recognition · Computer Science 2024-05-30 Zhuo Huang , Chang Liu , Yinpeng Dong , Hang Su , Shibao Zheng , Tongliang Liu

The deployment of autonomous vehicles controlled by machine learning techniques requires extensive testing in diverse real-world environments, robust handling of edge cases and out-of-distribution scenarios, and comprehensive safety…

Machine Learning · Computer Science 2024-11-26 Erfan Aasi , Phat Nguyen , Shiva Sreeram , Guy Rosman , Sertac Karaman , Daniela Rus

As the size of the pre-trained language model (PLM) continues to increase, numerous parameter-efficient transfer learning methods have been proposed recently to compensate for the tremendous cost of fine-tuning. Despite the impressive…

Computation and Language · Computer Science 2023-06-16 Hyunsoo Cho , Choonghyun Park , Junyeop Kim , Hyuhng Joon Kim , Kang Min Yoo , Sang-goo Lee

In real-world routing problems, users often propose conflicting or unreasonable requirements, which result in infeasible optimization models due to overly restrictive or contradictory constraints, leading to an empty feasible solution set.…

Artificial Intelligence · Computer Science 2025-08-06 Kai Li , Ruihao Zheng , Xinye Hao , Zhenkun Wang

Improving out-of-distribution (OOD) generalization during in-distribution (ID) adaptation is a primary goal of robust fine-tuning of zero-shot models beyond naive fine-tuning. However, despite decent OOD generalization performance from…

Computer Vision and Pattern Recognition · Computer Science 2024-11-08 Changdae Oh , Hyesu Lim , Mijoo Kim , Dongyoon Han , Sangdoo Yun , Jaegul Choo , Alexander Hauptmann , Zhi-Qi Cheng , Kyungwoo Song

Large language models (LLMs) have played a pivotal role in building communicative AI, yet they encounter the challenge of efficient updates. Model editing enables the manipulation of specific knowledge memories and the behavior of language…

Computation and Language · Computer Science 2024-10-28 Xinbei Ma , Tianjie Ju , Jiyang Qiu , Zhuosheng Zhang , Hai Zhao , Lifeng Liu , Yulong Wang

Image editing has advanced significantly with the development of diffusion models using both inversion-based and instruction-based methods. However, current inversion-based approaches struggle with big modifications (e.g., adding or…

Computer Vision and Pattern Recognition · Computer Science 2025-05-06 Yaowei Li , Yuxuan Bian , Xuan Ju , Zhaoyang Zhang , Junhao Zhuang , Ying Shan , Yuexian Zou , Qiang Xu

Traditional machine learning paradigms are based on the assumption that both training and test data follow the same statistical pattern, which is mathematically referred to as Independent and Identically Distributed ($i.i.d.$). However, in…

Machine Learning · Computer Science 2023-07-28 Jiashuo Liu , Zheyan Shen , Yue He , Xingxuan Zhang , Renzhe Xu , Han Yu , Peng Cui

In the realm of task-oriented dialogue systems, a robust intent detection mechanism must effectively handle malformed utterances encountered in real-world scenarios. This study presents a novel fine-tuning framework for large language…

Computation and Language · Computer Science 2024-09-23 Bo Liu , Liming Zhan , Yujie Feng , Zexin Lu , Chengqiang Xie , Lei Xue , Albert Y. S. Lam , Xiao-Ming Wu

Instruction-based text editing is increasingly critical for real-world applications such as code editors (e.g., Cursor), but Large Language Models (LLMs) continue to struggle with this task. Unlike free-form generation, editing requires…

Computation and Language · Computer Science 2025-12-16 Yiming Zeng , Jinghan Cao , Zexin Li , Wanhao Yu , Zhankai Ye , Dawei Xiang , Ting Hua , Xin Liu , Shangqian Gao , Tingting Yu

Instruction-based image editing has garnered significant attention due to its direct interaction with users. However, real-world user instructions are immensely diverse, and existing methods often fail to generalize effectively to…

Computer Vision and Pattern Recognition · Computer Science 2025-09-17 Qifei Jia , Yu Liu , Yajie Chai , Xintong Yao , Qiming Lu , Yasen Zhang , Runyu Shi , Ying Huang , Guoquan Zhang

Multi-objective optimization is a common problem in practical applications, and multi-objective evolutionary algorithm (MOEA) is considered as one of the effective methods to solve these problems. However, their randomness sometimes…

Neural and Evolutionary Computing · Computer Science 2024-10-04 Wanyi Liu , Long Chen , Zhenzhou Tang

Knowledge editing aims to update the embedded knowledge within Large Language Models (LLMs). However, existing approaches, whether through parameter modification or external memory integration, often suffer from inconsistent evaluation…

Computation and Language · Computer Science 2025-05-27 Guoxiu He , Xin Song , Futing Wang , Aixin Sun