English
Related papers

Related papers: Model Merging and Safety Alignment: One Bad Model …

200 papers

There is a growing interest in training domain-expert LLMs that excel in specific technical fields compared to their general-purpose instruction-tuned counterparts. However, these expert models often experience a loss in their safety…

Artificial Intelligence · Computer Science 2025-06-02 Megh Thakkar , Quentin Fournier , Matthew Riemer , Pin-Yu Chen , Amal Zouaq , Payel Das , Sarath Chandar

Model merging combines the parameters of multiple neural networks into a single model without additional training. As fine-tuned large language models (LLMs) proliferate, merging offers a computationally efficient alternative to ensembles…

Computation and Language · Computer Science 2026-03-31 Mingyang Song , Mao Zheng

Adapting general-purpose language models to new skills is currently an expensive process that must be repeated as new instruction datasets targeting new skills are created, or can cause the models to forget older skills. In this work, we…

Computation and Language · Computer Science 2024-10-18 Jacob Morrison , Noah A. Smith , Hannaneh Hajishirzi , Pang Wei Koh , Jesse Dodge , Pradeep Dasigi

Model merging, which combines multiple domain-specialized experts into a single model, offers a practical path to endow Large Language Models (LLMs) and Multimodal Large Language Models (MLLMs) with broad capabilities without the cost of…

Machine Learning · Computer Science 2025-10-01 Dengming Zhang , Xiaowen Ma , Zhenliang Ni , Zhenkai Wu , Han Shu , Xin Jiang , Xinghao Chen

Achieving balanced alignment of large language models (LLMs) in terms of Helpfulness, Honesty, and Harmlessness (3H optimization) constitutes a cornerstone of responsible AI. Existing methods like data mixture strategies face limitations,…

Computation and Language · Computer Science 2026-02-03 Jinluan Yang , Dingnan Jin , Anke Tang , Li Shen , Didi Zhu , Zhengyu Chen , Ziyu Zhao , Daixin Wang , Qing Cui , Zhiqiang Zhang , Jun Zhou , Fei Wu , Kun Kuang

Fine-tuning large language models (LLMs) for downstream tasks often leads to catastrophic forgetting, notably degrading the safety of originally aligned models. While some existing methods attempt to restore safety by incorporating…

Computation and Language · Computer Science 2025-08-29 Hua Farn , Hsuan Su , Shachi H Kumar , Saurav Sahay , Shang-Tse Chen , Hung-yi Lee

Model merging is an efficient empowerment technique in the machine learning community that does not require the collection of raw training data and does not require expensive computation. As model merging becomes increasingly prevalent…

Machine Learning · Computer Science 2026-01-01 Enneng Yang , Li Shen , Guibing Guo , Xingwei Wang , Xiaochun Cao , Jie Zhang , Dacheng Tao

Fine-tuning large language models (LLMs) is a common practice to adapt generalist models to specialized domains. However, recent studies show that fine-tuning can erode safety alignment, causing LLMs to respond to harmful or unethical…

Computation and Language · Computer Science 2026-04-24 Aladin Djuhera , Swanand Ravindra Kadhe , Farhan Ahmed , Syed Zawad , Holger Boche

The rapid development of large language models (LLMs) has not only provided numerous opportunities but also presented significant challenges. This becomes particularly evident when LLMs inadvertently generate harmful or toxic content,…

Computation and Language · Computer Science 2024-02-20 Kai Chen , Chunwei Wang , Kuo Yang , Jianhua Han , Lanqing Hong , Fei Mi , Hang Xu , Zhengying Liu , Wenyong Huang , Zhenguo Li , Dit-Yan Yeung , Lifeng Shang , Xin Jiang , Qun Liu

Model merging provides a scalable alternative to multi-task training by combining specialized finetuned models through parameter arithmetic, enabling efficient deployment without the need for joint training or access to all task data. While…

Machine Learning · Computer Science 2025-10-21 Yifei He , Siqi Zeng , Yuzheng Hu , Rui Yang , Tong Zhang , Han Zhao

Large Language Models (LLMs) have been adopted and deployed worldwide for a broad variety of applications. However, ensuring their safe use remains a significant challenge. Preference training and safety measures often overfit to harms…

Computation and Language · Computer Science 2024-10-15 Aakanksha , Arash Ahmadian , Seraphina Goldfarb-Tarrant , Beyza Ermis , Marzieh Fadaee , Sara Hooker

The recent success of specialized Large Language Models (LLMs) in domains such as mathematical reasoning and coding has led to growing interest in methods for merging these expert LLMs into a unified Mixture-of-Experts (MoE) model, with the…

Computation and Language · Computer Science 2025-02-18 Yuhang Zhou , Giannis Karamanolakis , Victor Soto , Anna Rumshisky , Mayank Kulkarni , Furong Huang , Wei Ai , Jianhua Lu

Model merging aims to combine multiple expert models into a more capable single model, offering benefits such as reduced storage and serving costs, improved generalization, and support for decentralized model development. Despite its…

Machine Learning · Computer Science 2024-10-07 Prateek Yadav , Tu Vu , Jonathan Lai , Alexandra Chronopoulou , Manaal Faruqui , Mohit Bansal , Tsendsuren Munkhdalai

Model merging has emerged as a powerful technique for combining specialized capabilities from multiple fine-tuned LLMs without additional training costs. However, the security implications of this widely-adopted practice remain critically…

Cryptography and Security · Computer Science 2026-04-02 Jiaqing Li , Zhibo Zhang , Shide Zhou , Yuxi Li , Tianlong Yu , Kailong Wang

Model merging, such as model souping, is the practice of combining different models with the same architecture together without further training. In this work, we present a model merging methodology that addresses the difficulty of…

Computation and Language · Computer Science 2025-05-27 Lucas Bandarkar , Benjamin Muller , Pritish Yuvraj , Rui Hou , Nayan Singhal , Hongjiang Lv , Bing Liu

Model merging combines multiple fine-tuned checkpoints into a single model without additional training, offering an attractive approach to reusing models and efficiently improving performance. However, it remains unclear whether the…

Computation and Language · Computer Science 2026-03-31 Oğuz Kağan Hitit , Leander Girrbach , Zeynep Akata

Software reuse has long been recognized as a critical and widely studied topic in software engineering, offering substantial benefits in reducing development costs, improving software quality, and enhancing operational efficiency. This…

Software Engineering · Computer Science 2026-02-02 You Lu , Jiyang Zhang , Bihuan Chen , Chaofeng Sha , Dingji Wang , Xin Peng

As safety remains a crucial concern throughout the development lifecycle of Large Language Models (LLMs), researchers and industrial practitioners have increasingly focused on safeguarding and aligning LLM behaviors with human preferences…

Computation and Language · Computer Science 2024-07-11 Jiayang Song , Yuheng Huang , Zhehua Zhou , Lei Ma

The widespread deployment of large language models (LLMs) across linguistic communities necessitates reliable multilingual safety alignment. However, recent efforts to extend alignment to other languages often require substantial resources,…

Computation and Language · Computer Science 2026-02-19 Yuyan Bu , Xiaohao Liu , ZhaoXing Ren , Yaodong Yang , Juntao Dai

Model merging combines multiple models into a single model with aggregated capabilities, making it a powerful tool for large language model (LLM) development. However, scaling model merging is challenging: performance depends on the choice…

Machine Learning · Computer Science 2026-02-03 Oliver Bolton , Aakanksha , Arash Ahmadian , Sara Hooker , Marzieh Fadaee , Beyza Ermis
‹ Prev 1 2 3 10 Next ›