中文
相关论文

相关论文: Mitigating the Backdoor Effect for Multi-Task Mode…

200 篇论文

A large body of research has shown that machine learning models are vulnerable to membership inference (MI) attacks that violate the privacy of the participants in the training data. Most MI research focuses on the case of a single…

机器学习 · 计算机科学 2022-05-16 Matthew Jagielski , Stanley Wu , Alina Oprea , Jonathan Ullman , Roxana Geambasu

Model merging aims to integrate multiple task-adapted models into a unified model that preserves the knowledge of each task. In this paper, we identify that the key to this knowledge retention lies in maintaining the directional consistency…

机器学习 · 计算机科学 2026-03-17 Han-Chen Zhang , Zi-Hao Zhou , Mao-Lin Luo , Shimin Di , Min-Ling Zhang , Tong Wei

Model merging has recently emerged as a lightweight alternative to ensembling, combining multiple fine-tuned models into a single set of parameters with no additional training overhead. Yet, existing merging methods fall short of matching…

Model merging aims to combine multiple task-specific expert models into a single model while preserving generalization across diverse tasks. However, interference among experts, especially when they are trained on different objectives,…

计算与语言 · 计算机科学 2026-04-09 Bo Xu , Haotian Wu , Hehai Lin , Weiquan Huang , Beier Zhu , Yao Shu , Chengwei Qin

The increasing operational reliance on complex Multi-Agent Systems (MAS) across safety-critical domains necessitates rigorous adversarial robustness assessment. Modern MAS are inherently heterogeneous, integrating conventional Multi-Agent…

密码学与安全 · 计算机科学 2025-12-19 Akhil Sharma , Shaikh Yaser Arafat , Jai Kumar Sharma , Ken Huang

From a multi-model compression perspective, model merging enables memory-efficient serving of multiple models fine-tuned from the same base, but suffers from degraded performance due to interference among their task-specific parameter…

机器学习 · 计算机科学 2025-05-19 Hangyu Zhou , Aaron Gokaslan , Volodymyr Kuleshov , Bharath Hariharan

A multi-agent AI system (MAS) is composed of multiple autonomous agents that interact, exchange information, and make decisions based on internal generative models. Recent advances in large language models and tool-using agents have made…

It is common practice to outsource the training of machine learning models to cloud providers. Clients who do so gain from the cloud's economies of scale, but implicitly assume trust: the server should not deviate from the client's training…

密码学与安全 · 计算机科学 2025-04-02 Hengrui Jia , Sierra Wyllie , Akram Bin Sediq , Ahmed Ibrahim , Nicolas Papernot

Recently backdoor attack has become an emerging threat to the security of deep neural network (DNN) models. To date, most of the existing studies focus on backdoor attack against the uncompressed model; while the vulnerability of compressed…

密码学与安全 · 计算机科学 2022-08-24 Huy Phan , Cong Shi , Yi Xie , Tianfang Zhang , Zhuohang Li , Tianming Zhao , Jian Liu , Yan Wang , Yingying Chen , Bo Yuan

We present a parameter-efficient method for continual video question-answering (VidQA) learning. Our method, named DAM, uses the proposed Dynamic Adapter Merging to (i) mitigate catastrophic forgetting, (ii) enable efficient adaptation to…

计算机视觉与模式识别 · 计算机科学 2024-04-24 Feng Cheng , Ziyang Wang , Yi-Lin Sung , Yan-Bo Lin , Mohit Bansal , Gedas Bertasius

Model merging aims to integrate task-specific abilities from individually fine-tuned models into a single model without extra training. In recent model merging methods, task vector has become a fundamental building block, as it can…

人工智能 · 计算机科学 2025-10-17 Bang An , Yibo Yang , Philip Torr , Bernard Ghanem

The Linear Parameter Varying Dynamical System (LPV-DS) is an effective approach that learns stable, time-invariant motion policies using statistical modeling and semi-definite optimization to encode complex motions for reactive robot…

机器人学 · 计算机科学 2024-03-26 Sunan Sun , Haihui Gao , Tianyu Li , Nadia Figueroa

Backdoor (trojan) attacks embed hidden, controllable behaviors into machine-learning models so that models behave normally on benign inputs but produce attacker-chosen outputs when a trigger is present. This survey reviews the rapidly…

密码学与安全 · 计算机科学 2025-09-10 Bilal Hussain Abbasi , Yanjun Zhang , Leo Zhang , Shang Gao

Reinforcement learning (RL) is central to post-training, particularly for agentic models that require specialized reasoning behaviors. In this setting, model merging offers a practical mechanism for integrating multiple RL-trained agents…

机器学习 · 计算机科学 2026-01-21 Xiangchi Yuan , Dachuan Shi , Chunhui Zhang , Zheyuan Liu , Shenglong Yao , Soroush Vosoughi , Wenke Lee

The success of large language models has garnered widespread attention for model merging techniques, especially training-free methods which combine model capabilities within the parameter space. However, two challenges remain: (1) uniform…

人工智能 · 计算机科学 2025-03-28 Jiaqi Han , Jingwen Ye , Shunyu Liu , Haofei Zhang , Jie Song , Zunlei Feng , Mingli Song

Back-door attack poses a severe threat to deep learning systems. It injects hidden malicious behaviors to a model such that any input stamped with a special pattern can trigger such behaviors. Detecting back-door is hence of pressing need.…

机器学习 · 计算机科学 2021-08-03 Guangyu Shen , Yingqi Liu , Guanhong Tao , Shengwei An , Qiuling Xu , Siyuan Cheng , Shiqing Ma , Xiangyu Zhang

Model merging enables the reuse of fine-tuned models without joint training or access to original data. Dynamic merging further improves flexibility by selectively activating task-relevant parameters and efficiently composing experts across…

机器学习 · 计算机科学 2026-05-20 Guodong Du , Wanyu Lin

Deep model fusion/merging is an emerging technique that merges the parameters or predictions of multiple deep learning models into a single one. It combines the abilities of different models to make up for the biases and errors of a single…

机器学习 · 计算机科学 2023-09-28 Weishi Li , Yong Peng , Miao Zhang , Liang Ding , Han Hu , Li Shen

Preventing collisions in multi-robot navigation is crucial for deployment. This requirement hinders the use of learning-based approaches, such as multi-agent reinforcement learning (MARL), on their own due to their lack of safety…

Deep learning models are vulnerable to backdoor attacks, where adversaries inject malicious functionality during training that activates on trigger inputs at inference time. Extensive research has focused on developing stealthy backdoor…

密码学与安全 · 计算机科学 2024-11-26 Jeongjin Shin , Sangdon Park