中文
相关论文

相关论文: Tamper-Resistant Safeguards for Open-Weight LLMs

200 篇论文

The LLM unlearning technique has recently been introduced to comply with data regulations and address the safety and ethical concerns of LLMs by removing the undesired data-model influence. However, state-of-the-art unlearning methods face…

机器学习 · 计算机科学 2025-05-28 Chongyu Fan , Jinghan Jia , Yihua Zhang , Anil Ramakrishna , Mingyi Hong , Sijia Liu

Large Language Model (LLM)-based Multi-agent Systems (MAS) have demonstrated remarkable capabilities in various complex tasks, ranging from collaborative problem-solving to autonomous decision-making. However, as these systems become…

密码学与安全 · 计算机科学 2025-02-18 Shilong Wang , Guibin Zhang , Miao Yu , Guancheng Wan , Fanci Meng , Chongye Guo , Kun Wang , Yang Wang

With the recent advancement of Large Language Models (LLMs), generating functionally correct code has become less complicated for a wide array of developers. While using LLMs has sped up the functional development process, it poses a heavy…

密码学与安全 · 计算机科学 2024-02-01 Nafis Tanveer Islam , Mohammad Bahrami Karkevandi , Peyman Najafirad

Large Language Models (LLMs) have exploded a new heatwave of AI for their ability to engage end-users in human-level conversations with detailed and articulate answers across many knowledge domains. In response to their fast adoption in…

The rapid advancement of Large Language Models (LLMs) has opened up new opportunities for leveraging artificial intelligence in a variety of application domains, including cybersecurity. As the volume and sophistication of cyber threats…

密码学与安全 · 计算机科学 2025-09-23 Hanxiang Xu , Shenao Wang , Ningke Li , Kailong Wang , Yanjie Zhao , Kai Chen , Ting Yu , Yang Liu , Haoyu Wang

Large Language Models (LLMs) have demonstrated extraordinary capabilities and contributed to multiple fields, such as generating and summarizing text, language translation, and question-answering. Nowadays, LLM is becoming a very popular…

计算与语言 · 计算机科学 2024-11-18 Badhan Chandra Das , M. Hadi Amini , Yanzhao Wu

Multimodal Large Language Models (MLLMs) have enabled transformative advancements across diverse applications but remain susceptible to safety threats, especially jailbreak attacks that induce harmful outputs. To systematically evaluate and…

The open-sourcing of large language models (LLMs) accelerates application development, innovation, and scientific progress. This includes both base models, which are pre-trained on extensive datasets without alignment, and aligned models,…

计算与语言 · 计算机科学 2024-04-17 Xiao Wang , Tianze Chen , Xianjun Yang , Qi Zhang , Xun Zhao , Dahua Lin

Large language models (LLMs) represent significant breakthroughs in artificial intelligence and hold potential for applications within smart grids. However, as demonstrated in previous literature, AI technologies are susceptible to various…

密码学与安全 · 计算机科学 2025-04-22 Jiangnan Li , Yingyuan Yang , Jinyuan Sun

Open-source Large Language Models (LLMs) often employ safety alignment methods to resist harmful instructions. However, recent research shows that maliciously fine-tuning these LLMs on harmful data can easily bypass these safeguards. To…

密码学与安全 · 计算机科学 2025-07-30 Zixuan Chen , Weikai Lu , Xin Lin , Ziqian Zeng

Despite the intrinsic risk-awareness of Large Language Models (LLMs), current defenses often result in shallow safety alignment, rendering models vulnerable to disguised attacks (e.g., prefilling) while degrading utility. To bridge this…

密码学与安全 · 计算机科学 2026-01-26 Xianya Fang , Xianying Luo , Yadong Wang , Xiang Chen , Yu Tian , Zequn Sun , Rui Liu , Jun Fang , Naiqiang Tan , Yuanning Cui , Sheng-Jun Huang

This paper introduces a tamper-resistant framework for large language models (LLMs) in medical applications, utilizing quantum gradient descent (QGD) to detect malicious parameter modifications in real time. Integrated into a LLaMA-based…

分子网络 · 定量生物学 2025-06-25 Fahmida Hai , Saif Nirzhor , Rubayat Khan , Don Roosan

The proliferation of large language models (LLMs) has sparked widespread and general interest due to their strong language generation capabilities, offering great potential for both industry and research. While previous research delved into…

人工智能 · 计算机科学 2024-07-09 Lukas Struppek , Minh Hieu Le , Dominik Hintersdorf , Kristian Kersting

Large Language Models (LLMs) have demonstrated remarkable success across various NLP benchmarks. However, excelling in complex tasks that require nuanced reasoning and precise decision-making demands more than raw language proficiency--LLMs…

计算与语言 · 计算机科学 2025-02-24 Ang Li , Yichuan Mo , Mingjie Li , Yifei Wang , Yisen Wang

Fine-tuning-as-a-Service introduces a critical vulnerability where a few malicious examples mixed into the user's fine-tuning dataset can compromise the safety alignment of Large Language Models (LLMs). While a recognized paradigm frames…

计算与语言 · 计算机科学 2025-08-12 Biao Yi , Jiahao Li , Baolei Zhang , Lihai Nie , Tong Li , Tiansheng Huang , Zheli Liu

Fine-tuning large language models (LLMs) to adapt to evolving safety policies is costly and impractical. Mechanistic interpretability enables inference-time control through latent activation steering, yet its potential for precise,…

机器学习 · 计算机科学 2025-06-06 Shaona Ghosh , Amrita Bhattacharjee , Yftah Ziser , Christopher Parisien

Large visual language models (LVLMs) have demonstrated excellent instruction-following capabilities, yet remain vulnerable to stealthy backdoor attacks when finetuned using contaminated data. Existing backdoor defense techniques are usually…

密码学与安全 · 计算机科学 2025-06-09 Yuan Xun , Siyuan Liang , Xiaojun Jia , Xinwei Liu , Xiaochun Cao

Large language models (LLMs) have shown great potential as general-purpose AI assistants in various domains. To meet the requirements of different applications, LLMs are often customized by further fine-tuning. However, the powerful…

机器学习 · 计算机科学 2023-11-07 Xin Zhou , Yi Lu , Ruotian Ma , Tao Gui , Qi Zhang , Xuanjing Huang

Large language models (LLMs) have emerged as powerful tools for addressing a wide range of general inquiries and tasks. Despite this, fine-tuning aligned LLMs on smaller, domain-specific datasets, critical to adapting them to specialized…

人工智能 · 计算机科学 2025-02-04 Guanlin Li , Kangjie Chen , Shangwei Guo , Jie Zhang , Han Qiu , Chao Zhang , Guoyin Wang , Tianwei Zhang , Jiwei Li

This study reveals a previously unexplored vulnerability in the safety alignment of Large Language Models (LLMs). Existing aligned LLMs predominantly respond to unsafe queries with refusals, which often begin with a fixed set of prefixes…

密码学与安全 · 计算机科学 2026-01-28 Yangyang Guo , Ziwei Xu , Si Liu , Zhiming Zheng , Mohan Kankanhalli