中文
相关论文

相关论文: CodeAttack: Revealing Safety Generalization Challe…

200 篇论文

The generalization capabilities of Large Language Models (LLMs) have led to their widespread deployment across various applications. However, this increased adoption has introduced several security threats, notably in the forms of…

密码学与安全 · 计算机科学 2025-08-04 Francesco Panebianco , Stefano Bonfanti , Francesco Trovò , Michele Carminati

Large Language Models (LLMs) show remarkable capabilities in understanding natural language and generating complex code. However, as practitioners adopt CodeLLMs for increasingly critical development tasks, research reveals that these…

密码学与安全 · 计算机科学 2026-03-13 Maximilian Wendlinger , Daniel Kowatsch , Konstantin Böttinger , Philip Sperl

Large language models (LLMs) are popular for high-quality text generation but can produce harmful content, even when aligned with human values through reinforcement learning. Adversarial prompts can bypass their safety measures. We propose…

计算与语言 · 计算机科学 2024-05-03 Mansi Phute , Alec Helbling , Matthew Hull , ShengYun Peng , Sebastian Szyller , Cory Cornelius , Duen Horng Chau

Automated detection of software vulnerabilities is critical for enhancing security, yet existing methods often struggle with the complexity and diversity of modern codebases. In this paper, we introduce EnStack, a novel ensemble stacking…

软件工程 · 计算机科学 2024-11-26 Shahriyar Zaman Ridoy , Md. Shazzad Hossain Shaon , Alfredo Cuzzocrea , Mst Shapna Akter

In the burgeoning field of Large Language Models (LLMs), developing a robust safety mechanism, colloquially known as "safeguards" or "guardrails", has become imperative to ensure the ethical use of LLMs within prescribed boundaries. This…

密码学与安全 · 计算机科学 2024-06-06 Yi Dong , Ronghui Mu , Yanghao Zhang , Siqi Sun , Tianle Zhang , Changshun Wu , Gaojie Jin , Yi Qi , Jinwei Hu , Jie Meng , Saddek Bensalem , Xiaowei Huang

While large language models (LLMs) exhibit remarkable capabilities across a wide range of tasks, they pose potential safety concerns, such as the ``jailbreak'' problem, wherein malicious instructions can manipulate LLMs to exhibit…

计算与语言 · 计算机科学 2024-03-05 Yue Deng , Wenxuan Zhang , Sinno Jialin Pan , Lidong Bing

Jailbreak attacks reveal critical vulnerabilities in Large Language Models (LLMs) by causing them to generate harmful or unethical content. Evaluating these threats is particularly challenging due to the evolving nature of LLMs and the…

机器学习 · 计算机科学 2025-07-11 Peiyan Zhang , Haibo Jin , Liying Kang , Haohan Wang

Large Language Models (LLMs) remain susceptible to jailbreak exploits that bypass safety filters and induce harmful or unethical behavior. This work presents a systematic taxonomy of existing jailbreak defenses across prompt-level,…

密码学与安全 · 计算机科学 2025-11-25 Ryan Wong , Hosea David Yu Fei Ng , Dhananjai Sharma , Glenn Jun Jie Ng , Kavishvaran Srinivasan

Large Language Models (LLMs) can generate code but often introduce security vulnerabilities, logical inconsistencies, and compilation errors. Prior work demonstrates that LLMs benefit substantially from structured feedback, static analysis,…

密码学与安全 · 计算机科学 2026-01-05 Vidyut Sriram , Sawan Pandita , Achintya Lakshmanan , Aneesh Shamraj , Suman Saha

The rapid integration of Generative AI (GenAI) and Large Language Models (LLMs) in sectors such as education and healthcare have marked a significant advancement in technology. However, this growth has also led to a largely unexplored…

密码学与安全 · 计算机科学 2024-03-20 Tri Nguyen , Huong Nguyen , Ahmad Ijaz , Saeid Sheikhi , Athanasios V. Vasilakos , Panos Kostakos

Large Language Models (LLMs) have performed exceptionally in various text-generative tasks, including question answering, translation, code completion, etc. However, the over-assistance of LLMs has raised the challenge of "jailbreaking",…

密码学与安全 · 计算机科学 2024-09-02 Sibo Yi , Yule Liu , Zhen Sun , Tianshuo Cong , Xinlei He , Jiaxing Song , Ke Xu , Qi Li

Large Language Models (LLM) have made remarkable progress, but concerns about potential biases and harmful content persist. To address these apprehensions, we introduce a practical solution for ensuring LLM's safe and ethical use. Our novel…

密码学与安全 · 计算机科学 2025-04-24 Chaima Njeh , Haïfa Nakouri , Fehmi Jaafar

Security vulnerabilities are increasingly prevalent in modern software and they are widely consequential to our society. Various approaches to defending against these vulnerabilities have been proposed, among which those leveraging deep…

密码学与安全 · 计算机科学 2024-02-28 Yu Nong , Mohammed Aldeen , Long Cheng , Hongxin Hu , Feng Chen , Haipeng Cai

Large Language Models (LLMs) are increasingly used to control robotic systems such as drones, but their risks of causing physical threats and harm in real-world applications remain unexplored. Our study addresses the critical gap in…

机器学习 · 计算机科学 2026-02-20 Yung-Chen Tang , Pin-Yu Chen , Tsung-Yi Ho

Federated learning (FL) enables multiple parties to collaboratively fine-tune an large language model (LLM) without the need of direct data sharing. Ideally, by training on decentralized data that is aligned with human preferences and…

计算与语言 · 计算机科学 2024-06-18 Rui Ye , Jingyi Chai , Xiangrui Liu , Yaodong Yang , Yanfeng Wang , Siheng Chen

This paper presents a critical examination of the surprising efficacy of Large Language Models (LLMs) in penetration testing. The paper thoroughly reviews the evolution of LLMs and their rapidly expanding capabilities which render them…

密码学与安全 · 计算机科学 2025-07-02 Andreas Happe , Jürgen Cito

Integrating large language models (LLMs) into robotic systems has revolutionised embodied artificial intelligence, enabling advanced decision-making and adaptability. However, ensuring reliability, encompassing both security against…

机器人学 · 计算机科学 2025-09-03 Wenxiao Zhang , Xiangrui Kong , Conan Dewitt , Thomas Bräunl , Jin B. Hong

Large Language Models (LLMs) presents significant priority in text understanding and generation. However, LLMs suffer from the risk of generating harmful contents especially while being employed to applications. There are several black-box…

计算与语言 · 计算机科学 2023-12-11 Chengyuan Liu , Fubang Zhao , Lizhi Qing , Yangyang Kang , Changlong Sun , Kun Kuang , Fei Wu

Large Language Models (LLMs) are one of the most promising developments in the field of artificial intelligence, and the software engineering community has readily noticed their potential role in the software development life-cycle.…

软件工程 · 计算机科学 2026-03-16 Greta Dolcetti , Vincenzo Arceri , Eleonora Iotti , Sergio Maffeis , Agostino Cortesi , Enea Zaffanella

Benefiting from the powerful capabilities of Large Language Models (LLMs), pre-trained visual encoder models connected to an LLMs can realize Vision Language Models (VLMs). However, existing research shows that the visual modality of VLMs…

计算机视觉与模式识别 · 计算机科学 2024-05-24 Zhendong Liu , Yuanbi Nie , Yingshui Tan , Xiangyu Yue , Qiushi Cui , Chongjun Wang , Xiaoyong Zhu , Bo Zheng