English
Related papers

Related papers: Localizing Malicious Outputs from CodeLLM

200 papers

Large Language Models (LLMs) can acquire deceptive behaviors through backdoor attacks, where the model executes prohibited actions whenever secret triggers appear in the input. Existing safety training methods largely fail to address this…

Cryptography and Security · Computer Science 2025-10-08 Guangyu Shen , Siyuan Cheng , Xiangzhe Xu , Yuan Zhou , Hanxi Guo , Zhuo Zhang , Xiangyu Zhang

Large language models (LLMs) have seen significant advancements, achieving superior performance in various Natural Language Processing (NLP) tasks, from understanding to reasoning. However, they remain vulnerable to backdoor attacks, where…

Computation and Language · Computer Science 2024-11-28 Chen Chen , Yuchen Sun , Xueluan Gong , Jiaxin Gao , Kwok-Yan Lam

Quantum Federated Learning (QFL) inherits the core vulnerability of federated optimization to malicious clients, while also introducing an attack surface from variational circuit training and measurement-driven gradients. This work proposes…

Quantum Physics · Physics 2026-05-28 Aakar Mathur , Mohammed Ruknuddin , Ashish Gupta

Large language model (LLM) systems increasingly power everyday AI applications such as chatbots, computer-use assistants, and autonomous robots, where performance often depends on manually well-crafted prompts. LLM-based prompt optimizers…

Machine Learning · Computer Science 2026-01-14 Andrew Zhao , Reshmi Ghosh , Vitor Carvalho , Emily Lawton , Keegan Hines , Gao Huang , Jack W. Stokes

Large language models (LLMs) have demonstrated superior performance compared to previous methods on various tasks, and often serve as the foundation models for many researches and services. However, the untrustworthy third-party LLMs may…

Cryptography and Security · Computer Science 2024-04-02 Hai Huang , Zhengyu Zhao , Michael Backes , Yun Shen , Yang Zhang

The remarkable performance of large language models (LLMs) in generation tasks has enabled practitioners to leverage publicly available models to power custom applications, such as chatbots and virtual assistants. However, the data used to…

Artificial Intelligence · Computer Science 2025-03-28 Yuetai Li , Zhangchen Xu , Fengqing Jiang , Luyao Niu , Dinuka Sahabandu , Bhaskar Ramasubramanian , Radha Poovendran

Fuzzing is an effective bug-finding technique but it struggles with complex systems like JavaScript engines that demand precise grammatical input. Recently, researchers have adopted language models for context-aware mutation in fuzzing to…

Cryptography and Security · Computer Science 2024-02-20 Jueon Eom , Seyeon Jeong , Taekyoung Kwon

Generative AI and large language models (LLMs) have shown strong capabilities in code understanding, but their use in cybersecurity, particularly for malware detection and analysis, remains limited. Existing detection systems often fail to…

Information Retrieval · Computer Science 2025-10-23 Hamed Jelodar , Mohammad Meymani , Roozbeh Razavi-Far , Ali A. Ghorbani

Automatic adversarial prompt generation provides remarkable success in jailbreaking safely-aligned large language models (LLMs). Existing gradient-based attacks, while demonstrating outstanding performance in jailbreaking white-box LLMs,…

Machine Learning · Computer Science 2025-01-22 Qizhang Li , Xiaochen Yang , Wangmeng Zuo , Yiwen Guo

Safety-aligned large language models (LLMs) remain vulnerable to backdoor attacks. Recent model editing-based approaches enable efficient backdoor injection by directly modifying a small set of parameters to map triggers to attacker-desired…

Computation and Language · Computer Science 2026-03-25 Houcheng Jiang , Zetong Zhao , Junfeng Fang , Haokai Ma , Ruipeng Wang , Xiang Wang , Xiangnan He , Yang Deng

With the rise of advanced reasoning capabilities, large language models (LLMs) are receiving increasing attention. However, although reasoning improves LLMs' performance on downstream tasks, it also introduces new security risks, as…

Cryptography and Security · Computer Science 2025-10-10 Man Hu , Xinyi Wu , Zuofeng Suo , Jinbo Feng , Linghui Meng , Yanhao Jia , Anh Tuan Luu , Shuai Zhao

Fine-tuned Large Language Models (LLMs) are vulnerable to backdoor attacks through data poisoning, yet the internal mechanisms governing these attacks remain a black box. Previous research on interpretability for LLM safety tends to focus…

Cryptography and Security · Computer Science 2025-10-01 Miao Yu , Zhenhong Zhou , Moayad Aloqaily , Kun Wang , Biwei Huang , Stephen Wang , Yueming Jin , Qingsong Wen

Large Language Model (LLM) based listwise ranking has shown superior performance in many passage ranking tasks. With the development of Large Reasoning Models (LRMs), many studies have demonstrated that step-by-step reasoning during…

Information Retrieval · Computer Science 2026-04-23 Wenhan Liu , Xinyu Ma , Weiwei Sun , Yutao Zhu , Yuchen Li , Dawei Yin , Zhicheng Dou

Despite being widely applied due to their exceptional capabilities, Large Language Models (LLMs) have been proven to be vulnerable to backdoor attacks. These attacks introduce targeted vulnerabilities into LLMs by poisoning training samples…

Cryptography and Security · Computer Science 2025-07-10 Shuai Zhao , Leilei Gan , Zhongliang Guo , Xiaobao Wu , Yanhao Jia , Luwei Xiao , Cong-Duy Nguyen , Luu Anh Tuan

Mutation-based Fault Localization (MBFL) has been widely explored for automated software debugging, leveraging artificial mutants to identify faulty code entities. However, MBFL faces significant challenges due to interference mutants…

Software Engineering · Computer Science 2025-12-01 Hengyuan Liu , Zheng Li , Donghua Wang , Yankai Wu , Xiang Chen , Yong Liu

Large language model (LLM) safety is a critical issue, with numerous studies employing red team testing to enhance model security. Among these, jailbreak methods explore potential vulnerabilities by crafting malicious prompts that induce…

Computation and Language · Computer Science 2025-03-07 Honglin Mu , Han He , Yuxin Zhou , Yunlong Feng , Yang Xu , Libo Qin , Xiaoming Shi , Zeming Liu , Xudong Han , Qi Shi , Qingfu Zhu , Wanxiang Che

In malware behavioral analysis, the list of accessed and created files very often indicates whether the examined file is malicious or benign. However, malware authors are trying to avoid detection by generating random filenames and/or…

Machine Learning · Computer Science 2021-10-26 Marek Galovic , Branislav Bosansky , Viliam Lisy

Large Language Models (LLMs) have shown impressive proficiency in code generation. Unfortunately, these models share a weakness with their human counterparts: producing code that inadvertently has security vulnerabilities. These…

Cryptography and Security · Computer Science 2024-10-17 Kamel Alrashedy , Abdullah Aljasser , Pradyumna Tambwekar , Matthew Gombolay

LLM coding agents now generate code at an unprecedented scale, yet LLM-generated code introduces cybersecurity vulnerabilities into codebases without human involvement. Even when frontier models are explicitly asked to write secure…

Cryptography and Security · Computer Science 2026-05-12 Houjun Liu , Lisa Einstein , John Yang , Joachim Baumann , Duncan Eddy , Christopher D. Manning , Mykel Kochenderfer , Diyi Yang

LLMs are increasingly used for code generation, but their outputs often follow recurring templates that can induce predictable vulnerabilities. We study vulnerability persistence in LLM-generated software and introduce Feature--Security…

Cryptography and Security · Computer Science 2026-03-10 Tomer Kordonsky , Maayan Yamin , Noam Benzimra , Amit LeVi , Avi Mendelson