中文
相关论文

相关论文: Minimal Prompt Perturbations Lead to Code Vulnerab…

200 篇论文

Large Language Models (LLMs) have emerged as powerful tools for automating programming tasks, including security-related ones. However, they can also introduce vulnerabilities during code generation, fail to detect existing vulnerabilities,…

密码学与安全 · 计算机科学 2026-03-18 Enna Basic , Alberto Giaretta

Large Language Models (LLMs) have shown remarkable potential in code generation, making them increasingly important in the field. However, the security issues of generated code have not been fully addressed, and the usability of LLMs in…

密码学与安全 · 计算机科学 2024-10-21 Shigang Liu , Bushra Sabir , Seung Ick Jang , Yuval Kansal , Yansong Gao , Kristen Moore , Alsharif Abuadbba , Surya Nepal

Prompt-based learning paradigm bridges the gap between pre-training and fine-tuning, and works effectively under the few-shot setting. However, we find that this learning paradigm inherits the vulnerability from the pre-training stage,…

计算与语言 · 计算机科学 2022-04-12 Lei Xu , Yangyi Chen , Ganqu Cui , Hongcheng Gao , Zhiyuan Liu

Small Language Models (SLMs) are increasingly being deployed in resource-constrained environments, yet their behavioral robustness to data contamination during instruction tuning remains poorly understood. We systematically investigate the…

计算与语言 · 计算机科学 2025-11-11 Nicy Scaria , Silvester John Joseph Kennedy , Deepak Subramani

Traditional static analysis methods struggle to detect semantic design flaws, such as violations of the SOLID principles, which require a strong understanding of object-oriented design patterns and principles. Existing solutions typically…

软件工程 · 计算机科学 2025-09-04 Fatih Pehlivan , Arçin Ülkü Ergüzen , Sahand Moslemi Yengejeh , Mayasah Lami , Anil Koyuncu

Large language models write production code, and yet they routinely introduce well-known vulnerabilities. We show that this is not a knowledge deficit: the same models that generate insecure code, correctly identify and explain the…

密码学与安全 · 计算机科学 2026-04-21 Gustavo Sandoval , Brendan Dolan-Gavitt , Siddharth Garg

Large Language Models (LLMs) are widely deployed in real-world systems. Given their broader applicability, prompt engineering has become an efficient tool for resource-scarce organizations to adopt LLMs for their own purposes. At the same…

密码学与安全 · 计算机科学 2026-02-27 Piyush Jaiswal , Aaditya Pratap , Shreyansh Saraswati , Harsh Kasyap , Somanath Tripathy

This paper introduces SGCode, a flexible prompt-optimizing system to generate secure code with large language models (LLMs). SGCode integrates recent prompt-optimization approaches with LLMs in a unified system accessible through front-end…

密码学与安全 · 计算机科学 2024-09-26 Khiem Ton , Nhi Nguyen , Mahmoud Nazzal , Abdallah Khreishah , Cristian Borcea , NhatHai Phan , Ruoming Jin , Issa Khalil , Yelong Shen

System prompts that include detailed instructions to describe the task performed by the underlying LLM can easily transform foundation models into tools and services with minimal overhead. They are often considered intellectual property,…

密码学与安全 · 计算机科学 2025-08-07 David Pape , Sina Mavali , Thorsten Eisenhofer , Lea Schönherr

The increasing use of generative Artificial Intelligence (AI) in modern software engineering, particularly Large Language Models (LLMs) for code generation, has transformed professional software development by boosting productivity and…

软件工程 · 计算机科学 2025-07-31 Sabrina Kaniewski , Dieter Holstein , Fabian Schmidt , Tobias Heer

Large language models (LLMs) have achieved widespread adoption across numerous applications. However, many LLMs are vulnerable to malicious attacks even after safety alignment. These attacks typically bypass LLMs' safety guardrails by…

密码学与安全 · 计算机科学 2025-06-17 Yucheng Li , Surin Ahn , Huiqiang Jiang , Amir H. Abdi , Yuqing Yang , Lili Qiu

Code generation, the task of producing source code from prompts, has seen significant advancements with the advent of pre-trained large language models (PLMs). Despite these achievements, there lacks a comprehensive taxonomy of weaknesses…

软件工程 · 计算机科学 2024-07-18 Xiaoli Lian , Shuaisong Wang , Jieping Ma , Fang Liu , Xin Tan , Li Zhang , Lin Shi , Cuiyun Gao

As the AI systems become deeply embedded in social media platforms, we've uncovered a concerning security vulnerability that goes beyond traditional adversarial attacks. It becomes important to assess the risks of LLMs before the general…

计算与语言 · 计算机科学 2025-05-30 Nilanjana Das , Edward Raff , Aman Chadha , Manas Gaur

The wide-ranging applications of large language models (LLMs), especially in safety-critical domains, necessitate the proper evaluation of the LLM's adversarial robustness. This paper proposes an efficient tool to audit the LLM's…

密码学与安全 · 计算机科学 2023-10-23 Xilie Xu , Keyi Kong , Ning Liu , Lizhen Cui , Di Wang , Jingfeng Zhang , Mohan Kankanhalli

In recent years, the AI wave has grown rapidly in software development. Even novice developers can now design and generate complex framework-constrained software systems based on their high-level requirements with the help of Large Language…

软件工程 · 计算机科学 2025-11-13 Yue Liu , Zhenchang Xing , Shidong Pan , Chakkrit Tantithamthavorn

Chain-of-Thought (CoT) prompting has emerged as a foundational technique for eliciting reasoning from Large Language Models (LLMs), yet the robustness of this approach to corruptions in intermediate reasoning steps remains poorly…

计算与语言 · 计算机科学 2026-04-20 Ashwath Vaithinathan Aravindan , Mayank Kejriwal

Code Large Language Models (Code LLMs) have been increasingly used by developers to boost productivity, but they often generate vulnerable code. Thus, there is an urgent need to ensure that code generated by Code LLMs is correct and secure.…

密码学与安全 · 计算机科学 2024-07-23 Yanjun Fu , Ethan Baker , Yu Ding , Yizheng Chen

Large language models (LLMs) have been proposed as powerful tools for detecting software vulnerabilities, where task-specific fine-tuning is typically employed to provide vulnerability-specific knowledge to the LLMs. However, existing…

软件工程 · 计算机科学 2025-07-22 Ruijun Feng , Hammond Pearce , Pietro Liguori , Yulei Sui

In-context learning (ICL) has emerged as a powerful paradigm leveraging LLMs for specific downstream tasks by utilizing labeled examples as demonstrations (demos) in the preconditioned prompts. Despite its promising performance, crafted…

机器学习 · 计算机科学 2025-05-30 Xiangyu Zhou , Yao Qiang , Saleh Zare Zade , Prashant Khanduri , Dongxiao Zhu

Code vulnerability detection (CVD) is essential for addressing and preventing system security issues, playing a crucial role in ensuring software security. Previous learning-based vulnerability detection methods rely on either fine-tuning…

计算与语言 · 计算机科学 2025-01-07 Xuefeng Jiang , Lvhua Wu , Sheng Sun , Jia Li , Jingjing Xue , Yuwei Wang , Tingting Wu , Min Liu