English
Related papers

Related papers: APPATCH: Automated Adaptive Prompting Large Langua…

200 papers

With the advent and widespread deployment of Multimodal Large Language Models (MLLMs), the imperative to ensure their safety has become increasingly pronounced. However, with the integration of additional modalities, MLLMs are exposed to…

Cryptography and Security · Computer Science 2024-03-15 Yu Wang , Xiaogeng Liu , Yu Li , Muhao Chen , Chaowei Xiao

Automatic program repair (APR) techniques have the potential to reduce manual efforts in uncovering and repairing program defects during the code review (CR) process. However, the limited accuracy and considerable time costs associated with…

Software Engineering · Computer Science 2024-01-01 Zelin Zhao , Zhaogui Xu , Jialong Zhu , Peng Di , Yuan Yao , Xiaoxing Ma

Automated Program Repair (APR) aims to automatically generate patches for buggy programs. Recent APR work has been focused on leveraging modern Large Language Models (LLMs) to directly generate patches for APR. Such LLM-based APR tools work…

Software Engineering · Computer Science 2024-12-11 Chunqiu Steven Xia , Lingming Zhang

Previous learning-based vulnerability detection methods relied on either medium-sized pre-trained models or smaller neural networks from scratch. Recent advancements in Large Pre-Trained Language Models (LLMs) have showcased remarkable…

Software Engineering · Computer Science 2024-01-30 Xin Zhou , Ting Zhang , David Lo

As large language models (LLMs) are increasingly deployed in diverse applications, including chatbot assistants and code generation, aligning their behavior with safety and ethical standards has become paramount. However, jailbreak attacks,…

Cryptography and Security · Computer Science 2025-02-13 Yang Ouyang , Hengrui Gu , Shuhang Lin , Wenyue Hua , Jie Peng , Bhavya Kailkhura , Meijun Gao , Tianlong Chen , Kaixiong Zhou

Large language models (LLMs) are susceptible to red teaming attacks, which can induce LLMs to generate harmful content. Previous research constructs attack prompts via manual or automatic methods, which have their own limitations on…

Computation and Language · Computer Science 2023-10-20 Boyi Deng , Wenjie Wang , Fuli Feng , Yang Deng , Qifan Wang , Xiangnan He

The performance of large language models (LLMs) depends on how they are prompted, with choices spanning both the high-level prompting pattern (e.g., Zero-Shot, CoT, ReAct, ReWOO) and the specific prompt content (instructions and few-shot…

Machine Learning · Computer Science 2025-11-05 Claudio Spiess , Mandana Vaziri , Louis Mandel , Martin Hirzel

The significant advancements in Large Language Models (LLMs) have resulted in their widespread adoption across various tasks within Software Engineering (SE), including vulnerability detection and repair. Numerous studies have investigated…

Software Engineering · Computer Science 2024-10-08 Xin Zhou , Sicong Cao , Xiaobing Sun , David Lo

Batch prompting, which combines a batch of multiple queries sharing the same context in one inference, has emerged as a promising solution to reduce inference costs. However, our study reveals a significant security vulnerability in batch…

Cryptography and Security · Computer Science 2025-06-23 Murong Yue , Ziyu Yao

Prompt engineering reduces reasoning mistakes in Large Language Models (LLMs). However, its effectiveness in mitigating vulnerabilities in LLM-generated code remains underexplored. To address this gap, we implemented a benchmark to…

Software Engineering · Computer Science 2025-02-11 Marc Bruni , Fabio Gabrielli , Mohammad Ghafari , Martin Kropp

Large language models (LLMs) have profoundly transformed natural language applications, with a growing reliance on instruction-based definitions for designing chatbots. However, post-deployment the chatbot definitions are fixed and are…

Machine Learning · Computer Science 2024-02-20 Reshabh K Sharma , Vinayak Gupta , Dan Grossman

Automated program repair (APR) aims to automatically repair program errors without human intervention, and recent years have witnessed a growing interest on this research topic. While much progress has been made and techniques originating…

Software Engineering · Computer Science 2025-12-16 Zhenyu Yang , Jingwen Wu , Zhen Yang , Zhongxing Yu

Loop vulnerabilities are one major risky construct in software development. They can easily lead to infinite loops or executions, exhaust resources, or introduce logical errors that degrade performance and compromise security. The problem…

Software Engineering · Computer Science 2026-01-23 Adeyemi Adeseye , Aisvarya Adeseye

Automated Program Repair (APR) agents leverage Large Language Models (LLMs) to autonomously diagnose and fix software bugs through reasoning, planning, and tool use. Despite impressive leaderboard gains on benchmarks such as SWE-bench,…

Software Engineering · Computer Science 2026-05-28 Ira Ceka , Hailie Mitchell , Saurabh Pujar , Luca Buratti , Shyam Ramji , Junfeng Yang , Gail Kaiser , Baishakhi Ray

As the pre-trained language models (PLMs) continue to grow, so do the hardware and data requirements for fine-tuning PLMs. Therefore, the researchers have come up with a lighter method called \textit{Prompt Learning}. However, during the…

Computation and Language · Computer Science 2022-09-07 Yundi Shi , Piji Li , Changchun Yin , Zhaoyang Han , Lu Zhou , Zhe Liu

LLM-based programming assistants offer the promise of programming faster but with the risk of introducing more security vulnerabilities. Prior work has studied how LLMs could be maliciously fine-tuned to suggest vulnerabilities more often.…

Cryptography and Security · Computer Science 2024-07-17 John Heibel , Daniel Lowd

Despite their remarkable success, large language models (LLMs) have shown limited ability on safety-critical code tasks such as vulnerability detection. Typically, static analysis (SA) tools, like CodeQL, CodeGuru Security, etc., are used…

Cryptography and Security · Computer Science 2025-09-15 Ira Ceka , Feitong Qiao , Anik Dey , Aastha Valecha , Gail Kaiser , Baishakhi Ray

Large language models (LLMs) aligned for safety through techniques like reinforcement learning from human feedback (RLHF) often exhibit emergent deceptive behaviors, where outputs appear compliant but subtly mislead or omit critical…

Machine Learning · Computer Science 2025-07-15 Santhosh Kumar Ravindran

Phishing attacks represent a significant cybersecurity threat, necessitating adaptive detection techniques. This study explores few-shot Adaptive Linguistic Prompting (ALP) in detecting phishing webpages through the multimodal capabilities…

Computation and Language · Computer Science 2025-08-26 Atharva Bhargude , Ishan Gonehal , Dave Yoon , Kaustubh Vinnakota , Chandler Haney , Aaron Sandoval , Kevin Zhu

Large Language Models (LLMs) have shown significant challenges in detecting and repairing vulnerable code, particularly when dealing with vulnerabilities involving multiple aspects, such as variables, code flows, and code structures. In…

Cryptography and Security · Computer Science 2025-06-25 Arshiya Khan , Guannan Liu , Xing Gao