English
Related papers

Related papers: Red Teaming Program Repair Agents: When Correct Pa…

200 papers

Self-healing systems have long been a focus of research, aiming to enable software to recover from unexpected runtime errors without human intervention. Traditional approaches rely on predefined heuristic rules, such as reusing error…

Software Engineering · Computer Science 2026-05-05 Zhensu Sun , Haotian Zhu , Bowen Xu , Xiaoning Du , Li Li , David Lo

Smart contracts are susceptible to various security issues, among which access control (AC) vulnerabilities are particularly critical. While existing research has proposed multiple detection tools, the automatic and appropriate repair of AC…

Software Engineering · Computer Science 2025-07-22 Lyuye Zhang , Kaixuan Li , Kairan Sun , Daoyuan Wu , Ye Liu , Haoye Tian , Yang Liu

[...] Since then, various APR approaches, especially those leveraging the power of large language models (LLMs), have been rapidly developed to fix general software bugs. Unfortunately, the effectiveness of these advanced techniques in the…

Software Engineering · Computer Science 2025-06-17 Anh Ho , Thanh Le-Cong , Bach Le , Christine Rizkallah

Automated Code Review (ACR) is crucial for software quality, yet existing benchmarks often fail to reflect real-world complexities, hindering the evaluation of modern Large Language Models (LLMs). Current benchmarks frequently focus on…

Software Engineering · Computer Science 2025-09-03 Zhengran Zeng , Ruikai Shi , Keke Han , Yixin Li , Kaicheng Sun , Yidong Wang , Zhuohao Yu , Rui Xie , Wei Ye , Shikun Zhang

The rapid progress in Automated Program Repair (APR) has been driven by advances in AI, particularly large language models (LLMs) and agent-based systems. SWE-Bench is a recent benchmark designed to evaluate LLM-based repair systems using…

Software Engineering · Computer Science 2026-02-06 Matias Martinez , Xavier Franch

Third-party skills are becoming the package ecosystem for LLM agents. They package natural-language instructions, helper scripts, templates, documents, and service configuration into reusable workflows. This makes skills useful, but it also…

Cryptography and Security · Computer Science 2026-05-15 Haomin Zhuang , Hanwen Xing , Yujun Zhou , Yuchen Ma , Yue Huang , Yili Shen , Yufei Han , Xiangliang Zhang

We propose VulnLLM-R, the~\emph{first specialized reasoning LLM} for vulnerability detection. Our key insight is that LLMs can reason about program states and analyze the potential vulnerabilities, rather than simple pattern matching. This…

Cryptography and Security · Computer Science 2025-12-09 Yuzhou Nie , Hongwei Li , Chengquan Guo , Ruizhe Jiang , Zhun Wang , Bo Li , Dawn Song , Wenbo Guo

Each year, thousands of software vulnerabilities are discovered and reported to the public. Unpatched known vulnerabilities are a significant security risk. It is imperative that software vendors quickly provide patches once vulnerabilities…

Cryptography and Security · Computer Science 2017-07-26 Benjamin L. Bullough , Anna K. Yanchenko , Christopher L. Smith , Joseph R. Zipkin

We stress test monitoring systems for detecting covert misbehavior in autonomous LLM agents (e.g., secretly sharing private information). To this end, we systematize a monitor red teaming (MRT) workflow that incorporates: (1) varying levels…

Artificial Intelligence · Computer Science 2025-08-28 Neil Kale , Chen Bo Calvin Zhang , Kevin Zhu , Ankit Aich , Paula Rodriguez , Scale Red Team , Christina Q. Knight , Zifan Wang

Large language models (LLMs) aligned for safety through techniques like reinforcement learning from human feedback (RLHF) often exhibit emergent deceptive behaviors, where outputs appear compliant but subtly mislead or omit critical…

Machine Learning · Computer Science 2025-07-15 Santhosh Kumar Ravindran

Large Language Models (LLMs) have demonstrated remarkable capabilities across various cybersecurity tasks, including vulnerability classification, detection, and patching. However, their potential in automated vulnerability report…

Automated program repair (APR) aims to fix software bugs automatically without human debugging efforts and plays a crucial role in software development and maintenance. Despite promising, APR is still challenged by a long-standing…

Software Engineering · Computer Science 2024-01-17 Quanjun Zhang , Chunrong Fang , Weisong Sun , Yan Liu , Tieke He , Xiaodong Hao , Zhenyu Chen

Memory-related errors in C programming continue to pose significant challenges in software development, primarily due to the complexities of manual memory management inherent in the language. These errors frequently serve as vectors for…

Software Engineering · Computer Science 2025-06-24 Xiao Cheng , Zhihao Guo , Huan Huo , Yulei Sui

Large language models are increasingly used to produce runnable software. In practice, security is often addressed through a Detect--Repair--Verify (DRV) loop that detects issues, applies fixes, and verifies the result. This work studies…

Software Engineering · Computer Science 2026-03-03 Cheng Cheng

Autonomous web agents such as \textbf{OpenClaw} are rapidly moving into high-impact real-world workflows, but their security robustness under live network threats remains insufficiently evaluated. Existing benchmarks mainly focus on static…

Cryptography and Security · Computer Science 2026-03-20 Haochen Zhao , Shaoyang Cui

Applications that use Large Language Models (LLMs) are becoming widespread, making the identification of system vulnerabilities increasingly important. Automated Red Teaming accelerates this effort by using an LLM to generate and execute…

Modern web applications often resort to application development frameworks such as React, Vue.js, and Angular. While the frameworks facilitate the development of web applications with several useful components, they are inevitably…

Software Engineering · Computer Science 2023-08-17 Arooba Shahoor , Askar Yeltayuly Khamit , Jooyong Yi , Dongsun Kim

Recently, people have suffered from LLM hallucination and have become increasingly aware of the reliability gap of LLMs in open and knowledge-intensive tasks. As a result, they have increasingly turned to search-augmented LLMs to mitigate…

Computation and Language · Computer Science 2026-02-10 Yu Yan , Sheng Sun , Mingfeng Li , Zheming Yang , Chiwei Zhu , Fei Ma , Benfeng Xu , Min Liu , Qi Li

Software vulnerabilities are increasing at an alarming rate. However, manual patching is both time-consuming and resource-intensive, while existing automated vulnerability repair (AVR) techniques remain limited in effectiveness. Recent…

Cryptography and Security · Computer Science 2025-11-17 Zichao Wei , Jun Zeng , Ming Wen , Zeliang Yu , Kai Cheng , Yiding Zhu , Jingyi Guo , Shiqi Zhou , Le Yin , Xiaodong Su , Zhechao Ma

Patch backporting, the process of migrating mainline security patches to older branches, is an essential task in maintaining popular open-source projects (e.g., Linux kernel). However, manual backporting can be labor-intensive, while…

Cryptography and Security · Computer Science 2025-10-28 Zhaoyang Li , Zheng Yu , Jingyi Song , Meng Xu , Yuxuan Luo , Dongliang Mu