English
Related papers

Related papers: Automated Penetration Testing with LLM Agents and …

200 papers

Penetration testing is essential to ensure Web security, which can detect and fix vulnerabilities in advance, and prevent data leakage and serious consequences. The powerful inference capabilities of large language models (LLMs) have made…

Cryptography and Security · Computer Science 2024-11-05 Benlong Wu , Guoqiang Chen , Kejiang Chen , Xiuwei Shang , Jiapeng Han , Yanru He , Weiming Zhang , Nenghai Yu

Penetration testing is a critical technique for identifying security vulnerabilities, traditionally performed manually by skilled security specialists. This complex process involves gathering information about the target system, identifying…

Cryptography and Security · Computer Science 2025-06-02 Xiangmin Shen , Lingzhi Wang , Zhenyuan Li , Yan Chen , Wencheng Zhao , Dawei Sun , Jiashui Wang , Wei Ruan

Hacking poses a significant threat to cybersecurity, inflicting billions of dollars in damages annually. To mitigate these risks, ethical hacking, or penetration testing, is employed to identify vulnerabilities in systems and networks.…

Cryptography and Security · Computer Science 2025-02-24 Isamu Isozaki , Manil Shrestha , Rick Console , Edward Kim

In our research, we introduce a new concept called "LLM Augmented Pentesting" demonstrated with a tool named "Pentest Copilot," that revolutionizes the field of ethical hacking by integrating Large Language Models (LLMs) into penetration…

Cryptography and Security · Computer Science 2025-05-20 Dhruva Goyal , Sitaraman Subramanian , Aditya Peela , Nisha P. Shetty

With the emergence of high-performance large language models (LLMs) such as GPT, Claude, and Gemini, the autonomous and semi-autonomous execution of tasks has significantly advanced across various domains. However, in highly specialized…

Cryptography and Security · Computer Science 2025-02-24 Masaya Kobayashi , Masane Fuchi , Amar Zanashir , Tomonori Yoneda , Tomohiro Takagi

Penetration testing, a crucial industrial practice for ensuring system security, has traditionally resisted automation due to the extensive expertise required by human professionals. Large Language Models (LLMs) have shown significant…

Software Engineering · Computer Science 2024-06-04 Gelei Deng , Yi Liu , Víctor Mayoral-Vilches , Peng Liu , Yuekang Li , Yuan Xu , Tianwei Zhang , Yang Liu , Martin Pinzger , Stefan Rass

Penetration testing is essential to securing modern web infrastructures, yet traditional manual methods struggle to keep pace with their scale and complexity. Large Language Models (LLMs) offer new opportunities for automating these tasks,…

Cryptography and Security · Computer Science 2026-05-26 William Guanting Li , Alsharif Abuadbba , Kristen Moore , Dan Dongseong Kim

Penetration testing is essential for assessing and strengthening system security against real-world threats, yet traditional workflows remain highly manual, expertise-intensive, and difficult to scale. Although recent advances in Large…

Software Engineering · Computer Science 2025-12-17 Ruozhao Yang , Mingfei Cheng , Gelei Deng , Tianwei Zhang , Junjie Wang , Xiaofei Xie

Penetration testing is a vital practice for identifying and mitigating vulnerabilities in cybersecurity systems, but its manual execution is labor-intensive and time-consuming. Existing large language model (LLM)-assisted or automated…

Software Engineering · Computer Science 2025-01-24 He Kong , Die Hu , Jingguo Ge , Liangxiong Li , Tong Li , Bingzhen Wu

Recent advances in Large Language Models (LLMs) have driven interest in automating cybersecurity penetration testing workflows, offering the promise of faster and more consistent vulnerability assessment for enterprise systems. Existing LLM…

Cryptography and Security · Computer Science 2025-11-19 Katsuaki Nakano , Reza Fayyazi , Shanchieh Jay Yang , Michael Zuzak

The rapid advancement of Large Language Models (LLMs) has created new opportunities for Automated Penetration Testing (AutoPT), spawning numerous frameworks aimed at achieving end-to-end autonomous attacks. However, despite the…

Penetration testing is essential for identifying vulnerabilities in web applications before real adversaries can exploit them. Recent work has explored automating this process with Large Language Model (LLM)-powered agents, but existing…

Software Engineering · Computer Science 2026-01-13 Huihui Huang , Jieke Shi , Junkai Chen , Ting Zhang , Yikun Li , Chengran Yang , Eng Lieh Ouh , Lwin Khin Shar , David Lo

The increasing complexity and scale of modern digital environments have exposed significant gaps in traditional cybersecurity penetration testing methods, which are often time-consuming, labor-intensive, and unable to rapidly adapt to…

Cryptography and Security · Computer Science 2024-09-09 Ibrahim Alshehri , Adnan Alshehri , Abdulrahman Almalki , Majed Bamardouf , Alaqsa Akbar

Large language models (LLMs) are increasingly used to automate or augment penetration testing, but their effectiveness and reliability across attack phases remain unclear. We present a comprehensive evaluation of multiple LLM-based agents,…

Artificial Intelligence · Computer Science 2025-11-14 Lanxiao Huang , Daksh Dave , Tyler Cody , Peter Beling , Ming Jin

Large Language Model (LLM) agents are increasingly proposed to automate offensive security tasks, with recent studies reporting near human-level success rates in Capture-the-Flag (CTF) challenges. We here revisit these results, providing a…

Cryptography and Security · Computer Science 2026-05-22 Youness Bouchari , Matteo Boffa , Marco Mellia , Idilio Drago , Thanh Minh Bui , Dario Rossi

Cyber threats are rapidly increasing, expanding their impact from large-scale enterprises to government services and individual users, making robust security systems increasingly essential. However, a significant shortage of skilled…

Cryptography and Security · Computer Science 2026-05-07 Yasod Ginige , Pasindu Marasinghe , Sajal Jain , Suranga Seneviratne

Large language models (LLMs) can autonomously conduct multi-stage cyber attacks, but the consistency of their offensive behavior under repeated trials remains unstudied. This work presents the first large-scale empirical measurement of LLM…

Cryptography and Security · Computer Science 2026-05-29 Galip Tolga Erdem

Generative AI agents, software systems powered by Large Language Models (LLMs), are emerging as a promising approach to automate cybersecurity tasks. Among the others, penetration testing is a challenging field due to the task complexity…

Cryptography and Security · Computer Science 2024-10-29 Luca Gioacchini , Marco Mellia , Idilio Drago , Alexander Delsanto , Giuseppe Siracusano , Roberto Bifulco

Recent advances in Large Language Models (LLMs) have shown significant potential in enhancing cybersecurity defenses against sophisticated threats. LLM-based penetration testing is an essential step in automating system security evaluations…

Cryptography and Security · Computer Science 2024-07-26 Junjie Huang , Quanyan Zhu

LLM-based agents show promise for automating penetration testing, yet reported performance varies widely across systems and benchmarks. We analyze 28 LLM-based penetration testing systems and evaluate five representative implementations…

Cryptography and Security · Computer Science 2026-02-20 Gelei Deng , Yi Liu , Yuekang Li , Ruozhao Yang , Xiaofei Xie , Jie Zhang , Han Qiu , Tianwei Zhang
‹ Prev 1 2 3 10 Next ›