English
Related papers

Related papers: Automated Penetration Testing with LLM Agents and …

200 papers

In the current rapidly changing digital environment, businesses are under constant stress to ensure that their systems are secured. Security audits help to maintain a strong security posture by ensuring that policies are in place, controls…

Cryptography and Security · Computer Science 2025-05-19 Jia Hui Chin , Pu Zhang , Yu Xin Cheong , Jonathan Pan

Large language models (LLMs) have demonstrated impressive results on natural language tasks, and security researchers are beginning to employ them in both offensive and defensive systems. In cyber-security, there have been multiple research…

Cryptography and Security · Computer Science 2024-03-05 Jiacen Xu , Jack W. Stokes , Geoff McDonald , Xuesong Bai , David Marshall , Siyue Wang , Adith Swaminathan , Zhou Li

A recent area of increasing research is the use of Large Language Models (LLMs) in penetration testing, which promises to reduce costs and thus allow for higher frequency. We conduct a review of related work, identifying best practices and…

Cryptography and Security · Computer Science 2025-05-16 Julius Henke

This paper presents a critical examination of the surprising efficacy of Large Language Models (LLMs) in penetration testing. The paper thoroughly reviews the evolution of LLMs and their rapidly expanding capabilities which render them…

Cryptography and Security · Computer Science 2025-07-02 Andreas Happe , Jürgen Cito

Penetration testing and vulnerability assessment are essential industry practices for safeguarding computer systems. As cyber threats grow in scale and complexity, the demand for pentesting has surged, surpassing the capacity of human…

Cryptography and Security · Computer Science 2025-10-08 Yasod Ginige , Akila Niroshan , Sajal Jain , Suranga Seneviratne

Large Language Models (LLMs) are redefining offensive cybersecurity by allowing the generation of harmful machine code with minimal human intervention. While attackers take advantage of dark LLMs such as XXXGPT and WolfGPT to produce…

Cryptography and Security · Computer Science 2026-04-14 Ricardo Bessa , Rui Claro , João Trindade , João Lourenço

Large language model (LLM) agents have shown impressive capabilities in human language comprehension and reasoning, yet their potential in cybersecurity remains underexplored. We introduce DefenderBench, a practical, open-source toolkit for…

Computation and Language · Computer Science 2025-10-15 Chiyu Zhang , Marc-Alexandre Cote , Michael Albada , Anush Sankaran , Jack W. Stokes , Tong Wang , Amir Abdi , William Blum , Muhammad Abdul-Mageed

Large Language Models (LLMs) are transforming a wide range of domains, yet verifying their outputs remains a significant challenge, especially for complex open-ended tasks such as consolidation, summarization, and knowledge extraction. To…

Automated penetration testing (AutoPT) powered by large language models (LLMs) has gained attention for its ability to automate ethical hacking processes and identify vulnerabilities in target systems by leveraging the inherent knowledge of…

Artificial Intelligence · Computer Science 2025-06-26 Hanzheng Dai , Yuanliang Li , Jun Yan , Zhibo Zhang

Large Language Models (LLMs) have shown significant promise in real-world decision-making tasks for embodied artificial intelligence, especially when fine-tuned to leverage their inherent common sense and reasoning abilities while being…

Cryptography and Security · Computer Science 2025-05-01 Ruochen Jiao , Shaoyuan Xie , Justin Yue , Takami Sato , Lixu Wang , Yixuan Wang , Qi Alfred Chen , Qi Zhu

Large language models (LLM) are perceived to offer promising potentials for automating security tasks, such as those found in security operation centers (SOCs). As a first step towards evaluating this perceived potential, we investigate the…

Cryptography and Security · Computer Science 2024-02-01 Kumar Shashwat , Francis Hahn , Xinming Ou , Dmitry Goldgof , Lawrence Hall , Jay Ligatti , S. Raj Rajgopalan , Armin Ziaie Tabari

Security code review is a time-consuming and labor-intensive process typically requiring integration with automated security defect detection tools. However, existing security analysis tools struggle with poor generalization, high false…

Software Engineering · Computer Science 2026-05-12 Jiaxin Yu , Peng Liang , Yujia Fu , Amjed Tahir , Mojtaba Shahin , Chong Wang , Yangxiao Cai

Enterprise penetration-testing is often limited by high operational costs and the scarcity of human expertise. This paper investigates the feasibility and effectiveness of using Large Language Model (LLM)-driven autonomous systems to…

Cryptography and Security · Computer Science 2025-09-12 Andreas Happe , Jürgen Cito

As the frequency of cyber threats increases, conventional penetration testing is failing to capture the entirety of todays complex environments. To solve this problem, we propose the Vulnerability Mitigation System (VMS), a novel agent…

Cryptography and Security · Computer Science 2025-07-30 Farzana Abdulzada

Automating penetration testing is crucial for enhancing cybersecurity, yet current Large Language Models (LLMs) face significant limitations in this domain, including poor error handling, inefficient reasoning, and an inability to perform…

Artificial Intelligence · Computer Science 2025-10-30 He Kong , Die Hu , Jingguo Ge , Liangxiong Li , Hui Li , Tong Li

Web applications remain the dominant attack surface in cybersecurity, where vulnerabilities such as SQL injection, XSS, and business logic flaws continue to cause significant data breaches. While penetration testing is effective for…

Cryptography and Security · Computer Science 2026-03-31 Tran Vy Khang , Nguyen Dang Nguyen Khang , Nghi Hoang Khoa , Do Thi Thu Hien , Van-Hau Pham , Phan The Duy

In the past year, large language models (LLMs) have had remarkable success in domains outside the traditional natural language processing, and their capacity is further expanded into the so-called LLM agents when connected with external…

Computation and Language · Computer Science 2025-02-17 Weizhe Chen , Sven Koenig , Bistra Dilkina

Batteryless IoT systems face energy constraints exacerbated by checkpointing overhead. Approximate computing offers solutions but demands manual expertise, limiting scalability. This paper presents CheckMate, an automated framework…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-02-28 Abdur-Rahman Ibrahim Sayyid-Ali , Abdul Rafay , Muhammad Abdullah Soomro , Muhammad Hamad Alizai , Naveed Anwar Bhatti

Large Language Models (LLMs) have shown promise in automating code generation and software engineering tasks, yet they often struggle with complex, multi-file projects due to context limitations and knowledge gaps. We propose a novel…

Software Engineering · Computer Science 2025-08-13 Muhammad Haseeb

Large Language Models (LLMs) such as ChatGPT-4, Claude 3, and LLaMA 4 are increasingly embedded in software/application development, supporting tasks from code generation to debugging. Yet, their real-world effectiveness in detecting…

Software Engineering · Computer Science 2026-04-28 Akshay Mhatre , Noujoud Nader , Patrick Diehl , Deepti Gupta