English
Related papers

Related papers: AutoPentester: An LLM Agent-based Framework for Au…

200 papers

Recent advances in Large Language Models (LLMs) have shown significant potential in enhancing cybersecurity defenses against sophisticated threats. LLM-based penetration testing is an essential step in automating system security evaluations…

Cryptography and Security · Computer Science 2024-07-26 Junjie Huang , Quanyan Zhu

Automating penetration testing is crucial for enhancing cybersecurity, yet current Large Language Models (LLMs) face significant limitations in this domain, including poor error handling, inefficient reasoning, and an inability to perform…

Artificial Intelligence · Computer Science 2025-10-30 He Kong , Die Hu , Jingguo Ge , Liangxiong Li , Hui Li , Tong Li

Large Language Models (LLMs) have been increasingly integrated into computer-use agents, which can autonomously operate tools on a user's computer to accomplish complex tasks. However, due to the inherently unstable and unpredictable nature…

Cryptography and Security · Computer Science 2025-09-10 Haitao Hu , Peng Chen , Yanpeng Zhao , Yuqi Chen

As the frequency of cyber threats increases, conventional penetration testing is failing to capture the entirety of todays complex environments. To solve this problem, we propose the Vulnerability Mitigation System (VMS), a novel agent…

Cryptography and Security · Computer Science 2025-07-30 Farzana Abdulzada

Penetration testing is essential to securing modern web infrastructures, yet traditional manual methods struggle to keep pace with their scale and complexity. Large Language Models (LLMs) offer new opportunities for automating these tasks,…

Cryptography and Security · Computer Science 2026-05-26 William Guanting Li , Alsharif Abuadbba , Kristen Moore , Dan Dongseong Kim

Penetration testing is a vital practice for identifying and mitigating vulnerabilities in cybersecurity systems, but its manual execution is labor-intensive and time-consuming. Existing large language model (LLM)-assisted or automated…

Software Engineering · Computer Science 2025-01-24 He Kong , Die Hu , Jingguo Ge , Liangxiong Li , Tong Li , Bingzhen Wu

With the increasing number of internet-based resources and applications, the amount of attacks faced by companies has increased significantly in the past years. Likewise, the techniques to test security and emulate attacks need to be…

Cryptography and Security · Computer Science 2023-11-23 Daniel Dalalana Bertoglio , Arthur Gil , Juan Acosta , Julia Godoy , Roben Castagna Lunardi , Avelino Francisco Zorzo

With the emergence of high-performance large language models (LLMs) such as GPT, Claude, and Gemini, the autonomous and semi-autonomous execution of tasks has significantly advanced across various domains. However, in highly specialized…

Cryptography and Security · Computer Science 2025-02-24 Masaya Kobayashi , Masane Fuchi , Amar Zanashir , Tomonori Yoneda , Tomohiro Takagi

Penetration testing is essential for identifying vulnerabilities in web applications before real adversaries can exploit them. Recent work has explored automating this process with Large Language Model (LLM)-powered agents, but existing…

Software Engineering · Computer Science 2026-01-13 Huihui Huang , Jieke Shi , Junkai Chen , Ting Zhang , Yikun Li , Chengran Yang , Eng Lieh Ouh , Lwin Khin Shar , David Lo

Backdoor attacks pose a serious threat to the secure deployment of large language models (LLMs), enabling adversaries to implant hidden behaviors triggered by specific inputs. However, existing methods often rely on manually crafted…

Cryptography and Security · Computer Science 2025-11-24 Yige Li , Zhe Li , Wei Zhao , Nay Myat Min , Hanxun Huang , Xingjun Ma , Jun Sun

Large Language Model (LLM) Agents are an emerging computing paradigm that blends generative machine learning with tools such as code interpreters, web browsing, email, and more generally, external resources. These agent-based systems…

Cryptography and Security · Computer Science 2024-10-23 Xiaohan Fu , Shuheng Li , Zihan Wang , Yihao Liu , Rajesh K. Gupta , Taylor Berg-Kirkpatrick , Earlence Fernandes

The increasing complexity and scale of modern digital environments have exposed significant gaps in traditional cybersecurity penetration testing methods, which are often time-consuming, labor-intensive, and unable to rapidly adapt to…

Cryptography and Security · Computer Science 2024-09-09 Ibrahim Alshehri , Adnan Alshehri , Abdulrahman Almalki , Majed Bamardouf , Alaqsa Akbar

Testing RESTful API is increasingly important in quality assurance of cloud-native applications. Recent advances in machine learning (ML) techniques have demonstrated that various testing activities can be performed automatically by large…

Software Engineering · Computer Science 2025-11-25 Xiaoke Han , Hong Zhu

From automated intrusion testing to discovery of zero-day attacks before software launch, agentic AI calls for great promises in security engineering. This strong capability is bound with a similar threat: the security and research…

Cryptography and Security · Computer Science 2025-05-13 Brian Challita , Pierre Parrend

Traditional ethical hacking relies on skilled professionals and time-intensive command management, which limits its scalability and efficiency. To address these challenges, we introduce PenTest++, an AI-augmented system that integrates…

Cryptography and Security · Computer Science 2025-02-14 Haitham S. Al-Sinani , Chris J. Mitchell

AI pentesting agents are increasingly credible as offensive security systems, but current benchmarks still provide limited guidance on which will perform best in real-world targets. Existing evaluation protocols assess and optimize for…

Artificial Intelligence · Computer Science 2026-05-12 Pedro Conde , Henrique Branquinho , Valerio Mazzone , Bruno Mendes , André Baptista , Nuno Moniz

The field of software security testing, more specifically penetration testing, is an activity that requires high levels of expertise and involves many manual testing and analysis steps. This paper explores the potential usage of…

Computation and Language · Computer Science 2023-10-19 Andreas Happe , Jürgen Cito

This work introduces xOffense, an AI-driven, multi-agent penetration testing framework that shifts the process from labor-intensive, expert-driven manual efforts to fully automated, machine-executable workflows capable of scaling seamlessly…

Cryptography and Security · Computer Science 2026-04-28 Phung Duc Luong , Le Tran Gia Bao , Nguyen Vu Khai Tam , Dong Huu Nguyen Khoa , Nguyen Huu Quyen , Van-Hau Pham , Phan The Duy

We introduce HackSynth, a novel Large Language Model (LLM)-based agent capable of autonomous penetration testing. HackSynth's dual-module architecture includes a Planner and a Summarizer, which enable it to generate commands and process…

Cryptography and Security · Computer Science 2024-12-03 Lajos Muzsai , David Imolai , András Lukács

The robustness of LLMs to jailbreak attacks, where users design prompts to circumvent safety measures and misuse model capabilities, has been studied primarily for LLMs acting as simple chatbots. Meanwhile, LLM agents -- which use external…