English
Related papers

Related papers: Red-MIRROR: Agentic LLM-based Autonomous Penetrati…

200 papers

Recent advances in Large Language Models (LLMs) have driven interest in automating cybersecurity penetration testing workflows, offering the promise of faster and more consistent vulnerability assessment for enterprise systems. Existing LLM…

Cryptography and Security · Computer Science 2025-11-19 Katsuaki Nakano , Reza Fayyazi , Shanchieh Jay Yang , Michael Zuzak

Standard reinforcement learning (RL) for large language model (LLM) agents typically optimizes extrinsic rewards, prioritizing isolated task completion over continual adaptation. Consequently, agents often converge to suboptimal policies…

Artificial Intelligence · Computer Science 2026-03-31 Xiaoying Zhang , Zichen Liu , Yipeng Zhang , Xia Hu , Wenqi Shao

Large Language Models (LLMs) integrated with agent-based reasoning frameworks have recently shown strong potential for autonomous decision-making and system-level operations. One promising yet underexplored direction is microservice…

Computation and Language · Computer Science 2025-11-04 Lingzhe Zhang , Yunpeng Zhai , Tong Jia , Chiming Duan , Minghua He , Leyi Pan , Zhaoyang Liu , Bolin Ding , Ying Li

Recent advances in prompt optimization, exemplified by methods such as TextGrad, enable automatic, gradient-like refinement of textual prompts to enhance the performance of large language models (LLMs) on specific downstream tasks. However,…

Artificial Intelligence · Computer Science 2025-08-27 Chunlong Wu , Zhibo Qu

Generative AI agents, software systems powered by Large Language Models (LLMs), are emerging as a promising approach to automate cybersecurity tasks. Among the others, penetration testing is a challenging field due to the task complexity…

Cryptography and Security · Computer Science 2024-10-29 Luca Gioacchini , Marco Mellia , Idilio Drago , Alexander Delsanto , Giuseppe Siracusano , Roberto Bifulco

Automating penetration testing is crucial for enhancing cybersecurity, yet current Large Language Models (LLMs) face significant limitations in this domain, including poor error handling, inefficient reasoning, and an inability to perform…

Artificial Intelligence · Computer Science 2025-10-30 He Kong , Die Hu , Jingguo Ge , Liangxiong Li , Hui Li , Tong Li

The rapid advancement of Vision-Language Models (VLMs) has brought their safety vulnerabilities into sharp focus. However, existing red teaming methods are fundamentally constrained by an inherent linear exploration paradigm, confining them…

Machine Learning · Computer Science 2026-03-25 Chunxiao Li , Lijun Li , Jing Shao

The integration of Large Language Models (LLMs) into healthcare is constrained by knowledge limitations, hallucinations, and a disconnect from Evidence-Based Medicine (EBM). While Retrieval-Augmented Generation (RAG) offers a solution,…

Computation and Language · Computer Science 2026-02-03 Qiaoyu Zheng , Yuze Sun , Chaoyi Wu , Weike Zhao , Pengcheng Qiu , Yongguo Yu , Kun Sun , Jian Zhang , Yanfeng Wang , Ya Zhang , Weidi Xie

The advent of large language models (LLMs) has transformed information access and reasoning through open-ended natural language interaction. However, LLMs remain limited by static knowledge, factual hallucinations, and the inability to…

Artificial Intelligence · Computer Science 2025-10-29 Minhua Lin , Zongyu Wu , Zhichao Xu , Hui Liu , Xianfeng Tang , Qi He , Charu Aggarwal , Hui Liu , Xiang Zhang , Suhang Wang

Effective incident response (IR) is critical for mitigating cyber threats, yet security teams are overwhelmed by alert fatigue, high false-positive rates, and the vast volume of unstructured Cyber Threat Intelligence (CTI) documents. While…

Cryptography and Security · Computer Science 2025-08-15 Amine Tellache , Abdelaziz Amara Korba , Amdjed Mokhtari , Horea Moldovan , Yacine Ghamri-Doudane

Retrieval-Augmented Generation (RAG) lifts the factuality of Large Language Models (LLMs) by injecting external knowledge, yet it falls short on problems that demand multi-step inference; conversely, purely reasoning-oriented approaches…

Hacking poses a significant threat to cybersecurity, inflicting billions of dollars in damages annually. To mitigate these risks, ethical hacking, or penetration testing, is employed to identify vulnerabilities in systems and networks.…

Cryptography and Security · Computer Science 2025-02-24 Isamu Isozaki , Manil Shrestha , Rick Console , Edward Kim

Penetration testing is essential to ensure Web security, which can detect and fix vulnerabilities in advance, and prevent data leakage and serious consequences. The powerful inference capabilities of large language models (LLMs) have made…

Cryptography and Security · Computer Science 2024-11-05 Benlong Wu , Guoqiang Chen , Kejiang Chen , Xiuwei Shang , Jiapeng Han , Yanru He , Weiming Zhang , Nenghai Yu

The application of Large Language Models (LLMs) in healthcare is expanding rapidly, with one potential use case being the translation of formal medical reports into patient-legible equivalents. Currently, LLM outputs often need to be edited…

Multiagent Systems · Computer Science 2024-08-06 Malavikha Sudarshan , Sophie Shih , Estella Yee , Alina Yang , John Zou , Cathy Chen , Quan Zhou , Leon Chen , Chinmay Singhal , George Shih

RAG (Retrieval-Augmented Generation) systems and web agents are increasingly evaluated on multi-hop deep search tasks, yet current practice suffers from two major limitations. First, most benchmarks leak the reasoning path in the question…

Computation and Language · Computer Science 2025-12-11 Maojia Song , Renhang Liu , Xinyu Wang , Yong Jiang , Pengjun Xie , Fei Huang , Jingren Zhou , Dorien Herremans , Soujanya Poria

Multi-Agent Debate (MAD), leveraging collaborative interactions among Large Language Models (LLMs), aim to enhance reasoning capabilities in complex tasks. However, the security implications of their iterative dialogues and role-playing…

Cryptography and Security · Computer Science 2025-04-24 Senmao Qi , Yifei Zou , Peng Li , Ziyi Lin , Xiuzhen Cheng , Dongxiao Yu

Automated penetration testing (AutoPT) based on reinforcement learning (RL) has proven its ability to improve the efficiency of vulnerability identification in information systems. However, RL-based PT encounters several challenges,…

Artificial Intelligence · Computer Science 2024-05-28 Yuanliang Li , Hanzheng Dai , Jun Yan

Autonomous agents based on Large Language Models (LLMs) are increasingly being utilized in complex software systems. However, reliability remains a significant challenge due to unpredictable failures such as hallucinations, execution…

Software Engineering · Computer Science 2026-05-11 Cheonsu Jeong , Younggun Shin

Large Language Models (LLMs) frequently generate buggy code with complex logic errors that are challenging to diagnose. While existing LLM-based self-repair approaches conduct intensive static semantic analysis or reply on superficial…

Software Engineering · Computer Science 2025-10-22 Yunkun Wang , Yue Zhang , Guochang Li , Chen Zhi , Binhua Li , Fei Huang , Yongbin Li , Shuiguang Deng

In the realm of web agent research, achieving both generalization and accuracy remains a challenging problem. Due to high variance in website structure, existing approaches often fail. Moreover, existing fine-tuning and in-context learning…

Computation and Language · Computer Science 2024-04-10 Michael Lutz , Arth Bohra , Manvel Saroyan , Artem Harutyunyan , Giovanni Campagna