English
Related papers

Related papers: Honeyval: A Comprehensive Evaluation Framework for…

200 papers

Large language models (LLMs) have emerged as a promising alternative to expensive human evaluations. However, the alignment and coverage of LLM-based evaluations are often limited by the scope and potential bias of the evaluation prompts…

Computation and Language · Computer Science 2024-02-27 Yuxuan Liu , Tianchi Yang , Shaohan Huang , Zihan Zhang , Haizhen Huang , Furu Wei , Weiwei Deng , Feng Sun , Qi Zhang

Honeypots, i.e. networked computer systems specially designed and crafted to mimic the normal operations of other systems while capturing and storing information about the interactions with the world outside, are a crucial technology into…

Cryptography and Security · Computer Science 2025-04-18 Michele Bombardieri , Salvatore Castanò , Fabrizio Curcio , Angelo Furfaro , Helen D. Karatza

Large language models (LLMs) are demonstrating increasing prowess in cybersecurity applications, creating creating inherent risks alongside their potential for strengthening defenses. In this position paper, we argue that current efforts to…

Cryptography and Security · Computer Science 2025-02-04 Kamilė Lukošiūtė , Adam Swanda

Jailbreak attacks represent one of the most sophisticated threats to the security of large language models (LLMs). To deal with such risks, we introduce an innovative framework that can help evaluate the effectiveness of jailbreak attacks…

Computation and Language · Computer Science 2025-03-19 Dong Shu , Chong Zhang , Mingyu Jin , Zihao Zhou , Lingyao Li , Yongfeng Zhang

Deceptive elements, including honeypots and decoys, were incorporated into the Microsoft CyberBattleSim experimentation and research platform. The defensive capabilities of the deceptive elements were tested using reinforcement learning…

Cryptography and Security · Computer Science 2021-09-01 Erich Walter , Kimberly Ferguson-Walter , Ahmad Ridley

The rapid advancement of Large Language Models (LLMs) has created new opportunities for Automated Penetration Testing (AutoPT), spawning numerous frameworks aimed at achieving end-to-end autonomous attacks. However, despite the…

Large language models (LLMs) have achieved remarkable performance in various evaluation benchmarks. However, concerns are raised about potential data contamination in their considerable volume of training corpus. Moreover, the static nature…

Artificial Intelligence · Computer Science 2024-03-15 Kaijie Zhu , Jiaao Chen , Jindong Wang , Neil Zhenqiang Gong , Diyi Yang , Xing Xie

As cyber threats continue to grow in scale and sophistication, blue team defenders increasingly require advanced tools to proactively detect and mitigate risks. Large Language Models (LLMs) offer promising capabilities for enhancing threat…

Cryptography and Security · Computer Science 2026-05-29 Yuqiao Meng , Luoxi Tang , Feiyang Yu , Xi Li , Guanhua Yan , Ping Yang , Zhaohan Xi

Cyber Security is a critical topic for organizations with IT/OT networks as they are always susceptible to attack, whether insider or outsider. Since the cyber landscape is an ever-evolving scenario, one must keep upgrading its security…

Cryptography and Security · Computer Science 2022-09-30 Upendra Bartwal , Subhasis Mukhopadhyay , Rohit Negi , Sandeep Shukla

Recent advances in multi-modal large language models (MLLMs) have enabled unified perception-reasoning capabilities, yet these systems remain highly vulnerable to jailbreak attacks that bypass safety alignment and induce harmful behaviors.…

Cryptography and Security · Computer Science 2025-12-09 Xiaojun Jia , Jie Liao , Qi Guo , Teng Ma , Simeng Qin , Ranjie Duan , Tianlin Li , Yihao Huang , Zhitao Zeng , Dongxian Wu , Yiming Li , Wenqi Ren , Xiaochun Cao , Yang Liu

Large Language Model (LLM) systems are inherently compositional, with individual LLM serving as the core foundation with additional layers of objects such as plugins, sandbox, and so on. Along with the great potential, there are also…

Cryptography and Security · Computer Science 2024-03-01 Fangzhou Wu , Ning Zhang , Somesh Jha , Patrick McDaniel , Chaowei Xiao

Scammers are increasingly harnessing generative AI(GenAI) technologies to produce convincing phishing content at scale, amplifying financial fraud and undermining public trust. While conventional defenses, such as detection algorithms, user…

Cryptography and Security · Computer Science 2025-09-11 Hossein Siadati , Haadi Jafarian , Sima Jafarikhah

Network infrastructure in a production environment is increasingly targeted by attackers every day. Many resources and services now rely on the internet, making network infrastructure one of the most critical parts to protect, as it hosts…

Networking and Internet Architecture · Computer Science 2025-12-09 Nawshad Ahmed Evan , Md Raihan Uddin

Decompilers are fundamental tools for critical security tasks, from vulnerability discovery to malware analysis, yet their evaluation remains fragmented. Existing approaches primarily focus on syntactic correctness through synthetic…

Software Engineering · Computer Science 2025-05-19 Zeyu Gao , Yuxin Cui , Hao Wang , Siliang Qin , Yuanda Wang , Bolun Zhang , Chao Zhang

Large Language Models (LLMs) remain vulnerable to multi-turn jailbreak attacks. We introduce HarmNet, a modular framework comprising ThoughtNet, a hierarchical semantic network; a feedback-driven Simulator for iterative query refinement;…

Cryptography and Security · Computer Science 2025-10-22 Sidhant Narula , Javad Rafiei Asl , Mohammad Ghasemigol , Eduardo Blanco , Daniel Takabi

Recent benchmark efforts have advanced the evaluation of large language models (LLMs) in cybersecurity, including tasks such as penetration testing and vulnerability identification. However, a critical cybersecurity task, namely intrusion…

Cryptography and Security · Computer Science 2026-05-22 Danyu Sun , Jinghuai Zhang , Yuan Tian , Zhou Li

Large language models (LLMs) are increasingly deployed as the service backend for LLM-integrated applications such as code completion and AI-powered search. LLM-integrated applications serve as middleware to refine users' queries with…

Cryptography and Security · Computer Science 2023-11-30 Fengqing Jiang , Zhangchen Xu , Luyao Niu , Boxin Wang , Jinyuan Jia , Bo Li , Radha Poovendran

This paper provides a comprehensive review of the future of cybersecurity through Generative AI and Large Language Models (LLMs). We explore LLM applications across various domains, including hardware design security, intrusion detection,…

The emergence of AI-driven web automation through Large Language Models (LLMs) offers unprecedented opportunities for optimizing digital workflows. However, deploying such systems within industry's real-world environments presents four core…

Software Engineering · Computer Science 2025-08-26 Ankur Tomar , Hengyue Liang , Indranil Bhattacharya , Natalia Larios , Francesco Carbone

Deceiving an attacker in the network security domain is a well established approach, mainly achieved through deployment of honeypots consisting of open network ports with the sole purpose of raising an alert on a connection. With attackers…

Cryptography and Security · Computer Science 2021-04-09 Daniel Reti , David Klaaßen , Simon Duque Anton , Hans Dieter Schotten