English
Related papers

Related papers: LLM in the Shell: Generative Honeypots

200 papers

Existing LLM-based automatic test generation methods mainly produce input and expected output pairs to categorize the intended behavior of correct programs. Although straightforward, these methods have limited diversity in generated tests…

Software Engineering · Computer Science 2025-11-04 Yujian Liu , Jiabao Ji , Yang Zhang , Wenbo Guo , Tommi Jaakkola , Shiyu Chang

The rapid advancement of large language model (LLM) technology has led to diverse applications, many of which inherently require randomness, such as stochastic decision-making, gaming, scheduling, AI agents, and cryptography-related tasks.…

Artificial Intelligence · Computer Science 2025-10-15 Rabimba Karanjai , Yang Lu , Ranjith Chodavarapu , Lei Xu , Weidong Shi

$ $Large Language Models (LLMs) are being increasingly utilized in various applications, with code generations being a notable example. While previous research has shown that LLMs have the capability to generate both secure and insecure…

Motivated by the remarkable progress of large language models (LLMs) in objective tasks like mathematics and coding, there is growing interest in their potential to simulate human behavior--a capability with profound implications for…

Computation and Language · Computer Science 2026-01-23 Yuxuan Lei , Tianfu Wang , Jianxun Lian , Zhengyu Hu , Defu Lian , Xing Xie

Large Language Models (LLMs) have revolutionized code generation, evolving from static tools into dynamic conversational interfaces that facilitate complex, multi-turn collaborative programming. While LLMs exhibit remarkable proficiency in…

Software Engineering · Computer Science 2026-03-31 Binquan Zhang , Li Zhang , Lin Shi , Song Wang , Yuwei Qian , Linhui Zhao , Fang Liu , An Fu , Yida Ye

Large language models (LLMs) have recently emerged as promising tools for augmenting Security Operations Center (SOC) workflows, with vendors increasingly marketing autonomous AI solutions for SOCs. However, there remains a limited…

Cryptography and Security · Computer Science 2026-04-14 Souradip Nath , Chih-Yi Huang , Aditi Ganapathi , Kashyap Thimmaraju , Jaron Mink , Gail-Joon Ahn

Program synthesis has been long studied with recent approaches focused on directly using the power of Large Language Models (LLMs) to generate code. Programming benchmarks, with curated synthesis problems and test-cases, are used to measure…

Software Engineering · Computer Science 2023-11-01 Jiawei Liu , Chunqiu Steven Xia , Yuyao Wang , Lingming Zhang

Large Language Models (LLMs) have shown tremendous promise in automated software engineering. In this paper, we investigate the opportunities of LLMs for automatic regression test generation for programs that take highly structured,…

Software Engineering · Computer Science 2025-01-22 Jing Liu , Seongmin Lee , Eleonora Losiouk , Marcel Böhme

Large Language Models (LLMs) suffer from a range of vulnerabilities that allow malicious users to solicit undesirable responses through manipulation of the input text. These so-called jailbreak prompts are designed to trick the LLM into…

Computation and Language · Computer Science 2025-10-13 John Hawkins , Aditya Pramar , Rodney Beard , Rohitash Chandra

Large Language Models (LLMs) have transformed software development and automated code generation. Motivated by these advancements, this paper explores the feasibility of LLMs in modifying malware source code to generate variants. We…

Cryptography and Security · Computer Science 2025-10-07 Md Ajwad Akil , Adrian Shuai Li , Imtiaz Karim , Arun Iyengar , Ashish Kundu , Vinny Parla , Elisa Bertino

Tabletop exercises are a crucial component of many company's strategy to test and evaluate its preparedness for security incidents in a realistic way. Traditionally led by external firms specializing in cybersecurity, these exercises can be…

Cryptography and Security · Computer Science 2024-08-31 Sam Hays , Jules White

The rapid growth of biomedical knowledge has outpaced our ability to efficiently extract insights and generate novel hypotheses. Large language models (LLMs) have emerged as a promising tool to revolutionize knowledge interaction and…

Computation and Language · Computer Science 2024-07-16 Biqing Qi , Kaiyan Zhang , Kai Tian , Haoxiang Li , Zhang-Ren Chen , Sihang Zeng , Ermo Hua , Hu Jinfang , Bowen Zhou

As an intriguing case is the goodness of the machine and deep learning models generated by these LLMs in conducting automated scientific data analysis, where a data analyst may not have enough expertise in manually coding and optimizing…

Artificial Intelligence · Computer Science 2024-12-02 Saroj Gopali , Sima Siami-Namini , Faranak Abri , Akbar Siami Namin

Large language models (LLMs) have achieved record adoption in a short period of time across many different sectors including high importance areas such as education [4] and healthcare [23]. LLMs are open-ended models trained on diverse data…

Cryptography and Security · Computer Science 2024-12-24 Herve Debar , Sven Dietrich , Pavel Laskov , Emil C. Lupu , Eirini Ntoutsi

LLMs show strong performance in code generation, but their outputs lack correctness guarantees. Sample-based uncertainty estimators address this by generating multiple candidate programs and measuring their disagreement. However, existing…

Software Engineering · Computer Science 2026-05-12 Weilin He , Arindam Sharma , Cristina David

Honeyfiles are security assets designed to attract and detect intruders on compromised systems. Honeyfiles are a type of honeypot that mimic real, sensitive documents, creating the illusion of the presence of valuable data. Interaction with…

Machine Learning · Computer Science 2024-04-09 David D. Nguyen , David Liebowitz , Surya Nepal , Salil S. Kanhere , Sharif Abuadbba

Large Language Models (LLMs) have recently emerged as powerful tools in cybersecurity, offering advanced capabilities in malware detection, generation, and real-time monitoring. Numerous studies have explored their application in…

Cryptography and Security · Computer Science 2025-04-11 Hamed Jelodar , Samita Bai , Parisa Hamedi , Hesamodin Mohammadian , Roozbeh Razavi-Far , Ali Ghorbani

Software vulnerabilities, caused by unintentional flaws in source code, are a primary root cause of cyberattacks. Static analysis of source code has been widely used to detect these unintentional defects introduced by software developers.…

Software Engineering · Computer Science 2024-08-08 Andrew A Mahyari

Large Language Models (LLMs) have shown remarkable proficiency in natural language understanding (NLU), opening doors for innovative applications. We introduce StreamLink - an LLM-driven distributed data system designed to improve the…

Databases · Computer Science 2025-05-29 Dawei Feng , Di Mei , Huiri Tan , Lei Ren , Xianying Lou , Zhangxi Tan

The recent popularity of large language models (LLMs) has brought a significant impact to boundless fields, particularly through their open-ended ecosystem such as the APIs, open-sourced models, and plugins. However, with their widespread…

Machine Learning · Computer Science 2023-08-31 Wentao Ye , Mingfeng Ou , Tianyi Li , Yipeng chen , Xuetao Ma , Yifan Yanggong , Sai Wu , Jie Fu , Gang Chen , Haobo Wang , Junbo Zhao