English
Related papers

Related papers: LLMs + Security = Trouble

200 papers

In software development, the predominant emphasis on functionality often supersedes security concerns, a trend gaining momentum with AI-driven automation tools like GitHub Copilot. These tools significantly improve developers' efficiency in…

As Large Language Models (LLMs) increasingly become key components in various AI applications, understanding their security vulnerabilities and the effectiveness of defense mechanisms is crucial. This survey examines the security challenges…

Machine Learning · Computer Science 2024-06-04 Frank Weizhen Liu , Chenhui Hu

Artificial Intelligence (AI) techniques, especially Large Language Models (LLMs), have started gaining popularity among researchers and software developers for generating source code. However, LLMs have been shown to generate code with…

Software Engineering · Computer Science 2024-11-08 Hyunjae Suh , Mahan Tafreshipour , Jiawei Li , Adithya Bhattiprolu , Iftekhar Ahmed

AI programming assistants have demonstrated a tendency to generate code containing basic security vulnerabilities. While developers are ultimately responsible for validating and reviewing such outputs, improving the inherent quality of…

Cryptography and Security · Computer Science 2025-11-14 Catherine Xia , Manar H. Alalfi

Despite the continued research and progress in building secure systems, Android applications continue to be ridden with vulnerabilities, necessitating effective detection methods. Current strategies involving static and dynamic analysis…

Cryptography and Security · Computer Science 2024-02-14 Noble Saji Mathews , Yelizaveta Brus , Yousra Aafer , Meiyappan Nagappan , Shane McIntosh

Language models for code (CodeLMs) have emerged as powerful tools for code-related tasks, outperforming traditional methods and standard machine learning approaches. However, these models are susceptible to security vulnerabilities, drawing…

Software Engineering · Computer Science 2025-05-20 Yuchen Chen , Weisong Sun , Chunrong Fang , Zhenpeng Chen , Yifei Ge , Tingxu Han , Quanjun Zhang , Yang Liu , Zhenyu Chen , Baowen Xu

While recent code-specific large language models (LLMs) have greatly enhanced their code generation capabilities, the safety of these models remains under-explored, posing potential risks as insecure code generated by these models may…

Cryptography and Security · Computer Science 2025-06-09 Xiangzhe Xu , Zian Su , Jinyao Guo , Kaiyuan Zhang , Zhenting Wang , Xiangyu Zhang

The widespread adoption of Large Language Models (LLMs) has revolutionized AI deployment, enabling autonomous and semi-autonomous applications across industries through intuitive language interfaces and continuous improvements in model…

Cryptography and Security · Computer Science 2025-10-20 Adam Swanda , Amy Chang , Alexander Chen , Fraser Burch , Paul Kassianik , Konstantin Berlin

Rapid evolution of Large Language Models (LLMs) has achieved major advances in reasoning, planning, and function-calling capabilities. Multi-agentic collaborative frameworks using such LLMs place them at the center of solving software…

Software Engineering · Computer Science 2026-01-16 Swapnil Shinde , Sahil Wadhwa , Andy Luo , Akshay Gupta , Mohammad Shahed Sorower

In recent years, large language models have been widely integrated into software engineering workflows, supporting tasks like code generation. While prior evaluations focus on functional correctness, there is still a limited understanding…

Software Engineering · Computer Science 2026-04-23 Xin Sun , Daniel Ståhl , Kristian Sandahl , Christoph Kessler

Large-language-model coding tools are now mainstream in software engineering. But as these same tools move human effort up the development stack, they present fresh dangers: 10% of real prompts leak private data, 42% of generated snippets…

Software Engineering · Computer Science 2025-06-23 Vladislav Belozerov , Peter J Barclay , Askhan Sami

Recent studies on the safety alignment of large language models (LLMs) have revealed that existing approaches often operate superficially, leaving models vulnerable to various adversarial attacks. Despite their significance, these studies…

Cryptography and Security · Computer Science 2025-06-02 Jianwei Li , Jung-Eun Kim

Large language models (LLMs) are increasingly used to help security analysts manage the surge of cyber threats, automating tasks from vulnerability assessment to incident response. Yet in operational CTI workflows, reliability gaps remain…

Cryptography and Security · Computer Science 2026-05-29 Yuqiao Meng , Luoxi Tang , Feiyang Yu , Jinyuan Jia , Guanhua Yan , Ping Yang , Zhaohan Xi

In recent years, large language models (LLMs) have made significant progress in the field of code generation. However, as more and more users rely on these models for software development, the security risks associated with code generation…

Artificial Intelligence · Computer Science 2024-08-21 Shangxi Wu , Jitao Sang

Most prior safety research of large language models (LLMs) has focused on enhancing the alignment of LLMs to better suit the safety requirements of humans. However, internalizing such safeguard features into larger models brought challenges…

Computation and Language · Computer Science 2025-01-24 Ohjoon Kwon , Donghyeon Jeon , Nayoung Choi , Gyu-Hwung Cho , Changbong Kim , Hyunwoo Lee , Inho Kang , Sun Kim , Taiwoo Park

It is expected that in the near future, AI software development assistants will play an important role in the software industry. However, current software development assistants tend to be unreliable, often producing incorrect, unsafe, or…

Software Engineering · Computer Science 2024-01-24 Daniel Maninger , Krishna Narasimhan , Mira Mezini

Large Language Model (LLM) is changing the software development paradigm and has gained huge attention from both academia and industry. Researchers and developers collaboratively explore how to leverage the powerful problem-solving ability…

Cryptography and Security · Computer Science 2024-11-05 Qiang Hu , Xiaofei Xie , Sen Chen , Lei Ma

Large Language Models (LLMs) such as ChatGPT and GitHub Copilot have revolutionized automated code generation in software engineering. However, as these models are increasingly utilized for software development, concerns have arisen…

Cryptography and Security · Computer Science 2024-12-03 Ahmad Mohsin , Helge Janicke , Adrian Wood , Iqbal H. Sarker , Leandros Maglaras , Naeem Janjua

Large Language Models (LLMs) can generate code but often introduce security vulnerabilities, logical inconsistencies, and compilation errors. Prior work demonstrates that LLMs benefit substantially from structured feedback, static analysis,…

Cryptography and Security · Computer Science 2026-01-05 Vidyut Sriram , Sawan Pandita , Achintya Lakshmanan , Aneesh Shamraj , Suman Saha

Large language models (LLMs) for automatic code generation have achieved breakthroughs in several programming tasks. Their advances in competition-level programming problems have made them an essential pillar of AI-assisted pair…

Cryptography and Security · Computer Science 2023-10-24 Hossein Hajipour , Keno Hassler , Thorsten Holz , Lea Schönherr , Mario Fritz