English
Related papers

Related papers: LM-Scout: Analyzing the Security of Language Model…

200 papers

When building Large Language Models (LLMs), it is paramount to bear safety in mind and protect them with guardrails. Indeed, LLMs should never generate content promoting or normalizing harmful, illegal, or unethical behavior that may…

Computation and Language · Computer Science 2024-06-25 Simone Tedeschi , Felix Friedrich , Patrick Schramowski , Kristian Kersting , Roberto Navigli , Huu Nguyen , Bo Li

As safety remains a crucial concern throughout the development lifecycle of Large Language Models (LLMs), researchers and industrial practitioners have increasingly focused on safeguarding and aligning LLM behaviors with human preferences…

Computation and Language · Computer Science 2024-07-11 Jiayang Song , Yuheng Huang , Zhehua Zhou , Lei Ma

$ $Large Language Models (LLMs) are being increasingly utilized in various applications, with code generations being a notable example. While previous research has shown that LLMs have the capability to generate both secure and insecure…

Large Language Models (LLMs) are increasingly used for automated software development, making their ability to preserve secure coding practices critical. In practice, however, many security requirements are implicit or underspecified,…

Cryptography and Security · Computer Science 2026-05-12 Yue Li , Xiao Li , Hao Wu , Yue Zhang , Yechao Zhang , Yating Liu , Fengyuan Xu , Sheng Zhong

Large Language Models (LLMs) demonstrate impressive capabilities across various fields, yet their increasing use raises critical security concerns. This article reviews recent literature addressing key issues in LLM security, with a focus…

Cryptography and Security · Computer Science 2025-11-26 Benji Peng , Keyu Chen , Ming Li , Pohsun Feng , Ziqian Bi , Junyu Liu , Xinyuan Song , Qian Niu

UI automation tests play a crucial role in ensuring the quality of mobile applications. Despite the growing popularity of machine learning techniques to generate these tests, they still face several challenges, such as the mismatch of UI…

Software Engineering · Computer Science 2024-09-13 Sidong Feng , Haochuan Lu , Jianqin Jiang , Ting Xiong , Likun Huang , Yinglin Liang , Xiaoqin Li , Yuetang Deng , Aldeida Aleti

Recent researches have shown that Large Language Models (LLMs) are susceptible to a security threat known as Backdoor Attack. The backdoored model will behave well in normal cases but exhibit malicious behaviours on inputs inserted with a…

Cryptography and Security · Computer Science 2024-04-04 Yunzhuo Hao , Wenkai Yang , Yankai Lin

Pre-trained large language models (LLMs) have recently emerged as a breakthrough technology in natural language processing and artificial intelligence, with the ability to handle large-scale datasets and exhibit remarkable performance…

Software Engineering · Computer Science 2024-03-05 Junjie Wang , Yuchao Huang , Chunyang Chen , Zhe Liu , Song Wang , Qing Wang

In this paper, we propose an LLM-empowered RM-API misuse detection solution, ChatDetector, which fully automates LLMs for documentation understanding which helps RM-API constraints retrieval and RM-API misuse detection. To correctly…

Cryptography and Security · Computer Science 2024-09-20 Yi Yang , Jinghua Liu , Kai Chen , Miaoqian Lin

The rapid development of large language models (LLMs) has opened new avenues across various fields, including cybersecurity, which faces an evolving threat landscape and demand for innovative technologies. Despite initial explorations into…

Cryptography and Security · Computer Science 2024-12-05 Jie Zhang , Haoyu Bu , Hui Wen , Yongji Liu , Haiqiang Fei , Rongrong Xi , Lun Li , Yun Yang , Hongsong Zhu , Dan Meng

Large language models (LLMs) have empowered intelligent agents to execute intricate tasks within domain-specific software such as browsers and games. However, when applied to general-purpose software systems like operating systems, LLM…

Artificial Intelligence · Computer Science 2024-02-12 Mingzhe Xing , Rongkai Zhang , Hui Xue , Qi Chen , Fan Yang , Zhen Xiao

Due to the vast array of Android applications, their multifarious functions and intricate behavioral semantics, attackers can adopt various tactics to conceal their genuine attack intentions within legitimate functions. However, numerous…

Cryptography and Security · Computer Science 2024-10-23 Wenxiang Zhao , Juntao Wu , Zhaoyi Meng

Large Language Models (LLMs) have gained significant attention in the software engineering community. Nowadays developers have the possibility to exploit these models through industrial-grade tools providing a handy interface toward LLMs,…

Software Engineering · Computer Science 2024-02-27 Rosalia Tufano , Antonio Mastropaolo , Federica Pepe , Ozren Dabić , Massimiliano Di Penta , Gabriele Bavota

LLM-integrated app systems extend the utility of Large Language Models (LLMs) with third-party apps that are invoked by a system LLM using interleaved planning and execution phases to answer user queries. These systems introduce new attack…

Cryptography and Security · Computer Science 2026-05-15 Evan Li , Tushin Mallick , Evan Rose , William Robertson , Alina Oprea , Cristina Nita-Rotaru

Safety lies at the core of developing and deploying large language models (LLMs). However, previous safety benchmarks only concern the safety in one language, e.g. the majority language in the pretraining data such as English. In this work,…

Computation and Language · Computer Science 2024-06-21 Wenxuan Wang , Zhaopeng Tu , Chang Chen , Youliang Yuan , Jen-tse Huang , Wenxiang Jiao , Michael R. Lyu

The majority of software developers use or are planning to use Artificial Intelligence (AI) tools in their development processes. Their top reasons include improving productivity and faster learning. In fact, Large Language Model…

Software Engineering · Computer Science 2026-05-25 Srivathsan G Morkonda , Mahmoud Selim , Hala Assal

Large Language Models (LLMs) have the potential to significantly enhance threat intelligence by automating the collection, preprocessing, and analysis of threat data. However, the usability of these tools is critical to ensure their…

Cryptography and Security · Computer Science 2024-09-24 Sanchana Srikanth , Mohammad Hasanuzzaman , Farah Tasnur Meem

Small language models (SLMs) have emerged as promising alternatives to large language models (LLMs) due to their low computational demands, enhanced privacy guarantees and comparable performance in specific domains through light-weight…

Cryptography and Security · Computer Science 2025-03-11 Wenhui Zhang , Huiyu Xu , Zhibo Wang , Zeqing He , Ziqi Zhu , Kui Ren

Android is the most widely deployed end-user focused operating system. With its growing set of use cases encompassing communication, navigation, media consumption, entertainment, finance, health, and access to sensors, actuators, cameras,…

A rapidly growing number of applications rely on a small set of closed-source language models (LMs). This dependency might introduce novel security risks if LMs develop self-recognition capabilities. Inspired by human identity verification…

Computation and Language · Computer Science 2024-10-11 Tim R. Davidson , Viacheslav Surkov , Veniamin Veselovsky , Giuseppe Russo , Robert West , Caglar Gulcehre