English
Related papers

Related papers: JADE: A Linguistics-based Safety Evaluation Platfo…

200 papers

Traditional cybersecurity methodologies target deterministic systems and fail to address the probabilistic nature of AI, leaving systems vulnerable to attack vectors such as model inversion, data poisoning, and prompt injection. Recent…

Cryptography and Security · Computer Science 2026-05-19 Tsafac Nkombong Regine Cyrille , Franziska Schwarz

Artificial Intelligence (AI)-driven code generation tools are increasingly used throughout the software development lifecycle to accelerate coding tasks. However, the security of AI-generated code using Large Language Models (LLMs) remains…

Cryptography and Security · Computer Science 2026-03-10 Mohammed Kharma , Soohyeon Choi , Mohammed AlKhanafseh , David Mohaisen

Jailbreaking in Large Language Models (LLMs) is a major security concern as it can deceive LLMs to generate harmful text. Yet, there is still insufficient understanding of how jailbreaking works, which makes it hard to develop effective…

Computation and Language · Computer Science 2025-05-22 Lang Gao , Jiahui Geng , Xiangliang Zhang , Preslav Nakov , Xiuying Chen

Large Language Models (LLMs) are increasingly used for cybersecurity threat analysis, but their deployment in security-sensitive environments raises trust and safety concerns. With over 21,000 vulnerabilities disclosed in 2025, manual…

Cryptography and Security · Computer Science 2025-09-04 Reza Fayyazi , Michael Zuzak , Shanchieh Jay Yang

The growing collaboration between humans and AI models in generative tasks has introduced new challenges in distinguishing between human-written, LLM-generated, and human-LLM collaborative texts. In this work, we collect a multilingual,…

Computation and Language · Computer Science 2026-02-10 Minh Ngoc Ta , Dong Cao Van , Duc-Anh Hoang , Minh Le-Anh , Truong Nguyen , My Anh Tran Nguyen , Yuxia Wang , Preslav Nakov , Sang Dinh

Retrieval-Augmented Generation (RAG) is a technique that enhances the capabilities of large language models (LLMs) by incorporating external knowledge sources. This method addresses common LLM limitations, including outdated information and…

Computation and Language · Computer Science 2024-07-16 Yuanjie Lyu , Zhiyu Li , Simin Niu , Feiyu Xiong , Bo Tang , Wenjin Wang , Hao Wu , Huanyong Liu , Tong Xu , Enhong Chen

This paper presents EASE (Effortless Algorithmic Solution Evolution), an open-source and fully modular framework for iterative algorithmic solution generation leveraging large language models (LLMs). EASE integrates generation, testing,…

Machine Learning · Computer Science 2025-09-24 Adam Viktorin , Tomas Kadavy , Jozef Kovac , Michal Pluhacek , Roman Senkerik

Jailbreak attacks in large language models (LLMs) entail inducing the models to generate content that breaches ethical and legal norm through the use of malicious prompts, posing a substantial threat to LLM security. Current strategies for…

Cryptography and Security · Computer Science 2024-06-07 Lin Lu , Hai Yan , Zenghui Yuan , Jiawen Shi , Wenqi Wei , Pin-Yu Chen , Pan Zhou

LLMs are increasingly applied to recommendation, retrieval, and reasoning, yet deploying a single end-to-end model that can jointly support these behaviors over large, heterogeneous catalogs remains challenging. Such systems must generate…

Large language models (LLMs) have shown impressive promise in code generation, yet their progress remains limited by the shortage of large-scale datasets that are both diverse and well-aligned with human reasoning. Most existing resources…

Machine Learning · Computer Science 2025-10-28 Amal Abed , Ivan Lukic , Jörg K. H. Franke , Frank Hutter

Identifying and classifying shutdown initiating events (SDIEs) is critical for developing low power shutdown probabilistic risk assessment for nuclear power plants. Existing computational approaches cannot achieve satisfactory performance…

Artificial Intelligence · Computer Science 2024-10-03 Min Xian , Tao Wang , Sai Zhang , Fei Xu , Zhegang Ma

Large language models (LLMs) are equipped with safety mechanisms to detect and block harmful queries, yet current alignment approaches primarily focus on overtly dangerous content and overlook more subtle threats. However, users can often…

Computation and Language · Computer Science 2026-01-01 Shenzhe Zhu

The safety of Large Language Models (LLMs) has gained increasing attention in recent years, but there still lacks a comprehensive approach for detecting safety issues within LLMs' responses in an aligned, customizable and explainable…

Computation and Language · Computer Science 2024-11-06 Zhexin Zhang , Yida Lu , Jingyuan Ma , Di Zhang , Rui Li , Pei Ke , Hao Sun , Lei Sha , Zhifang Sui , Hongning Wang , Minlie Huang

Large language models (LLMs) have transformed natural language processing (NLP), enabling applications from content generation to decision support. Retrieval-Augmented Generation (RAG) improves LLMs by incorporating external knowledge but…

Cryptography and Security · Computer Science 2025-11-11 Zirui Cheng , Jikai Sun , Anjun Gao , Yueyang Quan , Zhuqing Liu , Xiaohua Hu , Minghong Fang

As LLMs continue to shape real-world applications, automated jailbreak generation becomes essential to reveal safety weaknesses and guide model improvement. Existing automatic jailbreak generation methods have not yet fully considered two…

Neural and Evolutionary Computing · Computer Science 2026-05-06 Rui Tang , Kaiyu Xu , Pengsen Cheng , Hao Ren , Haizhou Wang , Shuyu Jiang

Large Language Models (LLMs) are transforming scientific hypothesis generation and validation by enabling information synthesis, latent relationship discovery, and reasoning augmentation. This survey provides a structured overview of…

Most prior safety research of large language models (LLMs) has focused on enhancing the alignment of LLMs to better suit the safety requirements of humans. However, internalizing such safeguard features into larger models brought challenges…

Computation and Language · Computer Science 2025-01-24 Ohjoon Kwon , Donghyeon Jeon , Nayoung Choi , Gyu-Hwung Cho , Changbong Kim , Hyunwoo Lee , Inho Kang , Sun Kim , Taiwoo Park

Retrieval-augmented generation (RAG) systems enhance large language models (LLMs) with external knowledge but are vulnerable to corpus poisoning and contamination attacks, which can compromise output integrity. Existing defenses often apply…

Computation and Language · Computer Science 2025-10-16 Xiaonan Si , Meilin Zhu , Simeng Qin , Lijia Yu , Lijun Zhang , Shuaitong Liu , Xinfeng Li , Ranjie Duan , Yang Liu , Xiaojun Jia

With rapid advances, generative large language models (LLMs) dominate various Natural Language Processing (NLP) tasks from understanding to reasoning. Yet, language models' inherent vulnerabilities may be exacerbated due to increased…

Cryptography and Security · Computer Science 2024-12-17 Haoran Li , Yulin Chen , Zihao Zheng , Qi Hu , Chunkit Chan , Heshan Liu , Yangqiu Song

Large Language Models (LLMs) have become powerful tools for automated code generation. However, these models often overlook critical security practices, which can result in the generation of insecure code that contains…

Software Engineering · Computer Science 2025-07-01 Hao Yan , Swapneel Suhas Vaidya , Xiaokuan Zhang , Ziyu Yao