English
Related papers

Related papers: Attributional Safety Failures in Large Language Mo…

200 papers

Recent research has shown that carefully crafted jailbreak inputs can induce large language models to produce harmful outputs, despite safety measures such as alignment. It is important to anticipate the range of potential Jailbreak attacks…

Cryptography and Security · Computer Science 2025-02-24 Pedram Zaree , Md Abdullah Al Mamun , Quazi Mishkatul Alam , Yue Dong , Ihsen Alouani , Nael Abu-Ghazaleh

Despite careful safety alignment, current large language models (LLMs) remain vulnerable to various attacks. To further unveil the safety risks of LLMs, we introduce a Safety Concept Activation Vector (SCAV) framework, which effectively…

Computation and Language · Computer Science 2024-12-03 Zhihao Xu , Ruixuan Huang , Changyu Chen , Xiting Wang

Watermarking provides a critical safeguard for large language model (LLM) services by facilitating the detection of LLM-generated text. Correspondingly, stealing watermark algorithms (SWAs) derive watermark information from watermarked…

Cryptography and Security · Computer Science 2026-04-14 Shuhao Zhang , Yuli Chen , Jiale Han , Bo Cheng , Jiabao Ma

Large language models (LLMs) can be prompted with specific styles (e.g., formatting responses as lists), including in malicious queries. Prior jailbreak research mainly augments these queries with additional string transformations to…

Machine Learning · Computer Science 2026-02-26 Yuxin Xiao , Sana Tonekaboni , Walter Gerych , Vinith Suriyakumar , Marzyeh Ghassemi

Multimodal large language models (MLLMs) enable interaction over both text and images, but their safety behavior can be driven by unimodal shortcuts instead of true joint intent understanding. We introduce CSR-Bench, a benchmark for…

Artificial Intelligence · Computer Science 2026-02-04 Yuxuan Liu , Yuntian Shi , Kun Wang , Haoting Shen , Kun Yang

Traffic safety remains a critical global challenge, with traditional Advanced Driver-Assistance Systems (ADAS) often struggling in dynamic real-world scenarios due to fragmented sensor processing and susceptibility to adversarial…

Computer Vision and Pattern Recognition · Computer Science 2025-04-24 Mohammad Abu Tami , Mohammed Elhenawy , Huthaifa I. Ashqar

Large language models (LLMs) are increasingly prevalent in security research. Their unique characteristics, however, introduce challenges that undermine established paradigms of reproducibility, rigor, and evaluation. Prior work has…

Large Multimodal Models (LMMs) have demonstrated the ability to interact with humans under real-world conditions by combining Large Language Models (LLMs) and modality encoders to align multimodal information (visual and auditory) with…

Computation and Language · Computer Science 2024-11-01 Hao Yang , Lizhen Qu , Ehsan Shareghi , Gholamreza Haffari

Instruction tuning enhances large vision-language models (LVLMs) but increases their vulnerability to backdoor attacks due to their open design. Unlike prior studies in static settings, this paper explores backdoor attacks in LVLM…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Siyuan Liang , Jiawei Liang , Tianyu Pang , Chao Du , Aishan Liu , Mingli Zhu , Xiaochun Cao , Dacheng Tao

Safety alignment has become a critical step to ensure LLMs refuse harmful requests while providing helpful and harmless responses. However, despite the ubiquity of safety alignment for deployed frontier models, two separate lines of recent…

Cryptography and Security · Computer Science 2026-04-06 John T. Halloran

Large language models (LLMs) are increasingly applied in multilingual contexts, yet their capacity for consistent, logically grounded alignment across languages remains underexplored. We present a controlled evaluation framework for…

Computation and Language · Computer Science 2025-08-21 Samir Abdaljalil , Erchin Serpedin , Khalid Qaraqe , Hasan Kurban

As large language model (LLM) based agents interact autonomously with one another, a new class of failures emerges that cannot be predicted from single agent performance: behavioral drifts in agent-agent conversations (AxA). Unlike…

Artificial Intelligence · Computer Science 2026-03-04 Sarath Shekkizhar , Romain Cosentino , Adam Earle , Silvio Savarese

Ensuring that Large Language Models (LLMs) adhere to safety principles without refusing benign requests remains a significant challenge. While OpenAI introduces deliberative alignment (DA) to enhance the safety of its o-series models…

Artificial Intelligence · Computer Science 2026-01-14 Can Jin , Rui Wu , Tong Che , Qixin Zhang , Hongwu Peng , Jiahui Zhao , Zhenting Wang , Wenqi Wei , Ligong Han , Zhao Zhang , Yuan Cao , Ruixiang Tang , Dimitris N. Metaxas

Security applications are increasingly relying on large language models (LLMs) for cyber threat detection; however, their opaque reasoning often limits trust, particularly in decisions that require domain-specific cybersecurity knowledge.…

Cryptography and Security · Computer Science 2025-11-03 Arnabh Borah , Md Tanvirul Alam , Nidhi Rastogi

Large Language Models (LLMs) have shown impressive proficiency in code generation. Unfortunately, these models share a weakness with their human counterparts: producing code that inadvertently has security vulnerabilities. These…

Cryptography and Security · Computer Science 2024-10-17 Kamel Alrashedy , Abdullah Aljasser , Pradyumna Tambwekar , Matthew Gombolay

Fine-tuning safety-aligned large language models (LLMs) can substantially compromise their safety. Previous approaches require many safety samples or calibration sets, which not only incur significant computational overhead during…

Machine Learning · Computer Science 2026-01-07 Jiawen Zhang , Lipeng He , Kejia Chen , Jian Lou , Jian Liu , Xiaohu Yang , Ruoxi Jia

We identify a structural weakness in current large language model (LLM) alignment: modern refusal mechanisms are fail-open. While existing approaches encode refusal behaviors across multiple latent features, suppressing a single dominant…

Machine Learning · Computer Science 2026-02-20 Zachary Coalson , Beth Sohler , Aiden Gabriel , Sanghyun Hong

Federated Self-Supervised Learning (FSSL) integrates the privacy advantages of distributed training with the capability of self-supervised learning to leverage unlabeled data, showing strong potential across applications. However, recent…

Cryptography and Security · Computer Science 2026-02-06 Jiayao Wang , Yiping Zhang , Jiale Zhang , Wenliang Yuan , Qilin Wu , Junwu Zhu , Dongfang Zhao

Large Language Models (LLMs) challenge conventional automated programming assessment because students can now produce functionally correct code without demonstrating corresponding understanding. This paper makes two contributions. First, it…

Software Engineering · Computer Science 2026-04-09 Eduard Frankford , Erik Cikalleshi , Ruth Breu

The integration of Large Language Models (LLMs) into software engineering has revolutionized code generation, enabling unprecedented productivity through promptware and autonomous AI agents. However, this transformation introduces…

Software Engineering · Computer Science 2025-08-19 Satyam Kumar Navneet , Joydeep Chandra