English
Related papers

Related papers: Unintended Misalignment from Agentic Fine-Tuning: …

200 papers

Optimizing large language models (LLMs) for downstream use cases often involves the customization of pre-trained LLMs through further fine-tuning. Meta's open release of Llama models and OpenAI's APIs for fine-tuning GPT-3.5 Turbo on custom…

Computation and Language · Computer Science 2023-10-06 Xiangyu Qi , Yi Zeng , Tinghao Xie , Pin-Yu Chen , Ruoxi Jia , Prateek Mittal , Peter Henderson

Recently, web-based Large Language Model (LLM) agents autonomously perform increasingly complex tasks, thereby bringing significant convenience. However, they also amplify the risks of malicious misuse cases such as unauthorized collection…

Cryptography and Security · Computer Science 2026-02-02 Sechan Lee , Sangdon Park

As Large Language Models (LLMs) continue to be increasingly applied across various domains, their widespread adoption necessitates rigorous monitoring to prevent unintended negative consequences and ensure robustness. Furthermore, LLMs must…

Computation and Language · Computer Science 2025-07-09 Seshu Tirupathi , Dhaval Salwala , Elizabeth Daly , Inge Vejsbjerg

The emergence of LLM (Large Language Model) integrated virtual assistants has brought about a rapid transformation in communication dynamics. During virtual assistant development, some developers prefer to leverage the system message, also…

Cryptography and Security · Computer Science 2024-01-03 Chun Fai Chan , Daniel Wankit Yip , Aysan Esmradi

Large language model (LLM) agents with extended autonomy unlock new capabilities, but also introduce heightened challenges for LLM safety. In particular, an LLM agent may pursue objectives that deviate from human values and ethical norms, a…

Computation and Language · Computer Science 2026-01-27 Chen Chen , Kim Young Il , Yuan Yang , Wenhao Su , Yilin Zhang , Xueluan Gong , Qian Wang , Yongsen Zheng , Ziyao Liu , Kwok-Yan Lam

This study reveals a previously unexplored vulnerability in the safety alignment of Large Language Models (LLMs). Existing aligned LLMs predominantly respond to unsafe queries with refusals, which often begin with a fixed set of prefixes…

Cryptography and Security · Computer Science 2026-01-28 Yangyang Guo , Ziwei Xu , Si Liu , Zhiming Zheng , Mohan Kankanhalli

Current LLM alignment methods are readily broken through specifically crafted adversarial prompts. While crafting adversarial prompts using discrete optimization is highly effective, such attacks typically use more than 100,000 LLM calls.…

Machine Learning · Computer Science 2025-03-04 Simon Geisler , Tom Wollschläger , M. H. I. Abdalla , Johannes Gasteiger , Stephan Günnemann

Large language model (LLM)-based agents combine LLMs with external tools to automate tasks such as scheduling meetings, managing documents, or booking travel. While these integrations unlock powerful capabilities, they also create new and…

Cryptography and Security · Computer Science 2026-04-22 Jonathan Evertz , Merlin Chlosta , Lea Schönherr , Thorsten Eisenhofer

Large Language Models (LLMs) are widely used for automated code generation, yet their apparent successes often mask a tension between pretraining objectives and alignment choices. While pretraining encourages models to exploit all available…

Software Engineering · Computer Science 2025-12-25 Oussama Ben Sghaier , Kevin Delcourt , Houari Sahraoui

Previous research has shown that LLMs finetuned on malicious or incorrect completions within narrow domains (e.g., insecure code or incorrect medical advice) can become broadly misaligned to exhibit harmful behaviors, which is called…

Computation and Language · Computer Science 2026-01-21 Xuhao Hu , Peng Wang , Xiaoya Lu , Dongrui Liu , Xuanjing Huang , Jing Shao

Large Language Model (LLM) agents use memory to learn from past interactions, enabling autonomous planning and decision-making in complex environments. However, this reliance on memory introduces a critical security risk: an adversary can…

Cryptography and Security · Computer Science 2025-10-06 Qianshan Wei , Tengchao Yang , Yaochen Wang , Xinfeng Li , Lijun Li , Zhenfei Yin , Yi Zhan , Thorsten Holz , Zhiqiang Lin , XiaoFeng Wang

Large language models are increasingly embedded into systems that interact with user data, retrieved web content, and external tools, creating a new attack surface: prompt injection, where malicious commands embedded in untrusted data…

Cryptography and Security · Computer Science 2026-05-05 Yuyang Gong , Zihao Wang , Jiawei Liu , XiaoFeng Wang

Fine-tuning large pre-trained language models on various downstream tasks with whole parameters is prohibitively expensive. Hence, Parameter-efficient fine-tuning has attracted attention that only optimizes a few task-specific parameters…

Computation and Language · Computer Science 2023-05-25 Zhen-Ru Zhang , Chuanqi Tan , Haiyang Xu , Chengyu Wang , Jun Huang , Songfang Huang

Ensuring robust safety alignment is crucial for Large Language Models (LLMs), yet existing defenses often lag behind evolving adversarial attacks due to their \textbf{reliance on static, pre-collected data distributions}. In this paper, we…

Artificial Intelligence · Computer Science 2026-02-09 Xiaoyu Wen , Zhida He , Han Qi , Ziyu Wan , Zhongtian Ma , Ying Wen , Tianhang Zheng , Xingcheng Xu , Chaochao Lu , Qiaosheng Zhang

Large Language Models (LLMs) remain vulnerable to jailbreak attacks, where adversarially crafted prompts induce policy-violating responses despite safety alignment. Existing defenses typically improve safety through external filtering,…

Cryptography and Security · Computer Science 2026-05-12 Yulong Chen , Qi Zhang , Jiawen Zhang , Yadong Liu , Mu Li , Jie Wen , Yong Xu

Large Language Models (LLMs) are increasingly evaluated on multiple-choice question answering (MCQA) tasks using *first-token probability* (FTP), which selects the answer option whose initial token has the highest likelihood. While…

Computation and Language · Computer Science 2026-04-06 Silvia Cappelletti , Tobia Poppi , Samuele Poppi , Zheng-Xin Yong , Diego Garcia-Olano , Marcella Cornia , Lorenzo Baraldi , Rita Cucchiara

Agentic large language model systems increasingly automate tasks by retrieving URLs and calling external tools. We show that this workflow gives rise to implicit prompt injection: adversarial instructions embedded in automatically generated…

Cryptography and Security · Computer Science 2026-02-27 Qianlong Lan , Anuj Kaul , Shaun Jones , Stephanie Westrum

The evolution of Large Language Models (LLMs) from passive text generators to autonomous, goal-driven systems represents a fundamental shift in artificial intelligence. This chapter examines the emergence of agentic AI systems that…

Artificial Intelligence · Computer Science 2026-01-07 Nadia Sibai , Yara Ahmed , Serry Sibaee , Sawsan AlHalawani , Adel Ammar , Wadii Boulila

Large Language Models (LLMs) acquire extensive knowledge and remarkable abilities from extensive text corpora, making them powerful tools for various applications. To make LLMs more usable, aligning them with human preferences is essential.…

Computation and Language · Computer Science 2024-10-21 Mozhi Zhang , Pengyu Wang , Chenkun Tan , Mianqiu Huang , Dong Zhang , Yaqian Zhou , Xipeng Qiu

Alignment tuning has enabled large language models to excel in reasoning, instruction-following, and minimizing harmful generations. However, despite their widespread deployment, these models exhibit a monolingual bias, raising concerns…

Computation and Language · Computer Science 2025-04-04 Nikhil Verma , Manasa Bharadwaj