English
Related papers

Related papers: Where to Start Alignment? Diffusion Large Language…

200 papers

Building scalable and reusable multi-agent decision policies from offline datasets remains a challenge in offline multi-agent reinforcement learning (MARL), as existing methods often rely on fixed observation formats and action spaces that…

Multiagent Systems · Computer Science 2026-04-28 Zhuohui Zhang , Bin Cheng , Bin He

In this work, we present a series of structure transformation attacks on LLM alignment, where we encode natural language intent using diverse syntax spaces, ranging from simple structure formats and basic query languages (e.g., SQL) to new…

Machine Learning · Computer Science 2025-07-04 Shehel Yoosuf , Temoor Ali , Ahmed Lekssays , Mashael AlSabah , Issa Khalil

Diffusion large language models (dLLMs) have emerged as a new architecture following auto regressive models. Their denoising process offers a powerful generative advantage, but they present significant challenges in learning and…

Machine Learning · Computer Science 2025-09-24 Ranfei Chen , Ming Chen

The safety mechanisms of large language models (LLMs) exhibit notable fragility, as even fine-tuning on datasets without harmful content may still undermine their safety capabilities. Meanwhile, existing safety alignment methods…

Computers and Society · Computer Science 2026-02-03 Guanghao Zhou , Panjia Qiu , Cen Chen , Hongyu Li , Mingyuan Chu , Xin Zhang , Jun Zhou

Large audio-language models (LALMs) extend text-based LLMs with auditory understanding, offering new opportunities for multimodal applications. While their perception, reasoning, and task performance have been widely studied, their safety…

Diffusion Language Models (DLMs) have emerged as a compelling alternative to autoregressive approaches, enabling parallel text generation with competitive performance. Despite these advantages, there is a critical instability in DLMs: the…

Computation and Language · Computer Science 2026-02-24 Zihou Zhang , Zheyong Xie , Li Zhong , Haifeng Liu , Yao Hu , Shaosheng Cao

Fine-tuning large language models (LLMs) on custom datasets has become a standard approach for adapting these models to specific domains and applications. However, recent studies have shown that such fine-tuning can lead to significant…

Computation and Language · Computer Science 2026-03-03 Yanping Li , Zhening Liu , Zijian Li , Zehong Lin , Jun Zhang

Fine-tuning large language models (LLMs) is a common practice to adapt generalist models to specialized domains. However, recent studies show that fine-tuning can erode safety alignment, causing LLMs to respond to harmful or unethical…

Computation and Language · Computer Science 2026-04-24 Aladin Djuhera , Swanand Ravindra Kadhe , Farhan Ahmed , Syed Zawad , Holger Boche

Information security is facing increasingly severe challenges, and traditional protection means are difficult to cope with complex and changing threats. In recent years, as an emerging intelligent technology, large language models (LLMs)…

Cryptography and Security · Computer Science 2026-02-03 Chang Gong , Zhongwen Li , Xiaoqi Li

Over the last year, significant advancements have been made in the realms of large language models (LLMs) and multi-modal large language models (MLLMs), particularly in their application to autonomous driving. These models have showcased…

Robotics · Computer Science 2024-06-11 Xiangrui Kong , Thomas Braunl , Marco Fahmi , Yue Wang

The popularity of large language models (LLMs) continues to grow, and LLM-based assistants have become ubiquitous. Information security awareness (ISA) is an important yet underexplored area of LLM safety. ISA encompasses LLMs' security…

Cryptography and Security · Computer Science 2026-03-23 Ofir Cohen , Gil Ari Agmon , Asaf Shabtai , Rami Puzis

Diffusion large language models (dLLMs) are emerging as a compelling alternative to dominant autoregressive models, replacing strictly sequential token generation with iterative denoising and parallel generation dynamics. However, their…

Computation and Language · Computer Science 2026-04-07 Jingyi Yang , Yuxian Jiang , Xuhao Hu , Shuang Cheng , Biqing Qi , Jing Shao

Large language models (LLMs) have revolutionized various applications, making robust safety alignment essential to prevent harmful outputs. Current safety alignment techniques, however, harbor inherent vulnerabilities due to their reliance…

Cryptography and Security · Computer Science 2026-04-21 Yuxi Li , Yi Liu , Yuekang Li , Ling Shi , Gelei Deng , Shengquan Chen , Kailong Wang

Diffusion language models (DLMs) have recently emerged as an alternative modeling paradigm to autoregressive (AR) language models, enabling parallel generation and bidirectional context modeling. Yet their security implications,…

Cryptography and Security · Computer Science 2026-05-12 Shengfang Zhai , Xiaoyang Ji , Yuling Shi , Haoran Gao , Fanyu Meng , Yan Zeng , Yuejian Fang , Yinpeng Dong , Jiaheng Zhang

Large Language Models (LLMs) have showcased remarkable capabilities across various domains. Accompanying the evolving capabilities and expanding deployment scenarios of LLMs, their deployment challenges escalate due to their sheer scale and…

Cryptography and Security · Computer Science 2025-06-11 Jiawen Zhang , Kejia Chen , Lipeng He , Jian Lou , Dan Li , Zunlei Feng , Mingli Song , Jian Liu , Kui Ren , Xiaohu Yang

Alignment of Large Language Models (LLMs) is the ability to satisfy desired objectives during generation, which is critical for trustworthy deployment. In practice, alignment is often operationalized through multiple objectives such as…

Computation and Language · Computer Science 2026-05-19 Gautam Siddharth Kashyap , Mark Dras , Usman Naseem

Large language models (LLMs) have become the backbone of modern natural language processing but pose privacy concerns about leaking sensitive training data. Membership inference attacks (MIAs), which aim to infer whether a sample is…

Machine Learning · Computer Science 2025-06-03 Toan Tran , Ruixuan Liu , Li Xiong

Diffusion Multi-modal Large Language Models (dMLLMs) have recently emerged as a novel architecture unifying image generation and understanding. However, developing effective and efficient Test-Time Scaling (TTS) methods to unlock their full…

Computer Vision and Pattern Recognition · Computer Science 2026-04-09 Yi Xin , Siqi Luo , Tianxiang Xu , Qi Qin , Haoxing Chen , Kaiwen Zhu , Zhiwei Zhang , Yangfan He , Rongchao Zhang , Jinbin Bai , Shuo Cao , Bin Fu , Junjun He , Yihao Liu , Yuewen Cao , Xiaohong Liu

Large language models (LLMs) have recently achieved significant success across various application domains, garnering substantial attention from different communities. Unfortunately, even for the best LLM, many \textit{faults} still exist…

Software Engineering · Computer Science 2024-11-06 Qiang Hu , Jin Wen , Maxime Cordy , Yuheng Huang , Wei Ma , Xiaofei Xie , Lei Ma

The rapid advancement of Large Language Models (LLMs) has brought about remarkable generative capabilities but also raised concerns about their potential misuse. While strategies like supervised fine-tuning and reinforcement learning from…

Computation and Language · Computer Science 2024-09-17 Qibing Ren , Chang Gao , Jing Shao , Junchi Yan , Xin Tan , Wai Lam , Lizhuang Ma