English
Related papers

Related papers: LSSF: Safety Alignment for Large Language Models t…

200 papers

Accurately quantifying uncertainty in large language models (LLMs) is crucial for their reliable deployment, especially in high-stakes applications. Current state-of-the-art methods for measuring semantic uncertainty in LLMs rely on strict…

Machine Learning · Computer Science 2024-10-31 Yashvir S. Grewal , Edwin V. Bonilla , Thang D. Bui

The widespread adoption of large language models (LLMs) across industries has increased the demand for high-quality and customizable outputs. However, traditional alignment methods often require retraining large pretrained models, making it…

Computation and Language · Computer Science 2025-12-16 Yi Liu , Dianqing Liu , Mingye Zhu , Junbo Guo , Yongdong Zhang , Zhendong Mao

Large Language Models (LLMs) have demonstrated remarkable proficiency in language comprehension and generation; however, their widespread adoption is constrained by substantial bandwidth and computational demands. While pruning and low-rank…

Computation and Language · Computer Science 2025-10-31 Zeliang Zong , Kai Zhang , Zheyang Li , Wenming Tan , Ye Ren , Yiyan Zhai , Jilin Hu

Recent work has shown that fine-tuning large language models (LLMs) on code with security vulnerabilities can result in misaligned and unsafe behaviors across broad domains. These results prompted concerns about the emergence of harmful…

Machine Learning · Computer Science 2025-07-08 Jeremiah Giordani

The rapid expansion of Large Language Models (LLMs) has posed significant challenges regarding the computational resources required for fine-tuning and deployment. Recent advancements in low-rank adapters have demonstrated their efficacy in…

Machine Learning · Computer Science 2025-01-29 J. Pablo Muñoz , Jinjie Yuan , Nilesh Jain

Ensuring safety is a foundational requirement for large language models (LLMs). Achieving an appropriate balance between enhancing the utility of model outputs and mitigating their potential for harm is a complex and persistent challenge.…

Machine Learning · Computer Science 2025-10-07 Kartik Pandit , Sourav Ganguly , Arnesh Banerjee , Shaahin Angizi , Arnob Ghosh

Safety alignment in Large Language Models (LLMs) often creates a systematic discrepancy between a model's aligned output and the underlying pre-aligned data distribution. We propose a framework in which the effect of safety alignment on…

Computation and Language · Computer Science 2026-02-03 Yuxuan Lu , Yongkang Guo , Yuqing Kong

As Large Language Models (LLMs) continue to advance in understanding and generating long sequences, new safety concerns have been introduced through the long context. However, the safety of LLMs in long-context tasks remains under-explored,…

Computation and Language · Computer Science 2025-02-25 Yida Lu , Jiale Cheng , Zhexin Zhang , Shiyao Cui , Cunxiang Wang , Xiaotao Gu , Yuxiao Dong , Jie Tang , Hongning Wang , Minlie Huang

Federated learning (FL) enables multiple parties to collaboratively fine-tune an large language model (LLM) without the need of direct data sharing. Ideally, by training on decentralized data that is aligned with human preferences and…

Computation and Language · Computer Science 2024-06-18 Rui Ye , Jingyi Chai , Xiangrui Liu , Yaodong Yang , Yanfeng Wang , Siheng Chen

Large Language Models (LLMs) generating unsafe responses to toxic prompts is a significant issue in their applications. While various efforts aim to address this safety concern, previous approaches often demand substantial human data…

Computation and Language · Computer Science 2024-12-12 Yuxiao Lu , Arunesh Sinha , Pradeep Varakantham

Language Confusion is a phenomenon where Large Language Models (LLMs) generate text that is neither in the desired language, nor in a contextually appropriate language. This phenomenon presents a critical challenge in text generation by…

Computation and Language · Computer Science 2025-02-11 Yiyi Chen , Qiongxiu Li , Russa Biswas , Johannes Bjerva

Reinforcement Learning (RL) algorithms for safety alignment of Large Language Models (LLMs), such as Direct Preference Optimization (DPO), encounter the challenge of distribution shift. Current approaches typically address this issue…

Computation and Language · Computer Science 2025-06-17 Qiyuan Deng , Xuefeng Bai , Kehai Chen , Yaowei Wang , Liqiang Nie , Min Zhang

Despite their strong performance, large language models (LLMs) face challenges in real-world application of lexical simplification (LS), particularly in privacy-sensitive and resource-constrained environments. Moreover, since vulnerable…

Computation and Language · Computer Science 2025-09-30 Akio Hayakawa , Stefan Bott , Horacio Saggion

With the rapid advancement of artificial intelligence, Large Language Models (LLMs) have shown remarkable capabilities in Natural Language Processing (NLP), including content generation, human-computer interaction, machine translation, and…

Computation and Language · Computer Science 2025-10-31 Songyang Liu , Chaozhuo Li , Jiameng Qiu , Xi Zhang , Feiran Huang , Litian Zhang , Yiming Hei , Philip S. Yu

Large Language Models (LLMs) are known to hallucinate, whereby they generate plausible but inaccurate text. This phenomenon poses significant risks in critical applications, such as medicine or law, necessitating robust hallucination…

Computation and Language · Computer Science 2024-10-23 Benedict Aaron Tjandra , Muhammed Razzak , Jannik Kossen , Kunal Handa , Yarin Gal

Language models (LMs) have demonstrated remarkable capabilities in NLP, yet adapting them efficiently and robustly to specific tasks remains challenging. As their scale and complexity grow, fine-tuning LMs on labelled data often…

Computation and Language · Computer Science 2025-06-27 Zhengyan Shi

Generative large language models (LLMs) have achieved state-of-the-art results on a wide range of tasks, yet they remain susceptible to backdoor attacks: carefully crafted triggers in the input can manipulate the model to produce…

Artificial Intelligence · Computer Science 2025-05-20 Yige Li , Hanxun Huang , Yunhan Zhao , Xingjun Ma , Jun Sun

Large language models (LLMs) exhibit severe multilingual safety misalignment: they possess strong safeguards in high-resource languages but remain highly vulnerable to jailbreak attacks in low-resource languages. Current safety alignment…

Machine Learning · Computer Science 2026-05-11 Ruiyang Qin , Qingzhuo Wang , Dongrui Liu , Qiang Li , Zhihua Wei , Wen Shen

Small language models (SLMs) are increasingly deployed on edge devices, making their safety alignment crucial yet challenging. Current shallow alignment methods that rely on direct refusal of malicious queries fail to provide robust…

Cryptography and Security · Computer Science 2025-11-11 Haonan Shi , Guoli Wang , Tu Ouyang , An Wang

While Large Language Models (LLMs) have seen widespread applications across numerous fields, their limited interpretability poses concerns regarding their safe operations from multiple aspects, e.g., truthfulness, robustness, and fairness.…

Software Engineering · Computer Science 2024-04-15 Xuan Xie , Jiayang Song , Zhehua Zhou , Yuheng Huang , Da Song , Lei Ma