中文
相关论文

相关论文: Mitigating Over-Refusal in Aligned Large Language …

200 篇论文

Large language model (LLM) has recently been considered a promising technique for many fields. This work explores LLM-based wireless network optimization via in-context learning. To showcase the potential of LLM technologies, we consider…

系统与控制 · 电气工程与系统科学 2025-06-17 Hao Zhou , Chengming Hu , Dun Yuan , Ye Yuan , Di Wu , Xue Liu , Charlie Zhang

Large Language Models (LLMs) have demonstrated impressive capabilities in natural language tasks, but their safety and morality remain contentious due to their training on internet text corpora. To address these concerns, alignment…

计算与语言 · 计算机科学 2024-08-06 Mohammad Bahrami Karkevandi , Nishant Vishwamitra , Peyman Najafirad

LLMs have shown remarkable capabilities, but precisely controlling their response behavior remains challenging. Existing activation steering methods alter LLM behavior indiscriminately, limiting their practical applicability in settings…

Although state-of-the-art Speech Foundational Models can produce high-quality text pseudo-labels, applying Semi-Supervised Learning (SSL) for in-the-wild real-world data remains challenging due to its richer and more complex acoustics…

计算与语言 · 计算机科学 2026-03-16 Wen Ding , Fan Qian

Alignment of Large Language Models (LLMs) is the ability to satisfy desired objectives during generation, which is critical for trustworthy deployment. In practice, alignment is often operationalized through multiple objectives such as…

计算与语言 · 计算机科学 2026-05-19 Gautam Siddharth Kashyap , Mark Dras , Usman Naseem

Large Vision-Language Models (LVLMs) exhibit powerful reasoning capabilities but suffer sophisticated jailbreak vulnerabilities. Fundamentally, aligning LVLMs is not just a safety challenge but a problem of economic efficiency. Current…

人工智能 · 计算机科学 2026-03-17 Ruoxi Cheng , Haoxuan Ma , Teng Ma , Hongyi Zhang

Speculative Decoding is a prominent technique for accelerating the autoregressive inference of large language models (LLMs) by employing a fast draft model to propose candidate token sequences and a large target model to verify them in…

计算与语言 · 计算机科学 2025-12-18 Chendong Sun , Ali Mao , Lei Xu , mingmin Chen

Identifying the vulnerabilities of large language models (LLMs) is crucial for improving their safety by addressing inherent weaknesses. Jailbreaks, in which adversaries bypass safeguards with crafted input prompts, play a central role in…

人工智能 · 计算机科学 2026-04-03 Hamin Koo , Minseon Kim , Jaehyung Kim

As LLMs are increasingly deployed in real-world applications, ensuring their ability to refuse malicious prompts, especially jailbreak attacks, is essential for safe and reliable use. Recently, activation steering has emerged as an…

Large language models (LLMs) are increasingly recognized for their exceptional generative capabilities and versatility across various tasks. However, the high inference costs associated with these models have not received adequate…

计算与语言 · 计算机科学 2025-03-18 Soham Poddar , Paramita Koley , Janardan Misra , Sanjay Podder , Niloy Ganguly , Saptarshi Ghosh

Autoregressive models (ARMs) currently constitute the dominant paradigm for large language models (LLMs). Energy-based models (EBMs) represent another class of models, which have historically been less prevalent in LLM development, yet…

机器学习 · 计算机科学 2026-05-26 Mathieu Blondel , Michael E. Sander , Germain Vivier-Ardisson , Tianlin Liu , Vincent Roulet

Large language models (LLMs), despite being safety-aligned, exhibit brittle refusal behaviors that can be circumvented by simple linguistic changes. As tense jailbreaking demonstrates that models refusing harmful requests often comply when…

人工智能 · 计算机科学 2026-04-15 Yein Park , Jungwoo Park , Jaewoo Kang

Despite significant progress in alignment, large language models (LLMs) remain vulnerable to adversarial attacks that elicit harmful behaviors. Activation steering techniques offer a promising inference-time intervention approach, but…

机器学习 · 计算机科学 2026-01-28 Quy-Anh Dang , Chris Ngo

Large Language Models (LLMs) are widely used across sectors, yet their alignment with International Humanitarian Law (IHL) is not well understood. This study evaluates eight leading LLMs on their ability to refuse prompts that explicitly…

计算机与社会 · 计算机科学 2025-06-10 John Mavi , Diana Teodora Găitan , Sergio Coronado

Large language models (LLMs) undergo safety alignment to ensure safe conversations with humans. However, this paper introduces a training-free attack method capable of reversing safety alignment, converting the outcomes of stronger…

计算与语言 · 计算机科学 2024-06-07 Zhanhui Zhou , Jie Liu , Zhichen Dong , Jiaheng Liu , Chao Yang , Wanli Ouyang , Yu Qiao

Large Language Models (LLMs) with safe-alignment training are powerful instruments with robust language comprehension capabilities. These models typically undergo meticulous alignment procedures involving human feedback to ensure the…

机器学习 · 计算机科学 2025-09-22 Maithili Joshi , Palash Nandi , Tanmoy Chakraborty

Driving in safety-critical scenarios requires quick, context-aware decision-making grounded in both situational understanding and experiential reasoning. Large Language Models (LLMs), with their powerful general-purpose reasoning…

人工智能 · 计算机科学 2025-06-26 Wenbin Gan , Minh-Son Dao , Koji Zettsu

While current Automated Essay Scoring (AES) methods demonstrate high scoring agreement with human raters, their decision-making mechanisms are not fully understood. Our proposed method, using counterfactual intervention assisted by Large…

计算与语言 · 计算机科学 2024-10-10 Yupei Wang , Renfen Hu , Zhe Zhao

Recent developments in Large Language Model (LLM) capabilities have brought great potential but also posed new risks. For example, LLMs with knowledge of bioweapons, advanced chemistry, or cyberattacks could cause violence if placed in the…

机器学习 · 计算机科学 2025-03-17 Matthew Khoriaty , Andrii Shportko , Gustavo Mercier , Zach Wood-Doughty

Fine-tuning lets practitioners repurpose aligned large language models (LLMs) for new domains, yet recent work reveals emergent misalignment (EMA): Even a small, domain-specific fine-tune can induce harmful behaviors far outside the target…

机器学习 · 计算机科学 2026-03-06 David Kaczér , Magnus Jørgenvåg , Clemens Vetter , Esha Afzal , Robin Haselhorst , Lucie Flek , Florian Mai