English
Related papers

Related papers: YuFeng-XGuard: A Reasoning-Centric, Interpretable,…

200 papers

Reasoning Large Language Models (LLMs) enable test-time scaling, with dataset-level accuracy improving as the token budget increases, motivating adaptive reasoning -- spending tokens when they improve reliability and stopping early when…

Artificial Intelligence · Computer Science 2026-05-15 Xi Wang , Anushri Suresh , Alvin Zhang , Rishi More , William Jurayj , Benjamin Van Durme , Mehrdad Farajtabar , Daniel Khashabi , Eric Nalisnick

Large Language Models (LLMs) exhibit impressive capabilities but also present risks such as biased content generation and privacy issues. One of the current alignment techniques includes principle-driven integration, but it faces challenges…

Computation and Language · Computer Science 2025-05-30 Yi Luo , Zhenghao Lin , Yuhao Zhang , Jiashuo Sun , Chen Lin , Chengjin Xu , Xiangdong Su , Yelong Shen , Jian Guo , Yeyun Gong

Large Language Models (LLMs) have demonstrated remarkable proficiency in vulnerability detection. However, a critical reliability gap persists: models frequently yield correct detection verdicts based on hallucinated logic or superficial…

Cryptography and Security · Computer Science 2026-02-09 Li Lu , Yanjie Zhao , Hongzhou Rao , Kechi Zhang , Haoyu Wang

While large language models (LLMs) are trained to align with human values, their generations may still violate safety constraints. A growing line of work addresses this problem by modifying the model's sampling policy at decoding time using…

Machine Learning · Computer Science 2026-05-15 Bat-Sheva Einbinder , Hen Davidov , Yee Whye Teh , Yarin Gal , Yaniv Romano

As large language models (LLMs) become integrated into everyday applications, ensuring their robustness and security is increasingly critical. In particular, LLMs can be manipulated into unsafe behaviour by prompts known as jailbreaks. The…

As large language models (LLMs) continue to advance in capabilities, ensuring their safety against jailbreak attacks remains a critical challenge. In this paper, we introduce a novel safety alignment approach called Answer-Then-Check, which…

Machine Learning · Computer Science 2026-03-09 Chentao Cao , Xiaojun Xu , Bo Han , Hang Li

In recent years, large language models (LLMs) have had great success in tasks such as casual conversation, contributing to significant advancements in domains like virtual assistance. However, they often generate responses that are not…

Computation and Language · Computer Science 2025-03-11 Ben Ganon , Alon Zolfi , Omer Hofman , Inderjeet Singh , Hisashi Kojima , Yuval Elovici , Asaf Shabtai

Large Language Models (LLMs) achieve strong performance through extended inference-time deliberation, yet how their reasoning failures arise remains poorly understood. By analyzing model-generated reasoning trajectories, we find that errors…

Artificial Intelligence · Computer Science 2026-04-17 Wei Zhu , Jian Zhang , Lixing Yu , Kun Yue , Zhiwen Tang

Although the rise of Large Language Models (LLMs) in enterprise settings brings new opportunities and capabilities, it also brings challenges, such as the risk of generating inappropriate, biased, or misleading content that violates…

Computation and Language · Computer Science 2024-03-05 Shubh Goyal , Medha Hira , Shubham Mishra , Sukriti Goyal , Arnav Goel , Niharika Dadu , Kirushikesh DB , Sameep Mehta , Nishtha Madaan

Large reasoning models (LRMs) achieve strong performance on complex reasoning tasks by generating long, multi-step reasoning trajectories, but inference-time scaling incurs substantial deployment cost. A key challenge is that generation…

Computation and Language · Computer Science 2026-02-09 Jiwon Song , Yoongon Kim , Jae-Joon Kim

Large Reasoning Models (LRMs) have demonstrated remarkable performance on tasks such as mathematics and code generation. Motivated by these strengths, recent work has empirically demonstrated the effectiveness of LRMs as guard models in…

Cryptography and Security · Computer Science 2025-09-29 Jiawei Zhao , Yuang Qi , Weiming Zhang , Nenghai Yu , Kejiang Chen

Studying the robustness of Large Language Models (LLMs) to unsafe behaviors is an important topic of research today. Building safety classification models or guard models, which are fine-tuned models for input/output safety classification…

Computation and Language · Computer Science 2025-07-30 Sowmya Vajjala

Recent advancements in large language models (LLMs) have underscored their vulnerability to safety alignment jailbreaks, particularly when subjected to downstream fine-tuning. However, existing mitigation strategies primarily focus on…

Cryptography and Security · Computer Science 2025-06-06 Lei Hsiung , Tianyu Pang , Yung-Chen Tang , Linyue Song , Tsung-Yi Ho , Pin-Yu Chen , Yaoqing Yang

Despite advances in multilingual capabilities, most large language models (LLMs) remain English-centric in their training and, crucially, in their production of reasoning traces. Even when tasked with non-English problems, these models…

Computation and Language · Computer Science 2026-04-15 Daniil Gurgurov , Tom Röhr , Sebastian von Rohrscheidt , Josef van Genabith , Alexander Löser , Simon Ostermann

Despite their superior performance on a wide range of domains, large language models (LLMs) remain vulnerable to misuse for generating harmful content, a risk that has been further amplified by various jailbreak attacks. Existing jailbreak…

Cryptography and Security · Computer Science 2025-10-27 Yukun Jiang , Mingjie Li , Michael Backes , Yang Zhang

Large Language Models (LLMs) excel in text generation, reasoning, and decision-making, enabling their adoption in high-stakes domains such as healthcare, law, and transportation. However, their reliability is a major concern, as they often…

Computation and Language · Computer Science 2025-06-05 Xiaoou Liu , Tiejin Chen , Longchao Da , Chacha Chen , Zhen Lin , Hua Wei

Large language models (LLMs) now mediate many web-based mental-health, crisis, and other emotionally sensitive services, yet their psychosocial safety in these settings remains poorly understood and weakly evaluated. We present DialogGuard,…

Artificial Intelligence · Computer Science 2025-12-03 Han Luo , Guy Laban

With the profound development of large language models(LLMs), their safety concerns have garnered increasing attention. However, there is a scarcity of Chinese safety benchmarks for LLMs, and the existing safety taxonomies are inadequate,…

Computation and Language · Computer Science 2024-09-04 Wenjing Zhang , Xuejiao Lei , Zhaoxiang Liu , Meijuan An , Bikun Yang , KaiKai Zhao , Kai Wang , Shiguo Lian

Current vision large language models (VLLMs) exhibit remarkable capabilities yet are prone to generate harmful content and are vulnerable to even the simplest jailbreaking attacks. Our initial analysis finds that this is due to the presence…

Machine Learning · Computer Science 2024-06-19 Yongshuo Zong , Ondrej Bohdal , Tingyang Yu , Yongxin Yang , Timothy Hospedales

Large Reasoning Models (LRMs) have recently demonstrated impressive performances across diverse domains. However, how the safety of Large Language Models (LLMs) benefits from enhanced reasoning capabilities against jailbreak queries remains…

Computation and Language · Computer Science 2025-09-23 Junda Zhu , Lingyong Yan , Shuaiqiang Wang , Dawei Yin , Lei Sha
‹ Prev 1 8 9 10 Next ›