English
Related papers

Related papers: Safety Context Injection: Inference-Time Safety Al…

200 papers

Recently, Zaremba et al. demonstrated that increasing inference-time computation improves robustness in large proprietary reasoning LLMs. In this paper, we first show that smaller-scale, open-source models (e.g., DeepSeek R1, Qwen3,…

Artificial Intelligence · Computer Science 2025-07-23 Tong Wu , Chong Xiang , Jiachen T. Wang , Weichen Yu , Chawin Sitawarin , Vikash Sehwag , Prateek Mittal

Reasoning ability, a core component of human intelligence, continues to pose a significant challenge for Large Language Models (LLMs) in the pursuit of AGI. Although model performance has improved under the training scaling law, significant…

Machine Learning · Computer Science 2026-01-21 Hengli Li , Chenxi Li , Tong Wu , Xuekai Zhu , Yuxuan Wang , Zhaoxin Yu , Eric Hanchen Jiang , Song-Chun Zhu , Zixia Jia , Ying Nian Wu , Zilong Zheng

Information retrieval in Large Language Models (LLMs) is increasingly recognized as intertwined with generation capabilities rather than mere lookup. While longer contexts are often assumed to improve retrieval, the effects of intra-context…

Computation and Language · Computer Science 2025-08-01 Chupei Wang , Jiaqiu Vince Sun

Large reasoning models (LRMs) increasingly expose chain-of-thought-like reasoning for transparency, verification, and deliberate problem solving. This creates a safety blind spot: harmful or policy-violating content may appear in reasoning…

Artificial Intelligence · Computer Science 2026-05-08 Xiaomin Li , Jianheng Hou , Zheyuan Deng , Zhiwei Zhang , Taoran Li , Binghang Lu , Bing Hu , Yunhan Zhao , Yuexing Hao

We present InvThink, a training and prompting framework that requires the model to enumerate, analyze, and constrain potential failures before generating its final response. Unlike existing safety alignment methods that optimize only for…

Artificial Intelligence · Computer Science 2026-05-11 Yubin Kim , Taehan Kim , Eugene Park , Chunjong Park , Cynthia Breazeal , Daniel McDuff , Hae Won Park

This study explores integrating large language models (LLMs) with situational awareness-based planning (SAP) to enhance the decision-making capabilities of AI agents in dynamic and uncertain environments. We employ a multi-agent reasoning…

Artificial Intelligence · Computer Science 2024-06-18 Liman Wang , Hanyang Zhong

Large Language Models (LLMs) are increasingly embedded in autonomous systems and public-facing environments, yet they remain susceptible to jailbreak vulnerabilities that may undermine their security and trustworthiness. Adversarial…

Machine Learning · Computer Science 2025-05-15 David Khachaturov , Robert Mullins

Large Language Models (LLMs) are increasingly integrated into high-stakes applications, making robust safety guarantees a central practical and commercial concern. Existing safety evaluations predominantly rely on fixed collections of…

Computation and Language · Computer Science 2026-03-23 Zafir Shamsi , Nikhil Chekuru , Zachary Guzman , Shivank Garg

Drawing on constructs from psychology, prior work has identified a distinction between explicit and implicit bias in large language models (LLMs). While many LLMs undergo post-training alignment and safety procedures to avoid expressions of…

Computers and Society · Computer Science 2026-02-05 Molly Apsel , Michael N. Jones

Large Language Models (LLMs) are increasingly deployed for code generation in high-stakes software development, yet their limited transparency in security reasoning and brittleness to evolving vulnerability patterns raise critical…

Software Engineering · Computer Science 2026-03-03 Manisha Mukherjee , Vincent J. Hellendoorn

Large language models (LLMs) are vital for a wide range of applications yet remain susceptible to jailbreak threats, which could lead to the generation of inappropriate responses. Conventional defenses, such as refusal and adversarial…

Cryptography and Security · Computer Science 2026-01-29 Xianglin Yang , Gelei Deng , Jieming Shi , Tianwei Zhang , Jin Song Dong

While large language models (LLMs) have seen unprecedented advancements in capabilities and applications across a variety of use-cases, safety alignment of these models is still an area of active research. The fragile nature of LLMs, even…

Computation and Language · Computer Science 2024-10-03 Amrita Bhattacharjee , Shaona Ghosh , Traian Rebedea , Christopher Parisien

The security of Large Language Model (LLM) applications is fundamentally challenged by "form-first" attacks like prompt injection and jailbreaking, where malicious instructions are embedded within user inputs. Conventional defenses, which…

Cryptography and Security · Computer Science 2025-10-15 Dominik Schwarz

Time-series diagnostic reasoning is essential for many applications, yet existing solutions face a persistent gap: general reasoning large language models (GRLMs) possess strong reasoning skills but lack the domain-specific knowledge to…

Large Language Models (LLMs) have enabled the development of powerful agentic systems capable of automating complex workflows across various fields. However, these systems are highly vulnerable to indirect prompt injection attacks, where…

Cryptography and Security · Computer Science 2026-01-16 Hao Li , Yankai Yang , G. Edward Suh , Ning Zhang , Chaowei Xiao

Large language models (LLMs) are entering clinician workflows, yet evaluations rarely measure how clinician reasoning shapes model behavior during clinical interactions. We combined 61 New England Journal of Medicine Case Records with 92…

Large language models (LLMs) have transformed the development of embodied intelligence. By providing a few contextual demonstrations, developers can utilize the extensive internal knowledge of LLMs to effortlessly translate complex tasks…

Artificial Intelligence · Computer Science 2024-08-07 Aishan Liu , Yuguang Zhou , Xianglong Liu , Tianyuan Zhang , Siyuan Liang , Jiakai Wang , Yanjun Pu , Tianlin Li , Junqi Zhang , Wenbo Zhou , Qing Guo , Dacheng Tao

Reinforcement learning (RL) based post-training for explicit chain-of-thought (e.g., GRPO) improves the reasoning ability of multimodal large-scale reasoning models (MLRMs). But recent evidence shows that it can simultaneously degrade…

Computation and Language · Computer Science 2026-02-12 Soumya Suvra Ghosal , Souradip Chakraborty , Vaibhav Singh , Furong Huang , Dinesh Manocha , Amrit Singh Bedi

The scarcity of data depicting dangerous situations presents a major obstacle to training AI systems for safety-critical applications, such as construction safety, where ethical and logistical barriers hinder real-world data collection.…

Artificial Intelligence · Computer Science 2025-05-21 Vu Dinh Xuan , Hao Vo , David Murphy , Hoang D. Nguyen

While there has been progress towards aligning Large Language Models (LLMs) with human values and ensuring safe behaviour at inference time, safety guards can easily be removed when fine tuned on unsafe and harmful datasets. While this…