中文
相关论文

相关论文: Safety Context Injection: Inference-Time Safety Al…

200 篇论文

Large Language Model (LLM) applications are vulnerable to prompt injection and context manipulation attacks that traditional security models cannot prevent. We introduce two novel primitives--authenticated prompts and authenticated…

密码学与安全 · 计算机科学 2026-02-12 Mohan Rajagopalan , Vinay Rao

Large Reasoning Models (LRMs) have demonstrated remarkable capabilities in complex problem-solving through Chain-of-Thought (CoT) reasoning. However, the multi-step nature of CoT introduces new safety challenges that extend beyond…

人工智能 · 计算机科学 2025-09-30 Zihao Zhu , Xinyu Wu , Gehan Hu , Siwei Lyu , Ke Xu , Baoyuan Wu

Large Reasoning Models (LRMs) have exhibited extraordinary prowess in tasks like mathematics and coding, leveraging their advanced reasoning capabilities. Nevertheless, as these capabilities progress, significant concerns regarding their…

Autonomous Driving (AD) encounters significant safety hurdles in long-tail unforeseen driving scenarios, largely stemming from the non-interpretability and poor generalization of the deep neural networks within the AD system, particularly…

人工智能 · 计算机科学 2024-03-25 Yixuan Wang , Ruochen Jiao , Sinong Simon Zhan , Chengtian Lang , Chao Huang , Zhaoran Wang , Zhuoran Yang , Qi Zhu

As LLMs become more common, non-expert users can pose risks, prompting extensive research into jailbreak attacks. However, most existing black-box jailbreak attacks rely on hand-crafted heuristics or narrow search spaces, which limit…

密码学与安全 · 计算机科学 2025-11-21 Zhen Sun , Zongmin Zhang , Deqi Liang , Han Sun , Yule Liu , Yun Shen , Xiangshan Gao , Yilong Yang , Shuai Liu , Yutao Yue , Xinlei He

While Large Language Model (LLM) capabilities have scaled, safety guardrails remain largely stateless, treating multi-turn dialogues as a series of disconnected events. This lack of temporal awareness facilitates a "Safety Gap" where…

人工智能 · 计算机科学 2026-02-20 Justin Albrethsen , Yash Datta , Kunal Kumar , Sharath Rajasekar

The rapid advancement of multi-modal large reasoning models (MLRMs) -- enhanced versions of multimodal language models (MLLMs) equipped with reasoning capabilities -- has revolutionized diverse applications. However, their safety…

机器学习 · 计算机科学 2025-04-15 Junfeng Fang , Yukai Wang , Ruipeng Wang , Zijun Yao , Kun Wang , An Zhang , Xiang Wang , Tat-Seng Chua

The past year has seen rapid acceleration in the development of large language models (LLMs). However, without proper steering and safeguards, LLMs will readily follow malicious instructions, provide unsafe advice, and generate toxic…

计算与语言 · 计算机科学 2024-02-19 Bertie Vidgen , Nino Scherrer , Hannah Rose Kirk , Rebecca Qian , Anand Kannappan , Scott A. Hale , Paul Röttger

While reasoning models have achieved remarkable success in complex reasoning tasks, their increasing power necessitates stringent safety measures. For safety alignment, the core challenge lies in the inherent trade-off between safety and…

密码学与安全 · 计算机科学 2026-02-17 Yanbo Wang , Minzheng Wang , Jian Liang , Lu Wang , Yongcan Yu , Ran He

Large language models (LLMs) have achieved remarkable success across many applications, but their ability to generate harmful content raises serious safety concerns. Although safety alignment techniques are often applied during pre-training…

机器学习 · 计算机科学 2026-04-24 Chengcan Wu , Zhixin Zhang , Zeming Wei , Yihao Zhang , Xiaokun Luan , Meng Sun

Emergency situations in scheduling systems often trigger local functional failures that undermine system stability and even cause system collapse. Existing methods primarily rely on robust scheduling or reactive scheduling, handling…

人工智能 · 计算机科学 2026-04-14 Shixing Zhao , Zheng Si , Pengpeng Ouyang , Zhengqing Hu , Wanqi Zhu , Dong Chen , Yibo Guo , Mingliang Xu

Multi-turn jailbreak attacks simulate real-world human interactions by engaging large language models (LLMs) in iterative dialogues, exposing critical safety vulnerabilities. However, existing methods often struggle to balance semantic…

While Large Language Models (LLMs) have achieved remarkable progress, they remain vulnerable to jailbreak attacks. Existing methods, primarily relying on discrete input optimization (e.g., GCG), often suffer from high computational costs…

计算与语言 · 计算机科学 2026-01-09 Wenpeng Xing , Mohan Li , Chunqiang Hu , Haitao Xu , Ningyu Zhang , Bo Lin , Meng Han

State-Space Models (SSMs) -- structured SSMs (S4, S4D, DSS, S5), selective SSMs (Mamba, Mamba-2), and hybrid architectures (Jamba) -- are deployed in safety-critical long-context applications: genomic analysis, clinical time-series…

密码学与安全 · 计算机科学 2026-04-21 Manoj Parmar

Large Language Models (LLMs) are powerful text generators, yet they can produce toxic or harmful content even when given seemingly harmless prompts. This presents a serious safety challenge and can cause real-world harm. Toxicity is often…

计算与语言 · 计算机科学 2026-02-09 Himanshu Singh , Ziwei Xu , A. V. Subramanyam , Mohan Kankanhalli

The performance of large language model (LLM) agents depends critically on the execution harness, the system layer that orchestrates tool use, context management, and state persistence. Yet this same architectural centrality makes the…

密码学与安全 · 计算机科学 2026-05-12 Xixun Lin , Yang Liu , Yancheng Chen , Yongxuan Wu , Yucheng Ning , Yilong Liu , Nan Sun , Shun Zhang , Bin Chong , Chuan Zhou , Yanan Cao

This paper target in addressing the challenges of underthinking and overthinking in long chain-of-thought (CoT) reasoning for Large Reasoning Models (LRMs) by introducing Reasoning Control Fields (RCF)--a novel test-time approach that…

Context-aware recommender systems (CARSs) apply sensing and analysis of user context in order to provide personalized services. Adding context to a recommendation model is challenging, since the addition of context may increases both the…

机器学习 · 计算机科学 2020-08-07 Amit Livne , Moshe Unger , Bracha Shapira , Lior Rokach

Retrieval-Augmented Generation (RAG) addresses large language model (LLM) hallucinations by grounding responses in external knowledge, but its effectiveness is compromised by poor-quality retrieved contexts containing irrelevant or noisy…

计算与语言 · 计算机科学 2025-10-27 Jiale Deng , Yanyan Shen , Ziyuan Pei , Youmin Chen , Linpeng Huang

Reinforcement learning (RL) is a framework for solving sequential decision-making problems. In this work, we demonstrate that, surprisingly, RL emerges during the inference time of large language models (LLMs), a phenomenon we term…

机器学习 · 计算机科学 2026-04-28 Kefan Song , Amir Moeini , Peng Wang , Lei Gong , Rohan Chandra , Shangtong Zhang , Yanjun Qi
‹ 上一页 1 8 9 10 下一页 ›