中文
相关论文

相关论文: CRaFT: Circuit-Guided Refusal Feature Selection vi…

200 篇论文

Language models are commonly fine-tuned for safety alignment to refuse harmful prompts. One approach fine-tunes them to generate categorical refusal tokens that distinguish different refusal types before responding. In this work, we…

人工智能 · 计算机科学 2026-03-17 Rishab Alagharu , Ishneet Sukhvinder Singh , Shaibi Shamsudeen , Zhen Wu , Ashwinee Panda

Adapting to latent confounded shift remains a core challenge in modern AI. This setting is driven by hidden variables that induce spurious correlations between inputs and outputs during training, leading models to rely on non-causal…

机器学习 · 计算机科学 2026-05-14 Jialin Yu , Yuxiang Zhou , Haoxuan Li , Junchi Yu , Mengyue Yang , Yulan He , Nevin L. Zhang , Philip Torr , Ricardo Silva

A physics-informed machine learning framework based on holomorphic neural networks is introduced for detecting cracks in two-dimensional solids from strain or displacement data. Crack detection is formulated as an inverse problem in which…

计算工程、金融与科学 · 计算机科学 2026-03-16 Jonas Hund , Nicolas Cuenca , Tito Andriollo

Current LLM safety research predominantly focuses on mitigating Goal Hijacking, preventing attackers from redirecting a model's high-level objective (e.g., from "summarizing emails" to "phishing users"). In this paper, we argue that this…

密码学与安全 · 计算机科学 2026-04-28 Yuansen Liu , Yixuan Tang , Anthony Kum Hoe Tun

Decision Transformers (DT) play a crucial role in modern reinforcement learning, leveraging offline datasets to achieve impressive results across various domains. However, DT requires high-quality, comprehensive data to perform optimally.…

人工智能 · 计算机科学 2025-05-15 Minh Hoang Nguyen , Linh Le Pham Van , Thommen George Karimpanal , Sunil Gupta , Hung Le

Evaluation and alignment pipelines for large language models increasingly rely on LLM-based judges, whose behavior is guided by natural-language rubrics and validated on benchmarks. We identify a previously under-recognized vulnerability in…

密码学与安全 · 计算机科学 2026-02-17 Ruomeng Ding , Yifei Pang , He Sun , Yizhong Wang , Zhiwei Steven Wu , Zhun Deng

Single-turn safety evaluation is a poor proxy for real fraud defense, where attackers escalate across multiple rounds. This paper evaluates fraud defenders under replay and adaptive multi-round attacks and measures when a defender refuses,…

密码学与安全 · 计算机科学 2026-05-21 Laura Jiang , Reza Ryan , Qian Li , Nasim Ferdosian

In this work, we propose BAIT (Boundary-Aware Iterative Trap), a three-step jailbreak framework that approaches malicious goals through internal disclosure. BAIT first asks the model to identify the protection boundary, then requires it to…

密码学与安全 · 计算机科学 2026-05-27 Xuan Luo , Yue Wang , Geng Tu , Jing Li , Ruifeng Xu

Causal chain reasoning (CCR) is an essential ability for many decision-making AI systems, which requires the model to build reliable causal chains by connecting causal pairs. However, CCR suffers from two main transitive problems: threshold…

人工智能 · 计算机科学 2024-11-15 Kai Xiong , Xiao Ding , Zhongyang Li , Li Du , Bing Qin , Yi Zheng , Baoxing Huai

Since the advent of autonomous driving technology, it has experienced remarkable progress over the last decade. However, most existing research still struggles to address the challenges posed by environments where multiple vehicles have to…

多智能体系统 · 计算机科学 2025-08-01 Jing Wang , Yan Jin , Fei Ding , Chongfeng Wei

Motivation: Sparse autoencoders (SAEs) decompose foundation model activations into interpretable features, but causal feature-to-feature interactions across network depth remain unknown for biological foundation models. Results: We…

机器学习 · 计算机科学 2026-03-05 Ihor Kendiukhov

Large language models (LLMs) are typically aligned to refuse harmful instructions through safety fine-tuning. A recent attack, termed abliteration, identifies and suppresses the single latent direction most responsible for refusal behavior,…

计算与语言 · 计算机科学 2025-10-08 Harethah Abu Shairah , Hasan Abed Al Kader Hammoud , Bernard Ghanem , George Turkiyyah

Role-playing systems powered by large language models (LLMs) have become increasingly influential in emotional communication applications. However, these systems are susceptible to character hallucinations, where the model deviates from…

计算与语言 · 计算机科学 2024-09-26 Yihong Tang , Bo Wang , Xu Wang , Dongming Zhao , Jing Liu , Jijun Zhang , Ruifang He , Yuexian Hou

Large Vision-Language Models (LVLMs) demonstrate exceptional performance across multimodal tasks, yet remain vulnerable to jailbreak attacks that bypass built-in safety mechanisms to elicit restricted content generation. Existing black-box…

计算与语言 · 计算机科学 2025-06-23 Lei Jiang , Zixun Zhang , Zizhou Wang , Xiaobing Sun , Zhen Li , Liangli Zhen , Xiaohua Xu

This paper proposes a simple yet effective jailbreak attack named FlipAttack against black-box LLMs. First, from the autoregressive nature, we reveal that LLMs tend to understand the text from left to right and find that they struggle to…

密码学与安全 · 计算机科学 2026-05-18 Yue Liu , Xiaoxin He , Miao Xiong , Jinlan Fu , Shumin Deng , Yingwei Ma , Jiaheng Zhang , Bryan Hooi

In many domains of empirical sciences, discovering the causal structure within variables remains an indispensable task. Recently, to tackle with unoriented edges or latent assumptions violation suffered by conventional methods, researchers…

机器学习 · 计算机科学 2024-12-30 Shixuan Liu , Yanghe Feng , Keyu Wu , Guangquan Cheng , Jincai Huang , Zhong Liu

In healthcare tabular predictions, classical models with feature engineering often outperform neural approaches. Recent advances in Large Language Models enable the integration of domain knowledge into feature engineering, offering a…

机器学习 · 计算机科学 2026-03-04 Zizheng Zhang , Yiming Li , Justin Xu , Jinyu Wang , Rui Wang , Lei Song , Jiang Bian , David W Eyre , Jingjing Fu

Current LLMs are trained to refuse potentially harmful input queries regardless of whether users actually had harmful intents, causing a tradeoff between safety and user experience. Through a study of 480 participants evaluating 3,840…

计算与语言 · 计算机科学 2025-12-04 Mingqian Zheng , Wenjia Hu , Patrick Zhao , Motahhare Eslami , Jena D. Hwang , Faeze Brahman , Carolyn Rose , Maarten Sap

Large Language Models (LLMs) face severe safety risks from jailbreak attacks, yet current safety testing largely relies on static datasets and lacks systematic criteria to evaluate test suite quality and adequacy. While coverage criteria…

软件工程 · 计算机科学 2026-05-13 Zeming Wei , Zhixin Zhang , Chengcan Wu , Yihao Zhang , Xiaokun Luan , Meng Sun

Large Reasoning Models (LRMs) achieve strong reasoning performance by generating long chains of thought (CoTs), yet only a small fraction of these traces meaningfully contributes to answer prediction, while the majority contains repetitive…

计算与语言 · 计算机科学 2026-02-03 Siyuan Wang , Yanchen Liu , Xiang Ren