English
Related papers

Related papers: CRaFT: Circuit-Guided Refusal Feature Selection vi…

200 papers

Language models are commonly fine-tuned for safety alignment to refuse harmful prompts. One approach fine-tunes them to generate categorical refusal tokens that distinguish different refusal types before responding. In this work, we…

Artificial Intelligence · Computer Science 2026-03-17 Rishab Alagharu , Ishneet Sukhvinder Singh , Shaibi Shamsudeen , Zhen Wu , Ashwinee Panda

Adapting to latent confounded shift remains a core challenge in modern AI. This setting is driven by hidden variables that induce spurious correlations between inputs and outputs during training, leading models to rely on non-causal…

Machine Learning · Computer Science 2026-05-14 Jialin Yu , Yuxiang Zhou , Haoxuan Li , Junchi Yu , Mengyue Yang , Yulan He , Nevin L. Zhang , Philip Torr , Ricardo Silva

A physics-informed machine learning framework based on holomorphic neural networks is introduced for detecting cracks in two-dimensional solids from strain or displacement data. Crack detection is formulated as an inverse problem in which…

Computational Engineering, Finance, and Science · Computer Science 2026-03-16 Jonas Hund , Nicolas Cuenca , Tito Andriollo

Current LLM safety research predominantly focuses on mitigating Goal Hijacking, preventing attackers from redirecting a model's high-level objective (e.g., from "summarizing emails" to "phishing users"). In this paper, we argue that this…

Cryptography and Security · Computer Science 2026-04-28 Yuansen Liu , Yixuan Tang , Anthony Kum Hoe Tun

Decision Transformers (DT) play a crucial role in modern reinforcement learning, leveraging offline datasets to achieve impressive results across various domains. However, DT requires high-quality, comprehensive data to perform optimally.…

Artificial Intelligence · Computer Science 2025-05-15 Minh Hoang Nguyen , Linh Le Pham Van , Thommen George Karimpanal , Sunil Gupta , Hung Le

Evaluation and alignment pipelines for large language models increasingly rely on LLM-based judges, whose behavior is guided by natural-language rubrics and validated on benchmarks. We identify a previously under-recognized vulnerability in…

Cryptography and Security · Computer Science 2026-02-17 Ruomeng Ding , Yifei Pang , He Sun , Yizhong Wang , Zhiwei Steven Wu , Zhun Deng

Single-turn safety evaluation is a poor proxy for real fraud defense, where attackers escalate across multiple rounds. This paper evaluates fraud defenders under replay and adaptive multi-round attacks and measures when a defender refuses,…

Cryptography and Security · Computer Science 2026-05-21 Laura Jiang , Reza Ryan , Qian Li , Nasim Ferdosian

In this work, we propose BAIT (Boundary-Aware Iterative Trap), a three-step jailbreak framework that approaches malicious goals through internal disclosure. BAIT first asks the model to identify the protection boundary, then requires it to…

Cryptography and Security · Computer Science 2026-05-27 Xuan Luo , Yue Wang , Geng Tu , Jing Li , Ruifeng Xu

Causal chain reasoning (CCR) is an essential ability for many decision-making AI systems, which requires the model to build reliable causal chains by connecting causal pairs. However, CCR suffers from two main transitive problems: threshold…

Artificial Intelligence · Computer Science 2024-11-15 Kai Xiong , Xiao Ding , Zhongyang Li , Li Du , Bing Qin , Yi Zheng , Baoxing Huai

Since the advent of autonomous driving technology, it has experienced remarkable progress over the last decade. However, most existing research still struggles to address the challenges posed by environments where multiple vehicles have to…

Multiagent Systems · Computer Science 2025-08-01 Jing Wang , Yan Jin , Fei Ding , Chongfeng Wei

Motivation: Sparse autoencoders (SAEs) decompose foundation model activations into interpretable features, but causal feature-to-feature interactions across network depth remain unknown for biological foundation models. Results: We…

Machine Learning · Computer Science 2026-03-05 Ihor Kendiukhov

Large language models (LLMs) are typically aligned to refuse harmful instructions through safety fine-tuning. A recent attack, termed abliteration, identifies and suppresses the single latent direction most responsible for refusal behavior,…

Computation and Language · Computer Science 2025-10-08 Harethah Abu Shairah , Hasan Abed Al Kader Hammoud , Bernard Ghanem , George Turkiyyah

Role-playing systems powered by large language models (LLMs) have become increasingly influential in emotional communication applications. However, these systems are susceptible to character hallucinations, where the model deviates from…

Computation and Language · Computer Science 2024-09-26 Yihong Tang , Bo Wang , Xu Wang , Dongming Zhao , Jing Liu , Jijun Zhang , Ruifang He , Yuexian Hou

Large Vision-Language Models (LVLMs) demonstrate exceptional performance across multimodal tasks, yet remain vulnerable to jailbreak attacks that bypass built-in safety mechanisms to elicit restricted content generation. Existing black-box…

Computation and Language · Computer Science 2025-06-23 Lei Jiang , Zixun Zhang , Zizhou Wang , Xiaobing Sun , Zhen Li , Liangli Zhen , Xiaohua Xu

This paper proposes a simple yet effective jailbreak attack named FlipAttack against black-box LLMs. First, from the autoregressive nature, we reveal that LLMs tend to understand the text from left to right and find that they struggle to…

Cryptography and Security · Computer Science 2026-05-18 Yue Liu , Xiaoxin He , Miao Xiong , Jinlan Fu , Shumin Deng , Yingwei Ma , Jiaheng Zhang , Bryan Hooi

In many domains of empirical sciences, discovering the causal structure within variables remains an indispensable task. Recently, to tackle with unoriented edges or latent assumptions violation suffered by conventional methods, researchers…

Machine Learning · Computer Science 2024-12-30 Shixuan Liu , Yanghe Feng , Keyu Wu , Guangquan Cheng , Jincai Huang , Zhong Liu

In healthcare tabular predictions, classical models with feature engineering often outperform neural approaches. Recent advances in Large Language Models enable the integration of domain knowledge into feature engineering, offering a…

Machine Learning · Computer Science 2026-03-04 Zizheng Zhang , Yiming Li , Justin Xu , Jinyu Wang , Rui Wang , Lei Song , Jiang Bian , David W Eyre , Jingjing Fu

Current LLMs are trained to refuse potentially harmful input queries regardless of whether users actually had harmful intents, causing a tradeoff between safety and user experience. Through a study of 480 participants evaluating 3,840…

Computation and Language · Computer Science 2025-12-04 Mingqian Zheng , Wenjia Hu , Patrick Zhao , Motahhare Eslami , Jena D. Hwang , Faeze Brahman , Carolyn Rose , Maarten Sap

Large Language Models (LLMs) face severe safety risks from jailbreak attacks, yet current safety testing largely relies on static datasets and lacks systematic criteria to evaluate test suite quality and adequacy. While coverage criteria…

Software Engineering · Computer Science 2026-05-13 Zeming Wei , Zhixin Zhang , Chengcan Wu , Yihao Zhang , Xiaokun Luan , Meng Sun

Large Reasoning Models (LRMs) achieve strong reasoning performance by generating long chains of thought (CoTs), yet only a small fraction of these traces meaningfully contributes to answer prediction, while the majority contains repetitive…

Computation and Language · Computer Science 2026-02-03 Siyuan Wang , Yanchen Liu , Xiang Ren