English
Related papers

Related papers: Committed SAE-Feature Traces for Audited-Session S…

200 papers

We report a small, reproducible audit of which sparse-autoencoder (SAE) features of GPT-2 small fire differently on failed versus successful trials of the Indirect Object Identification (IOI) task. On 300 prompts, GPT-2 small reaches 79.7%…

Machine Learning · Computer Science 2026-05-22 Mahdi Nasermoghadasi

Failure attribution in LLM-based multi-agent systems aims to identify the steps that contribute to a failed execution. This task remains difficult because a single execution can contain many agent actions and tool calls, failure evidence…

Software Engineering · Computer Science 2026-05-15 Yang Liu , Hongjiang Feng , Junsong Pu , Zhuangbin Chen

This paper presents a framework for converting wireless signals into structured datasets, which can be fed into machine learning algorithms for the detection of active eavesdropping attacks at the physical layer. More specifically, a…

Signal Processing · Electrical Eng. & Systems 2021-02-24 Tiep M. Hoang , Trung Q. Duong , Hoang Duong Tuan , Sangarapillai Lambotharan , Emi Garcia-Palacios , Long D. Nguyen

Long-context and memory systems usually treat personalization as a recall problem. In practice, many failures occur later, when a system commits: it turns noisy hints into hard constraints, drops rare witnesses, forgets downstream…

Artificial Intelligence · Computer Science 2026-05-20 Rui Tang , Yichi Zhang , Xi Chen , Chen Dong , Youwei Yang , Yumeng Shen , Qiangqiang Liu

Fraud detection and anti-money-laundering (AML) compliance are high-value domains for large language models (LLMs), but their serving requirements differ sharply from generic chat workloads. Compliance prompts are often prefix-heavy,…

Artificial Intelligence · Computer Science 2026-05-13 Prathamesh Vasudeo Naik , Naresh Dintakurthi , Yue Wang

Despite the syntactic fluency of Large Language Models (LLMs), ensuring their logical correctness in high-stakes domains remains a fundamental challenge. We present a neurosymbolic framework that combines LLMs with SMT solvers to produce…

Computation and Language · Computer Science 2026-05-05 Vikash Singh , Darion Cassel , Nathaniel Weir , Nick Feng , Sam Bayless

LLM-as-a-Judge systems supply the reward signal in modern RLHF and RLVR pipelines, but their binary verdict reduces to a single linear readout F_gap on one hidden state. We show this readout is shallow enough that short, low-perplexity…

Machine Learning · Computer Science 2026-05-28 Tung-Ling Li , Yuhao Wu , Hongliang Liu

Large Language Models (LLMs) have shown promising performance in software vulnerability detection, particularly after domain-specific Supervised Fine-Tuning (SFT). However, it remains unclear whether these models genuinely internalize…

Cryptography and Security · Computer Science 2026-05-22 Feiyang Huang , Yuqiang Sun , Fan Zhang , Ziqi Yang , Han Liu , Yang Liu

Mechanistic interpretability aims to reverse-engineer the internal computations of Large Language Models (LLMs), yet separating sparse semantic signals from high-dimensional polysemantic noise remains a significant challenge. This paper…

Quantum Physics · Physics 2026-02-09 Jonathan Pan

Despite the general capabilities of Large Language Models (LLM), these models still request fine-tuning or adaptation with customized data when meeting specific business demands. However, this process inevitably introduces new threats,…

Cryptography and Security · Computer Science 2024-06-21 Jiongxiao Wang , Jiazhao Li , Yiquan Li , Xiangyu Qi , Junjie Hu , Yixuan Li , Patrick McDaniel , Muhao Chen , Bo Li , Chaowei Xiao

Safety alignment mechanisms in Large Language Models (LLMs) often operate as latent internal states, obscuring the model's inherent capabilities. Building on this observation, we model the safety mechanism as an unobserved confounder from a…

Computation and Language · Computer Science 2026-02-09 Yao Zhou , Zeen Song , Wenwen Qiang , Fengge Wu , Shuyi Zhou , Changwen Zheng , Hui Xiong

The rapid integration of Large Language Models (LLMs) into educational assessment rests on the unverified assumption that instruction following capability translates directly to objective adjudication. We demonstrate that this assumption is…

Computation and Language · Computer Science 2026-01-30 Devanshu Sahoo , Manish Prasad , Vasudev Majhi , Arjun Neekhra , Yash Sinha , Murari Mandal , Vinay Chamola , Dhruv Kumar

Safety-aligned LLMs suffer from two failure modes: jailbreak (answering harmful inputs) and over-refusal (declining benign queries). Existing vector steering methods adjust the magnitude of answer vectors, but this creates a fundamental…

Machine Learning · Computer Science 2026-05-05 Haonan Zhang , Dongxia Wang , Yi Liu , Kexin Chen , Wenhai Wang

Modeling open hole failure of composites is a complex task, consisting in a highly nonlinear response with interacting failure modes. Numerical modeling of this phenomenon has traditionally been based on the finite element method, but…

Computational Engineering, Finance, and Science · Computer Science 2025-08-19 Giorgio Tosti Balducci , Boyang Chen , Matthias Möller , Marc Gerritsma , Roeland De Breuker

Sparse autoencoders (SAEs) are increasingly used to extract activation directions for inference-time steering, but their standard sparsity objective treats latent features as independent. This prior can be poorly matched to high-level…

Machine Learning · Computer Science 2026-05-18 Jehyeok Yeon , Federico Cinus , Yifan Wu , Luca Luceri

Vertical split learning (SL) enables collaborative model training across parties holding complementary features without sharing raw data, but recent work has shown that it is highly vulnerable to poisoning-based backdoor attacks operating…

Cryptography and Security · Computer Science 2026-04-07 Yuhan Shui , Ruobin Jin , Zhihao Dou , Zhiqiang Gao

Large Language Models (LLMs) remain vulnerable to jailbreaking attacks where adversarial prompts elicit harmful outputs. Yet most evaluations focus on single-turn interactions while real-world attacks unfold through adaptive multi-turn…

Computation and Language · Computer Science 2025-12-23 Aashray Reddy , Andrew Zagula , Nicholas Saban

Reinforcement learning with verifiable rewards (RLVR) has achieved remarkable success in enhancing the reasoning capabilities of large language models (LLMs). However, existing RLVR methods often suffer from exploration inefficiency due to…

Machine Learning · Computer Science 2025-09-09 Ziheng Li , Zexu Sun , Jinman Zhao , Erxue Min , Yongcheng Zeng , Hui Wu , Hengyi Cai , Shuaiqiang Wang , Dawei Yin , Xu Chen , Zhi-Hong Deng

We study behavioral alignment and representation dynamics of large language model (LLM) agents in financial decision environments. Using TradeArena, an auditable trading-agent testbed with risk reports, execution simulation, memory, and…

Machine Learning · Computer Science 2026-05-29 Weicheng Xue

Jailbreaking in Large Language Models (LLMs) threatens their safe use in sensitive domains like education by allowing users to bypass ethical safeguards. This study focuses on detecting jailbreaks in 2-Sigma, a clinical education platform…