English
Related papers

Related papers: Committed SAE-Feature Traces for Audited-Session S…

200 papers

Sparse Autoencoders (SAEs) have emerged as a powerful unsupervised method for extracting sparse representations from language models, yet scalable training remains a significant challenge. We introduce a suite of 256 SAEs, trained on each…

Institutions with limited data and computing resources often outsource model training to third-party providers in a semi-honest setting, assuming adherence to prescribed training protocols with pre-defined learning paradigm (e.g.,…

Machine Learning · Computer Science 2025-04-02 Xuan Wang , Siyuan Liang , Dongping Liao , Han Fang , Aishan Liu , Xiaochun Cao , Yu-liang Lu , Ee-Chien Chang , Xitong Gao

Trusted Execution Environments (TEEs) provide hardware-enforced isolation that protects sensitive code and data from untrusted software. Despite their strong security guarantees, analyzing TEE applications remains challenging due to the…

Software Engineering · Computer Science 2026-05-22 Chengyan Ma , Jieke Shi , Ruidong Han , Ye Liu , Yuqing Niu , David Lo

Existing work on jailbreak Multimodal Large Language Models (MLLMs) has focused primarily on adversarial examples in model inputs, with less attention to vulnerabilities, especially in model API. To fill the research gap, we carry out the…

Cryptography and Security · Computer Science 2024-01-23 Yuanwei Wu , Xiang Li , Yixin Liu , Pan Zhou , Lichao Sun

Sparse Autoencoders (SAEs) decompose large language model representations into interpretable features, but how these features interact under uncertainty remains poorly understood. We introduce Feature Rivalry -- negatively correlated SAE…

Machine Learning · Computer Science 2026-05-12 Harshavardhan

Large language models (LLMs) have rapidly grown in scale, creating substantial memory and computational costs that hinder efficient deployment. Singular value decomposition (SVD) has emerged as an effective post-training compression…

Machine Learning · Computer Science 2026-05-12 Hengyi Zhu , Zhendong Mi , Grace Li Zhang , Shaoyi Huang

Large language models (LLMs) remain acutely vulnerable to prompt injection and related jailbreak attacks; heuristic guardrails (rules, filters, LLM judges) are routinely bypassed. We present Contextual Integrity Verification (CIV), an…

Cryptography and Security · Computer Science 2025-08-20 Aayush Gupta

Software vulnerabilities such as buffer overflows and SQL injections are a major source of security breaches. Traditional methods for vulnerability detection remain essential but are limited by high false positive rates, scalability issues,…

Software Engineering · Computer Science 2026-04-10 Rui Melo , Claudia Mamede , Andre Catarino , Rui Abreu , Henrique Lopes Cardoso

Accurate anomaly detection is critical in vision-based infrastructure inspection, where it helps prevent costly failures and enhances safety. Self-Supervised Learning (SSL) offers a promising approach by learning robust representations from…

Computer Vision and Pattern Recognition · Computer Science 2024-10-08 Daniel Otero , Rafael Mateus , Randall Balestriero

The evaluation of large language models (LLMs) relies heavily on standardized benchmarks. These benchmarks provide useful aggregated metrics for a given capability, but those aggregated metrics can obscure (i) particular sub-areas where the…

Computation and Language · Computer Science 2025-12-25 Matyas Bohacek , Nino Scherrer , Nicholas Dufour , Thomas Leung , Christoph Bregler , Stephanie C. Y. Chan

The ever-increasing size of open-source Large Language Models (LLMs) renders local deployment impractical for individual users. Decentralized computing has emerged as a cost-effective solution, allowing individuals and small companies to…

Machine Learning · Computer Science 2026-02-03 Yifan Sun , Yuhang Li , Yue Zhang , Yuchen Jin , Huan Zhang

With the increasing security issues in blockchain, smart contract vulnerability detection has become a research focus. Existing vulnerability detection methods have their limitations: 1) Static analysis methods struggle with complex…

Cryptography and Security · Computer Science 2025-07-31 Lei Yu , Shiqi Cheng , Zhirong Huang , Jingyuan Zhang , Chenjie Shen , Junyi Lu , Li Yang , Fengjun Zhang , Jiajia Ma

Large language models (LLMs) have seen widespread applications across various domains, yet remain vulnerable to adversarial prompt injections. While most existing research on jailbreak attacks and hallucination phenomena has focused…

Computation and Language · Computer Science 2025-05-20 Linghan Huang , Haolin Jin , Zhaoge Bi , Pengyue Yang , Peizhou Zhao , Taozhao Chen , Xiongfei Wu , Lei Ma , Huaming Chen

Customized Large Language Model (LLM) agents face a critical security threat from black-box instruction backdoors, where malicious behaviors are covertly injected through hidden system instructions. Although existing prompt-based defenses…

Cryptography and Security · Computer Science 2026-04-17 Zhengxian Wu , Juan Wen , Wanli Peng , Haowei Chang , Yinghan Zhou , Yiming Xue

LLMs increasingly require surgical model editing to enhance domain-specific capabilities without incurring the computational cost or catastrophic forgetting associated with full fine-tuning. Sparse Autoencoders (SAEs) have emerged as a…

Machine Learning · Computer Science 2026-05-28 Li Lei , Madalina Ciobanu , Qingqing Mao , Ritankar Das

We show that even the most recent safety-aligned LLMs are not robust to simple adaptive jailbreaking attacks. First, we demonstrate how to successfully leverage access to logprobs for jailbreaking: we initially design an adversarial prompt…

Cryptography and Security · Computer Science 2025-04-21 Maksym Andriushchenko , Francesco Croce , Nicolas Flammarion

LLM serving platforms are increasingly deployed as multi-model cloud systems, where user demand is often long-tailed: a few popular large models receive most requests, while many smaller tail models remain underutilized. We propose…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-05-13 Jincheng Xie , Yawen Ling , Qi Xiao , Feiyu Zhang , Zhongyi Huang , Wen Hu , Yu Zheng

Automated proof generation for formal software verification remains largely unresolved despite advances in large language models (LLMs). While LLMs perform well in NLP, vision, and code generation, formal verification still requires…

Logic in Computer Science · Computer Science 2026-04-10 Youngjoo Ahn , Sangyeop Yeo , Gijung Im , Jongmin Lee , Jinyoung Yeo , Jieung Kim

In long conversations, an LLM can produce a next utterance that sounds plausible but rests on premises the conversation has already abandoned. Context-manipulation attacks against deployed agents now actively exploit this gap. We close it…

Artificial Intelligence · Computer Science 2026-05-15 Qisong He , Yi Dong , Xiaowei Huang

Privacy-preserving Transformer inference has gained attention due to the potential leakage of private information. Despite recent progress, existing frameworks still fall short of practical model scales, with gaps up to a hundredfold. A…

Cryptography and Security · Computer Science 2026-01-13 Bowen Shen , Yuyue Chen , Peng Yang , Bin Zhang , Xi Zhang , Zoe L. Jiang