English
Related papers

Related papers: Probing the Representational Power of Sparse Autoe…

200 papers

Protein language models have revolutionized structure prediction, but their nonlinear nature obscures how sequence representations inform structure prediction. While sparse autoencoders (SAEs) offer a path to interpretability here by…

Biomolecules · Quantitative Biology 2025-03-13 Nithin Parsan , David J. Yang , John J. Yang

Vision-language models learn powerful multimodal embeddings, yet their internal semantics remain opaque. While sparse autoencoders (SAEs) can extract interpretable features, they rely on expanding the representation dimension, which…

Computer Vision and Pattern Recognition · Computer Science 2026-05-22 Piotr Kubaty , Patryk Marszałek , Łukasz Struski , Adam Wróbel , Jacek Tabor , Marek Śmieja

Sparse autoencoders (SAEs) emerged as a promising tool for mechanistic interpretability of transformer-based foundation models. Very recently, SAEs were also adopted for the visual domain, enabling the discovery of visual concepts and their…

Computer Vision and Pattern Recognition · Computer Science 2025-07-17 Muhammed Furkan Dasdelen , Hyesu Lim , Michele Buck , Katharina S. Götze , Carsten Marr , Steffen Schneider

Software vulnerabilities such as buffer overflows and SQL injections are a major source of security breaches. Traditional methods for vulnerability detection remain essential but are limited by high false positive rates, scalability issues,…

Software Engineering · Computer Science 2026-04-10 Rui Melo , Claudia Mamede , Andre Catarino , Rui Abreu , Henrique Lopes Cardoso

Sparse Autoencoders (SAEs) are a prominent tool in mechanistic interpretability (MI) for decomposing neural network activations into interpretable features. However, the aspiration to identify a canonical set of features is challenged by…

Machine Learning · Computer Science 2025-05-27 Xiangchen Song , Aashiq Muhamed , Yujia Zheng , Lingjing Kong , Zeyu Tang , Mona T. Diab , Virginia Smith , Kun Zhang

Interpretability is critical in high-stakes domains such as medical imaging, where understanding model decisions is essential for clinical adoption. In this work, we introduce Sparse Autoencoder (SAE)-based interpretability to breast…

Computer Vision and Pattern Recognition · Computer Science 2025-08-19 Krishna Kanth Nakka

Sparse Autoencoders (SAEs) can efficiently identify candidate monosemantic features from pretrained neural networks for galaxy morphology. We demonstrate this on Euclid Q1 images using both supervised (Zoobot) and new self-supervised (MAE)…

Instrumentation and Methods for Astrophysics · Physics 2025-11-13 John F. Wu , Michael Walmsley

Steering vectors are a promising approach to control the behaviour of large language models. However, their underlying mechanisms remain poorly understood. While sparse autoencoders (SAEs) may offer a potential method to interpret steering…

Machine Learning · Computer Science 2024-11-14 Harry Mayne , Yushi Yang , Adam Mahdi

Modern text classification methods heavily rely on contextual embeddings from large language models (LLMs). Compared to human-engineered features, these embeddings provide automatic and effective representations for classification model…

Computation and Language · Computer Science 2025-07-29 Xuansheng Wu , Wenhao Yu , Xiaoming Zhai , Ninghao Liu

Sparse Autoencoder (SAE) features have become essential tools for mechanistic interpretability research. SAE features are typically characterized by examining their activating examples, which are often "monosemantic" and align with human…

Artificial Intelligence · Computer Science 2025-09-30 Claire Tian , Katherine Tian , Nathan Hu

Text-to-image diffusion models generate images through an iterative denoising process, so internal neural layers produce trajectories of activations rather than single static representations. Sparse autoencoders (SAEs) have recently been…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Calvin Yeung , Prathyush Poduval , Ali Zakeri , Zhuowen Zou , Mohsen Imani

Masked image modeling (MIM) has been recognized as a strong self-supervised pre-training approach in the vision domain. However, the mechanism and properties of the learned representations by such a scheme, as well as how to further enhance…

Computer Vision and Pattern Recognition · Computer Science 2024-04-10 Kevin Zhang , Zhiqiang Shen

This study presents Latent Diffusion Autoencoder (LDAE), a novel encoder-decoder diffusion-based framework for efficient and meaningful unsupervised learning in medical imaging, focusing on Alzheimer disease (AD) using brain MR from the…

Computer Vision and Pattern Recognition · Computer Science 2026-01-12 Gabriele Lozupone , Alessandro Bria , Francesco Fontanella , Frederick J. A. Meijer , Claudio De Stefano , Henkjan Huisman

Sparse autoencoders (SAEs) have recently emerged as pivotal tools for introspection into large language models. SAEs can uncover high-quality, interpretable features at different levels of granularity and enable targeted steering of the…

Information Retrieval · Computer Science 2026-01-19 Martin Spišák , Ladislav Peška , Petr Škoda , Vojtěch Vančura , Rodrigo Alves

Effective multimodal reasoning depends on the alignment of visual and linguistic representations, yet the mechanisms by which vision-language models (VLMs) achieve this alignment remain poorly understood. Following the LiMBeR framework, we…

Computer Vision and Pattern Recognition · Computer Science 2025-06-24 Constantin Venhoff , Ashkan Khakzar , Sonia Joseph , Philip Torr , Neel Nanda

Large language models (LLMs) store vast amounts of information, making them powerful yet raising privacy and safety concerns when selective knowledge removal is required. Existing unlearning strategies, ranging from gradient-based…

Computation and Language · Computer Science 2025-06-02 Xu Wang , Zihao Li , Benyou Wang , Yan Hu , Difan Zou

Sparse autoencoders (SAEs) have emerged as a powerful tool for interpreting language model activations by decomposing them into sparse, interpretable features. A popular approach is the TopK SAE, that uses a fixed number of the most active…

Machine Learning · Computer Science 2024-12-10 Bart Bussmann , Patrick Leask , Neel Nanda

Standard Sparse Autoencoders (SAEs) excel at discovering a dictionary of a model's learned features, offering a powerful observational lens. However, the ambiguous and ungrounded nature of these features makes them unreliable instruments…

Machine Learning · Computer Science 2025-09-29 Jianrong Ding , Muxi Chen , Chenchen Zhao , Qiang Xu

Deterministically controlling the target generation language of large multilingual language models (LLMs) remains a fundamental challenge, particularly in zero-shot settings where neither explicit language prompts nor fine-tuning are…

Computation and Language · Computer Science 2025-10-17 Cheng-Ting Chou , George Liu , Jessica Sun , Cole Blondin , Kevin Zhu , Vasu Sharma , Sean O'Brien

Sparse Autoencoders (SAEs) have emerged as a promising solution for decomposing large language model representations into interpretable features. However, Paulo and Belrose (2025) have highlighted instability across different initialization…

Machine Learning · Computer Science 2025-06-24 Seonglae Cho , Harryn Oh , Donghyun Lee , Luis Eduardo Rodrigues Vieira , Andrew Bermingham , Ziad El Sayed