English
Related papers

Related papers: Jacobian Sparse Autoencoders: Sparsify Computation…

200 papers

Sparse autoencoders (SAEs) are a popular tool for interpreting large language model activations, but their utility in addressing open questions in interpretability remains unclear. In this work, we demonstrate their effectiveness by using…

Machine Learning · Computer Science 2025-04-21 Dmitrii Kharlapenko , Stepan Shabalin , Fazl Barez , Arthur Conmy , Neel Nanda

Sparse autoencoders (SAEs) model the activations of a neural network as linear combinations of sparsely occurring directions of variation (latents). The ability of SAEs to reconstruct activations follows scaling laws w.r.t. the number of…

Machine Learning · Computer Science 2025-09-05 Eric J. Michaud , Liv Gorton , Tom McGrath

Symbolic regression (SR) aims to discover closed-form mathematical expressions that accurately describe data, offering interpretability and analytical insight beyond standard black-box models. Existing SR methods often rely on…

Machine Learning · Computer Science 2025-06-17 Mansooreh Montazerin , Majd Al Aawar , Antonio Ortega , Ajitesh Srivastava

Sparse autoencoders (SAEs) enable feature-level mechanistic interpretability and activation steering in large language models (LLMs), but SAE-based language control remains unreliable in multilingual settings: most SAEs are trained on…

Computation and Language · Computer Science 2026-05-25 Yusser Al Ghussin , Daniil Gurgurov , Tanja Baeumel , Josef van Genabith , Patrick Schramowski , Simon Ostermann

Recently, sparse autoencoders (SAEs) have emerged as a promising technique for interpreting activations in foundation models by disentangling features into a sparse set of concepts. However, identifying the optimal level of sparsity for…

Machine Learning · Computer Science 2026-04-17 Dongsheng Wang , Jinsen Zhang , Dawei Su , Hui Huang

Sparse Autoencoders (SAEs) can efficiently identify candidate monosemantic features from pretrained neural networks for galaxy morphology. We demonstrate this on Euclid Q1 images using both supervised (Zoobot) and new self-supervised (MAE)…

Instrumentation and Methods for Astrophysics · Physics 2025-11-13 John F. Wu , Michael Walmsley

Sparse autoencoders (SAEs) are widely used to extract interpretable features from neural network representations, often under the implicit assumption that concepts correspond to independent linear directions. However, a growing body of…

Sparse autoencoders (SAEs) have emerged as a powerful technique for extracting human-interpretable features from neural networks activations. Previous works compared different models based on SAE-derived features but those comparisons have…

Computer Vision and Pattern Recognition · Computer Science 2025-07-25 Clément Cornet , Romaric Besançon , Hervé Le Borgne

Recently, convolutional auto-encoders (CAE) were introduced for image coding. They achieved performance improvements over the state-of-the-art JPEG2000 method. However, these performances were obtained using massive CAEs featuring a large…

Image and Video Processing · Electrical Eng. & Systems 2022-09-13 Cyprien Gille , Frédéric Guyard , Marc Antonini , Michel Barlaud

Radiological services are experiencing unprecedented demand, leading to increased interest in automating radiology report generation. Existing Vision-Language Models (VLMs) suffer from hallucinations, lack interpretability, and require…

Computer Vision and Pattern Recognition · Computer Science 2024-10-07 Ahmed Abdulaal , Hugo Fry , Nina Montaña-Brown , Ayodeji Ijishakin , Jack Gao , Stephanie Hyland , Daniel C. Alexander , Daniel C. Castro

Sparse Autoencoders (SAEs) are a prominent tool in mechanistic interpretability (MI) for decomposing neural network activations into interpretable features. However, the aspiration to identify a canonical set of features is challenged by…

Machine Learning · Computer Science 2025-05-27 Xiangchen Song , Aashiq Muhamed , Yujia Zheng , Lingjing Kong , Zeyu Tang , Mona T. Diab , Virginia Smith , Kun Zhang

Sparse autoencoders (SAEs) have been applied to large language models and protein language models, but not systematically to electronic health record (EHR) foundation models. We train TopK SAEs on FlatASCEND, a 14.5-million-parameter…

Machine Learning · Computer Science 2026-05-07 Chris Sainsbury , Feng Dong , Andreas Karwath

Sparse Autoencoders (SAEs) extract features from LLM internal activations, meant to correspond to interpretable concepts. A core SAE training hyperparameter is L0: how many SAE features should fire per token on average. Existing work…

Machine Learning · Computer Science 2025-12-08 David Chanin , Adrià Garriga-Alonso

Sparse autoencoders (SAEs) are a mechanistic interpretability technique that have been used to provide insight into learned concepts within large protein language models. Here, we employ TopK and Ordered SAEs to investigate autoregressive…

We present Universal Sparse Autoencoders (USAEs), a framework for uncovering and aligning interpretable concepts spanning multiple pretrained deep neural networks. Unlike existing concept-based interpretability methods, which focus on a…

Computer Vision and Pattern Recognition · Computer Science 2026-03-20 Harrish Thasarathan , Julian Forsyth , Thomas Fel , Matthew Kowal , Konstantinos G. Derpanis

Sparse Auto-Encoders (SAEs) are commonly employed in mechanistic interpretability to decompose the residual stream into monosemantic SAE latents. Recent work demonstrates that perturbing a model's activations at an early layer results in a…

Machine Learning · Computer Science 2024-11-19 Giorgi Giglemiani , Nora Petrova , Chatrik Singh Mangat , Jett Janiak , Stefan Heimersheim

Sparse Autoencoders (SAEs) are widely used to steer large language models (LLMs), based on the assumption that their interpretable features naturally enable effective model behavior steering. Yet, a fundamental question remains unanswered:…

Machine Learning · Computer Science 2025-10-07 Xu Wang , Yan Hu , Benyou Wang , Difan Zou

Modern text classification methods heavily rely on contextual embeddings from large language models (LLMs). Compared to human-engineered features, these embeddings provide automatic and effective representations for classification model…

Computation and Language · Computer Science 2025-07-29 Xuansheng Wu , Wenhao Yu , Xiaoming Zhai , Ninghao Liu

SAEs have recently been employed as a promising unsupervised approach for understanding the representations of layers of Large Language Models (LLMs). However, with the growth in model size and complexity, training SAEs is computationally…

Computation and Language · Computer Science 2025-09-23 Davide Ghilardi , Federico Belotti , Marco Molinari , Tao Ma , Matteo Palmonari

Learning a generative model of visual information with sparse and compositional features has been a challenge for both theoretical neuroscience and machine learning communities. Sparse coding models have achieved great success in explaining…

Machine Learning · Computer Science 2021-01-26 Linxing Preston Jiang , Luciano de la Iglesia