English
Related papers

Related papers: Sparse Visual Thought Circuits in Vision-Language …

200 papers

Sparse autoencoders (SAEs) are used to decompose neural network activations into human-interpretable features. Typically, features learned by a single SAE are used for downstream applications. However, it has recently been shown that SAEs…

Machine Learning · Computer Science 2025-05-23 Soham Gadgil , Chris Lin , Su-In Lee

Translating the internal representations and computations of models into concepts that humans can understand is a key goal of interpretability. While recent dictionary learning methods such as Sparse Autoencoders (SAEs) provide a promising…

Computation and Language · Computer Science 2026-02-27 Usha Bhalla , Alex Oesterling , Claudio Mayrink Verdun , Himabindu Lakkaraju , Flavio P. Calmon

Scientific archives now contain hundreds of petabytes of data across genomics, ecology, climate, and molecular biology that could reveal undiscovered patterns if systematically analyzed at scale. Large-scale, weakly-supervised datasets in…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Samuel Stevens , Jacob Beattie , Tanya Berger-Wolf , Yu Su

Sparse Autoencoders (SAEs) can efficiently identify candidate monosemantic features from pretrained neural networks for galaxy morphology. We demonstrate this on Euclid Q1 images using both supervised (Zoobot) and new self-supervised (MAE)…

Instrumentation and Methods for Astrophysics · Physics 2025-11-13 John F. Wu , Michael Walmsley

Sparse Autoencoders (SAEs) are powerful tools for interpreting neural representations, yet their use in audio remains underexplored. We train SAEs across all encoder layers of Whisper and HuBERT, provide an extensive evaluation of their…

Sparse Autoencoders (SAEs) are a promising approach for extracting neural network representations by learning a sparse and overcomplete decomposition of the network's internal activations. However, SAEs are traditionally trained considering…

Machine Learning · Computer Science 2025-04-02 Jeffrey Olmo , Jared Wilson , Max Forsey , Bryce Hepner , Thomas Vin Howe , David Wingate

Sparse autoencoders (SAEs) and transcoders have become important tools for machine learning interpretability. However, measuring how interpretable they are remains challenging, with weak consensus about which benchmarks to use. Most…

Machine Learning · Computer Science 2025-07-14 Gonçalo Paulo , Nora Belrose

Software vulnerabilities such as buffer overflows and SQL injections are a major source of security breaches. Traditional methods for vulnerability detection remain essential but are limited by high false positive rates, scalability issues,…

Software Engineering · Computer Science 2026-04-10 Rui Melo , Claudia Mamede , Andre Catarino , Rui Abreu , Henrique Lopes Cardoso

To control the behavior of language models, steering methods attempt to ensure that outputs of the model satisfy specific pre-defined properties. Adding steering vectors to the model is a promising method of model control that is easier…

Machine Learning · Computer Science 2024-11-22 Sviatoslav Chalnev , Matthew Siu , Arthur Conmy

Sparse autoencoders (SAEs) have been used widely to decompose and interpret neural network activations, especially those of transformer language models. One key issue with SAEs is their inability to directly model multidimensional features.…

Machine Learning · Computer Science 2026-05-12 Collin Francel

The ability of large language models (LLMs) to follow instructions is crucial for their practical applications, yet the underlying mechanisms remain poorly understood. This paper presents a novel framework that leverages sparse autoencoders…

Machine Learning · Computer Science 2025-02-18 Zirui He , Haiyan Zhao , Yiran Qiao , Fan Yang , Ali Payani , Jing Ma , Mengnan Du

Sparse autoencoders (SAEs) are widely used for interpreting language model activations. A key evaluation metric is the increase in cross-entropy loss between the original model logits and the reconstructed model logits when replacing model…

Machine Learning · Computer Science 2025-04-01 Adam Karvonen

Understanding the internal machinations of deep Transformer-based NLP models is more crucial than ever as these models see widespread use in various domains that affect the public at large, such as industry, academia, finance, health. While…

Computation and Language · Computer Science 2026-05-13 Dan Pluth , Zachary Nicholas Houghton , Yu Zhou , Vijay K. Gurbani

The rapid advancement of Vision-Language models (VLMs) has raised growing concerns that their black-box reasoning processes could lead to unintended forms of social bias. Current debiasing approaches focus on mitigating surface-level bias…

Computer Vision and Pattern Recognition · Computer Science 2026-03-02 Na Min An , Yoonna Jang , Yusuke Hirota , Ryo Hachiuma , Isabelle Augenstein , Hyunjung Shim

Sparse autoencoders (SAEs) are a recent technique for decomposing neural network activations into human-interpretable features. However, in order for SAEs to identify all features represented in frontier models, it will be necessary to…

Machine Learning · Computer Science 2025-06-04 Anish Mudide , Joshua Engels , Eric J. Michaud , Max Tegmark , Christian Schroeder de Witt

Vision-language models (VLMs) align images and text with remarkable success, yet the geometry of their shared embedding space remains poorly understood. To probe this geometry, we begin from the Iso-Energy Assumption, which exploits…

Computer Vision and Pattern Recognition · Computer Science 2026-02-11 Grégoire Dhimoïla , Thomas Fel , Victor Boutin , Agustin Picard

Sparse Autoencoders (SAEs) have emerged as a powerful framework for machine learning interpretability, enabling the unsupervised decomposition of model representations into a dictionary of abstract, human-interpretable concepts. However, we…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Thomas Fel , Ekdeep Singh Lubana , Jacob S. Prince , Matthew Kowal , Victor Boutin , Isabel Papadimitriou , Binxu Wang , Martin Wattenberg , Demba Ba , Talia Konkle

A key goal in mechanistic interpretability is circuit analysis: finding sparse subgraphs of models corresponding to specific behaviors or capabilities. However, MLP sublayers make fine-grained circuit analysis on transformer-based language…

Machine Learning · Computer Science 2024-11-08 Jacob Dunefsky , Philippe Chlenski , Neel Nanda

Sparse Autoencoders (SAEs) have emerged as a promising solution for decomposing large language model representations into interpretable features. However, Paulo and Belrose (2025) have highlighted instability across different initialization…

Machine Learning · Computer Science 2025-06-24 Seonglae Cho , Harryn Oh , Donghyun Lee , Luis Eduardo Rodrigues Vieira , Andrew Bermingham , Ziad El Sayed

Sparse auto-encoders (SAEs) have become a prevalent tool for interpreting language models' inner workings. However, it is unknown how tightly SAE features correspond to computationally important directions in the model. This work…

Machine Learning · Computer Science 2025-02-25 Thomas Dooms , Daniel Wilhelm