English
Related papers

Related papers: Sparse Visual Thought Circuits in Vision-Language …

200 papers

Disentangling model activations into meaningful features is a central problem in interpretability. However, the absence of ground-truth for these features in realistic scenarios makes validating recent approaches, such as sparse dictionary…

Machine Learning · Computer Science 2024-05-21 Aleksandar Makelov , George Lange , Neel Nanda

We propose a novel method that leverages sparse autoencoders (SAEs) and clustering techniques to analyze the internal token representations of large language models (LLMs) and guide generations in mathematical reasoning tasks. Our approach…

Artificial Intelligence · Computer Science 2025-10-03 Daniel Zhao , Abhilash Shankarampeta , Lanxiang Hu , Tajana Rosing , Hao Zhang

Understanding what sparse auto-encoder (SAE) features in vision transformers truly represent is usually done by inspecting the patches where a feature's activation is highest. However, self-attention mixes information across the entire…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Sangyu Han , Yearim Kim , Nojun Kwak

Transformer models have become state-of-the-art in decoding stimuli and behavior from neural activity, significantly advancing neuroscience research. Yet greater transparency in their decision-making processes would substantially enhance…

Quantitative Methods · Quantitative Biology 2025-06-18 Laurence Freeman , Philip Shamash , Vinam Arora , Caswell Barry , Tiago Branco , Eva Dyer

Sparse autoencoders (SAEs) interpret neural network representations by decomposing activations into sparse combinations of dictionary atoms. However, SAEs assume features combine additively through linear reconstruction, an assumption that…

Machine Learning · Computer Science 2026-05-26 Panagiotis Koromilas , Andreas D. Demou , James Oldfield , Yannis Panagakis , Mihalis Nicolaou

Deterministically controlling the target generation language of large multilingual language models (LLMs) remains a fundamental challenge, particularly in zero-shot settings where neither explicit language prompts nor fine-tuning are…

Computation and Language · Computer Science 2025-10-17 Cheng-Ting Chou , George Liu , Jessica Sun , Cole Blondin , Kevin Zhu , Vasu Sharma , Sean O'Brien

Sparse Autoencoders (SAEs) have shown to find interpretable features in neural networks from polysemantic neurons caused by superposition. Previous work has shown SAEs are an effective tool to extract interpretable features from the early…

Computer Vision and Pattern Recognition · Computer Science 2025-04-17 Matthew Bozoukov

Sparse autoencoders (SAEs) have become an important tool for analyzing and interpreting the activation space of transformer-based language models (LMs). However, SAEs suffer several shortcomings that diminish their utility and internal…

Computation and Language · Computer Science 2025-06-27 Ryosuke Takahashi , Tatsuro Inaba , Kentaro Inui , Benjamin Heinzerling

Steering vectors are a promising approach to control the behaviour of large language models. However, their underlying mechanisms remain poorly understood. While sparse autoencoders (SAEs) may offer a potential method to interpret steering…

Machine Learning · Computer Science 2024-11-14 Harry Mayne , Yushi Yang , Adam Mahdi

We introduce methods for discovering and applying sparse feature circuits. These are causally implicated subnetworks of human-interpretable features for explaining language model behaviors. Circuits identified in prior work consist of…

Machine Learning · Computer Science 2025-03-28 Samuel Marks , Can Rager , Eric J. Michaud , Yonatan Belinkov , David Bau , Aaron Mueller

We investigate whether sparse autoencoders (SAEs) can be used to remove knowledge from language models. We use the biology subset of the Weapons of Mass Destruction Proxy dataset and test on the gemma-2b-it and gemma-2-2b-it language…

Machine Learning · Computer Science 2024-11-05 Eoin Farrell , Yeu-Tong Lau , Arthur Conmy

Sensitive directions experiments attempt to understand the computational features of Language Models (LMs) by measuring how much the next token prediction probabilities change by perturbing activations along specific directions. We extend…

Machine Learning · Computer Science 2024-11-19 Daniel J. Lee , Stefan Heimersheim

The linear representation hypothesis states that neural network activations encode high-level concepts as linear mixtures. However, under superposition, this encoding is a projection from a higher-dimensional concept space into a…

Machine Learning · Computer Science 2026-03-31 Vitória Barin Pacela , Shruti Joshi , Isabela Camacho , Simon Lacoste-Julien , David Klindt

Sparse Autoencoders (SAEs) aim to decompose the activation space of large language models (LLMs) into human-interpretable latent directions or features. As we increase the number of features in the SAE, hierarchical features tend to split…

Computation and Language · Computer Science 2025-11-18 David Chanin , James Wilken-Smith , Tomáš Dulka , Hardik Bhatnagar , Satvik Golechha , Joseph Bloom

We identify semantically coherent, context-consistent network components in large language models (LLMs) using coactivation of sparse autoencoder (SAE) features collected from just a handful of prompts. Focusing on concept-relation…

Computation and Language · Computer Science 2026-04-21 Ruixuan Deng , Xiaoyang Hu , Miles Gilberti , Shane Storks , Aman Taxali , Mike Angstadt , Chandra Sripada , Joyce Chai

Sparse autoencoders (SAEs) provide a powerful mechanism for decomposing the dense representations produced by Large Language Models (LLMs) into interpretable latent features. We posit that SAEs constitute a natural foundation for Learned…

Machine Learning · Computer Science 2026-03-17 Thibault Formal , Maxime Louis , Hervé Dejean , Stéphane Clinchant

Large-scale pre-trained vision-language models like CLIP demonstrate remarkable zero-shot performance across diverse tasks. However, fine-tuning these models to improve downstream performance often degrades robustness against distribution…

Computer Vision and Pattern Recognition · Computer Science 2026-05-18 Fabian Morelli , Arnas Uselis , Ankit Sonthalia , Seong Joon Oh

One of the roadblocks to a better understanding of neural networks' internals is \textit{polysemanticity}, where neurons appear to activate in multiple, semantically distinct contexts. Polysemanticity prevents us from identifying concise,…

Machine Learning · Computer Science 2023-10-05 Hoagy Cunningham , Aidan Ewart , Logan Riggs , Robert Huben , Lee Sharkey

Despite their impressive performance, generative image models trained on large-scale datasets frequently fail to produce images with seemingly simple concepts -- e.g., human hands or objects appearing in groups of four -- that are…

Graphics · Computer Science 2025-06-25 Matyas Bohacek , Thomas Fel , Maneesh Agrawala , Ekdeep Singh Lubana

Sparse autoencoders (SAEs) have recently emerged as a powerful tool for interpreting the internal representations of large language models (LLMs), revealing latent latent features with semantical meaning. This interpretability has also…

Other Quantitative Biology · Quantitative Biology 2025-07-11 Haoxiang Guan , Jiyan He , Jie Zhang
‹ Prev 1 4 5 6 7 8 10 Next ›