English
Related papers

Related papers: Interpretable and Steerable Concept Bottleneck Spa…

200 papers

Recent work on sparse autoencoders (SAEs) has shown promise in extracting interpretable features from neural networks and addressing challenges with polysemantic neurons caused by superposition. In this paper, we apply SAEs to the early…

Machine Learning · Computer Science 2024-09-10 Liv Gorton

Sparse Autoencoders (SAEs) are increasingly used to interpret foundation models, but their role as an actionable intervention space remains less understood, especially in vision. We study whether sparse visual features can be used not only…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Gerasimos Chatzoudis , Zhuowei Li , Gemma E. Moran , Hao Wang , Dimitris N. Metaxas

Sparse Autoencoders (SAEs) have emerged as a useful tool for interpreting the internal representations of neural networks. However, naively optimising SAEs for reconstruction loss and sparsity results in a preference for SAEs that are…

Machine Learning · Computer Science 2024-10-16 Kola Ayonrinde , Michael T. Pearce , Lee Sharkey

Sparse Autoencoders have emerged as powerful tools for interpreting the internal representations of Large Language Models, yet they often fail to capture domain-specific features not prevalent in their training corpora. This paper…

Machine Learning · Computer Science 2025-07-18 Nikita Koriagin , Yaroslav Aksenov , Daniil Laptev , Gleb Gerasimov , Nikita Balagansky , Daniil Gavrilov

Recent LLMs like DeepSeek-R1 have demonstrated state-of-the-art performance by integrating deep thinking and complex reasoning during generation. However, the internal mechanisms behind these reasoning processes remain unexplored. We…

Computation and Language · Computer Science 2025-08-07 Andrey Galichin , Alexey Dontsov , Polina Druzhinina , Anton Razzhigaev , Oleg Y. Rogov , Elena Tutubalina , Ivan Oseledets

Internal activations of diffusion models encode rich semantic information, but interpreting such representations remains challenging. While Sparse Autoencoders (SAEs) have shown promise in disentangling latent representations, existing…

Machine Learning · Computer Science 2026-01-23 Zhenghao He , Guangzhi Xiong , Boyang Wang , Sanchit Sinha , Aidong Zhang

Pathology plays an important role in disease diagnosis, treatment decision-making and drug development. Previous works on interpretability for machine learning models on pathology images have revolved around methods such as attention value…

The ability of large language models (LLMs) to follow instructions is crucial for their practical applications, yet the underlying mechanisms remain poorly understood. This paper presents a novel framework that leverages sparse autoencoders…

Machine Learning · Computer Science 2025-02-18 Zirui He , Haiyan Zhao , Yiran Qiao , Fan Yang , Ali Payani , Jing Ma , Mengnan Du

The recent mass adoption of DNNs, even in safety-critical scenarios, has shifted the focus of the research community towards the creation of inherently intrepretable models. Concept Bottleneck Models (CBMs) constitute a popular approach…

Machine Learning · Computer Science 2023-08-22 Konstantinos P. Panousis , Dino Ienco , Diego Marcos

Linear concept vectors effectively steer LLMs, but existing methods suffer from noisy features in diverse datasets that undermine steering robustness. We propose Sparse Autoencoder-Denoised Concept Vectors (SDCV), which selectively keep the…

Computation and Language · Computer Science 2025-07-31 Haiyan Zhao , Xuansheng Wu , Fan Yang , Bo Shen , Ninghao Liu , Mengnan Du

Interpretability is critical in high-stakes domains such as medical imaging, where understanding model decisions is essential for clinical adoption. In this work, we introduce Sparse Autoencoder (SAE)-based interpretability to breast…

Computer Vision and Pattern Recognition · Computer Science 2025-08-19 Krishna Kanth Nakka

The high-level concepts that a neural network uses to perform computation need not be aligned to individual neurons (Smolensky, 1986). Language model interpretability research has thus turned to techniques such as \textit{sparse…

Computation and Language · Computer Science 2026-02-02 Aryaman Arora , Zhengxuan Wu , Jacob Steinhardt , Sarah Schwettmann

Radiological services are experiencing unprecedented demand, leading to increased interest in automating radiology report generation. Existing Vision-Language Models (VLMs) suffer from hallucinations, lack interpretability, and require…

Computer Vision and Pattern Recognition · Computer Science 2024-10-07 Ahmed Abdulaal , Hugo Fry , Nina Montaña-Brown , Ayodeji Ijishakin , Jack Gao , Stephanie Hyland , Daniel C. Alexander , Daniel C. Castro

Unlearning methods for vision-language models (VLMs) have primarily adapted techniques from large language models (LLMs), relying on weight updates that demand extensive annotated forget sets. Moreover, these methods perform unlearning at a…

Computer Vision and Pattern Recognition · Computer Science 2025-03-21 Qing Li , Jiahui Geng , Derui Zhu , Fengyu Cai , Chenyang Lyu , Fakhri Karray

Sparse autoencoders (SAEs) have recently emerged as a powerful tool for interpreting the internal representations of large language models (LLMs), revealing latent latent features with semantical meaning. This interpretability has also…

Other Quantitative Biology · Quantitative Biology 2025-07-11 Haoxiang Guan , Jiyan He , Jie Zhang

What latent features are encoded in language model (LM) representations? Recent work on training sparse autoencoders (SAEs) to disentangle interpretable features in LM representations has shown significant promise. However, evaluating the…

A common goal of mechanistic interpretability is to decompose the activations of neural networks into features: interpretable properties of the input computed by the model. Sparse autoencoders (SAEs) are a popular method for finding these…

Machine Learning · Computer Science 2025-02-10 Patrick Leask , Bart Bussmann , Michael Pearce , Joseph Bloom , Curt Tigges , Noura Al Moubayed , Lee Sharkey , Neel Nanda

Sparse autoencoders (SAEs) are used to analyze embeddings, but their role and practical value are debated. We propose a new perspective on SAEs by demonstrating that they can be naturally understood as topic models. We propose a continuous…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Leander Girrbach , Zeynep Akata

Sparse Autoencoders (SAEs) are an interpretability technique aimed at decomposing neural network activations into interpretable units. However, a major bottleneck for SAE development has been the lack of high-quality performance metrics,…

Machine Learning · Computer Science 2024-12-02 Adam Karvonen , Can Rager , Samuel Marks , Neel Nanda

Variational Autoencoders (VAEs) are powerful generative models for learning latent representations. Standard VAEs generate dispersed and unstructured latent spaces by utilizing all dimensions, which limits their interpretability, especially…

Computer Vision and Pattern Recognition · Computer Science 2025-05-21 Farshad Sangari Abiz , Reshad Hosseini , Babak N. Araabi