English
Related papers

Related papers: From Knots to Knobs: Towards Steerable Collaborati…

200 papers

Sparse autoencoders (SAEs) emerged as a promising tool for mechanistic interpretability of transformer-based foundation models. Very recently, SAEs were also adopted for the visual domain, enabling the discovery of visual concepts and their…

Computer Vision and Pattern Recognition · Computer Science 2025-07-17 Muhammed Furkan Dasdelen , Hyesu Lim , Michele Buck , Katharina S. Götze , Carsten Marr , Steffen Schneider

Understanding how features evolve across layers in deep neural networks is a fundamental challenge in mechanistic interpretability, particularly due to polysemanticity and feature superposition. While Sparse Autoencoders (SAEs) have been…

Machine Learning · Computer Science 2025-03-04 Nikita Balagansky , Ian Maksimov , Daniil Gavrilov

While sparse autoencoders (SAEs) successfully extract interpretable features from language models, applying them to audio generation faces unique challenges: audio's dense nature requires compression that obscures semantic meaning, and…

Machine Learning · Computer Science 2025-10-31 Nathan Paek , Yongyi Zang , Qihui Yang , Randal Leistikow

Sparse Autoencoders uncover thousands of features in vision models, yet explaining these features without requiring human intervention remains an open challenge. While previous work has proposed generating correlation-based explanations…

Computer Vision and Pattern Recognition · Computer Science 2026-03-26 Javier Ferrando , Enrique Lopez-Cuena , Pablo Agustin Martin-Torres , Daniel Hinjos , Anna Arias-Duart , Dario Garcia-Gasulla

The linear representation hypothesis states that neural network activations encode high-level concepts as linear mixtures. However, under superposition, this encoding is a projection from a higher-dimensional concept space into a…

Machine Learning · Computer Science 2026-03-31 Vitória Barin Pacela , Shruti Joshi , Isabela Camacho , Simon Lacoste-Julien , David Klindt

While large language models provide strong compositional reasoning, existing reasoning segmentation pipelines fail to transparently connect this reasoning to visual perception. Current methods, such as latent query alignment, are end-to-end…

Computer Vision and Pattern Recognition · Computer Science 2026-05-22 Zhenyu Lu , Liupeng Li , Jinpeng Wang , Haoqian Kang , Yan Feng , Ke Chen , Yaowei Wang

Sparse autoencoders (SAEs) have emerged as a promising approach in language model interpretability, offering unsupervised extraction of sparse features. For interpretability methods to succeed, they must identify abstract features across…

Machine Learning · Computer Science 2025-09-08 Lovis Heindrich , Philip Torr , Fazl Barez , Veronika Thost

Sparse autoencoders (SAEs) have emerged as a promising approach for learning interpretable features from neural network activations. However, the optimization landscape for SAE training can be challenging due to correlations in the input…

Machine Learning · Computer Science 2025-11-19 Ashwin Saraswatula , David Klindt

EEG foundation models achieve state-of-the-art clinical performance, yet the internal computations driving their predictions remain opaque: a barrier to clinical trust. We apply TopK Sparse Autoencoders (SAEs) across three architecturally…

Standard Sparse Autoencoders (SAEs) excel at discovering a dictionary of a model's learned features, offering a powerful observational lens. However, the ambiguous and ungrounded nature of these features makes them unreliable instruments…

Machine Learning · Computer Science 2025-09-29 Jianrong Ding , Muxi Chen , Chenchen Zhao , Qiang Xu

The rapid advancements in transformer-based language models have revolutionized natural language processing, yet understanding the internal mechanisms of these models remains a significant challenge. This paper explores the application of…

Machine Learning · Computer Science 2025-02-14 Edith Natalia Villegas Garcia , Alessio Ansuini

Sparse Autoencoders (SAEs) are a prominent tool in mechanistic interpretability (MI) for decomposing neural network activations into interpretable features. However, the aspiration to identify a canonical set of features is challenged by…

Machine Learning · Computer Science 2025-05-27 Xiangchen Song , Aashiq Muhamed , Yujia Zheng , Lingjing Kong , Zeyu Tang , Mona T. Diab , Virginia Smith , Kun Zhang

We investigate whether sparse autoencoders (SAEs) can be used to remove knowledge from language models. We use the biology subset of the Weapons of Mass Destruction Proxy dataset and test on the gemma-2b-it and gemma-2-2b-it language…

Machine Learning · Computer Science 2024-11-05 Eoin Farrell , Yeu-Tong Lau , Arthur Conmy

Sparse autoencoders (SAEs) have emerged as powerful techniques for interpretability of large language models (LLMs), aiming to decompose hidden states into meaningful semantic features. While several SAE variants have been proposed, there…

Machine Learning · Computer Science 2025-10-03 Xudong Zhu , Mohammad Mahdi Khalili , Zhihui Zhu

Sparse Autoencoders (SAEs) have emerged as a powerful unsupervised method for extracting sparse representations from language models, yet scalable training remains a significant challenge. We introduce a suite of 256 SAEs, trained on each…

Sparse autoencoders (SAEs) model the activations of a neural network as linear combinations of sparsely occurring directions of variation (latents). The ability of SAEs to reconstruct activations follows scaling laws w.r.t. the number of…

Machine Learning · Computer Science 2025-09-05 Eric J. Michaud , Liv Gorton , Tom McGrath

Steering has emerged as a promising approach in controlling large language models (LLMs) without modifying model parameters. However, most existing steering methods rely on large-scale datasets to learn clear behavioral information, which…

Machine Learning · Computer Science 2025-10-06 Anyi Wang , Xuansheng Wu , Dong Shu , Yunpu Ma , Ninghao Liu

Sparse autoencoders (SAEs) have emerged as a powerful technique for decomposing language model representations into interpretable features. Current interpretation methods infer feature semantics from activation patterns, but overlook that…

Machine Learning · Computer Science 2026-02-02 Yiting Liu , Zhi-Hong Deng

Text-to-image diffusion models generate images through an iterative denoising process, so internal neural layers produce trajectories of activations rather than single static representations. Sparse autoencoders (SAEs) have recently been…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Calvin Yeung , Prathyush Poduval , Ali Zakeri , Zhuowen Zou , Mohsen Imani

Sparse autoencoders (SAEs) have received considerable recent attention as tools for mechanistic interpretability, showing success at extracting interpretable features even from very large LLMs. However, this research has been largely…

Machine Learning · Computer Science 2025-05-20 Jeremy Budd , Javier Ideami , Benjamin Macdowall Rynne , Keith Duggar , Randall Balestriero