English
Related papers

Related papers: Sparse Autoencoders Map Brain-LLM Alignment onto C…

200 papers

The ability of large language models (LLMs) to follow instructions is crucial for their practical applications, yet the underlying mechanisms remain poorly understood. This paper presents a novel framework that leverages sparse autoencoders…

Machine Learning · Computer Science 2025-02-18 Zirui He , Haiyan Zhao , Yiran Qiao , Fan Yang , Ali Payani , Jing Ma , Mengnan Du

Sparse autoencoders (SAEs) offer a natural path toward comparable explanations across different representation spaces. However, current SAEs are trained per modality, producing dictionaries whose features are not directly understandable and…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Difei Gu , Yunhe Gao , Gerasimos Chatzoudis , Zihan Dong , Guoning Zhang , Bangwei Guo , Yang Zhou , Mu Zhou , Dimitris Metaxas

Pathology plays an important role in disease diagnosis, treatment decision-making and drug development. Previous works on interpretability for machine learning models on pathology images have revolved around methods such as attention value…

It is assumed that sparse autoencoders (SAEs) decompose polysemantic activations into interpretable linear directions, as long as the activations are composed of sparse linear combinations of underlying features. However, we find that if an…

Machine Learning · Computer Science 2025-09-29 David Chanin , Tomáš Dulka , Adrià Garriga-Alonso

A key goal in mechanistic interpretability is circuit analysis: finding sparse subgraphs of models corresponding to specific behaviors or capabilities. However, MLP sublayers make fine-grained circuit analysis on transformer-based language…

Machine Learning · Computer Science 2024-11-08 Jacob Dunefsky , Philippe Chlenski , Neel Nanda

Vision-Language-Action (VLA) models have emerged as a promising approach for general-purpose robot manipulation. However, their generalization is inconsistent: while these models can perform impressively in some settings, fine-tuned…

Robotics · Computer Science 2026-03-20 Aiden Swann , Lachlain McGranahan , Hugo Buurmeijer , Monroe Kennedy , Mac Schwager

Sparse Autoencoders (SAEs) are powerful tools for interpreting neural representations, yet their use in audio remains underexplored. We train SAEs across all encoder layers of Whisper and HuBERT, provide an extensive evaluation of their…

Large language models (LLMs) exhibit substantial performance disparities across languages, particularly between high- and low-resource settings. We propose a framework for improving performance in underrepresented languages while preserving…

Computation and Language · Computer Science 2026-02-05 Daniil Gurgurov , Tanja Baeumel , Josef van Genabith , Simon Ostermann

We investigate whether sparse autoencoders (SAEs) can be used to remove knowledge from language models. We use the biology subset of the Weapons of Mass Destruction Proxy dataset and test on the gemma-2b-it and gemma-2-2b-it language…

Machine Learning · Computer Science 2024-11-05 Eoin Farrell , Yeu-Tong Lau , Arthur Conmy

The alignment of vision-language representations endows current Vision-Language Models (VLMs) with strong multi-modal reasoning capabilities. However, the interpretability of the alignment component remains uninvestigated due to the…

Computer Vision and Pattern Recognition · Computer Science 2025-10-27 Shufan Shen , Junshu Sun , Qingming Huang , Shuhui Wang

While large language models provide strong compositional reasoning, existing reasoning segmentation pipelines fail to transparently connect this reasoning to visual perception. Current methods, such as latent query alignment, are end-to-end…

Computer Vision and Pattern Recognition · Computer Science 2026-05-22 Zhenyu Lu , Liupeng Li , Jinpeng Wang , Haoqian Kang , Yan Feng , Ke Chen , Yaowei Wang

Sparse autoencoders (SAEs) and transcoders have become important tools for machine learning interpretability. However, measuring how interpretable they are remains challenging, with weak consensus about which benchmarks to use. Most…

Machine Learning · Computer Science 2025-07-14 Gonçalo Paulo , Nora Belrose

Large language models (LLMs) store vast amounts of information, making them powerful yet raising privacy and safety concerns when selective knowledge removal is required. Existing unlearning strategies, ranging from gradient-based…

Computation and Language · Computer Science 2025-06-02 Xu Wang , Zihao Li , Benyou Wang , Yan Hu , Difan Zou

Sparse autoencoders (SAEs) have recently emerged as a powerful tool for language model steering. Prior work has explored top-k SAE latents for steering, but we observe that many dimensions among the top-k latents capture non-semantic…

Computation and Language · Computer Science 2025-10-03 Jiaqing Xie

We investigate feature universality in Gemma-2 language models (Gemma-2-2B and Gemma-2-9B), asking whether models with a four-fold difference in scale still converge on comparable internal concepts. Using the Sparse Autoencoder (SAE)…

Computation and Language · Computer Science 2025-08-01 Daniel Son , Sanjana Rathore , Andrew Rufail , Adrian Simon , Daniel Zhang , Soham Dave , Cole Blondin , Kevin Zhu , Sean O'Brien

Protein language models have revolutionized structure prediction, but their nonlinear nature obscures how sequence representations inform structure prediction. While sparse autoencoders (SAEs) offer a path to interpretability here by…

Biomolecules · Quantitative Biology 2025-03-13 Nithin Parsan , David J. Yang , John J. Yang

Identifying the features learned by neural networks is a core challenge in mechanistic interpretability. Sparse autoencoders (SAEs), which learn a sparse, overcomplete dictionary that reconstructs a network's internal activations, have been…

Machine Learning · Computer Science 2024-05-27 Dan Braun , Jordan Taylor , Nicholas Goldowsky-Dill , Lee Sharkey

Despite rapid adoption and deployment of large language models (LLMs), the internal computations of these models remain opaque and poorly understood. In this work, we seek to understand how high-level human-interpretable features are…

Machine Learning · Computer Science 2023-06-06 Wes Gurnee , Neel Nanda , Matthew Pauly , Katherine Harvey , Dmitrii Troitskii , Dimitris Bertsimas

LLMs increasingly require surgical model editing to enhance domain-specific capabilities without incurring the computational cost or catastrophic forgetting associated with full fine-tuning. Sparse Autoencoders (SAEs) have emerged as a…

Machine Learning · Computer Science 2026-05-28 Li Lei , Madalina Ciobanu , Qingqing Mao , Ritankar Das

As Large Language Models become integral to software development, with substantial portions of AI-suggested code entering production, understanding their internal correctness mechanisms becomes critical for safe deployment. We apply sparse…

Software Engineering · Computer Science 2025-10-06 Kriz Tahimic , Charibeth Cheng
‹ Prev 1 4 5 6 7 8 10 Next ›