English
Related papers

Related papers: From Knots to Knobs: Towards Steerable Collaborati…

200 papers

There is growing interest in leveraging mechanistic interpretability and controllability to better understand and influence the internal dynamics of large language models (LLMs). However, current methods face fundamental challenges in…

Computation and Language · Computer Science 2025-12-02 Ruben Härle , Felix Friedrich , Manuel Brack , Stephan Wäldchen , Björn Deiseroth , Patrick Schramowski , Kristian Kersting

Previous studies primarily utilize MLP neurons as units of analysis for understanding the mechanisms of factual knowledge in Language Models (LMs); however, neurons suffer from polysemanticity, leading to limited knowledge expression and…

Computation and Language · Computer Science 2025-02-28 Yuheng Chen , Pengfei Cao , Kang Liu , Jun Zhao

Sparse Autoencoders (SAEs) have emerged as a promising tool for interpreting neural networks by decomposing their activations into sparse sets of human-interpretable features. Recent work has introduced multiple SAE variants and…

Machine Learning · Computer Science 2026-02-17 Anton Korznikov , Andrey Galichin , Alexey Dontsov , Oleg Rogov , Ivan Oseledets , Elena Tutubalina

Sparse autoencoders (SAEs) \citep{bricken2023monosemanticity,gao2024scalingevaluatingsparseautoencoders} rely on dictionary learning to extract interpretable features from neural networks at scale in an unsupervised manner, with…

Machine Learning · Computer Science 2025-05-02 Hans Peter , Anders Søgaard

We propose a novel filter for sparse big data, called an integrated autoencoder (IAE), which utilizes auxiliary information to mitigate data sparsity. The proposed model achieves an appropriate balance between prediction accuracy,…

Machine Learning · Computer Science 2019-06-17 Baogui Xin , Wei Peng

Sparse Autoencoders (SAEs) have emerged as a useful tool for interpreting the internal representations of neural networks. However, naively optimising SAEs for reconstruction loss and sparsity results in a preference for SAEs that are…

Machine Learning · Computer Science 2024-10-16 Kola Ayonrinde , Michael T. Pearce , Lee Sharkey

Recent work by Anthropic on Mechanistic interpretability claims to understand and control Large Language Models by extracting human-interpretable features from their neural activation patterns using sparse autoencoders (SAEs). If…

Machine Learning · Computer Science 2026-01-07 Raphael Ronge , Markus Maier , Frederick Eberhardt

Object-centric representations form the basis of human perception, and enable us to reason about the world and to systematically generalize to new settings. Currently, most works on unsupervised object discovery focus on slot-based…

Machine Learning · Computer Science 2022-11-21 Sindy Löwe , Phillip Lippe , Maja Rudolph , Max Welling

Neural network based models for collaborative filtering have started to gain attention recently. One branch of research is based on using deep generative models to model user preferences where variational autoencoders were shown to produce…

Machine Learning · Statistics 2019-11-05 Daeryong Kim , Bongwon Suh

Neural Audio Codecs (NACs) are widely adopted in modern speech systems, yet how they encode linguistic and paralinguistic information remains unclear. Improving the interpretability of NAC representations is critical for understanding and…

Sparse Autoencoders (SAEs) have shown promise in improving the interpretability of neural network activations, but can learn features that are not features of the input, limiting their effectiveness. We propose \textsc{Mutual Feature…

Machine Learning · Computer Science 2024-11-07 Luke Marks , Alasdair Paren , David Krueger , Fazl Barez

Sparse autoencoders are a standard tool for uncovering interpretable latent representations in neural networks. Yet, their interpretation depends on the inputs, making their isolated study incomplete. Polynomials offer a solution; they…

Machine Learning · Computer Science 2025-10-21 Thomas Dooms , Ward Gauderis

Collaborative Filtering (CF) remains the cornerstone of modern recommender systems, with dense embedding--based methods dominating current practice. However, these approaches suffer from a critical limitation: our theoretical analysis…

Information Retrieval · Computer Science 2026-01-15 Hanze Guo , Jianxun Lian , Xiao Zhou

Sparse Autoencoders (SAEs) have emerged as a promising solution for decomposing large language model representations into interpretable features. However, Paulo and Belrose (2025) have highlighted instability across different initialization…

Machine Learning · Computer Science 2025-06-24 Seonglae Cho , Harryn Oh , Donghyun Lee , Luis Eduardo Rodrigues Vieira , Andrew Bermingham , Ziad El Sayed

Understanding what sparse auto-encoder (SAE) features in vision transformers truly represent is usually done by inspecting the patches where a feature's activation is highest. However, self-attention mixes information across the entire…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Sangyu Han , Yearim Kim , Nojun Kwak

Large Reasoning Models (LRMs) exhibit human-like cognitive reasoning strategies (e.g. backtracking, cross-verification) during reasoning process, which improves their performance on complex tasks. Currently, reasoning strategies are…

Artificial Intelligence · Computer Science 2026-01-08 Yi Fang , Wenjie Wang , Mingfeng Xue , Boyi Deng , Fengli Xu , Dayiheng Liu , Fuli Feng

Sparse autoencoders (SAEs) have emerged as a powerful tool for interpreting neural networks by extracting the concepts represented in their activations. However, choosing the size of the SAE dictionary (i.e. number of learned concepts)…

Machine Learning · Computer Science 2025-03-25 Bart Bussmann , Noa Nabeshima , Adam Karvonen , Neel Nanda

This paper presents a novel convolutional neural network (CNN) based image compression framework via scalable auto-encoder (SAE). Specifically, our SAE based deep image codec consists of hierarchical coding layers, each of which is an…

Multimedia · Computer Science 2019-04-02 Chuanmin Jia , Zhaoyi Liu , Yao Wang , Siwei Ma , Wen Gao

One of the roadblocks to a better understanding of neural networks' internals is \textit{polysemanticity}, where neurons appear to activate in multiple, semantically distinct contexts. Polysemanticity prevents us from identifying concise,…

Machine Learning · Computer Science 2023-10-05 Hoagy Cunningham , Aidan Ewart , Logan Riggs , Robert Huben , Lee Sharkey

Sparse Autoencoders (SAEs) aim to decompose the activation space of large language models (LLMs) into human-interpretable latent directions or features. As we increase the number of features in the SAE, hierarchical features tend to split…

Computation and Language · Computer Science 2025-11-18 David Chanin , James Wilken-Smith , Tomáš Dulka , Hardik Bhatnagar , Satvik Golechha , Joseph Bloom