English
Related papers

Related papers: Transformers Use Causal World Models in Maze-Solvi…

200 papers

Sparse Auto-Encoders (SAEs) are commonly employed in mechanistic interpretability to decompose the residual stream into monosemantic SAE latents. Recent work demonstrates that perturbing a model's activations at an early layer results in a…

Machine Learning · Computer Science 2024-11-19 Giorgi Giglemiani , Nora Petrova , Chatrik Singh Mangat , Jett Janiak , Stefan Heimersheim

World Models have emerged as a powerful paradigm for learning compact, predictive representations of environment dynamics, enabling agents to reason, plan, and generalize beyond direct experience. Despite recent interest in World Models,…

Artificial Intelligence · Computer Science 2026-02-18 Lucas Maes , Quentin Le Lidec , Dan Haramati , Nassim Massaudi , Damien Scieur , Yann LeCun , Randall Balestriero

In this work, we demonstrate that affine mappings between residual streams of language models is a cheap way to effectively transfer represented features between models. We apply this technique to transfer the weights of Sparse Autoencoders…

Computation and Language · Computer Science 2025-11-04 Alan Chen , Jack Merullo , Alessandro Stolfo , Ellie Pavlick

We investigate the capacity of transformers to learn algorithms involving their context while solely being trained using next token prediction. We set up Markov chains with random transition matrices and we train transformers to predict the…

Machine Learning · Computer Science 2025-08-07 Simon Lepage , Jeremie Mary , David Picard

Modern Foundation Models (FMs) are typically trained on corpora spanning a wide range of different data modalities, topics and downstream tasks. Utilizing these models can be very computationally expensive and is out of reach for most…

Machine Learning · Computer Science 2025-06-09 Andrey Zhmoginov , Jihwan Lee , Mark Sandler

Transformer architectures have achieved remarkable success across language, vision, and multimodal tasks, and there is growing demand for them to address in-context compositional learning tasks. In these tasks, models solve the target…

Machine Learning · Computer Science 2025-11-26 Wei Chen , Jingxi Yu , Zichen Miao , Qiang Qiu

A common goal of mechanistic interpretability is to decompose the activations of neural networks into features: interpretable properties of the input computed by the model. Sparse autoencoders (SAEs) are a popular method for finding these…

Machine Learning · Computer Science 2025-02-10 Patrick Leask , Bart Bussmann , Michael Pearce , Joseph Bloom , Curt Tigges , Noura Al Moubayed , Lee Sharkey , Neel Nanda

Capturing the structure of a data-generating process by means of appropriate inductive biases can help in learning models that generalize well and are robust to changes in the input distribution. While methods that harness spatial and…

Recent advances in Large Multimodal Models (LMMs) lead to significant breakthroughs in both academia and industry. One question that arises is how we, as humans, can understand their internal neural representations. This paper takes an…

Computer Vision and Pattern Recognition · Computer Science 2025-09-19 Kaichen Zhang , Yifei Shen , Bo Li , Ziwei Liu

Sparse autoencoders (SAEs) are a mechanistic interpretability technique that have been used to provide insight into learned concepts within large protein language models. Here, we employ TopK and Ordered SAEs to investigate autoregressive…

Transformers are increasingly adopted for modeling and forecasting time-series, yet their internal mechanisms remain poorly understood from a dynamical systems perspective. In contrast to classical autoregressive and state-space models,…

Machine Learning · Computer Science 2025-12-25 Gregory Duthé , Nikolaos Evangelou , Wei Liu , Ioannis G. Kevrekidis , Eleni Chatzi

Sparse Autoencoders (SAEs) have emerged as a promising solution for decomposing large language model representations into interpretable features. However, Paulo and Belrose (2025) have highlighted instability across different initialization…

Machine Learning · Computer Science 2025-06-24 Seonglae Cho , Harryn Oh , Donghyun Lee , Luis Eduardo Rodrigues Vieira , Andrew Bermingham , Ziad El Sayed

The ability to perceive and reason about individual objects and their interactions is a goal to be achieved for building intelligent artificial systems. State-of-the-art approaches use a feedforward encoder to extract object embeddings and…

Computer Vision and Pattern Recognition · Computer Science 2024-02-07 Jonathan Collu , Riccardo Majellaro , Aske Plaat , Thomas M. Moerland

Linear probes and sparse autoencoders consistently recover meaningful structure from transformer representations -- yet why should such simple methods succeed in deep, nonlinear systems? We show this is not merely an empirical regularity…

Machine Learning · Computer Science 2026-02-11 Andres Saurez , Yousung Lee , Dongsoo Har

Diffusion models have become the go-to method for text-to-image generation, producing high-quality images from pure noise. However, the inner workings of diffusion models is still largely a mystery due to their black-box nature and complex,…

Computer Vision and Pattern Recognition · Computer Science 2026-01-23 Berk Tinaz , Zalan Fabian , Mahdi Soltanolkotabi

While the successes of transformers across many domains are indisputable, accurate understanding of the learning mechanics is still largely lacking. Their capabilities have been probed on benchmarks which include a variety of structured and…

Machine Learning · Computer Science 2023-07-25 Yuchen Li , Yuanzhi Li , Andrej Risteski

Even though Transformers are extensively used for Natural Language Processing tasks, especially for machine translation, they lack an explicit memory to store key concepts of processed texts. This paper explores the properties of the…

Computation and Language · Computer Science 2024-06-21 Alsu Sagirova , Mikhail Burtsev

Sparse autoencoders (SAEs) are widely used to extract sparse, interpretable latents from transformer activations. We test whether commonly used SAE quality metrics and automatic explanation pipelines can distinguish trained transformers…

Machine Learning · Computer Science 2026-01-28 Thomas Heap , Tim Lawson , Lucy Farnik , Laurence Aitchison

Experimental evidence indicates that simple models outperform complex deep networks on many unsupervised similarity tasks. We provide a simple yet rigorous explanation for this behaviour by introducing the concept of an optimal…

Artificial Intelligence · Computer Science 2018-05-10 Vitalii Zhelezniak , Dan Busbridge , April Shen , Samuel L. Smith , Nils Y. Hammerla

Transformer architectures, and their attention mechanisms in particular, form the foundation of modern large language models. While transformer models are widely believed to operate in high-dimensional hidden spaces, we show that attention…

Machine Learning · Computer Science 2026-02-12 Junxuan Wang , Xuyang Ge , Wentao Shu , Zhengfu He , Xipeng Qiu
‹ Prev 1 8 9 10 Next ›