English
Related papers

Related papers: Jacobian Sparse Autoencoders: Sparsify Computation…

200 papers

Text-to-image diffusion models generate images through an iterative denoising process, so internal neural layers produce trajectories of activations rather than single static representations. Sparse autoencoders (SAEs) have recently been…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Calvin Yeung , Prathyush Poduval , Ali Zakeri , Zhuowen Zou , Mohsen Imani

EEG foundation models achieve state-of-the-art clinical performance, yet the internal computations driving their predictions remain opaque: a barrier to clinical trust. We apply TopK Sparse Autoencoders (SAEs) across three architecturally…

Sparse autoencoders (SAEs) emerged as a promising tool for mechanistic interpretability of transformer-based foundation models. Very recently, SAEs were also adopted for the visual domain, enabling the discovery of visual concepts and their…

Computer Vision and Pattern Recognition · Computer Science 2025-07-17 Muhammed Furkan Dasdelen , Hyesu Lim , Michele Buck , Katharina S. Götze , Carsten Marr , Steffen Schneider

Sparse Autoencoders (SAEs) that can accurately reconstruct their input (minimizing distortion) by making efficient use of few features (minimizing the rate) often fail to learn monosemantic representations (highly interpretable), limiting…

Machine Learning · Computer Science 2026-05-15 Tommaso Mencattini , Francesco Montagna , Francesco Locatello

Learned Sparse IR models, such as SPLADE, offer an excellent efficiency-effectiveness tradeoff. However, they rely on the underlying backbone vocabulary, which might hinder performance (polysemicity and synonymy) and pose a challenge for…

Information Retrieval · Computer Science 2026-04-24 Yuxuan Zong , Mathias Vast , Basile Van Cooten , Laure Soulier , Benjamin Piwowarski

Large Language Models (LLMs) are traditionally viewed as black-box algorithms, therefore reducing trustworthiness and obscuring potential approaches to increasing performance on downstream tasks. In this work, we apply an effective LLM…

Computation and Language · Computer Science 2025-07-10 Shun Wang , Tyler Loakman , Youbo Lei , Yi Liu , Bohao Yang , Yuting Zhao , Dong Yang , Chenghua Lin

Sparse Autoencoders have emerged as powerful tools for interpreting the internal representations of Large Language Models, yet they often fail to capture domain-specific features not prevalent in their training corpora. This paper…

Machine Learning · Computer Science 2025-07-18 Nikita Koriagin , Yaroslav Aksenov , Daniil Laptev , Gleb Gerasimov , Nikita Balagansky , Daniil Gavrilov

Vision-language models (VLMs) have advanced rapidly and are increasingly deployed in real-world applications, especially with the rise of agent-based systems. However, their safety has received relatively limited attention. Even the latest…

Computer Vision and Pattern Recognition · Computer Science 2026-05-11 Hao Wang , Yiqun Sun , Pengfei Wei , Lawrence B. Hsieh , Daisuke Kawahara

While large language models provide strong compositional reasoning, existing reasoning segmentation pipelines fail to transparently connect this reasoning to visual perception. Current methods, such as latent query alignment, are end-to-end…

Computer Vision and Pattern Recognition · Computer Science 2026-05-22 Zhenyu Lu , Liupeng Li , Jinpeng Wang , Haoqian Kang , Yan Feng , Ke Chen , Yaowei Wang

As black box models and pretrained models gain traction in time series applications, understanding and explaining their predictions becomes increasingly vital, especially in high-stakes domains where interpretability and trust are…

Machine Learning · Computer Science 2026-01-16 Khalid Oublal , Quentin Bouniot , Qi Gan , Stephan Clémençon , Zeynep Akata

Sparse Autoencoders (SAEs) have emerged as a powerful framework for machine learning interpretability, enabling the unsupervised decomposition of model representations into a dictionary of abstract, human-interpretable concepts. However, we…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Thomas Fel , Ekdeep Singh Lubana , Jacob S. Prince , Matthew Kowal , Victor Boutin , Isabel Papadimitriou , Binxu Wang , Martin Wattenberg , Demba Ba , Talia Konkle

We develop the sparse VAE for unsupervised representation learning on high-dimensional data. The sparse VAE learns a set of latent factors (representations) which summarize the associations in the observed data features. The underlying…

Machine Learning · Statistics 2025-04-16 Gemma E. Moran , Dhanya Sridhar , Yixin Wang , David M. Blei

Adapting foundation models for specific purposes has become a standard approach to build machine learning systems for downstream applications. Yet, it is an open question which mechanisms take place during adaptation. Here we develop a new…

Computer Vision and Pattern Recognition · Computer Science 2025-03-24 Hyesu Lim , Jinho Choi , Jaegul Choo , Steffen Schneider

Model internals encode rich information about how a large language model (LLM) processes its training data; however, post-training data engineering largely relies on external signals and ignores rich intrinsic signals lying in model…

Machine Learning · Computer Science 2026-05-27 Yi Jing , Zao Dai , Jinwu Hu , Zijun Yao , Lei Hou , Juanzi Li , Xiaozhi Wang

Sparsity constraints on the control inputs of a linear dynamical system naturally arise in several practical applications such as networked control, computer vision, seismic signal processing, and cyber-physical systems. In this work, we…

Systems and Control · Electrical Eng. & Systems 2024-09-11 Rupam Kalyan Chakraborty , Geethu Joseph , Chandra R. Murthy

A key challenge in AI alignment is guiding large language models (LLMs) to follow desired behaviors at test time. Activation steering, which modifies internal model activations during inference, offers a potential solution. However, prior…

Machine Learning · Computer Science 2025-03-04 Reza Bayat , Ali Rahimi-Kalahroudi , Mohammad Pezeshki , Sarath Chandar , Pascal Vincent

The Linear Representation Hypothesis asserts that the embeddings learned by neural networks can be understood as linear combinations of features corresponding to high-level concepts. Based on this ansatz, sparse autoencoders (SAEs) have…

Machine Learning · Computer Science 2026-01-29 Chiraag Kaushik , Davis Barch , Andrea Fanelli

It is assumed that sparse autoencoders (SAEs) decompose polysemantic activations into interpretable linear directions, as long as the activations are composed of sparse linear combinations of underlying features. However, we find that if an…

Machine Learning · Computer Science 2025-09-29 David Chanin , Tomáš Dulka , Adrià Garriga-Alonso

Sparsity is a desirable attribute. It can lead to more efficient and more effective representations compared to the dense model. Meanwhile, learning sparse latent representations has been a challenging problem in the field of computer…

Computer Vision and Pattern Recognition · Computer Science 2022-09-22 Hanao Li , Tian Han

Scientific archives now contain hundreds of petabytes of data across genomics, ecology, climate, and molecular biology that could reveal undiscovered patterns if systematically analyzed at scale. Large-scale, weakly-supervised datasets in…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Samuel Stevens , Jacob Beattie , Tanya Berger-Wolf , Yu Su
‹ Prev 1 8 9 10 Next ›