English
Related papers

Related papers: Interpretable and Testable Vision Features via Spa…

200 papers

Sparse autoencoders (SAEs) interpret neural network representations by decomposing activations into sparse combinations of dictionary atoms. However, SAEs assume features combine additively through linear reconstruction, an assumption that…

Machine Learning · Computer Science 2026-05-26 Panagiotis Koromilas , Andreas D. Demou , James Oldfield , Yannis Panagakis , Mihalis Nicolaou

Understanding how different AI models encode the same high-level concepts, such as objects or attributes, remains challenging because each model typically produces its own isolated representation. Existing interpretability methods like…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Ali Nasiri-Sarvi , Hassan Rivaz , Mahdi S. Hosseini

Responsible deployment of language models requires mechanisms for refusing unsafe prompts while preserving model performance. While most approaches modify model weights through additional training, we explore an alternative: steering model…

As black box models and pretrained models gain traction in time series applications, understanding and explaining their predictions becomes increasingly vital, especially in high-stakes domains where interpretability and trust are…

Machine Learning · Computer Science 2026-01-16 Khalid Oublal , Quentin Bouniot , Qi Gan , Stephan Clémençon , Zeynep Akata

Sparse Autoencoders (SAEs) have emerged as a predominant tool in mechanistic interpretability, aiming to identify interpretable monosemantic features. However, how does sparse encoding organize the representations of activation vector from…

Machine Learning · Computer Science 2025-05-29 Wenjie Sun , Bingzhe Wu , Zhile Yang , Chengke Wu

The high-level concepts that a neural network uses to perform computation need not be aligned to individual neurons (Smolensky, 1986). Language model interpretability research has thus turned to techniques such as \textit{sparse…

Computation and Language · Computer Science 2026-02-02 Aryaman Arora , Zhengxuan Wu , Jacob Steinhardt , Sarah Schwettmann

Sparse Autoencoders (SAEs) have shown promise in improving the interpretability of neural network activations, but can learn features that are not features of the input, limiting their effectiveness. We propose \textsc{Mutual Feature…

Machine Learning · Computer Science 2024-11-07 Luke Marks , Alasdair Paren , David Krueger , Fazl Barez

The mechanisms behind multilingual capabilities in Large Language Models (LLMs) have been examined using neuron-based or internal-activation-based methods. However, these methods often face challenges such as superposition and layer-wise…

Computation and Language · Computer Science 2025-05-28 Boyi Deng , Yu Wan , Yidan Zhang , Baosong Yang , Fuli Feng

Sparse Autoencoders (SAEs) have emerged as a useful tool for interpreting the internal representations of neural networks. However, naively optimising SAEs for reconstruction loss and sparsity results in a preference for SAEs that are…

Machine Learning · Computer Science 2024-10-16 Kola Ayonrinde , Michael T. Pearce , Lee Sharkey

Sparse autoencoders (SAEs) model the activations of a neural network as linear combinations of sparsely occurring directions of variation (latents). The ability of SAEs to reconstruct activations follows scaling laws w.r.t. the number of…

Machine Learning · Computer Science 2025-09-05 Eric J. Michaud , Liv Gorton , Tom McGrath

It has been long known that sparsity is an effective inductive bias for learning efficient representation of data in vectors with fixed dimensionality, and it has been explored in many areas of representation learning. Of particular…

Computation and Language · Computer Science 2021-04-20 Victor Prokhorov , Yingzhen Li , Ehsan Shareghi , Nigel Collier

Vision-language models (VLMs) have advanced rapidly and are increasingly deployed in real-world applications, especially with the rise of agent-based systems. However, their safety has received relatively limited attention. Even the latest…

Computer Vision and Pattern Recognition · Computer Science 2026-05-11 Hao Wang , Yiqun Sun , Pengfei Wei , Lawrence B. Hsieh , Daisuke Kawahara

Protein language models have revolutionized structure prediction, but their nonlinear nature obscures how sequence representations inform structure prediction. While sparse autoencoders (SAEs) offer a path to interpretability here by…

Biomolecules · Quantitative Biology 2025-03-13 Nithin Parsan , David J. Yang , John J. Yang

Artificial intelligence in healthcare requires models that are accurate and interpretable. We advance mechanistic interpretability in medical vision by applying Medical Sparse Autoencoders (MedSAEs) to the latent space of MedCLIP, a…

Artificial Intelligence · Computer Science 2026-05-25 Riccardo Renzulli , Colas Lepoutre , Enrico Cassano , Marco Grangetto

Software vulnerabilities such as buffer overflows and SQL injections are a major source of security breaches. Traditional methods for vulnerability detection remain essential but are limited by high false positive rates, scalability issues,…

Software Engineering · Computer Science 2026-04-10 Rui Melo , Claudia Mamede , Andre Catarino , Rui Abreu , Henrique Lopes Cardoso

RFdiffusion is a popular and well-established model for generation of protein structures. However, this generative process offers limited insight into its internal representations and how they contribute to the final protein structure.…

Quantitative Methods · Quantitative Biology 2025-12-01 Wojciech Zarzecki , Paulina Szymczak , Ewa Szczurek , Kamil Deja

Diffusion models have become the go-to method for text-to-image generation, producing high-quality images from pure noise. However, the inner workings of diffusion models is still largely a mystery due to their black-box nature and complex,…

Computer Vision and Pattern Recognition · Computer Science 2026-01-23 Berk Tinaz , Zalan Fabian , Mahdi Soltanolkotabi

Despite their impressive performance, generative image models trained on large-scale datasets frequently fail to produce images with seemingly simple concepts -- e.g., human hands or objects appearing in groups of four -- that are…

Graphics · Computer Science 2025-06-25 Matyas Bohacek , Thomas Fel , Maneesh Agrawala , Ekdeep Singh Lubana

Sparse autoencoders (SAEs) are designed to extract interpretable features from language models by enforcing a sparsity constraint. Ideally, training an SAE would yield latents that are both sparse and semantically meaningful. However, many…

Machine Learning · Computer Science 2025-11-06 Xiaoqing Sun , Alessandro Stolfo , Joshua Engels , Ben Wu , Senthooran Rajamanoharan , Mrinmaya Sachan , Max Tegmark

Deep neural networks are powerful tools for biomedical image segmentation. These models are often trained with heavy supervision, relying on pairs of images and corresponding voxel-level labels. However, obtaining segmentations of…

Image and Video Processing · Electrical Eng. & Systems 2020-04-30 Evan M. Yu , Juan Eugenio Iglesias , Adrian V. Dalca , Mert R. Sabuncu
‹ Prev 1 8 9 10 Next ›