English
Related papers

Related papers: Insights into a radiology-specialised multimodal l…

200 papers

Interpretability is essential in medical imaging to ensure that clinicians can comprehend and trust artificial intelligence models. In this paper, we propose a novel interpretable approach that combines attribute regularization of the…

Image and Video Processing · Electrical Eng. & Systems 2023-12-15 Maxime Di Folco , Cosmin I. Bercea , Julia A. Schnabel

Sparse Autoencoders uncover thousands of features in vision models, yet explaining these features without requiring human intervention remains an open challenge. While previous work has proposed generating correlation-based explanations…

Computer Vision and Pattern Recognition · Computer Science 2026-03-26 Javier Ferrando , Enrique Lopez-Cuena , Pablo Agustin Martin-Torres , Daniel Hinjos , Anna Arias-Duart , Dario Garcia-Gasulla

Sparse Autoencoders (SAEs) that can accurately reconstruct their input (minimizing distortion) by making efficient use of few features (minimizing the rate) often fail to learn monosemantic representations (highly interpretable), limiting…

Machine Learning · Computer Science 2026-05-15 Tommaso Mencattini , Francesco Montagna , Francesco Locatello

This work proposes a unified self-supervised pre-training framework for transferable multi-modal perception representation learning via masked multi-modal reconstruction in Neural Radiance Field (NeRF), namely NeRF-Supervised Masked…

Computer Vision and Pattern Recognition · Computer Science 2023-12-07 Xiaohao Xu

Despite growing research on bias in large language models (LLMs), most work has focused on gender and race, with little attention to religious identity. This paper explores how religion is internally represented in LLMs and how it…

Machine Learning · Computer Science 2025-09-23 Katharina Simbeck , Mariam Mahran

Sparse autoencoders (SAEs) have received considerable recent attention as tools for mechanistic interpretability, showing success at extracting interpretable features even from very large LLMs. However, this research has been largely…

Machine Learning · Computer Science 2025-05-20 Jeremy Budd , Javier Ideami , Benjamin Macdowall Rynne , Keith Duggar , Randall Balestriero

There has been a growing interest in using deep learning models for processing long surgical videos, in order to automatically detect clinical/operational activities and extract metrics that can enable workflow efficiency tools and…

Computer Vision and Pattern Recognition · Computer Science 2023-05-22 Muhammad Abdullah Jamal , Omid Mohareri

Sparse autoencoders (SAEs) are a recent technique for decomposing neural network activations into human-interpretable features. However, in order for SAEs to identify all features represented in frontier models, it will be necessary to…

Machine Learning · Computer Science 2025-06-04 Anish Mudide , Joshua Engels , Eric J. Michaud , Max Tegmark , Christian Schroeder de Witt

The standard sparse-autoencoder (SAE) interpretability protocol labels each feature from its top-activating contexts and validates by single-feature steering. We propose the pairwise matrix protocol, co-varying steering coefficient with…

Machine Learning · Computer Science 2026-05-06 Michael A. Riegler , Birk Sebastian Frostelid Torpmann-Hagen

Recent advances in language model interpretability using sparse autoencoders (SAEs) have yet to effectively translate to the visual domain, mainly due to the difficulty and ambiguity of labeling visual concepts. In this paper, we introduce…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Alexey Kravets , Da Li , Chuan Li , Da Chen , Vinay P. Namboodiri

Sparse Autoencoders (SAEs) have emerged as a promising solution for decomposing large language model representations into interpretable features. However, Paulo and Belrose (2025) have highlighted instability across different initialization…

Machine Learning · Computer Science 2025-06-24 Seonglae Cho , Harryn Oh , Donghyun Lee , Luis Eduardo Rodrigues Vieira , Andrew Bermingham , Ziad El Sayed

Sparse Autoencoders (SAEs) have recently emerged as powerful tools for interpreting and steering the internal representations of large language models (LLMs). However, conventional approaches to analyzing SAEs typically rely solely on…

Machine Learning · Computer Science 2025-09-24 Dong Shu , Xuansheng Wu , Haiyan Zhao , Mengnan Du , Ninghao Liu

Sparse autoencoders (SAEs) improve interpretability in multimodal models, but it remains unclear whether SAE features form modular, composable units for reasoning-an assumption underlying many intervention-based steering methods. We test…

Artificial Intelligence · Computer Science 2026-03-27 Yunpeng Zhou

Self-supervised learning (SSL) enables learning useful inductive biases through utilizing pretext tasks that require no labels. The unlabeled nature of SSL makes it especially important for whole slide histopathological images (WSIs), where…

Computer Vision and Pattern Recognition · Computer Science 2022-11-15 Wisdom Oluchi Ikezogwo , Mehmet Saygin Seyfioglu , Linda Shapiro

Sparse Autoencoders (SAEs) are increasingly used to interpret foundation models, but their role as an actionable intervention space remains less understood, especially in vision. We study whether sparse visual features can be used not only…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Gerasimos Chatzoudis , Zhuowei Li , Gemma E. Moran , Hao Wang , Dimitris N. Metaxas

Understanding AI systems' inner workings is critical for ensuring value alignment and safety. This review explores mechanistic interpretability: reverse engineering the computational mechanisms and representations learned by neural networks…

Artificial Intelligence · Computer Science 2024-08-27 Leonard Bereska , Efstratios Gavves

Masked autoencoder (MAE), a simple and effective self-supervised learning framework based on the reconstruction of masked image regions, has recently achieved prominent success in a variety of vision tasks. Despite the emergence of…

Machine Learning · Computer Science 2023-06-09 Lingjing Kong , Martin Q. Ma , Guangyi Chen , Eric P. Xing , Yuejie Chi , Louis-Philippe Morency , Kun Zhang

In the field of medical image segmentation, challenges such as indistinct lesion features, ambiguous boundaries,and multi-scale characteristics have long revailed. This paper proposes an improved method named Intensity-Spatial Dual Masked…

Image and Video Processing · Electrical Eng. & Systems 2025-02-17 Yuexing Ding , Jun Wang , Hongbing Lyu

Polysemanticity is pervasive in language models and remains a major challenge for interpretation and model behavioral control. Leveraging sparse autoencoders (SAEs), we map the polysemantic topology of two small models (Pythia-70M and…

Artificial Intelligence · Computer Science 2026-03-19 Bofan Gong , Shiyang Lai , James Evans , Dawn Song

"Masked Autoencoders (MAE) Are Scalable Vision Learners" revolutionizes the self-supervised learning method in that it not only achieves the state-of-the-art for image pre-training, but is also a milestone that bridges the gap between…

Computer Vision and Pattern Recognition · Computer Science 2022-02-10 Shuhao Cao , Peng Xu , David A. Clifton