English
Related papers

Related papers: MedSAE: Dissecting MedCLIP Representations with Sp…

200 papers

Sparse Autoencoders (SAEs) have shown promise in improving the interpretability of neural network activations, but can learn features that are not features of the input, limiting their effectiveness. We propose \textsc{Mutual Feature…

Machine Learning · Computer Science 2024-11-07 Luke Marks , Alasdair Paren , David Krueger , Fazl Barez

Sparse Autoencoders (SAEs) have emerged as a useful tool for interpreting the internal representations of neural networks. However, naively optimising SAEs for reconstruction loss and sparsity results in a preference for SAEs that are…

Machine Learning · Computer Science 2024-10-16 Kola Ayonrinde , Michael T. Pearce , Lee Sharkey

Sparse autoencoders (SAEs) are commonly used to interpret the internal activations of large language models (LLMs) by mapping them to human-interpretable concept representations. While existing evaluations of SAEs focus on metrics such as…

Machine Learning · Computer Science 2026-01-26 Aaron J. Li , Suraj Srinivas , Usha Bhalla , Himabindu Lakkaraju

In data-driven applications relying on tabular data, where interpretability is key, machine learning models such as decision trees and linear regression are applied. Although neural networks can provide higher predictive performance, they…

Machine Learning · Computer Science 2026-03-30 Khawla Elhadri , Jörg Schlötterer , Christin Seifert

Sparse Autoencoders (SAEs) are increasingly used to interpret foundation models, but their role as an actionable intervention space remains less understood, especially in vision. We study whether sparse visual features can be used not only…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Gerasimos Chatzoudis , Zhuowei Li , Gemma E. Moran , Hao Wang , Dimitris N. Metaxas

Integrating high-level semantically correlated contents and low-level anatomical features is of central importance in medical image segmentation. Towards this end, recent deep learning-based medical segmentation methods have shown great…

Computer Vision and Pattern Recognition · Computer Science 2023-07-19 Chenyu You , Weicheng Dai , Yifei Min , Lawrence Staib , James S. Duncan

Accurate and robust prediction of patient's response to drug treatments is critical for developing precision medicine. However, it is often difficult to obtain a sufficient amount of coherent drug response data from patients directly for…

Machine Learning · Computer Science 2021-02-02 Di He , Lei Xie

Artificial Intelligence (AI) has the potential to revolutionize diagnosis and segmentation in medical imaging. However, development and clinical implementation face multiple challenges including limited data availability, lack of…

Image and Video Processing · Electrical Eng. & Systems 2025-01-22 Zelong Liu , Andrew Tieu , Nikhil Patel , Georgios Soultanidis , Louisa Deyer , Ying Wang , Sean Huver , Alexander Zhou , Yunhao Mei , Zahi A. Fayad , Timothy Deyer , Xueyan Mei

Predicting high-dimensional or extreme multilabels, such as in medical coding, requires both accuracy and interpretability. Existing works often rely on local interpretability methods, failing to provide comprehensive explanations of the…

Computation and Language · Computer Science 2025-03-25 John Wu , David Wu , Jimeng Sun

Medical imaging tasks are very challenging due to the lack of publicly available labeled datasets. Hence, it is difficult to achieve high performance with existing deep-learning models as they require a massive labeled dataset to be trained…

Image and Video Processing · Electrical Eng. & Systems 2024-07-23 Anubhav Gupta , Islam Osman , Mohamed S. Shehata , John W. Braun

Previous research on word embeddings has shown that sparse representations, which can be either learned on top of existing dense embeddings or obtained through model constraints during training time, have the benefit of increased…

Computation and Language · Computer Science 2018-09-26 Valentin Trifonov , Octavian-Eugen Ganea , Anna Potapenko , Thomas Hofmann

Accurate and efficient 3D medical image segmentation is essential for clinical AI, where models must remain reliable under stringent memory, latency, and data availability constraints. Transformer-based methods achieve strong accuracy but…

Machine Learning · Computer Science 2026-03-10 Kavyansh Tyagi , Vishwas Rathi , Puneet Goyal

Interpretability is essential in medical imaging to ensure that clinicians can comprehend and trust artificial intelligence models. Several approaches have been recently considered to encode attributes in the latent space to enhance its…

Image and Video Processing · Electrical Eng. & Systems 2024-08-27 Maxime Di Folco , Cosmin I. Bercea , Emily Chan , Julia A. Schnabel

Sparse autoencoders (SAEs) have received considerable recent attention as tools for mechanistic interpretability, showing success at extracting interpretable features even from very large LLMs. However, this research has been largely…

Machine Learning · Computer Science 2025-05-20 Jeremy Budd , Javier Ideami , Benjamin Macdowall Rynne , Keith Duggar , Randall Balestriero

High-precision medical diagnosis relies not only on static imaging features but also on the implicit diagnostic memory experts instantly invoke during image interpretation. We pinpoint a fundamental cognitive misalignment in medical VLMs…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Chunzheng Zhu , Jiaqi Zeng , Junyu Jiang , Jianxin Lin , Yijun Wang

Counterfactual explanations (CEs) aim to enhance the interpretability of machine learning models by illustrating how alterations in input features would affect the resulting predictions. Common CE approaches require an additional model and…

Computer Vision and Pattern Recognition · Computer Science 2024-10-02 Matan Atad , David Schinz , Hendrik Moeller , Robert Graf , Benedikt Wiestler , Daniel Rueckert , Nassir Navab , Jan S. Kirschke , Matthias Keicher

Recent advancements in self-supervised learning have unlocked the potential to harness unlabeled data for auxiliary tasks, facilitating the learning of beneficial priors. This has been particularly advantageous in fields like medical image…

Computer Vision and Pattern Recognition · Computer Science 2024-04-30 Pranav Singh , Jacopo Cirrone

Deep neural networks excel in radiological image classification but frequently suffer from poor interpretability, limiting clinical acceptance. We present MedicalPatchNet, an inherently self-explainable architecture for chest X-ray…

Computer Vision and Pattern Recognition · Computer Science 2026-02-26 Patrick Wienholt , Christiane Kuhl , Jakob Nikolas Kather , Sven Nebelung , Daniel Truhn

Speech holds promise as a cost-effective and non-invasive biomarker for neurological conditions such as Parkinson's disease (PD). While deep learning systems trained on raw audio can find subtle signals not available from hand-crafted…

Audio and Speech Processing · Electrical Eng. & Systems 2025-07-24 Peter Plantinga , Jen-Kai Chen , Roozbeh Sattari , Mirco Ravanelli , Denise Klein

Artificial intelligence (AI) has significant potential in healthcare applications, but its training and deployment faces challenges due to healthcare's diverse data, complex tasks, and the need to preserve privacy. Foundation models that…