English
Related papers

Related papers: Sparse Autoencoders as Plug-and-Play Firewalls for…

200 papers

Although deep neural networks (DNNs) have shown impressive performance on many perceptual tasks, they are vulnerable to adversarial examples that are generated by adding slight but maliciously crafted perturbations to benign images.…

Machine Learning · Computer Science 2022-10-18 Hui Liu , Bo Zhao , Kehuan Zhang , Peng Liu

Sparse Autoencoders (SAEs) can efficiently identify candidate monosemantic features from pretrained neural networks for galaxy morphology. We demonstrate this on Euclid Q1 images using both supervised (Zoobot) and new self-supervised (MAE)…

Instrumentation and Methods for Astrophysics · Physics 2025-11-13 John F. Wu , Michael Walmsley

Currently, a plethora of saliency models based on deep neural networks have led great breakthroughs in many complex high-level vision tasks (e.g. scene description, object detection). The robustness of these models, however, has not yet…

Computer Vision and Pattern Recognition · Computer Science 2019-04-03 Zhaohui Che , Ali Borji , Guangtao Zhai , Suiyi Ling , Guodong Guo , Patrick Le Callet

Recent advances in explainable machine learning have highlighted the potential of sparse autoencoders in uncovering mono-semantic features in densely encoded embeddings. While most research has focused on Large Language Model (LLM)…

Computation and Language · Computer Science 2025-02-04 Daniel Pluth , Yu Zhou , Vijay K. Gurbani

Machine learning malware detectors are vulnerable to adversarial EXEmples, i.e., carefully-crafted Windows programs tailored to evade detection. Unlike other adversarial problems, attacks in this context must be functionality-preserving, a…

Machine Learning · Computer Science 2026-01-14 Marco Rando , Luca Demetrio , Lorenzo Rosasco , Fabio Roli

Active learning aims to develop label-efficient algorithms by sampling the most representative queries to be labeled by an oracle. We describe a pool-based semi-supervised active learning algorithm that implicitly learns this sampling…

Machine Learning · Computer Science 2019-10-30 Samarth Sinha , Sayna Ebrahimi , Trevor Darrell

Sparse autoencoders (SAEs) are a promising approach to interpreting the internal representations of transformer language models. However, SAEs are usually trained separately on each transformer layer, making it difficult to use them to…

Machine Learning · Computer Science 2025-02-25 Tim Lawson , Lucy Farnik , Conor Houghton , Laurence Aitchison

Recent advances in adversarial Deep Learning (DL) have opened up a largely unexplored surface for malicious attacks jeopardizing the integrity of autonomous DL systems. With the wide-spread usage of DL in critical and time-sensitive…

Cryptography and Security · Computer Science 2018-08-22 Bita Darvish Rouhani , Mohammad Samragh , Mojan Javaheripi , Tara Javidi , Farinaz Koushanfar

Sparse Autoencoders (SAEs) have emerged as a promising solution for decomposing large language model representations into interpretable features. However, Paulo and Belrose (2025) have highlighted instability across different initialization…

Machine Learning · Computer Science 2025-06-24 Seonglae Cho , Harryn Oh , Donghyun Lee , Luis Eduardo Rodrigues Vieira , Andrew Bermingham , Ziad El Sayed

Sparse autoencoders (SAEs) have emerged as a promising approach for learning interpretable features from neural network activations. However, the optimization landscape for SAE training can be challenging due to correlations in the input…

Machine Learning · Computer Science 2025-11-19 Ashwin Saraswatula , David Klindt

Deep learning based intrusion detection systems (DL-based IDS) have emerged as one of the best choices for providing security solutions against various network intrusion attacks. However, due to the emergence and development of adversarial…

Cryptography and Security · Computer Science 2023-12-12 Xinwei Yuan , Shu Han , Wei Huang , Hongliang Ye , Xianglong Kong , Fan Zhang

Research into adversarial examples (AE) has developed rapidly, yet static adversarial patches are still the main technique for conducting attacks in the real world, despite being obvious, semi-permanent and unmodifiable once deployed. In…

Computer Vision and Pattern Recognition · Computer Science 2021-01-07 Giulio Lovisotto , Henry Turner , Ivo Sluganovic , Martin Strohmeier , Ivan Martinovic

Distributed learning and Edge AI necessitate efficient data processing, low-latency communication, decentralized model training, and stringent data privacy to facilitate real-time intelligence on edge devices while reducing dependency on…

Machine Learning · Computer Science 2025-07-08 Lucas Heublein , Simon Kocher , Tobias Feigl , Alexander Rügamer , Christopher Mutschler , Felix Ott

This work introduces a novel method for enhancing confidence in anomaly detection in Intrusion Detection Systems (IDS) through the use of a Variational Autoencoder (VAE) architecture. By developing a confidence metric derived from latent…

Cryptography and Security · Computer Science 2024-09-24 Ioannis Pitsiorlas , George Arvanitakis , Marios Kountouris

Image and language modeling is of crucial importance for vision-language pre-training (VLP), which aims to learn multi-modal representations from large-scale paired image-text data. However, we observe that most existing VLP methods focus…

Computer Vision and Pattern Recognition · Computer Science 2022-08-22 Sunan He , Taian Guo , Tao Dai , Ruizhi Qiao , Chen Wu , Xiujun Shu , Bo Ren

Sparse Autoencoders (SAEs) have been proposed as an unsupervised approach to learn a decomposition of a model's latent space. This enables useful applications such as steering - influencing the output of a model towards a desired concept -…

Machine Learning · Computer Science 2025-12-23 Dana Arad , Aaron Mueller , Yonatan Belinkov

Sparse autoencoders (SAEs) offer a natural path toward comparable explanations across different representation spaces. However, current SAEs are trained per modality, producing dictionaries whose features are not directly understandable and…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Difei Gu , Yunhe Gao , Gerasimos Chatzoudis , Zihan Dong , Guoning Zhang , Bangwei Guo , Yang Zhou , Mu Zhou , Dimitris Metaxas

Sparse autoencoders (SAEs) are widely used to extract interpretable features from neural network representations, often under the implicit assumption that concepts correspond to independent linear directions. However, a growing body of…

Large Vision-Language Models (LVLMs) have shown remarkable capabilities across a wide range of multimodal tasks. However, their integration of visual inputs introduces expanded attack surfaces, thereby exposing them to novel security…

Computation and Language · Computer Science 2025-05-29 Juan Ren , Mark Dras , Usman Naseem

Effective crime linkage analysis is crucial for identifying serial offenders and enhancing public safety. To address limitations of traditional crime linkage methods in handling high-dimensional, sparse, and heterogeneous data, we propose a…

Machine Learning · Computer Science 2026-01-13 Yicheng Zhan , Fahim Ahmed , Amy Burrell , Matthew J. Tonkin , Sarah Galambos , Jessica Woodhams , Dalal Alrajeh
‹ Prev 1 8 9 10 Next ›