English
Related papers

Related papers: Preserving Task-Relevant Information Under Linear …

200 papers

Explaining deep learning models is of vital importance for understanding artificial intelligence systems, improving safety, and evaluating fairness. To better understand and control the CNN model, many methods for…

Machine Learning · Computer Science 2022-11-24 Zhihao Wang , Chuang Zhu

This paper evaluates whether training a decision tree based on concepts extracted from a concept-based explainer can increase interpretability for Convolutional Neural Networks (CNNs) models and boost the fidelity and performance of the…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Gayda Mutahar , Tim Miller

Learning representations unaffected by superficial characteristics is important to ensure that shifts in these characteristics at test time do not compromise downstream prediction performance. For instance, in healthcare applications, we…

Machine Learning · Computer Science 2025-07-28 Minghui Sun , Benjamin A. Goldstein , Matthew M. Engelhard

Unsupervised Concept Extraction aims to extract concepts from a single image; however, existing methods suffer from the inability to extract composable intrinsic concepts. To address this, this paper introduces a new task called…

Computer Vision and Pattern Recognition · Computer Science 2026-04-13 Hanyu Shi , Hong Tao , Guoheng Huang , Jianbin Jiang , Xuhang Chen , Chi-Man Pun , Shanhu Wang , Pan Pan

Pre-trained language models have achieved remarkable success across diverse applications but remain susceptible to spurious, concept-driven correlations that impair robustness and fairness. In this work, we introduce CURE, a novel and…

Computation and Language · Computer Science 2025-09-11 Aysenur Kocak , Shuo Yang , Bardh Prenkaj , Gjergji Kasneci

Concept erasure aims to remove specified features from an embedding. It can improve fairness (e.g. preventing a classifier from using gender or race) and interpretability (e.g. removing a concept to observe changes in model behavior). We…

Machine Learning · Computer Science 2025-04-04 Nora Belrose , David Schneider-Joseph , Shauli Ravfogel , Ryan Cotterell , Edward Raff , Stella Biderman

As large-scale diffusion models continue to advance, they excel at producing high-quality images but often generate unwanted content, such as sexually explicit or violent content. Existing methods for concept removal generally guide the…

Computer Vision and Pattern Recognition · Computer Science 2024-12-04 Lingyun Zhang , Yu Xie , Yanwei Fu , Ping Chen

Amnesic probing is a technique used to examine the influence of specific linguistic information on the behaviour of a model. This involves identifying and removing the relevant information and then assessing whether the model's performance…

Computation and Language · Computer Science 2025-06-16 Alicja Dobrzeniecka , Antske Fokkens , Pia Sommerauer

While significant advances exist in pseudo-label generation for semi-supervised semantic segmentation, pseudo-label selection remains understudied. Existing methods typically use fixed confidence thresholds to retain high-confidence…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Pan Liu , Jinshi Liu

The industry 4.0 is leveraging digital technologies and machine learning techniques to connect and optimize manufacturing processes. Central to this idea is the ability to transform raw data into human understandable knowledge for reliable…

Artificial Intelligence · Computer Science 2023-06-07 Andrés Felipe Posada-Moreno , Kai Müller , Florian Brillowski , Friedrich Solowjow , Thomas Gries , Sebastian Trimpe

It is well known that attention mechanisms can effectively improve the performance of many CNNs including object detectors. Instead of refining feature maps prevalently, we reduce the prohibitive computational complexity by a novel attempt…

Computer Vision and Pattern Recognition · Computer Science 2020-02-05 Hefei Ling , Yangyang Qin , Li Zhang , Yuxuan Shi , Ping Li

Concept erasure in text-to-image diffusion models aims to disable pre-trained diffusion models from generating images related to a target concept. To perform reliable concept erasure, the properties of robustness and locality are desirable.…

Computer Vision and Pattern Recognition · Computer Science 2024-07-19 Chi-Pin Huang , Kai-Po Chang , Chung-Ting Tsai , Yung-Hsuan Lai , Fu-En Yang , Yu-Chiang Frank Wang

Erasing specific concepts from text-to-image diffusion models is essential for avoiding the generation of copyrighted and explicit content. Closed-form concept erasure methods offer a fast alternative to backpropagation-based techniques,…

Machine Learning · Computer Science 2026-05-12 Nicola Novello , Andrea M. Tonello

Text-to-image diffusion models have achieved remarkable progress, yet their use raises copyright and misuse concerns, prompting research into machine unlearning. However, extending multi-concept unlearning to large-scale scenarios remains…

Machine Learning · Computer Science 2026-05-19 Kaiyuan Deng , Gen Li , Yang Xiao , Bo Hui , Xiaolong Ma

Semantic segmentation and instance level segmentation made substantial progress in recent years due to the emergence of deep neural networks (DNNs). A number of deep architectures with Convolution Neural Networks (CNNs) were proposed that…

Computer Vision and Pattern Recognition · Computer Science 2019-09-18 Pulak Purkait , Christopher Zach , Ian Reid

We investigate the behavior of methods that use linear projections to remove information about a concept from a language representation, and we consider the question of what happens to a dataset transformed by such a method. A theoretical…

Computation and Language · Computer Science 2024-03-26 Richard Johansson

We introduce Projection-based Reduction of Implicit Spurious bias in vision-language Models (PRISM), a new data-free and task-agnostic solution for bias mitigation in VLMs like CLIP. VLMs often inherit and amplify biases in their training…

Computer Vision and Pattern Recognition · Computer Science 2025-07-15 Mahdiyar Molahasani , Azadeh Motamedi , Michael Greenspan , Il-Min Kim , Ali Etemad

Techniques for concept extraction, such as sparse autoencoders and transcoders, aim to extract high-level symbolic concepts from low-level nonsymbolic representations. When these extracted concepts are used for downstream tasks such as…

Machine Learning · Computer Science 2026-04-29 Chandler Squires , Pradeep Ravikumar

With the popularity of deep neural networks (DNNs), model interpretability is becoming a critical concern. Many approaches have been developed to tackle the problem through post-hoc analysis, such as explaining how predictions are made or…

Computer Vision and Pattern Recognition · Computer Science 2023-07-11 Haixing Dai , Lu Zhang , Lin Zhao , Zihao Wu , Zhengliang Liu , David Liu , Xiaowei Yu , Yanjun Lyu , Changying Li , Ninghao Liu , Tianming Liu , Dajiang Zhu

As a subset of unsupervised representation learning, self-supervised representation learning adopts self-defined signals as supervision and uses the learned representation for downstream tasks, such as object detection and image captioning.…

Machine Learning · Computer Science 2021-03-24 Yao-Hung Hubert Tsai , Yue Wu , Ruslan Salakhutdinov , Louis-Philippe Morency