English
Related papers

Related papers: Measuring Implicit Bias Using SHAP Feature Importa…

200 papers

In recent years, diffusion models, and more generally score-based deep generative models, have achieved remarkable success in various applications, including image and audio generation. In this paper, we view diffusion models as an implicit…

Statistics Theory · Mathematics 2026-02-12 Hyeok Kyu Kwon , Dongha Kim , Ilsang Ohn , Minwoo Chae

Feature selection is a vital technique in machine learning, as it can reduce computational complexity, improve model performance, and mitigate the risk of overfitting. However, the increasing complexity and dimensionality of datasets pose…

Machine Learning · Computer Science 2024-07-24 Yuepeng Chen , Weiping Ding , Hengrong Ju , Jiashuang Huang , Tao Yin

It is evident that deep text classification models trained on human data could be biased. In particular, they produce biased outcomes for texts that explicitly include identity terms of certain demographic groups. We refer to this type of…

Computation and Language · Computer Science 2021-05-07 Haochen Liu , Wei Jin , Hamid Karimi , Zitao Liu , Jiliang Tang

Designing machine learning algorithms that are accurate yet fair, not discriminating based on any sensitive attribute, is of paramount importance for society to accept AI for critical applications. In this article, we propose a novel fair…

Machine Learning · Computer Science 2023-12-04 Adam Gronowski , William Paul , Fady Alajaji , Bahman Gharesifard , Philippe Burlina

We consider a fair representation learning perspective, where optimal predictors, on top of the data representation, are ensured to be invariant with respect to different sub-groups. Specifically, we formulate this intuition as a bi-level…

Machine Learning · Computer Science 2022-05-27 Changjian Shui , Qi Chen , Jiaqi Li , Boyu Wang , Christian Gagné

Visual explanation maps enhance the trustworthiness of decisions made by deep learning models and offer valuable guidance for developing new algorithms in image recognition tasks. Class activation maps (CAM) and their variants (e.g.,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-30 Yi Liao , Ugochukwu Ejike Akpudo , Jue Zhang , Yongsheng Gao , Jun Zhou , Wenyi Zeng , Weichuan Zhang

Previous works on the fairness of toxic language classifiers compare the output of models with different identity terms as input features but do not consider the impact of other important concepts present in the context. Here, besides…

Computation and Language · Computer Science 2022-10-20 Isar Nejadgholi , Esma Balkır , Kathleen C. Fraser , Svetlana Kiritchenko

Conditional Feature Importance (CFI) is a classical variable importance measure that accounts for the relationship between the studied feature and the others. However, CFI has not yet been studied from a theoretical perspective because the…

Statistics Theory · Mathematics 2026-02-03 Angel Reyero-Lobo , Pierre Neuvial , Bertrand Thirion

Algorithm fairness has become a central problem for the broad adoption of artificial intelligence. Although the past decade has witnessed an explosion of excellent work studying algorithm biases, achieving fairness in real-world AI…

Machine Learning · Computer Science 2023-09-06 James Enouen , Tianshu Sun , Yan Liu

Feature importance aims at measuring how crucial each input feature is for model prediction. It is widely used in feature engineering, model selection and explainable artificial intelligence (XAI). In this paper, we propose a new tree-model…

Machine Learning · Statistics 2020-09-17 Fan Fang , Carmine Ventre , Lingbo Li , Leslie Kanthan , Fan Wu , Michail Basios

Understanding the decisions of deep learning (DL) models is essential for the acceptance of DL to risk-sensitive applications. Although methods, like class activation maps (CAMs), give a glimpse into the black box, they do miss some crucial…

Computer Vision and Pattern Recognition · Computer Science 2024-10-23 Yanli Li , Tahereh Hassanzadeh , Denis P. Shamonin , Monique Reijnierse , Annette H. M. van der Helm-van Mil , Berend C. Stoel

As an important problem in modern data analytics, classification has witnessed varieties of applications from different domains. Different from conventional classification approaches, fair classification concerns the issues of unintentional…

Machine Learning · Statistics 2020-12-25 Qing Ye , Weijun Xie

Feature selection is an essential process in machine learning, especially when dealing with high-dimensional datasets. It helps reduce the complexity of machine learning models, improve performance, mitigate overfitting, and decrease…

Machine Learning · Computer Science 2024-10-10 Egor Kraev , Baran Koseoglu , Luca Traverso , Mohammed Topiwalla

In many applications of computer vision it is important to accurately estimate the trajectory of an object over time by fusing data from a number of sources, of which 2D and 3D imagery is only one. In this paper, we show how to use a deep…

Computer Vision and Pattern Recognition · Computer Science 2021-12-06 Fan Jiang , Andrew Marmon , Ildebrando De Courten , Marc Rasi , Frank Dellaert

Understanding why a model makes a certain prediction can be as crucial as the prediction's accuracy in many applications. However, the highest accuracy for large modern datasets is often achieved by complex models that even experts struggle…

Artificial Intelligence · Computer Science 2017-11-28 Scott Lundberg , Su-In Lee

Matching of binary image features is an important step in many different computer vision applications. Conventionally, an arbitrary threshold is used to identify a correct match from incorrect matches using Hamming distance which may…

Computer Vision and Pattern Recognition · Computer Science 2017-04-21 Erkan Bostanci , Nadia Kanwal , Betul Bostanci , Mehmet Serdar Guzel

The paper introduces a white-box attack on computer vision models using SHAP values. It demonstrates how adversarial evasion attacks can compromise the performance of deep learning models by reducing output confidence or inducing…

Computer Vision and Pattern Recognition · Computer Science 2026-04-13 Frank Mollard , Marcus Becker , Florian Roehrbein

Artificial Intelligence algorithms have now become pervasive in multiple high-stakes domains. However, their internal logic can be obscure to humans. Explainable Artificial Intelligence aims to design tools and techniques to illustrate the…

Human-Computer Interaction · Computer Science 2024-04-29 Eleonora Cappuccio , Daniele Fadda , Rosa Lanzilotti , Salvatore Rinzivillo

Current practice in interpretable machine learning often focuses on explaining the final model trained from data, e.g., by using the Shapley additive explanations (SHAP) method. The recently developed Shapley variable importance cloud…

Machine Learning · Computer Science 2022-12-19 Yilin Ning , Mingxuan Liu , Nan Liu

Unbiased data collection is essential to guaranteeing fairness in artificial intelligence models. Implicit bias, a form of behavioral conditioning that leads us to attribute predetermined characteristics to members of certain groups and…

Artificial Intelligence · Computer Science 2020-03-03 Rupam Acharyya , Shouman Das , Ankani Chattoraj , Oishani Sengupta , Md Iftekar Tanveer