English
Related papers

Related papers: Debiased-CAM to mitigate systematic error with fai…

200 papers

The widespread use of black-box AI models has raised the need for algorithms and methods that explain the decisions made by these models. In recent years, the AI research community is increasingly interested in models' explainability since…

Computer Vision and Pattern Recognition · Computer Science 2022-09-28 Savvas Karatsiolis , Andreas Kamilaris

As deep learning models become tasked with more and more decisions that impact human lives, such as criminal recidivism, loan repayment, and face recognition for law enforcement, bias is becoming a growing concern. Debiasing algorithms are…

Machine Learning · Computer Science 2022-04-12 Yash Savani , Colin White , Naveen Sundar Govindarajulu

Machine learning systems have become popular in fields such as marketing, financing, or data mining. While they are highly accurate, complex machine learning systems pose challenges for engineers and users. Their inherent complexity makes…

Computers and Society · Computer Science 2019-07-31 Andrea Papenmeier , Gwenn Englebienne , Christin Seifert

The increased interest in deep learning applications, and their hard-to-detect biases result in the need to validate and explain complex models. However, current explanation methods are limited as far as both the explanation of the…

Computer Vision and Pattern Recognition · Computer Science 2023-01-05 Weronika Hryniewska , Adrianna Grudzień , Przemysław Biecek

Machine learning models have been shown to inherit biases from their training datasets. This can be particularly problematic for vision-language foundation models trained on uncurated datasets scraped from the internet. The biases can be…

Machine Learning · Computer Science 2023-05-16 Ching-Yao Chuang , Varun Jampani , Yuanzhen Li , Antonio Torralba , Stefanie Jegelka

The recent advancements in Deep Learning models and techniques have led to significant strides in performance across diverse tasks and modalities. However, while the overall capabilities of models show promising growth, our understanding of…

Artificial Intelligence · Computer Science 2025-04-04 Erik Arakelyan

Computational models for blind image quality assessment (BIQA) are typically trained in well-controlled laboratory environments with limited generalizability to realistically distorted images. Similarly, BIQA models optimized for images…

Computer Vision and Pattern Recognition · Computer Science 2020-05-21 Weixia Zhang , Kede Ma , Guangtao Zhai , Xiaokang Yang

Explainable artificial intelligence (XAI) plays an indispensable role in demystifying the decision-making processes of AI, especially within the healthcare industry. Clinicians rely heavily on detailed reasoning when making a diagnosis,…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Anna Stubbin , Thompson Chyrikov , Jim Zhao , Christina Chajo

This paper reveals a data bias issue that can severely affect the performance while conducting a machine learning model for malicious URL detection. We describe how such bias can be identified using interpretable machine learning…

Machine Learning · Computer Science 2024-02-12 YunDa Tsai , Cayon Liow , Yin Sheng Siang , Shou-De Lin

Neural networks achieve the state-of-the-art in image classification tasks. However, they can encode spurious variations or biases that may be present in the training data. For example, training an age predictor on a dataset that is not…

Computer Vision and Pattern Recognition · Computer Science 2018-09-28 Mohsan Alvi , Andrew Zisserman , Christoffer Nellaker

Surveillance systems play a critical role in security and reconnaissance, but their performance is often compromised by low-quality images and videos, leading to reduced accuracy in face recognition. Additionally, existing AI-based facial…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Anees Nashath Shaik , Barbara Villarini , Vasileios Argyriou

Explainable AI (XAI) has been proposed as a valuable tool to assist in downstream tasks involving human and AI collaboration. Perhaps the most psychologically valid XAI techniques are case based approaches which display 'whole' exemplars to…

Artificial Intelligence · Computer Science 2023-11-07 Eoin Kenny , Eoin Delaney , Mark Keane

Effectively explaining decisions of black-box machine learning models is critical to responsible deployment of AI systems that rely on them. Recognizing their importance, the field of explainable AI (XAI) provides several techniques to…

Artificial Intelligence · Computer Science 2025-07-25 Yao Rong , Peizhu Qian , Vaibhav Unhelkar , Enkelejda Kasneci

The wide-spread adoption of representation learning technologies in clinical decision making strongly emphasizes the need for characterizing model reliability and enabling rigorous introspection of model behavior. While the former need is…

Machine Learning · Computer Science 2020-05-01 Jayaraman J. Thiagarajan , Prasanna Sattigeri , Deepta Rajan , Bindya Venkatesh

Vision-language models are growing in popularity and public visibility to generate, edit, and caption images at scale; but their outputs can perpetuate and amplify societal biases learned during pre-training on uncurated image-text pairs…

Computer Vision and Pattern Recognition · Computer Science 2023-05-25 Brandon Smith , Miguel Farinha , Siobhan Mackenzie Hall , Hannah Rose Kirk , Aleksandar Shtedritski , Max Bain

The rapid advancement of Vision-Language models (VLMs) has raised growing concerns that their black-box reasoning processes could lead to unintended forms of social bias. Current debiasing approaches focus on mitigating surface-level bias…

Computer Vision and Pattern Recognition · Computer Science 2026-03-02 Na Min An , Yoonna Jang , Yusuke Hirota , Ryo Hachiuma , Isabelle Augenstein , Hyunjung Shim

Teaching unbiased decision-making is crucial for addressing biased decision-making in daily life. Although both raising awareness of personal biases and providing guidance on unbiased decision-making are essential, the latter topics remains…

Human-Computer Interaction · Computer Science 2024-04-09 Mingzhe Yang , Hiromi Arai , Naomi Yamashita , Yukino Baba

Existing multi-view learning models struggle in open-set scenarios due to their implicit assumption of class completeness. Moreover, static view-induced biases, which arise from spurious view-label associations formed during training,…

Computer Vision and Pattern Recognition · Computer Science 2025-08-07 Zihan Fang , Zhiyong Xu , Lan Du , Shide Du , Zhiling Cai , Shiping Wang

Deep learning models, particularly Convolutional Neural Networks (CNNs), have demonstrated exceptional performance in diagnosing skin diseases, often outperforming dermatologists. However, they have also unveiled biases linked to specific…

Computer Vision and Pattern Recognition · Computer Science 2024-05-17 Anshul Pundhir , Balasubramanian Raman , Pravendra Singh

The growing capabilities of AI models are leading to their wider use, including in safety-critical domains. Explainable AI (XAI) aims to make these models safer to use by making their inference process more transparent. However, current…