English
Related papers

Related papers: CAuSE: Decoding Multimodal Classifiers using Faith…

200 papers

How do we learn from biased data? Historical datasets often reflect historical prejudices; sensitive or protected attributes may affect the observed treatments and outcomes. Classification algorithms tasked with predicting outcomes…

Machine Learning · Computer Science 2018-12-04 David Madras , Elliot Creager , Toniann Pitassi , Richard Zemel

Explanation methods and their evaluation have become a significant issue in explainable artificial intelligence (XAI) due to the recent surge of opaque AI models in decision support systems (DSS). Since the most accurate AI models are…

Artificial Intelligence · Computer Science 2023-08-30 Helena Löfström , Karl Hammar , Ulf Johansson

A highly accurate but overconfident model is ill-suited for deployment in critical applications such as healthcare and autonomous driving. The classification outcome should reflect a high uncertainty on ambiguous in-distribution samples…

Machine Learning · Computer Science 2022-10-25 Sumedha Singla , Nihal Murali , Forough Arabshahi , Sofia Triantafyllou , Kayhan Batmanghelich

Chain-of-Thought (CoT) prompting has improved LLM reasoning, but models often generate explanations that appear coherent while containing unfaithful intermediate steps. Existing self-evaluation approaches are prone to inherent biases: the…

Artificial Intelligence · Computer Science 2026-04-21 Yuxi Sun , Aoqi Zuo , Haotian Xie , Wei Gao , Mingming Gong , Jing Ma

Causal modeling has been recognized as a potential solution to many challenging problems in machine learning (ML). Here, we describe how a recently proposed counterfactual approach developed to deconfound linear structural causal models can…

Machine Learning · Computer Science 2020-11-23 Elias Chaibub Neto

Machine learning models are increasingly used in areas such as loan approvals and hiring, yet they often function as black boxes, obscuring their decision-making processes. Transparency is crucial, and individuals need explanations to…

Artificial Intelligence · Computer Science 2024-07-12 Sopam Dasgupta , Joaquín Arias , Elmer Salazar , Gopal Gupta

As machine learning black boxes are increasingly being deployed in domains such as healthcare and criminal justice, there is growing emphasis on building tools and techniques for explaining these black boxes in an interpretable manner. Such…

Machine Learning · Computer Science 2020-02-04 Dylan Slack , Sophie Hilgard , Emily Jia , Sameer Singh , Himabindu Lakkaraju

Most existing debiasing methods for multimodal models, including causal intervention and inference methods, utilize approximate heuristics to represent the biases, such as shallow features from early stages of training or unimodal features…

Machine Learning · Computer Science 2023-11-29 Vaidehi Patil , Adyasha Maharana , Mohit Bansal

Autoencoders have been used for finding interpretable and disentangled features underlying neural network representations in both image and text domains. While the efficacy and pitfalls of such methods are well-studied in vision, there is a…

Machine Learning · Computer Science 2025-02-06 Abhinav Menon , Manish Shrivastava , David Krueger , Ekdeep Singh Lubana

Causal machine learning tools are beginning to see use in real-world policy evaluation tasks to flexibly estimate treatment effects. One issue with these methods is that the machine learning models used are generally black boxes, i.e.,…

Machine Learning · Computer Science 2024-04-01 Patrick Rehill , Nicholas Biddle

The widespread adoption of algorithmic decision-making systems has brought about the necessity to interpret the reasoning behind these decisions. The majority of these systems are complex black box models, and auxiliary models are often…

Human-Computer Interaction · Computer Science 2022-02-28 Md Naimul Hoque , Klaus Mueller

While multimodal AI systems (models jointly trained on heterogeneous data types such as text, time series, graphs, and images) have become ubiquitous and achieved remarkable performance across high-stakes applications, transparent and…

Artificial Intelligence · Computer Science 2025-06-17 Chirag Agarwal

Fairness for machine learning predictions is widely required in practice for legal, ethical, and societal reasons. Existing work typically focuses on settings without unobserved confounding, even though unobserved confounding can lead to…

Machine Learning · Computer Science 2024-10-23 Maresa Schröder , Dennis Frauen , Stefan Feuerriegel

There is a broad consensus on the importance of deep learning models in tasks involving complex data. Often, an adequate understanding of these models is required when focusing on the transparency of decisions in human-critical…

The Causal Roadmap outlines a systematic approach to asking and answering questions of cause-and-effect: define the quantity of interest, evaluate needed assumptions, conduct statistical estimation, and carefully interpret results. To…

Methodology · Statistics 2024-05-30 Nerissa Nance , Maya L. Petersen , Mark van der Laan , Laura B. Balzer

Deep models that are both effective and explainable are desirable in many settings; prior explainable models have been unimodal, offering either image-based visualization of attention weights or text-based generation of post-hoc…

Artificial Intelligence · Computer Science 2018-02-23 Dong Huk Park , Lisa Anne Hendricks , Zeynep Akata , Anna Rohrbach , Bernt Schiele , Trevor Darrell , Marcus Rohrbach

Self-evolving large language models (LLMs) learn by generating their own training tasks and solutions, reducing reliance on human-curated supervision. However, in many reasoning domains, the model must also validate generated tasks and…

Artificial Intelligence · Computer Science 2026-05-28 Bowen Wei , Nan Wang , Yuqing Zhou , Jinhao Pan , Ziwei Zhu

Machine learning model bias can arise from dataset composition: correlated sensitive features can distort the downstream classification model's decision boundary and lead to performance differences along these features. Existing de-biasing…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Miao Zhang , Zee fryer , Ben Colman , Ali Shahriyari , Gaurav Bharaj

Deep learning has led to tremendous success in computer vision, largely due to Convolutional Neural Networks (CNNs). However, CNNs have been shown to be vulnerable to crafted adversarial perturbations. This vulnerability of adversarial…

Machine Learning · Computer Science 2026-01-21 Hichem Debbi

Model robustness to bias is often determined by the generalization on carefully designed out-of-distribution datasets. Recent debiasing methods in natural language understanding (NLU) improve performance on such datasets by pressuring…

Computation and Language · Computer Science 2021-09-10 Michael Mendelson , Yonatan Belinkov