English
Related papers

Related papers: ABE: A Unified Framework for Robust and Faithful A…

200 papers

The popularity of machine learning has increased the risk of unfair models getting deployed in high-stake applications, such as justice system, drug/vaccination design, and medical diagnosis. Although there are effective methods to train…

Machine Learning · Computer Science 2022-07-14 Mohit Bajaj , Lingyang Chu , Vittorio Romaniello , Gursimran Singh , Jian Pei , Zirui Zhou , Lanjun Wang , Yong Zhang

Decision-making in complex systems often relies on machine learning models, yet highly accurate models such as XGBoost and neural networks can obscure the reasoning behind their predictions. In operations research applications,…

Machine Learning · Computer Science 2025-02-28 Gaurav Arwade , Sigurdur Olafsson

The field of explainable artificial intelligence (XAI) attempts to develop methods that provide insight into how complicated machine learning methods make predictions. Many methods of explanation have focused on the concept of feature…

Machine Learning · Computer Science 2024-03-13 Kurt Butler , Guanchao Feng , Petar M. Djuric

In the context of human-in-the-loop Machine Learning applications, like Decision Support Systems, interpretability approaches should provide actionable insights without making the users wait. In this paper, we propose Accelerated…

Machine Learning · Computer Science 2021-12-24 David Dandolo , Chiara Masiero , Mattia Carletti , Davide Dalle Pezze , Gian Antonio Susto

Deep neural networks are one of the most successful classifiers across different domains. However, due to their limitations concerning interpretability their use is limited in safety critical context. The research field of explainable…

Machine Learning · Computer Science 2022-05-30 Dominique Mercier , Andreas Dengel , Sheraz Ahmed

The lack of explainability of a decision from an Artificial Intelligence (AI) based "black box" system/model, despite its superiority in many real-world applications, is a key stumbling block for adopting AI in many high stakes applications…

Artificial Intelligence · Computer Science 2021-01-26 Sheikh Rabiul Islam , William Eberle , Sheikh Khaled Ghafoor , Mohiuddin Ahmed

The field of eXplainable Artificial Intelligence (XAI) aims to bring transparency to today's powerful but opaque deep learning models. While local XAI methods explain individual predictions in form of attribution maps, thereby identifying…

Explainability has been a challenge in AI for as long as AI has existed. With the recently increased use of AI in society, it has become more important than ever that AI systems would be able to explain the reasoning behind their results…

Artificial Intelligence · Computer Science 2020-09-30 Kary Främling

Explainable AI (XAI) builds trust in complex systems through model attribution methods that reveal the decision rationale. However, due to the absence of a unified optimal explanation, existing XAI methods lack a ground truth for objective…

Machine Learning · Computer Science 2025-08-06 Yuhan Guo , Lizhong Ding , Shihan Jia , Yanyu Ren , Pengqi Li , Jiarun Fu , Changsheng Li , Ye yuan , Guoren Wang

The trade-off between accuracy and interpretability has long been a challenge in machine learning (ML). This tension is particularly significant for emerging interpretable-by-design methods, which aim to redesign ML algorithms for…

Machine Learning · Computer Science 2025-05-28 Geyu Liang , Senne Michielssen , Salar Fattahi

Machine learning transparency calls for interpretable explanations of how inputs relate to predictions. Feature attribution is a way to analyze the impact of features on predictions. Feature interactions are the contextual dependence…

Machine Learning · Statistics 2020-06-22 Michael Tsang , Sirisha Rambhatla , Yan Liu

Large Language Models (LLMs) are increasingly applied in various science domains, yet their broader adoption remains constrained by a critical challenge: the lack of trustworthy, verifiable outputs. Current LLMs often generate answers…

Computation and Language · Computer Science 2025-09-25 João Eduardo Batista , Emil Vatai , Mohamed Wahib

Feature attribution methods are a popular approach to explain the behavior of machine learning models. They assign importance scores to each input feature, quantifying their influence on the model's prediction. However, evaluating these…

Machine Learning · Computer Science 2025-06-02 Magamed Taimeskhanov , Damien Garreau

AI explainability improves the transparency of models, making them more trustworthy. Such goals are motivated by the emergence of deep learning models, which are obscure by nature; even in the domain of images, where deep learning has…

Machine Learning · Computer Science 2022-03-01 Anna Arias-Duart , Ferran Parés , Dario Garcia-Gasulla , Victor Gimenez-Abalos

The importance of explainability in AI has become a pressing concern, for which several explainable AI (XAI) approaches have been recently proposed. However, most of the available XAI techniques are post-hoc methods, which however may be…

Machine Learning · Computer Science 2022-04-15 Leonardo Lucio Custode , Giovanni Iacca

Explainability in AI is gaining attention in the computer science community in response to the increasing success of deep learning and the important need of justifying how such systems make predictions in life-critical applications. The…

Artificial Intelligence · Computer Science 2020-03-03 David Tuckey , Alessandra Russo , Krysia Broda

Explainable AI (XAI) is increasingly essential as modern models become more complex and high-stakes applications demand transparency, trust, and regulatory compliance. Existing global attribution methods often incur high computational…

Machine Learning · Computer Science 2025-11-21 Poushali Sengupta , Yan Zhang , Frank Eliassen , Sabita Maharjan

Effectiveness and interpretability are two essential properties for trustworthy AI systems. Most recent studies in visual reasoning are dedicated to improving the accuracy of predicted answers, and less attention is paid to explaining the…

Computer Vision and Pattern Recognition · Computer Science 2022-03-14 Shi Chen , Qi Zhao

As the manufacturing industry advances with sensor integration and automation, the opaque nature of deep learning models in machine learning poses a significant challenge for fault detection and diagnosis. And despite the related predictive…

Artificial Intelligence · Computer Science 2024-06-11 Ahmed Maged , Salah Haridy , Herman Shen