English
Related papers

Related papers: Explaining black boxes with a SMILE: Statistical M…

200 papers

Unlike classical lexical overlap metrics such as BLEU, most current evaluation metrics (such as BERTScore or MoverScore) are based on black-box language models such as BERT or XLM-R. They often achieve strong correlations with human…

Computation and Language · Computer Science 2022-03-22 Christoph Leiter , Piyawat Lertvittayakumjorn , Marina Fomicheva , Wei Zhao , Yang Gao , Steffen Eger

Despite the wide use of explainability techniques to attempt to understand the behavior of Artificial Intelligence (AI), the generated explanations may not always be reliable. An explanation can appear plausible to humans but fail to…

Machine Learning · Computer Science 2026-05-28 Tomás Pereira , João Vitorino , Eva Maia , Isabel Praça

Explainability is needed to establish confidence in machine learning results. Some explainable methods take a post hoc approach to explain the weights of machine learning models, others highlight areas of the input contributing to…

Machine Learning · Computer Science 2024-07-15 Paul Whitten , Francis Wolff , Chris Papachristou

In recent years, explainable machine learning methods have been very successful. Despite their success, most explainable machine learning methods are applied to black-box models without any domain knowledge. By incorporating domain…

Machine Learning · Computer Science 2023-09-26 Dangxing Chen

Interpretability and explainability have gained more and more attention in the field of machine learning as they are crucial when it comes to high-stakes decisions and troubleshooting. Since both provide information about predictors and…

Machine Learning · Computer Science 2024-04-26 Benjamin Leblanc , Pascal Germain

In the last years many accurate decision support systems have been constructed as black boxes, that is as systems that hide their internal logic to the user. This lack of explanation constitutes both a practical and an ethical issue. The…

Computers and Society · Computer Science 2018-06-22 Riccardo Guidotti , Anna Monreale , Salvatore Ruggieri , Franco Turini , Dino Pedreschi , Fosca Giannotti

While deep learning makes significant achievements in Artificial Intelligence (AI), the lack of transparency has limited its broad application in various vertical domains. Explainability is not only a gateway between AI and real world, but…

Machine Learning · Computer Science 2020-04-28 Sheng Shi , Yangzhou Du , Wei Fan

In spite of the strong performance of machine learning (ML) models in radiology, they have not been widely accepted by radiologists, limiting clinical integration. A key reason is the lack of explainability, which ensures that model…

Human-Computer Interaction · Computer Science 2026-04-14 Sara Ketabi , Matthias W. Wagner , Birgit Betina Ertl-Wagner , Greg A. Jamieson , Farzad Khalvati

Deep learning methods have been very effective for a variety of medical diagnostic tasks and has even beaten human experts on some of those. However, the black-box nature of the algorithms has restricted clinical use. Recent explainability…

Computer Vision and Pattern Recognition · Computer Science 2020-05-29 Amitojdeep Singh , Sourya Sengupta , Vasudevan Lakshminarayanan

Recent engineering developments in specialised computational hardware, data-acquisition and storage technology have seen the emergence of Machine Learning (ML) as a powerful form of data analysis with widespread applicability beyond its…

Machine Learning · Computer Science 2022-05-19 Ashwin Srinivasan , Michael Bain , Enrico Coiera

Unlike classical lexical overlap metrics such as BLEU, most current evaluation metrics for machine translation (for example, COMET or BERTScore) are based on black-box large language models. They often achieve strong correlations with human…

Computation and Language · Computer Science 2024-11-19 Christoph Leiter , Piyawat Lertvittayakumjorn , Marina Fomicheva , Wei Zhao , Yang Gao , Steffen Eger

Medical imaging diagnosis increasingly relies on Machine Learning (ML) models. This is a task that is often hampered by severely imbalanced datasets, where positive cases can be quite rare. Their use is further compromised by their limited…

Machine Learning · Computer Science 2024-01-26 Yumnah Hasan , Allan de Lima , Fatemeh Amerehi , Darian Reyes Fernandez de Bulnes , Patrick Healy , Conor Ryan

Artificial Intelligence has emerged as a useful aid in numerous clinical applications for diagnosis and treatment decisions. Deep neural networks have shown same or better performance than clinicians in many tasks owing to the rapid…

Image and Video Processing · Electrical Eng. & Systems 2021-11-05 Zohaib Salahuddin , Henry C Woodruff , Avishek Chatterjee , Philippe Lambin

Interpretable machine learning has exploded as an area of interest over the last decade, sparked by the rise of increasingly large datasets and deep neural networks. Simultaneously, large language models (LLMs) have demonstrated remarkable…

Computation and Language · Computer Science 2024-02-06 Chandan Singh , Jeevana Priya Inala , Michel Galley , Rich Caruana , Jianfeng Gao

Malware detection is a constant challenge in cybersecurity due to the rapid development of new attack techniques. Traditional signature-based approaches struggle to keep pace with the sheer volume of malware samples. Machine learning offers…

Cryptography and Security · Computer Science 2024-05-07 Peter Anthony , Francesco Giannini , Michelangelo Diligenti , Martin Homola , Marco Gori , Stefan Balogh , Jan Mojzis

Machine Learning (ML) provides important techniques for classification and predictions. Most of these are black-box models for users and do not provide decision-makers with an explanation. For the sake of transparency or more validity of…

Machine Learning · Computer Science 2021-02-26 Léonard Kwuida , Dmitry I. Ignatov

As black box explanations are increasingly being employed to establish model credibility in high-stakes settings, it is important to ensure that these explanations are accurate and reliable. However, prior work demonstrates that…

Machine Learning · Computer Science 2021-11-09 Dylan Slack , Sophie Hilgard , Sameer Singh , Himabindu Lakkaraju

Machines are being increasingly used in decision-making processes, resulting in the realization that decisions need explanations. Unfortunately, an increasing number of these deployed models are of a 'black-box' nature where the reasoning…

Artificial Intelligence · Computer Science 2023-11-07 Sopam Dasgupta

Deep reinforcement learning (RL) has shown remarkable success in complex domains, however, the inherent black box nature of deep neural network policies raises significant challenges in understanding and trusting the decision-making…

Machine Learning · Computer Science 2025-01-20 Peilang Li , Umer Siddique , Yongcan Cao

The application of machine learning to support the processing of large datasets holds promise in many industries, including financial services. However, practical issues for the full adoption of machine learning remain with the focus being…

Machine Learning · Computer Science 2021-05-14 Ismini Psychoula , Andreas Gutmann , Pradip Mainali , S. H. Lee , Paul Dunphy , Fabien A. P. Petitcolas