English
Related papers

Related papers: Improving Prediction Performance and Model Interpr…

200 papers

Explainability is motivated by the lack of transparency of black-box Machine Learning approaches, which do not foster trust and acceptance of Machine Learning algorithms. This also happens in the Predictive Process Monitoring field, where…

Artificial Intelligence · Computer Science 2025-07-25 Williams Rizzi , Marco Comuzzi , Chiara Di Francescomarino , Chiara Ghidini , Suhwan Lee , Fabrizio Maria Maggi , Alexander Nolte

There is a growing concern about typically opaque decision-making with high-performance machine learning algorithms. Providing an explanation of the reasoning process in domain-specific terms can be crucial for adoption in risk-sensitive…

Computer Vision and Pattern Recognition · Computer Science 2022-11-28 Aditya Chattopadhyay , Stewart Slocum , Benjamin D. Haeffele , Rene Vidal , Donald Geman

Causal machine learning tools are beginning to see use in real-world policy evaluation tasks to flexibly estimate treatment effects. One issue with these methods is that the machine learning models used are generally black boxes, i.e.,…

Machine Learning · Computer Science 2024-04-01 Patrick Rehill , Nicholas Biddle

Inspired by recent work in attention models for image captioning and question answering, we present a soft attention model for the reinforcement learning domain. This model uses a soft, top-down attention mechanism to create a bottleneck in…

Machine Learning · Computer Science 2019-06-07 Alex Mott , Daniel Zoran , Mike Chrzanowski , Daan Wierstra , Danilo J. Rezende

In recent years, deep learning researchers have focused on how to find the interpretability behind deep learning models. However, today cognitive competence of human has not completely covered the deep learning model. In other words, there…

Machine Learning · Computer Science 2018-12-04 Jinwei Zhao , Qizhou Wang , Yufei Wang , Xinhong Hei , Yu Liu

With the broader and highly successful usage of machine learning in industry and the sciences, there has been a growing demand for Explainable AI. Interpretability and explanation methods for gaining a better understanding about the problem…

Machine Learning · Computer Science 2021-02-26 Wojciech Samek , Grégoire Montavon , Sebastian Lapuschkin , Christopher J. Anders , Klaus-Robert Müller

Machines are being increasingly used in decision-making processes, resulting in the realization that decisions need explanations. Unfortunately, an increasing number of these deployed models are of a 'black-box' nature where the reasoning…

Artificial Intelligence · Computer Science 2023-11-07 Sopam Dasgupta

In this review, we examine the problem of designing interpretable and explainable machine learning models. Interpretability and explainability lie at the core of many machine learning and statistical applications in medicine, economics,…

Machine Learning · Computer Science 2023-03-02 Ričards Marcinkevičs , Julia E. Vogt

The debate around the interpretability of attention mechanisms is centered on whether attention scores can be used as a proxy for the relative amounts of signal carried by sub-components of data. We propose to study the interpretability of…

Machine Learning · Computer Science 2022-07-27 Jonathan Haab , Nicolas Deutschmann , Maria Rodríguez Martínez

Evaluation of students' performance for the completion of courses has been a major problem for both students and faculties during the work-from-home period in this COVID pandemic situation. To this end, this paper presents an in-depth…

Machine Learning · Computer Science 2020-09-08 Vipul Bansal , Himanshu Buckchash , Balasubramanian Raman

Deep neural network models have recently draw lots of attention, as it consistently produce impressive results in many computer vision tasks such as image classification, object detection, etc. However, interpreting such model and show the…

Machine Learning · Computer Science 2019-01-30 Shipeng Xie , Da Chen , Rong Zhang , Hui Xue

Machine learning technologies are increasingly developed for use in healthcare. While research communities have focused on creating state-of-the-art models, there has been less focus on real world implementation and the associated…

Computers and Society · Computer Science 2019-12-10 Mark Sendak , Madeleine Elish , Michael Gao , Joseph Futoma , William Ratliff , Marshall Nichols , Armando Bedoya , Suresh Balu , Cara O'Brien

Deep neural networks have achieved remarkable success in various challenging tasks. However, the black-box nature of such networks is not acceptable to critical applications, such as healthcare. In particular, the existence of adversarial…

Machine Learning · Computer Science 2019-09-12 Shaeke Salman , Seyedeh Neelufar Payrovnaziri , Xiuwen Liu , Pablo Rengifo-Moreno , Zhe He

Studying the reliability of complex systems using machine learning techniques involves facing a series of technical and practical challenges, ranging from the intrinsic nature of the system and data to the difficulties in modeling and…

Machine Learning · Computer Science 2024-10-08 Maria Luz Gamiz , Fernando Navas-Gomez , Rafael Nozal-Cañadas , Rocio Raya-Miranda

Recent advances in Deep Learning have greatly improved performance on various tasks such as object detection, image segmentation, sentiment analysis. The focus of most research directions up until very recently has been on beating…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Cristian Simionescu

Language models based on the Transformer architecture achieve excellent results in many language-related tasks, such as text classification or sentiment analysis. However, despite the architecture of these models being well-defined, little…

Computation and Language · Computer Science 2025-04-14 Miguel López-Otal , Jorge Gracia , Jordi Bernad , Carlos Bobed , Lucía Pitarch-Ballesteros , Emma Anglés-Herrero

Machine learning (ML) in general and deep learning (DL) in particular has become an extremely popular tool in several vision applications (like object detection, super resolution, segmentation, object tracking etc.). Almost in parallel, the…

Computer Vision and Pattern Recognition · Computer Science 2021-12-21 Manish Narwaria

Recently, interpretable machine learning has re-explored concept bottleneck models (CBM). An advantage of this model class is the user's ability to intervene on predicted concept values, affecting the downstream output. In this work, we…

Machine Learning · Computer Science 2024-10-29 Sonia Laguna , Ričards Marcinkevičs , Moritz Vandenhirtz , Julia E. Vogt

Neural networks are ubiquitous in applied machine learning for education. Their pervasive success in predictive performance comes alongside a severe weakness, the lack of explainability of their decisions, especially relevant in…

Machine Learning · Computer Science 2022-07-04 Vinitra Swamy , Bahar Radmehr , Natasa Krco , Mirko Marras , Tanja Käser

While the uptake of data-driven approaches for materials science and chemistry is at an exciting, early stage, to realise the true potential of machine learning models for successful scientific discovery, they must have qualities beyond…

Materials Science · Physics 2022-06-28 Felipe Oviedo , Juan Lavista Ferres , Tonio Buonassisi , Keith Butler