English
Related papers

Related papers: Interpretable ML Under the Microscope: Performance…

200 papers

While deep neural network models offer unmatched classification performance, they are prone to learning spurious correlations in the data. Such dependencies on confounding information can be difficult to detect using performance metrics if…

Machine Learning · Computer Science 2023-08-09 Susu Sun , Lisa M. Koch , Christian F. Baumgartner

The visual representation of a pre-trained model prioritizes the classifiability on downstream tasks, while the widespread applications for pre-trained visual models have posed new requirements for representation interpretability. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-10-29 Shufan Shen , Zhaobo Qi , Junshu Sun , Qingming Huang , Qi Tian , Shuhui Wang

Mixtures of Hidden Markov Models (MHMMs) are frequently used for clustering of sequential data. An important aspect of MHMMs, as of any clustering approach, is that they can be interpretable, allowing for novel insights to be gained from…

Artificial Intelligence · Computer Science 2021-03-24 Negar Safinianaini , Henrik Boström

We present an interpretable companion model for any pre-trained black-box classifiers. The idea is that for any input, a user can decide to either receive a prediction from the black-box model, with high accuracy but no explanations, or…

Machine Learning · Statistics 2020-02-12 Danqing Pan , Tong Wang , Satoshi Hara

The forecasting of the credit default risk has been an important research field for several decades. Traditionally, logistic regression has been widely recognized as a solution due to its accuracy and interpretability. As a recent trend,…

Computational Finance · Quantitative Finance 2022-09-22 Dangxing Chen , Weicheng Ye , Jiahui Ye

Clinical decisions are high-stakes and require explicit justification, making model interpretability essential for auditing deep clinical models prior to deployment. As the ecosystem of model architectures and explainability methods…

Machine Learning · Computer Science 2026-03-27 Yongda Fan , John Wu , Andrea Fitzpatrick , Naveen Baskaran , Jimeng Sun , Adam Cross

Although modern machine learning and deep learning methods allow for complex and in-depth data analytics, the predictive models generated by these methods are often highly complex, and lack transparency. Explainable AI (XAI) methods are…

Machine Learning · Computer Science 2021-06-17 Mythreyi Velmurugan , Chun Ouyang , Catarina Moreira , Renuka Sindhgatta

Selective inference aims at providing valid inference after a data-driven selection of models or hypotheses. It is essential to avoid overconfident results and replicability issues. While significant advances have been made in this area for…

Methodology · Statistics 2025-03-14 Matteo D'Alessandro , Magne Thoresen

Interpretable machine learning models offer understandable reasoning behind their decision-making process, though they may not always match the performance of their black-box counterparts. This trade-off between interpretability and model…

Artificial Intelligence · Computer Science 2025-03-12 Pranjal Atrey , Michael P. Brundage , Min Wu , Sanghamitra Dutta

While predictive accuracy is often prioritized in machine learning (ML) models, interpretability remains essential in scientific and high-stakes domains. However, diverse interpretability algorithms frequently yield conflicting…

Machine Learning · Computer Science 2026-04-29 Antonio Jesús Banegas-Luna , Horacio Pérez-Sánchez , Carlos Martínez-Cortés

Interpretability provides a means for humans to verify aspects of machine learning (ML) models and empower human+ML teaming in situations where the task cannot be fully automated. Different contexts require explanations with different…

Machine Learning · Computer Science 2024-07-15 Zixi Chen , Varshini Subhash , Marton Havasi , Weiwei Pan , Finale Doshi-Velez

Large Language Models (LLMs) have achieved unprecedented breakthroughs in various natural language processing domains. However, the enigmatic ``black-box'' nature of LLMs remains a significant challenge for interpretability, hampering…

Computation and Language · Computer Science 2023-12-27 Zhen Tan , Tianlong Chen , Zhenyu Zhang , Huan Liu

Macroeconomic nowcasting sits at the intersection of traditional econometrics, data-rich information systems, and AI applications in business, economics, and policy. Machine learning (ML) methods are increasingly used to nowcast quarterly…

Econometrics · Economics 2025-12-02 Luca Attolico

The field of machine learning has seen tremendous progress in recent years, with deep learning models delivering exceptional performance across a range of tasks. However, these models often come at the cost of interpretability, as they…

Machine Learning · Computer Science 2024-01-08 Shun Liu

The successful application of machine learning (ML) methods becomes increasingly dependent on their interpretability or explainability. Designing explainable ML systems is instrumental to ensuring transparency of automated decision-making…

Machine Learning · Computer Science 2022-07-04 L. Zhang , G. Karakasidis , A. Odnoblyudova , L. Dogruel , A. Jung

Recent years have witnessed the rapid growth of machine learning in a wide range of fields such as image recognition, text classification, credit scoring prediction, recommendation system, etc. In spite of their great performance in…

Machine Learning · Computer Science 2021-09-20 Guandong Xu , Tri Dung Duong , Qian Li , Shaowu Liu , Xianzhi Wang

Deep learning approaches have recently been extensively explored for the prognostics of industrial assets. However, they still suffer from a lack of interpretability, which hinders their adoption in safety-critical applications. To improve…

Machine Learning · Computer Science 2024-05-29 Florent Forest , Katharina Rombach , Olga Fink

We propose learning flexible but interpretable functions that aggregate a variable-length set of permutation-invariant feature vectors to predict a label. We use a deep lattice network model so we can architect the model structure to…

Machine Learning · Computer Science 2018-06-04 Andrew Cotter , Maya Gupta , Heinrich Jiang , James Muller , Taman Narayan , Serena Wang , Tao Zhu

There is a growing concern about typically opaque decision-making with high-performance machine learning algorithms. Providing an explanation of the reasoning process in domain-specific terms can be crucial for adoption in risk-sensitive…

Computer Vision and Pattern Recognition · Computer Science 2022-11-28 Aditya Chattopadhyay , Stewart Slocum , Benjamin D. Haeffele , Rene Vidal , Donald Geman

Deep Learning based models are currently dominating most state-of-the-art solutions for disease prediction. Existing works employ RNNs along with multiple levels of attention mechanisms to provide interpretability. These deep learning…

Machine Learning · Statistics 2022-06-01 Subhadip Maji , Raghav Bali , Sree Harsha Ankem , Kishore V Ayyadevara