English
Related papers

Related papers: Measuring Cross-Modal Interactions in Multimodal M…

200 papers

Multimodal AI models have achieved impressive performance in tasks that require integrating information from multiple modalities, such as vision and language. However, their "black-box" nature poses a major barrier to deployment in…

Artificial Intelligence · Computer Science 2026-02-18 Zhanliang Wang , Kai Wang

Multimodal deep learning for cancer prognosis is commonly assumed to benefit from synergistic cross-modal interactions, yet this assumption has not been directly tested in survival prediction settings. This work adapts InterSHAP, a Shapley…

Machine Learning · Computer Science 2026-04-15 Iain Swift , JingHua Ye , Ruairi O'Reilly

Hyperparameters tuning is a fundamental, yet computationally expensive, step in optimizing machine learning models. Beyond optimization, understanding the relative importance and interaction of hyperparameters is critical to efficient model…

Machine Learning · Computer Science 2025-12-23 Moncef Garouani , Ayah Barhrhouj

As deep learning advances, there is an ever-growing demand for models capable of synthesizing information from multi-modal resources to address the complex tasks raised from real-life applications. Recently, many large multi-modal datasets…

Machine Learning · Computer Science 2022-05-03 Pengbo Hu , Xingyu Li , Yi Zhou

Hyperparameter optimization (HPO) is a crucial step in achieving strong predictive performance. Yet, the impact of individual hyperparameters on model generalization is highly context-dependent, prohibiting a one-size-fits-all solution and…

Machine Learning · Computer Science 2025-11-11 Marcel Wever , Maximilian Muschalik , Fabian Fumagalli , Marius Lindauer

Humans are sophisticated at reading interlocutors' emotions from multimodal signals, such as speech contents, voice tones and facial expressions. However, machines might struggle to understand various emotions due to the difficulty of…

Artificial Intelligence · Computer Science 2022-12-21 Feng Qiu , Wanzeng Kong , Yu Ding

Predictive black-box models can exhibit high accuracy but their opaque nature hinders their uptake in safety-critical deployment environments. Explanation methods (XAI) can provide confidence for decision-making through increased…

Machine Learning · Statistics 2023-06-27 Lucile Ter-Minassian , Oscar Clivio , Karla Diaz-Ordaz , Robin J. Evans , Chris Holmes

When using machine learning techniques in decision-making processes, the interpretability of the models is important. Shapley additive explanation (SHAP) is one of the most promising interpretation methods for machine learning models.…

Machine Learning · Computer Science 2022-08-08 Yasunobu Nohara , Toyoshi Inoguchi , Chinatsu Nojiri , Naoki Nakashima

Explaining machine learning (ML) models using eXplainable AI (XAI) techniques has become essential to make them more transparent and trustworthy. This is especially important in high-stakes domains like healthcare, where understanding model…

Machine Learning · Computer Science 2025-12-04 Felix Tempel , Daniel Groos , Espen Alexander F. Ihlen , Lars Adde , Inga Strümke

In the field of eXplainable AI (XAI), robust "blackbox" algorithms such as Convolutional Neural Networks (CNNs) are known for making high prediction performance. However, the ability to explain and interpret these algorithms still require…

Machine Learning · Computer Science 2021-11-25 Shaw-Hwa Lo , Yiqiao Yin

eXplainable Artificial Intelligence (XAI) is a sub-field of Artificial Intelligence (AI) that is at the forefront of AI research. In XAI, feature attribution methods produce explanations in the form of feature importance. People often use…

Artificial Intelligence · Computer Science 2022-02-09 Jamie Duell , Monika Seisenberger , Gert Aarts , Shangming Zhou , Xiuyi Fan

Multimodal learning has witnessed remarkable advancements in recent years, particularly with the integration of attention-based models, leading to significant performance gains across a variety of tasks. Parallel to this progress, the…

Machine Learning · Computer Science 2026-04-28 Md Raisul Kibria , Sébastien Lafond , Janan Arslan

In high-stakes domains, such as healthcare and industry, the explainability of AI-based decision-making has become crucial. Without insight into model reasoning, the reliability of these models cannot be ensured. Applications often rely on…

Artificial Intelligence · Computer Science 2026-04-24 Annemarie Jutte , Faizan Ahmed , Jeroen Linssen , Maurice van Keulen

SHAP is a popular approach to explain black-box models by revealing the importance of individual features. As it ignores feature interactions, SHAP explanations can be confusing up to misleading. NSHAP, on the other hand, reports the…

Machine Learning · Computer Science 2024-04-22 Sascha Xu , Joscha Cüppers , Jilles Vreeken

Explainable Artificial Intelligence (XAI) is essential for the transparency and clinical adoption of Clinical Decision Support Systems (CDSS). However, the real-world effectiveness of existing XAI methods remains limited and is…

Machine Learning · Computer Science 2026-01-26 Alessandro Gambetti , Qiwei Han , Hong Shen , Claudia Soares

While shallow decision trees may be interpretable, larger ensemble models like gradient-boosted trees, which often set the state of the art in machine learning problems involving tabular data, still remain black box models. As a remedy, the…

Machine Learning · Computer Science 2024-06-21 Maximilian Muschalik , Fabian Fumagalli , Barbara Hammer , Eyke Hüllermeier

This study proposes DeltaSHAP, a novel explainable artificial intelligence (XAI) algorithm specifically designed for online patient monitoring systems. In clinical environments, discovering the causes driving patient risk evolution is…

Machine Learning · Computer Science 2025-07-15 Changhun Kim , Yechan Mun , Sangchul Hahn , Eunho Yang

Predominately in explainable artificial intelligence (XAI) research, the Shapley value (SV) is applied to determine feature attributions for any black box model. Shapley interaction indices extend the SV to define any-order feature…

Machine Learning · Computer Science 2023-10-31 Fabian Fumagalli , Maximilian Muschalik , Patrick Kolpaczki , Eyke Hüllermeier , Barbara Hammer

Integrating heterogeneous biomedical data including imaging, omics, and clinical records supports accurate diagnosis and personalised care. Graph-based models fuse such non-Euclidean data by capturing spatial and relational structure, yet…

Genomics · Quantitative Biology 2025-05-06 Alireza Sadeghi , Farshid Hajati , Ahmadreza Argha , Nigel H Lovell , Min Yang , Hamid Alinejad-Rokny

Vision and language models (VL) are known to exploit unrobust indicators in individual modalities (e.g., introduced by distributional biases) instead of focusing on relevant information in each modality. That a unimodal model achieves…

Computer Vision and Pattern Recognition · Computer Science 2024-09-20 Letitia Parcalabescu , Anette Frank
‹ Prev 1 2 3 10 Next ›