English
Related papers

Related papers: Measuring Cross-Modal Interactions in Multimodal M…

200 papers

We share observations and challenges from an ongoing effort to implement Explainable AI (XAI) in a domain-specific workflow for cybersecurity analysts. Specifically, we briefly describe a preliminary case study on the use of XAI for source…

Human-Computer Interaction · Computer Science 2024-08-12 Ashley Suh , Harry Li , Caitlin Kenney , Kenneth Alperin , Steven R. Gomez

While artificial intelligence (AI) has made many successful applications in various domains, its adoption in healthcare lags a little bit behind other high-stakes settings. Several factors contribute to this slower uptake, including…

Artificial Intelligence · Computer Science 2023-08-10 Soheyla Amirian , Luke A. Carlson , Matthew F. Gong , Ines Lohse , Kurt R. Weiss , Johannes F. Plate , Ahmad P. Tafti

Sarcasm in social media, frequently conveyed through the interplay of text and images, presents significant challenges for sentiment analysis and intention mining. Existing multi-modal sarcasm detection approaches have been shown to…

Computation and Language · Computer Science 2025-11-14 Junjie Chen , Hang Yu , Subin Huang , Sanmin Liu , Linfeng Zhang

Healthcare professionals need effective ways to use, understand, and validate AI-driven clinical decision support systems. Existing systems face two key limitations: complex visualizations and a lack of grounding in scientific evidence. We…

Human-Computer Interaction · Computer Science 2025-07-08 Reza Samimi , Aditya Bhattacharya , Lucija Gosak , Gregor Stiglic , Katrien Verbert

In healthcare, making the best possible predictions with complex models (e.g., neural networks, ensembles/stacks of different models) can impact patient welfare. In order to make these complex models explainable, we present DeepSHAP for…

Machine Learning · Computer Science 2019-11-28 Hugh Chen , Scott Lundberg , Su-In Lee

The field of eXplainable Artificial Intelligence (XAI) is increasingly recognizing the need to personalize and/or interactively adapt the explanation to better reflect users' explanation needs. While dialogue-based approaches to XAI have…

Machine Learning · Computer Science 2024-08-15 Dimitry Mindlin , Amelie Sophie Robrecht , Michael Morasch , Philipp Cimiano

Artificial intelligence-driven adaptive learning systems are reshaping education through data-driven adaptation of learning experiences. Yet many of these systems lack transparency, offering limited insight into how decisions are made. Most…

Artificial Intelligence · Computer Science 2025-08-04 Maryam Mosleh , Marie Devlin , Ellis Solaiman

With the rapid development of artificial intelligence technology, its application in the optimization of complex computer systems is becoming more and more extensive. Edge computing is an efficient distributed computing architecture, and…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-01-28 Xiaoxuan Sun , Yue Yao , Xiaoye Wang , Pochun Li , Xuan Li

Most methods for explaining black-box classifiers (e.g. on tabular data, images, or time series) rely on measuring the impact that removing/perturbing features has on the model output. This forces the explanation language to match the…

Machine Learning · Computer Science 2023-07-10 Alan Perotti , Paolo Bajardi , Francesco Bonchi , André Panisson

Explainability and interpretability of AI models is an essential factor affecting the safety of AI. While various explainable AI (XAI) approaches aim at mitigating the lack of transparency in deep networks, the evidence of the effectiveness…

Artificial Intelligence · Computer Science 2020-03-03 Kamran Alipour , Jurgen P. Schulze , Yi Yao , Avi Ziskind , Giedrius Burachas

Human activity recognition (HAR) using IMU sensors, namely accelerometer and gyroscope, has several applications in smart homes, healthcare and human-machine interface systems. In practice, the IMU-based HAR system is expected to encounter…

Human-Computer Interaction · Computer Science 2022-11-08 Anand Dubey , Niall Lyons , Avik Santra , Ashutosh Pandey

Among explainability techniques, SHAP stands out as one of the most popular, but often overlooks the causal structure of the problem. In response, do-SHAP employs interventional queries, but its reliance on estimands hinders its practical…

Machine Learning · Computer Science 2026-01-13 Álvaro Parafita , Tomas Garriga , Axel Brando , Francisco J. Cazorla

Shapley values have emerged as a central game-theoretic tool in explainable AI (XAI). However, computing Shapley values exactly requires $2^d$ game evaluations for a model with $d$ features. Lundberg and Lee's KernelSHAP algorithm has…

Artificial Intelligence · Computer Science 2026-05-14 Fabian Fumagalli , R. Teal Witter , Christopher Musco

Medical doctors rely on images of the human anatomy, such as magnetic resonance imaging (MRI), to localize regions of interest in the patient during diagnosis and treatment. Despite advances in medical imaging technology, the information…

Human-Computer Interaction · Computer Science 2024-07-10 Laura Schütz , Sasan Matinfar , Gideon Schafroth , Navid Navab , Merle Fairhurst , Arthur Wagner , Benedikt Wiestler , Ulrich Eck , Nassir Navab

Bias in medical AI is often framed as a problem of representation. However, in image-based tasks such as fetal ultrasound, performance disparities can arise even when representation is adequate, because predictive accuracy depends strongly…

The remarkable success of deep learning has prompted interest in its application to medical imaging diagnosis. Even though state-of-the-art deep learning models have achieved human-level accuracy on the classification of different types of…

Image and Video Processing · Electrical Eng. & Systems 2023-09-20 Cristiano Patrício , João C. Neves , Luís F. Teixeira

Medical data poses a daunting challenge for AI algorithms: it exists in many different modalities, experiences frequent distribution shifts, and suffers from a scarcity of examples and labels. Recent advances, including transformers and…

Deep neural networks have accelerated inverse-kinematics (IK) inference to the point where low cost manipulators can execute complex trajectories in real time, yet the opaque nature of these models contradicts the transparency and safety…

Robotics · Computer Science 2025-12-30 Sheng-Kai Chen , Yi-Ling Tsai , Chun-Chih Chang , Yan-Chen Chen , Po-Chiang Lin

Multimodal learning assumes all modality combinations of interest are available during training to learn cross-modal correspondences. In this paper, we challenge this modality-complete assumption for multimodal learning and instead strive…

Computer Vision and Pattern Recognition · Computer Science 2023-10-26 Yunhua Zhang , Hazel Doughty , Cees G. M. Snoek

Most of the existing multi-modal models, hindered by their incapacity to adeptly manage interleaved image-and-text inputs in multi-image, multi-round dialogues, face substantial constraints in resource allocation for training and data…

Computer Vision and Pattern Recognition · Computer Science 2023-11-30 Zhewei Yao , Xiaoxia Wu , Conglong Li , Minjia Zhang , Heyang Qin , Olatunji Ruwase , Ammar Ahmad Awan , Samyam Rajbhandari , Yuxiong He