English
Related papers

Related papers: Interpretable Multimodal Machine Learning Analysis…

200 papers

Interpretability of deep neural networks (DNNs) is essential since it enables users to understand the overall strengths and weaknesses of the models, conveys an understanding of how the models will behave in the future, and how to diagnose…

Computer Vision and Pattern Recognition · Computer Science 2017-03-31 Yinpeng Dong , Hang Su , Jun Zhu , Bo Zhang

Machine-learning models have demonstrated a great ability to learn complex patterns and make predictions. In high-dimensional nonlinear problems of fluid dynamics, data representation often greatly affects the performance and…

Fluid Dynamics · Physics 2022-07-29 Runze Li , Yufei Zhang , Haixin Chen

This paper proposes a multimodal emotion recognition system based on hybrid fusion that classifies the emotions depicted by speech utterances and corresponding images into discrete classes. A new interpretability technique has been…

Computer Vision and Pattern Recognition · Computer Science 2023-01-10 Puneet Kumar , Sarthak Malik , Balasubramanian Raman

End-to-end deep learning models fed with multi-band galaxy images are powerful data-driven tools used to estimate galaxy physical properties in the absence of spectroscopy. However, due to a lack of interpretability and the associational…

Instrumentation and Methods for Astrophysics · Physics 2025-11-26 Wei Zhang , Qiufan Lin , Yuan-Sen Ting , Shupei Chen , Hengxin Ruan , Song Li , Yifan Wang

Discovering patterns in data that best describe the differences between classes allows to hypothesize and reason about class-specific mechanisms. In molecular biology, for example, this bears promise of advancing the understanding of…

Machine Learning · Computer Science 2023-12-08 Nils Philipp Walter , Jonas Fischer , Jilles Vreeken

Recent studies show that deep learning models achieve good performance on medical imaging tasks such as diagnosis prediction. Among the models, multimodality has been an emerging trend, integrating different forms of data such as chest…

Machine Learning · Computer Science 2022-02-10 Haodi Zhang , Chenyu Xu , Peirou Liang , Ke Duan , Hao Ren , Weibin Cheng , Kaishun Wu

Many machine learning algorithms for tabular data produce black-box models, which prevent users from understanding the rationale behind the model predictions. In their unconstrained form, graph neural networks fall into this category, and…

Machine Learning · Computer Science 2024-08-15 Amr Alkhatib , Henrik Boström

It is widely recognized that the predictions of deep neural networks are difficult to parse relative to simpler approaches. However, the development of methods to investigate the mode of operation of such models has advanced rapidly in the…

Machine Learning · Computer Science 2020-07-08 Cosmas Heiß , Ron Levie , Cinjon Resnick , Gitta Kutyniok , Joan Bruna

Digital mammography is essential to breast cancer detection, and deep learning offers promising tools for faster and more accurate mammogram analysis. In radiology and other high-stakes environments, uninterpretable ("black box") deep…

Computer Vision and Pattern Recognition · Computer Science 2024-06-11 Julia Yang , Alina Jade Barnett , Jon Donnelly , Satvik Kishore , Jerry Fang , Fides Regina Schwartz , Chaofan Chen , Joseph Y. Lo , Cynthia Rudin

Tree ensemble models like random forests and gradient boosting machines are widely used in machine learning due to their excellent predictive performance. However, a high-performance ensemble consisting of a large number of decision trees…

Machine Learning · Statistics 2024-10-28 Zebin Yang , Agus Sudjianto , Xiaoming Li , Aijun Zhang

Referring remote sensing image segmentation (RRSIS) is a novel visual task in remote sensing images segmentation, which aims to segment objects based on a given text description, with great significance in practical application. Previous…

Computer Vision and Pattern Recognition · Computer Science 2025-03-17 Leideng Shi , Juan Zhang

This paper presents an approach integrating explainable artificial intelligence (XAI) techniques with adaptive learning to enhance energy consumption prediction models, with a focus on handling data distribution shifts. Leveraging SHAP…

Machine Learning · Computer Science 2024-02-08 Tobias Clement , Hung Truong Thanh Nguyen , Nils Kemmerzell , Mohamed Abdelaal , Davor Stjelja

X-ray interaction with matter is an energy-dependent process that is contingent on the atomic structure of the constituent material elements. The most advanced models to capture this relationship currently rely on Monte Carlo (MC)…

Machine Learning · Computer Science 2023-07-11 Raziye Kubra Kumrular , Thomas Blumensath

Recent years in NLP have seen the continued development of domain-specific information extraction tools for scientific documents, alongside the release of increasingly multimodal pretrained transformer models. While the opportunity for…

Computation and Language · Computer Science 2025-06-25 Sireesh Gururaja , Yueheng Zhang , Guannan Tang , Tianhao Zhang , Kevin Murphy , Yu-Tsen Yi , Junwon Seo , Anthony Rollett , Emma Strubell

Accurate methane sorption prediction across heterogeneous coal ranks requires models that combine thermodynamic consistency, efficient knowledge transfer across data-scarce geological systems, and calibrated uncertainty estimates,…

Machine Learning · Computer Science 2026-04-16 Mohammad Nooraiepour , Zezhang Song , Wei Li , Sarah Perez

When the training dataset comprises a 1:1 proportion of dogs to cats, a generative model that produces 1:1 dogs and cats better resembles the training species distribution than another model with 3:1 dogs and cats. Can we capture this…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Dongkyun Kim , Mingi Kwon , Youngjung Uh

Recent year has brought considerable advancements in Electric Vehicles (EVs) and associated infrastructures/communications. Intrusion Detection Systems (IDS) are widely deployed for anomaly detection in such critical infrastructures. This…

The current catalyst discovery and development pipeline for energy-intensive applications like methane conversion remains bottlenecked by expensive trial-and-error experimentation, irreproducible chemical intuition, and a lack of frameworks…

Chemical Physics · Physics 2026-05-12 Oyinkansola Romiluyi

Recent advancements in diffusion models have significantly impacted the trajectory of generative machine learning research, with many adopting the strategy of fine-tuning pre-trained models using domain-specific text-to-image datasets.…

Computer Vision and Pattern Recognition · Computer Science 2023-12-21 Mischa Dombrowski , Hadrien Reynaud , Johanna P. Müller , Matthew Baugh , Bernhard Kainz

Deep Neural Networks (DNNs) are widely used for decision making in a myriad of critical applications, ranging from medical to societal and even judicial. Given the importance of these decisions, it is crucial for us to be able to interpret…

Computer Vision and Pattern Recognition · Computer Science 2022-11-28 Teddy Koker , Fatemehsadat Mireshghallah , Tom Titcombe , Georgios Kaissis