English
Related papers

Related papers: GalaxAI: Machine learning toolbox for interpretabl…

200 papers

End-to-end deep learning models fed with multi-band galaxy images are powerful data-driven tools used to estimate galaxy physical properties in the absence of spectroscopy. However, due to a lack of interpretability and the associational…

Instrumentation and Methods for Astrophysics · Physics 2025-11-26 Wei Zhang , Qiufan Lin , Yuan-Sen Ting , Shupei Chen , Hengxin Ruan , Song Li , Yifan Wang

Neural Networks are ubiquitous in high energy physics research. However, these highly nonlinear parameterized functions are treated as \textit{black boxes}- whose inner workings to convey information and build the desired input-output…

High Energy Physics - Experiment · Physics 2022-06-15 Mark S. Neubauer , Avik Roy

Explainable AI (XAI) methods have mostly been built to investigate and shed light on single machine learning models and are not designed to capture and explain differences between multiple models effectively. This paper addresses the…

Machine Learning · Computer Science 2025-04-01 Adam Rida , Marie-Jeanne Lesot , Xavier Renard , Christophe Marsala

Explaining the predictions of opaque machine learning algorithms is an important and challenging task, especially as complex models are increasingly used to assist in high-stakes decisions such as those arising in healthcare and finance.…

Machine Learning · Computer Science 2022-06-29 David S. Watson

Ensuring transparency and trust in artificial intelligence (AI) models is essential as they are increasingly deployed in safety-critical and high-stakes domains. Explainable AI (XAI) has emerged as a promising approach to address this…

Computer Vision and Pattern Recognition · Computer Science 2025-11-05 Reem Hammoud , Abdul Karim Gizzini , Ali J. Ghandour

As AI-based medical devices are becoming more common in imaging fields like radiology and histology, interpretability of the underlying predictive models is crucial to expand their use in clinical practice. Existing heatmap-based…

Image and Video Processing · Electrical Eng. & Systems 2021-01-20 Kathryn Schutte , Olivier Moindrot , Paul Hérent , Jean-Baptiste Schiratti , Simon Jégou

Explainable Artificial Intelligence (XAI) techniques are used to provide transparency to complex, opaque predictive models. However, these techniques are often designed for image and text data, and it is unclear how fit-for-purpose they are…

Computers and Society · Computer Science 2024-10-18 Mythreyi Velmurugan , Chun Ouyang , Yue Xu , Renuka Sindhgatta , Bemali Wickramanayake , Catarina Moreira

The increasing adoption of artificial intelligence requires accurate forecasts and means to understand the reasoning of artificial intelligence models behind such a forecast. Explainable Artificial Intelligence (XAI) aims to provide cues…

Artificial Intelligence · Computer Science 2021-05-07 Jože M. Rožanec , Patrik Zajec , Klemen Kenda , Inna Novalija , Blaž Fortuna , Dunja Mladenić

We present PlanetPack, a new software tool that we developed to facilitate and standardize the advanced analysis of radial velocity (RV) data for the goal of exoplanets detection, characterization, and basic dynamical $N$-body simulations.…

Instrumentation and Methods for Astrophysics · Physics 2013-08-06 Roman V. Baluev

The opacity of AI models necessitates both validation and evaluation before their integration into services. To investigate these models, explainable AI (XAI) employs methods that elucidate the relationship between input features and output…

Cryptography and Security · Computer Science 2024-10-02 Zerui Wang , Yan Liu

We present a new approach based on Supervised Machine Learning (SML) algorithms to infer key physical properties of galaxies (density, metallicity, column density and ionization parameter) from their emission line spectra. We introduce a…

Astrophysics of Galaxies · Physics 2016-12-21 Graziano Ucci , Andrea Ferrara , Simona Gallerani , Andrea Pallottini

In today's data-driven era, computational systems generate vast amounts of data that drive the digital transformation of industries, where Artificial Intelligence (AI) plays a key role. Currently, the demand for eXplainable AI (XAI) has…

Artificial Intelligence · Computer Science 2025-03-07 Georgios Makridis , Vasileios Koukos , Georgios Fatouros , Dimosthenis Kyriazis

Improving the interpretability of geospatial artificial intelligence (GeoAI) models has become critically important to open the "black box" of complex AI models, such as deep learning. This paper compares popular saliency map generation…

Computer Vision and Pattern Recognition · Computer Science 2023-03-20 Chia-Yu Hsu , Wenwen Li

Explainable AI (XAI) and interpretable machine learning methods help to build trust in model predictions and derived insights, yet also present a perverse incentive for analysts to manipulate XAI metrics to support pre-specified…

Machine Learning · Computer Science 2025-07-16 Rahul Sharma , Sergey Redyuk , Sumantrak Mukherjee , Andrea Šipka , Eyke Hüllermeier , Sebastian Vollmer , David Selby

Explainable artificial intelligence (XAI) enhances AI system transparency by framing interpretability as an optimization problem. However, this approach often necessitates numerous iterations of computationally intensive operations,…

Artificial Intelligence · Computer Science 2026-01-30 Ayesha Siddique , Khurram Khalil , Khaza Anuarul Hoque

AI systems, in particular with deep learning techniques, have demonstrated superior performance for various real-world applications. Given the need for tailored optimization in specific scenarios, as well as the concerns related to the…

Artificial Intelligence · Computer Science 2024-11-12 Zhiyu Zhu , Zhibo Jin , Hongsheng Hu , Minhui Xue , Ruoxi Sun , Seyit Camtepe , Praveen Gauravaram , Huaming Chen

Interpretability of Deep Learning (DL) is a barrier to trustworthy AI. Despite great efforts made by the Explainable AI (XAI) community, explanations lack robustness -- indistinguishable input perturbations may lead to different XAI…

Machine Learning · Computer Science 2023-08-01 Wei Huang , Xingyu Zhao , Gaojie Jin , Xiaowei Huang

Deep learning models have recently demonstrated remarkable results in a variety of tasks, which is why they are being increasingly applied in high-stake domains, such as industry, medicine, and finance. Considering that automatic…

Machine Learning · Computer Science 2021-08-19 Ilija Šimić , Vedran Sabol , Eduardo Veas

An explainable AI (XAI) model aims to provide transparency (in the form of justification, explanation, etc) for its predictions or actions made by it. Recently, there has been a lot of focus on building XAI models, especially to provide…

Human-Computer Interaction · Computer Science 2022-01-11 Arjun Akula , Song-Chun Zhu

Most of state of the art methods applied on time series consist of deep learning methods that are too complex to be interpreted. This lack of interpretability is a major drawback, as several applications in the real world are critical…

Machine Learning · Computer Science 2021-04-05 Thomas Rojat , Raphaël Puget , David Filliat , Javier Del Ser , Rodolphe Gelin , Natalia Díaz-Rodríguez