English
Related papers

Related papers: Dynamic Importance Learning using Fisher Informati…

200 papers

Class Activation Mapping (CAM) is a powerful technique used to understand the decision making of Convolutional Neural Network (CNN) in computer vision. Recently, there have been attempts not only to generate better visual explanations, but…

Machine Learning · Computer Science 2021-05-04 Kwang Hee Lee , Chaewon Park , Junghyun Oh , Nojun Kwak

The escalating integration of machine learning in high-stakes fields such as healthcare raises substantial concerns about model fairness. We propose an interpretable framework - Fairness-Aware Interpretable Modeling (FAIM), to improve model…

Machine Learning · Computer Science 2024-03-11 Mingxuan Liu , Yilin Ning , Yuhe Ke , Yuqing Shang , Bibhas Chakraborty , Marcus Eng Hock Ong , Roger Vaughan , Nan Liu

The Fisher information matrix (FIM) is a foundational concept in statistical signal processing. The FIM depends on the probability distribution, assumed to belong to a smooth parametric family. Traditional approaches to estimating the FIM…

Computation · Statistics 2015-06-22 Visar Berisha , Alfred O. Hero

The functional independence measure (FIM) is widely used to evaluate patients' physical independence in activities of daily living. However, traditional FIM assessment imposes a significant burden on both patients and healthcare…

Machine Learning · Computer Science 2025-11-17 Jun Masaki , Ariaki Higashi , Naoko Shinagawa , Kazuhiko Hirata , Yuichi Kurita , Akira Furui

High-dimensional recordings of dynamical processes are often characterized by a much smaller set of effective variables, evolving on low-dimensional manifolds. Identifying these latent dynamics requires solving two intertwined problems:…

Machine Learning · Computer Science 2026-01-21 Manuel Hinz , Maximilian Mauel , Patrick Seifner , David Berghaus , Kostadin Cvejoski , Ramses J. Sanchez

We present a novel and simple method to numerically calculate Fisher Information Matrices for stochastic chemical kinetics models. The linear noise approximation is used to derive model equations and a likelihood function which leads to an…

Applications · Statistics 2015-05-27 Michal Komorowski , Maria J. Costa , David A. Rand , Michael Stumpf

Advanced machine learning algorithms are increasingly utilized to provide data-based prediction and decision-making support in Industry 4.0. However, the prediction accuracy achieved by the existing models is insufficient to warrant…

Machine Learning · Computer Science 2024-03-06 Zhipeng Ma , Bo Nørregaard Jørgensen , Zheng Grace Ma

Decisions made by convolutional neural networks(CNN) can be understood and explained by visualizing discriminative regions on images. To this end, Class Activation Map (CAM) based methods were proposed as powerful interpretation tools,…

Computer Vision and Pattern Recognition · Computer Science 2023-07-12 Yi Liao , Yongsheng Gao , Weichuan Zhang

Deep neural networks are being used increasingly to automate data analysis and decision making, yet their decision-making process is largely unclear and is difficult to explain to the end users. In this paper, we address the problem of…

Computer Vision and Pattern Recognition · Computer Science 2018-09-27 Vitali Petsiuk , Abir Das , Kate Saenko

Interpreting black-box machine learning models is challenging due to their strong dependence on data and inherently non-parametric nature. This paper reintroduces the concept of importance through "Marginal Variable Importance Metric"…

Machine Learning · Statistics 2025-01-30 Mohammad Kaviul Anam Khan , Olli Saarela , Rafal Kustra

Visual explanation maps enhance the trustworthiness of decisions made by deep learning models and offer valuable guidance for developing new algorithms in image recognition tasks. Class activation maps (CAM) and their variants (e.g.,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-30 Yi Liao , Ugochukwu Ejike Akpudo , Jue Zhang , Yongsheng Gao , Jun Zhou , Wenyi Zeng , Weichuan Zhang

The rapid advancement and widespread adoption of machine learning-driven technologies have underscored the practical and ethical need for creating interpretable artificial intelligence systems. Feature importance, a method that assigns…

Machine Learning · Computer Science 2023-12-07 Nimrod Harel , Uri Obolski , Ran Gilad-Bachrach

In an era where black-box AI models are integral to decision-making across industries, robust methods for explaining these models are more critical than ever. While these models leverage complex feature interplay for accurate predictions,…

Human-Computer Interaction · Computer Science 2025-03-24 Anna Kleinau , Bernhard Preim , Monique Meuschke

Physics-Informed Neural Networks (PINNs) have emerged as a powerful tool for solving differential equations and modeling physical systems by embedding physical laws into the learning process. However, rigorously quantifying how well a PINN…

Machine Learning · Computer Science 2026-01-21 Josafat Ribeiro Leal Filho , Antônio Augusto Fröhlich

The Fisher information matrix (FIM) has long been of interest in statistics and other areas. It is widely used to measure the amount of information and calculate the lower bound for the variance for maximum likelihood estimation (MLE). In…

Information Theory · Computer Science 2015-06-19 Shenghan Guo

Black-box neural network models are widely used in industry and science, yet are hard to understand and interpret. Recently, the attention mechanism was introduced, offering insights into the inner workings of neural language models. This…

Machine Learning · Computer Science 2021-01-19 Blaž Škrlj , Sašo Džeroski , Nada Lavrač , Matej Petkovič

Vital signs are crucial in intensive care units (ICUs). They are used to track the patient's state and to identify clinically significant changes. Predicting vital sign trajectories is valuable for early detection of adverse events.…

Machine Learning · Computer Science 2024-03-28 Bar Eini Porat , Danny Eytan , Uri Shalit

It has been observed that deep neural networks (DNNs) often use both genuine as well as spurious features. In this work, we propose "Amending Inherent Interpretability via Self-Supervised Masking" (AIM), a simple yet interestingly effective…

Computer Vision and Pattern Recognition · Computer Science 2025-08-18 Eyad Alshami , Shashank Agnihotri , Bernt Schiele , Margret Keuper

Few-shot classification (FSC) is one of the most concerned hot issues in recent years. The general setting consists of two phases: (1) Pre-train a feature extraction model (FEM) with base data (has large amounts of labeled samples). (2) Use…

Computer Vision and Pattern Recognition · Computer Science 2021-09-08 Shuai Shao , Lei Xing , Yixin Chen , Yan-Jiang Wang , Bao-Di Liu , Yicong Zhou

Model interpretation is one of the key aspects of the model evaluation process. The explanation of the relationship between model variables and outputs is relatively easy for statistical models, such as linear regressions, thanks to the…

Machine Learning · Computer Science 2013-12-05 Anna Palczewska , Jan Palczewski , Richard Marchese Robinson , Daniel Neagu