English
Related papers

Related papers: Attention-like feature explanation for tabular dat…

200 papers

Tabular data are omnipresent in various sectors of industries. Neural networks for tabular data such as TabNet have been proposed to make predictions while leveraging the attention mechanism for interpretability. However, the inferred…

Machine Learning · Computer Science 2024-06-12 Jacob Si , Wendy Yusi Cheng , Michael Cooper , Rahul G. Krishnan

In this paper, we address the "black-box" problem in predictive process analytics by building interpretable models that are capable to inform both what and why is a prediction. Predictive process analytics is a newly emerged discipline…

Machine Learning · Computer Science 2022-04-26 Bemali Wickramanayake , Zhipeng He , Chun Ouyang , Catarina Moreira , Yue Xu , Renuka Sindhgatta

Most methods for explaining black-box classifiers (e.g. on tabular data, images, or time series) rely on measuring the impact that removing/perturbing features has on the model output. This forces the explanation language to match the…

Machine Learning · Computer Science 2023-07-10 Alan Perotti , Paolo Bajardi , Francesco Bonchi , André Panisson

A new approach to the local and global explanation is proposed. It is based on selecting a convex hull constructed for the finite number of points around an explained instance. The convex hull allows us to consider a dual representation of…

Machine Learning · Computer Science 2024-01-30 Andrei V. Konstantinov , Boris V. Kozlov , Stanislav R. Kirpichenko , Lev V. Utkin

Various factorization-based methods have been proposed to leverage second-order, or higher-order cross features for boosting the performance of predictive models. They generally enumerate all the cross features under a predefined maximum…

Machine Learning · Computer Science 2020-06-25 Weiyu Cheng , Yanyan Shen , Linpeng Huang

In state-of-the-art deep neural networks, both feature normalization and feature attention have become ubiquitous. % with significant performance improvement shown in a vast amount of tasks. They are usually studied as separate modules,…

Computer Vision and Pattern Recognition · Computer Science 2021-03-26 Xilai Li , Wei Sun , Tianfu Wu

Counterfactual explanations offer an intuitive way to interpret graph neural networks (GNNs) by identifying minimal changes that alter a model's prediction, thereby answering "what must differ for a different outcome?". In this work, we…

Machine Learning · Computer Science 2026-02-09 Yu Zhang , Sean Bin Yang , Arijit Khan , Cuneyt Gurcan Akcora

The attention mechanism lies at the core of the transformer architecture, providing an interpretable model-internal signal that has motivated a growing interest in attention-based model explanations. Although attention weights do not…

Machine Learning · Computer Science 2025-08-13 Marte Eggen , Jacob Lysnæs-Larsen , Inga Strümke

Accurate load forecasting is critical for reliable and efficient planning and operation of electric power grids. In this paper, we propose a unifying deep learning framework for load forecasting, which includes time-varying feature…

Machine Learning · Computer Science 2023-05-10 Jing Xiong , Yu Zhang

In recent years, model explanation methods have been designed to interpret model decisions faithfully and intuitively so that users can easily understand them. In this paper, we propose a framework, Faithful Attention Explainer (FAE),…

Computation and Language · Computer Science 2024-05-28 Yao Rong , David Scheerer , Enkelejda Kasneci

Most existing interpretable methods explain a black-box model in a post-hoc manner, which uses simpler models or data analysis techniques to interpret the predictions after the model is learned. However, they (a) may derive contradictory…

Machine Learning · Computer Science 2020-01-22 Mengzhuo Guo , Qingpeng Zhang , Xiuwu Liao , Daniel Dajun Zeng

Artificial Intelligence algorithms have now become pervasive in multiple high-stakes domains. However, their internal logic can be obscure to humans. Explainable Artificial Intelligence aims to design tools and techniques to illustrate the…

Human-Computer Interaction · Computer Science 2024-04-29 Eleonora Cappuccio , Daniele Fadda , Rosa Lanzilotti , Salvatore Rinzivillo

We present a simple and intuitive Focus-and-eXpand (\fax) method to guide the training process of a neural network towards a specific solution. Optimizing a neural network is a highly non-convex problem. Typically, the space of solutions is…

Machine Learning · Computer Science 2020-07-16 Moab Arar , Noa Fish , Dani Daniel , Evgeny Tenetov , Ariel Shamir , Amit Bermano

Transformer-based speech recognition models have achieved great success due to the self-attention (SA) mechanism that utilizes every frame in the feature extraction process. Especially, SA heads in lower layers capture various phonetic…

Computation and Language · Computer Science 2022-07-13 Kyuhong Shim , Wonyong Sung

We propose Black Box Explanations through Transparent Approximations (BETA), a novel model agnostic framework for explaining the behavior of any black-box classifier by simultaneously optimizing for fidelity to the original model and…

Artificial Intelligence · Computer Science 2017-07-06 Himabindu Lakkaraju , Ece Kamar , Rich Caruana , Jure Leskovec

Collaborative Filtering (CF) based recommendation methods have been widely studied, which can be generally categorized into two types, i.e., representation learning-based CF methods and matching function learning-based CF methods.…

Information Retrieval · Computer Science 2021-04-13 Zi-Yuan Hu , Jin Huang , Zhi-Hong Deng , Chang-Dong Wang , Ling Huang , Jian-Huang Lai , Philip S. Yu

Factorization Machines (FMs) are a supervised learning approach that enhances the linear regression model by incorporating the second-order feature interactions. Despite effectiveness, FM can be hindered by its modelling of all feature…

Machine Learning · Computer Science 2017-08-17 Jun Xiao , Hao Ye , Xiangnan He , Hanwang Zhang , Fei Wu , Tat-Seng Chua

Monitoring and maintaining machine learning models are among the most critical challenges in translating recent advances in the field into real-world applications. However, current monitoring methods lack the capability of provide…

Machine Learning · Computer Science 2024-08-27 Thomas Decker , Alexander Koebler , Michael Lebacher , Ingo Thon , Volker Tresp , Florian Buettner

This work introduces the definition of observation-specific explanations to assign a score to each data point proportional to its importance in the definition of the prediction process. Such explanations involve the identification of the…

Machine Learning · Statistics 2024-04-16 Valentina Ghidini , Michael Multerer , Jacopo Quizi , Rohan Sen

Investigating deep learning language models has always been a significant research area due to the ``black box" nature of most advanced models. With the recent advancements in pre-trained language models based on transformers and their…

Computation and Language · Computer Science 2023-06-22 Mohamad Ballout , Ulf Krumnack , Gunther Heidemann , Kai-Uwe Kühnberger