English
Related papers

Related papers: Not All Features Are Equal: Feature Leveling Deep …

200 papers

Deep Neural Networks (DNNs) have become very popular for prediction in many areas. Their strength is in representation with a high number of parameters that are commonly learned via gradient descent or similar optimization methods. However,…

Machine Learning · Statistics 2016-10-11 Anthony Caterini , Dong Eui Chang

One significant challenge of exploiting Graph neural networks (GNNs) in real-life scenarios is that they are always treated as black boxes, therefore leading to the requirement of interpretability. To address this, model-level…

Machine Learning · Computer Science 2025-09-22 Xiao Yue , Guangzhi Qu , Lige Gan

Large Language Models (LLMs) excel at intuitive, implicit reasoning. Guiding LLMs to construct thought chains can enhance their deliberate reasoning abilities, but also faces challenges such as hallucination. Knowledge Graphs (KGs) can…

Computation and Language · Computer Science 2025-03-07 Guangyi Liu , Yongqi Zhang , Yong Li , Quanming Yao

Representations in the hidden layers of Deep Neural Networks (DNN) are often hard to interpret since it is difficult to project them into an interpretable domain. Graph Convolutional Networks (GCN) allow this projection, but existing…

Computation and Language · Computer Science 2019-09-25 Robert Schwarzenberg , Marc Hübner , David Harbecke , Christoph Alt , Leonhard Hennig

Despite their great success in recent years, deep neural networks (DNN) are mainly black boxes where the results obtained by running through the network are difficult to understand and interpret. Compared to e.g. decision trees or bayesian…

Machine Learning · Computer Science 2019-07-02 Jan Niclas Reimann , Andreas Schwung

For reliability, it is important that the predictions made by machine learning methods are interpretable by human. In general, deep neural networks (DNNs) can provide accurate predictions, although it is difficult to interpret why such…

Machine Learning · Computer Science 2021-12-16 Yuya Yoshikawa , Tomoharu Iwata

Being able to interpret, or explain, the predictions made by a machine learning model is of fundamental importance. This is especially true when there is interest in deploying data-driven models to make high-stakes decisions, e.g. in…

Machine Learning · Computer Science 2019-10-01 An-phi Nguyen , María Rodríguez Martínez

We propose a novel perspective to understand deep neural networks in an interpretable disentanglement form. For each semantic class, we extract a class-specific functional subnetwork from the original full model, with compressed structure…

Machine Learning · Computer Science 2019-10-08 Yulong Wang , Xiaolin Hu , Hang Su

Deep learning models are favored in many research and industry areas and have reached the accuracy of approximating or even surpassing human level. However they've long been considered by researchers as black-box models for their…

Machine Learning · Computer Science 2020-10-16 Xiaojian Wang , Jingyuan Wang , Ke Tang

Deep neural networks have exhibited remarkable performance across a wide range of real-world tasks. However, comprehending the underlying reasons for their effectiveness remains a challenging problem. Interpreting deep neural networks…

Computer Vision and Pattern Recognition · Computer Science 2023-10-18 Chenxu Zhao , Wei Qian , Yucheng Shi , Mengdi Huai , Ninghao Liu

While deep neural networks (DNN) have become an effective computational tool, the prediction results are often criticized by the lack of interpretability, which is essential in many real-world applications such as health informatics.…

Computer Vision and Pattern Recognition · Computer Science 2018-05-29 Mengnan Du , Ninghao Liu , Qingquan Song , Xia Hu

Integrating large language models (LLMs) with knowledge graphs derived from domain-specific data represents an important advancement towards more powerful and factual reasoning. As these models grow more capable, it is crucial to enable…

Artificial Intelligence · Computer Science 2024-04-19 Stefan Dernbach , Khushbu Agarwal , Alejandro Zuniga , Michael Henry , Sutanay Choudhury

The interpretability of neural networks (NNs) is a challenging but essential topic for transparency in the decision-making process using machine learning. One of the reasons for the lack of interpretability is random weight initialization,…

Machine Learning · Computer Science 2021-03-01 Shohei Kubota , Hideaki Hayashi , Tomohiro Hayase , Seiichi Uchida

Graph neural networks (GNNs) demonstrate a robust capability for representation learning on graphs with complex structures, showcasing superior performance in various applications. The majority of existing GNNs employ a graph convolution…

Machine Learning · Computer Science 2025-02-19 Jinlu Wang , Jipeng Guo , Yanfeng Sun , Junbin Gao , Shaofan Wang , Yachao Yang , Baocai Yin

Due to the widespread use of complex machine learning models in real-world applications, it is becoming critical to explain model predictions. However, these models are typically black-box deep neural networks, explained post-hoc via…

Machine Learning · Computer Science 2022-10-20 Filip Radenovic , Abhimanyu Dubey , Dhruv Mahajan

Graph neural networks (GNN) represent an emerging line of deep learning models that operate on graph structures. It is becoming more and more popular due to its high accuracy achieved in many graph-related tasks. However, GNN is not as well…

Hardware Architecture · Computer Science 2021-12-28 Zhihui Zhang , Jingwen Leng , Lingxiao Ma , Youshan Miao , Chao Li , Minyi Guo

Graph neural networks (GNNs) have demonstrated a significant boost in prediction performance on graph data. At the same time, the predictions made by these models are often hard to interpret. In that regard, many efforts have been made to…

Machine Learning · Computer Science 2023-05-24 Yiqiao Li , Jianlong Zhou , Sunny Verma , Fang Chen

The deep neural networks (DNNs) have achieved great success in learning complex patterns with strong predictive power, but they are often thought of as "black box" models without a sufficient level of transparency and interpretability. It…

Machine Learning · Computer Science 2020-11-10 Agus Sudjianto , William Knauth , Rahul Singh , Zebin Yang , Aijun Zhang

The unification of low-level perception and high-level reasoning is a long-standing problem in artificial intelligence, which has the potential to not only bring the areas of logic and learning closer together but also demonstrate how…

Artificial Intelligence · Computer Science 2019-11-27 Anton Fuxjaeger , Vaishak Belle

Large language models (LLMs) have achieved remarkable progress in linguistic tasks, necessitating robust evaluation frameworks to understand their capabilities and limitations. Inspired by Feynman's principle of understanding through…

Computation and Language · Computer Science 2024-06-11 Zhiquan Tan , Lai Wei , Jindong Wang , Xing Xie , Weiran Huang