English
Related papers

Related papers: Interpretable Graph Networks Formulate Universal A…

200 papers

Graph neural networks (GNN) represent an emerging line of deep learning models that operate on graph structures. It is becoming more and more popular due to its high accuracy achieved in many graph-related tasks. However, GNN is not as well…

Hardware Architecture · Computer Science 2021-12-28 Zhihui Zhang , Jingwen Leng , Lingxiao Ma , Youshan Miao , Chao Li , Minyi Guo

Artificial General Intelligence (AGI) has revolutionized numerous fields, yet its integration with graph data, a cornerstone in our interconnected world, remains nascent. This paper presents a pioneering survey on the emerging domain of…

Artificial Intelligence · Computer Science 2023-11-29 Xiangguo Sun , Jiawen Zhang , Xixi Wu , Hong Cheng , Yun Xiong , Jia Li

The last decade of machine learning has seen drastic increases in scale and capabilities. Deep neural networks (DNNs) are increasingly being deployed in the real world. However, they are difficult to analyze, raising concerns about using…

Machine Learning · Computer Science 2023-08-22 Tilman Räuker , Anson Ho , Stephen Casper , Dylan Hadfield-Menell

The adaptive processing of graph data is a long-standing research topic which has been lately consolidated as a theme of major interest in the deep learning community. The snap increase in the amount and breadth of related research has come…

Machine Learning · Computer Science 2020-06-16 Davide Bacciu , Federico Errica , Alessio Micheli , Marco Podda

Graph embedding methods such as Graph Neural Networks (GNNs) and Graph Transformers have contributed to the development of graph reasoning algorithms for various tasks on knowledge graphs. However, the lack of interpretability and…

Artificial Intelligence · Computer Science 2023-10-26 Qinyong Wang , Zhenxiang Gao , Rong Xu

The remarkable performance of convolutional neural networks (CNNs) is entangled with their huge number of uninterpretable parameters, which has become the bottleneck limiting the exploitation of their full potential. Towards network…

Computer Vision and Pattern Recognition · Computer Science 2020-08-26 Yuchao Li , Rongrong Ji , Shaohui Lin , Baochang Zhang , Chenqian Yan , Yongjian Wu , Feiyue Huang , Ling Shao

Ongoing efforts to understand deep neural networks (DNN) have provided many insights, but DNNs remain incompletely understood. Improving DNN's interpretability has practical benefits, such as more accountable usage, better algorithm…

Machine Learning · Computer Science 2021-02-09 Erico Tjoa , Guan Cuntai

Neural networks that process the parameters of other neural networks find applications in domains as diverse as classifying implicit neural representations, generating neural network weights, and predicting generalization errors. However,…

Complex prediction models such as deep learning are the output from fitting machine learning, neural networks, or AI models to a set of training data. These are now standard tools in science. A key challenge with the current generation of…

Machine Learning · Computer Science 2022-10-21 Meng Liu , Tamal K. Dey , David F. Gleich

In this article, we extend several algebraic graph analysis methods to bipartite networks. In various areas of science, engineering and commerce, many types of information can be represented as networks, and thus the discipline of network…

Discrete Mathematics · Computer Science 2015-01-16 Jérôme Kunegis

Currently, attention mechanisms have garnered increasing attention in Graph Neural Networks (GNNs), such as Graph Attention Networks (GATs) and Graph Transformers (GTs). It is not only due to the commendable boost in performance they offer…

Machine Learning · Computer Science 2024-10-10 Lijie Hu , Tianhao Huang , Lu Yu , Wanyu Lin , Tianhang Zheng , Di Wang

A network-theoretic approach for determining the complexity of a graph is proposed. This approach is based on the relationship between the linear algebra (theory of determinants) and the graph theory. In this paper we contribute a new…

Discrete Mathematics · Computer Science 2018-12-04 E. M. Badr , B. Mohamed

Complex networks or graphs are ubiquitous in sciences and engineering: biological networks, brain networks, transportation networks, social networks, and the World Wide Web, to name a few. Spectral graph theory provides a set of useful…

Statistics Theory · Mathematics 2019-01-23 Subhadeep Mukhopadhyay , Kaijun Wang

This research addresses a new tool for data analysis known as Topological Data Analysis TDA It underlies an area of Mathematics known as Combinatorial Algebra or more recently Algebraic Topology which through making strong use of…

Statistics Theory · Mathematics 2021-06-29 Daniel Trejo Medina , Karla Sarai Jimenez

With the recent popularity of neural networks comes the need for efficient serving of inference workloads. A neural network inference workload can be represented as a computational graph with nodes as operators transforming multidimensional…

Despite the recent progress in Graph Neural Networks (GNNs), it remains challenging to explain the predictions made by GNNs. Existing explanation methods mainly focus on post-hoc explanations where another explanatory model is employed to…

Machine Learning · Computer Science 2021-12-03 Zaixi Zhang , Qi Liu , Hao Wang , Chengqiang Lu , Cheekong Lee

Human brains lie at the core of complex neurobiological systems, where the neurons, circuits, and subsystems interact in enigmatic ways. Understanding the structural and functional mechanisms of the brain has long been an intriguing pursuit…

Neurons and Cognition · Quantitative Biology 2022-07-26 Hejie Cui , Wei Dai , Yanqiao Zhu , Xiaoxiao Li , Lifang He , Carl Yang

The graph classification problem has been widely studied; however, achieving an interpretable model with high predictive performance remains a challenging issue. This paper proposes an interpretable classification algorithm for attributed…

Machine Learning · Computer Science 2024-02-13 Tajima Shinji , Ren Sugihara , Ryota Kitahara , Masayuki Karasuyama

We propose a novel high-performance and interpretable canonical deep tabular data learning architecture, TabNet. TabNet uses sequential attention to choose which features to reason from at each decision step, enabling interpretability and…

Machine Learning · Computer Science 2020-12-10 Sercan O. Arik , Tomas Pfister

Link prediction is a crucial task in graph machine learning with diverse applications. We explore the interplay between node attributes and graph topology and demonstrate that incorporating pre-trained node attributes improves the…

Machine Learning · Computer Science 2023-07-19 Ayan Chatterjee , Robin Walters , Giulia Menichetti , Tina Eliassi-Rad