English
Related papers

Related papers: Interpretable Neuron Structuring with Graph Spectr…

200 papers

The current understanding of deep neural networks can only partially explain how input structure, network parameters and optimization algorithms jointly contribute to achieve the strong generalization power that is typically observed in…

Machine Learning · Computer Science 2021-01-28 Francesco Craighero , Fabrizio Angaroni , Alex Graudenzi , Fabio Stella , Marco Antoniotti

Comprehensible neural network explanations are foundations for a better understanding of decisions, especially when the input data are infused with malicious perturbations. Existing solutions generally mitigate the impact of perturbations…

Machine Learning · Computer Science 2025-02-21 Yicong Li , Kuanjiu Zhou , Shuo Yu , Qiang Zhang , Renqiang Luo , Xiaodong Li , Feng Xia

Graph Neural Networks (GNNs) have emerged as the de facto standard for modeling graph data, with attention mechanisms and transformers significantly enhancing their performance on graph-based tasks. Despite these advancements, the…

Machine Learning · Computer Science 2025-04-07 Nikhil Shivakumar Nayak

Graph neural networks (GNNs) have demonstrated remarkable capabilities in learning from graph-structured data, often outperforming traditional Multilayer Perceptrons (MLPs) in numerous graph-based tasks. Although existing works have…

Machine Learning · Computer Science 2025-06-09 Wei Huang , Yuan Cao , Haonan Wang , Xin Cao , Taiji Suzuki

The emergence of explainability methods has enabled a better comprehension of how deep neural networks operate through concepts that are easily understood and implemented by the end user. While most explainability methods have been designed…

Neurons and Cognition · Quantitative Biology 2022-03-17 Fernanda L. Ribeiro , Steffen Bollmann , Ross Cunnington , Alexander M. Puckett

We consider a network of interconnected dynamical systems. Spectral network identification consists in recovering the eigenvalues of the network Laplacian from the measurements of a very limited number (possibly one) of signals. These…

Systems and Control · Computer Science 2017-09-14 Alexandre Mauroy , Julien Hendrickx

The deep neural networks (DNNs) have achieved great success in learning complex patterns with strong predictive power, but they are often thought of as "black box" models without a sufficient level of transparency and interpretability. It…

Machine Learning · Computer Science 2020-11-10 Agus Sudjianto , William Knauth , Rahul Singh , Zebin Yang , Aijun Zhang

Interpretability is a critical factor in applying complex deep learning models to advance the understanding of brain disorders in neuroimaging studies. To interpret the decision process of a trained classifier, existing techniques typically…

Image and Video Processing · Electrical Eng. & Systems 2021-06-29 Zixuan Liu , Ehsan Adeli , Kilian M. Pohl , Qingyu Zhao

Mechanistic Interpretability aims to reverse engineer the algorithms implemented by neural networks by studying their weights and activations. An obstacle to reverse engineering neural networks is that many of the parameters inside a…

Neural networks leverage robust internal representations in order to generalise. Learning them is difficult, and often requires a large training set that covers the data distribution densely. We study a common setting where our task is not…

Graph Neural Networks leverage the connectivity structure of graphs as an inductive bias. Latent graph inference focuses on learning an adequate graph structure to diffuse information on and improve the downstream performance of the model.…

Machine Learning · Computer Science 2023-04-13 Haitz Sáez de Ocáriz Borde , Álvaro Arroyo , Ingmar Posner

We present GraphMix, a regularization method for Graph Neural Network based semi-supervised object classification, whereby we propose to train a fully-connected network jointly with the graph neural network via parameter sharing and…

Machine Learning · Computer Science 2020-10-12 Vikas Verma , Meng Qu , Kenji Kawaguchi , Alex Lamb , Yoshua Bengio , Juho Kannala , Jian Tang

While deep learning has achieved great success in many fields, one common criticism about deep learning is its lack of interpretability. In most cases, the hidden units in a deep neural network do not have a clear semantic meaning or…

Genomics · Quantitative Biology 2019-06-04 Tianle Ma , Aidong Zhang

Graphs can model real-world, complex systems by representing entities and their interactions in terms of nodes and edges. To better exploit the graph structure, graph neural networks have been developed, which learn entity and edge…

Machine Learning · Computer Science 2022-06-06 Tong Liu , Yushan Liu , Marcel Hildebrandt , Mitchell Joblin , Hang Li , Volker Tresp

Despite their impressive performance, Deep Neural Networks (DNNs) typically underperform Gradient Boosting Trees (GBTs) on many tabular-dataset learning tasks. We propose that applying a different regularization coefficient to each weight…

Machine Learning · Statistics 2018-10-25 Ira Shavitt , Eran Segal

Medical image classification requires not only high predictive performance but also interpretability to ensure clinical trust and adoption. Graph Neural Networks (GNNs) offer a powerful framework for modeling relational structures within…

Image and Video Processing · Electrical Eng. & Systems 2025-10-10 Prajit Sengupta , Islem Rekik

Improving the accuracy and robustness of deep neural nets (DNNs) and adapting them to small training data are primary tasks in deep learning research. In this paper, we replace the output activation function of DNNs, typically the…

Machine Learning · Computer Science 2019-07-17 Bao Wang , Stanley J. Osher

Regularizers help deep neural networks prevent feature co-adaptations. Dropout, as a commonly used regularization technique, stochastically disables neuron activations during network optimization. However, such complete feature disposal can…

Machine Learning · Computer Science 2022-01-25 Tiange Xiang , Chaoyi Zhang , Yang Song , Siqi Liu , Hongliang Yuan , Weidong Cai

Deep Neural Networks have often been called the black box because of the complex, deep architecture and non-transparency presented by the inner layers. There is a lack of trust to use Artificial Intelligence in critical and high-precision…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Frincy Clement , Ji Yang , Irene Cheng

In recent years, spectral graph neural networks, characterized by polynomial filters, have garnered increasing attention and have achieved remarkable performance in tasks such as node classification. These models typically assume that…

Machine Learning · Computer Science 2025-02-25 Kangkang Lu , Yanhua Yu , Hao Fei , Xuan Li , Zixuan Yang , Zirui Guo , Meiyu Liang , Mengran Yin , Tat-Seng Chua