中文
相关论文

相关论文: Exploring and Improving Initialization for Deep Gr…

200 篇论文

The popularity of deep learning techniques renewed the interest in neural architectures able to process complex structures that can be represented using graphs, inspired by Graph Neural Networks (GNNs). We focus our attention on the…

机器学习 · 计算机科学 2021-09-02 Matteo Tiezzi , Giuseppe Marra , Stefano Melacci , Marco Maggini

Spiking neural networks (SNNs) represent a promising approach in machine learning, combining the hierarchical learning capabilities of deep neural networks with the energy efficiency of spike-based computations. Traditional end-to-end…

神经与进化计算 · 计算机科学 2024-11-12 Ruyin Wan , Qian Zhang , George Em Karniadakis

Graph neural networks (GNNs) have attracted considerable attention due to their diverse applications. However, the scarcity and quality limitations of graph data present challenges to their training process in practical settings. To…

机器学习 · 计算机科学 2024-11-07 Hanyang Yuan , Jiarong Xu , Renhong Huang , Mingli Song , Chunping Wang , Yang Yang

State-of-the-art Graph Neural Networks (GNNs) have limited scalability with respect to the graph and model sizes. On large graphs, increasing the model depth often means exponential expansion of the scope (i.e., receptive field). Beyond…

Training a neural network (NN) depends on multiple factors, including but not limited to the initial weights. In this paper, we focus on initializing deep NN parameters such that it performs better, comparing to random or zero…

机器学习 · 计算机科学 2020-11-10 Mohamad H. Danesh

Training deep graph neural networks (GNNs) poses a challenging task, as the performance of GNNs may suffer from the number of hidden message-passing layers. The literature has focused on the proposals of {over-smoothing} and…

机器学习 · 统计学 2023-02-27 Yirui Liu , Xinghao Qiao , Liying Wang , Jessica Lam

In recent years, with the rapid enhancement of computing power, deep learning methods have been widely applied in wireless networks and achieved impressive performance. To effectively exploit the information of graph-structured data as well…

信息论 · 计算机科学 2021-11-19 S. He , S. Xiong , Y. Ou , J. Zhang , J. Wang , Y. Huang , Y. Zhang

With recent advancements in graph neural networks (GNNs), spectral GNNs have received increasing popularity by virtue of their ability to retrieve graph signals in the spectral domain. These models feature uniqueness in efficient…

机器学习 · 计算机科学 2025-08-21 Ningyi Liao , Haoyu Liu , Zulun Zhu , Siqiang Luo , Laks V. S. Lakshmanan

Graph Neural Networks (GNN) are currently the most popular approach for learning and prediction on graph-structured data and are deployed in various fields, from social network analysis to drug discovery. However, there is limited…

统计方法学 · 统计学 2026-05-26 Nil Ayday , Mahalakshmi Sabanayagam , Debarghya Ghoshdastidar

As an efficient neural network model for graph data, graph neural networks (GNNs) recently find successful applications for various wireless optimization problems. Given that the inference stage of GNNs can be naturally implemented in a…

信息论 · 计算机科学 2023-05-31 Mengyuan Lee , Guanding Yu , Huaiyu Dai

Graph neural networks (GNNs) are the most widely adopted model in graph-structured data oriented learning and representation. Despite their extraordinary success in real-world applications, understanding their working mechanism by theory is…

机器学习 · 计算机科学 2023-05-16 Huayi Tang , Yong Liu

The optimization of multi-user multi-input multi-output (MU-MIMO) precoders is a widely recognized challenging problem. Existing work has demonstrated the potential of graph neural networks (GNNs) in learning precoding policies. However,…

信号处理 · 电气工程与系统科学 2025-03-11 Lin Zhang , Shengqian Han , Chenyang Yang

Graph neural networks (GNNs) are among the most powerful tools in deep learning. They routinely solve complex problems on unstructured networks, such as node classification, graph classification, or link prediction, with high accuracy.…

机器学习 · 计算机科学 2023-08-21 Maciej Besta , Torsten Hoefler

Inspired by the extensive success of deep learning, graph neural networks (GNNs) have been proposed to learn expressive node representations and demonstrated promising performance in various graph learning tasks. However, existing endeavors…

机器学习 · 计算机科学 2022-04-05 Kaize Ding , Jianling Wang , James Caverlee , Huan Liu

Graph neural networks (GNNs) are typically applied to static graphs that are assumed to be known upfront. This static input structure is often informed purely by insight of the machine learning practitioner, and might not be optimal for the…

Graph Neural Networks (GNNs) show strong promise for circuit analysis, but scaling to modern large-scale circuit graphs is limited by GPU memory and training cost, especially for deep models. We revisit deep GNNs for circuit graphs and show…

机器学习 · 计算机科学 2026-03-31 Yuebo Luo , Shiyang Li , Yifei Feng , Vishal Kancharla , Shaoyi Huang , Caiwen Ding

Neural Architecture Search (NAS) methods have shown to output networks that largely outperform human-designed networks. However, conventional NAS methods have mostly tackled the single dataset scenario, incuring in a large computational…

计算机视觉与模式识别 · 计算机科学 2024-05-14 Sofia Casarin , Oswald Lanz , Sergio Escalera

Massive Multiple-Input Multiple-Out (MIMO) detection is an important problem in modern wireless communication systems. While traditional Belief Propagation (BP) detectors perform poorly on loopy graphs, the recent Graph Neural Networks…

信息论 · 计算机科学 2022-06-15 Hongyi Li , Junxiang Wang , Yongchao Wang

Graph Neural Networks (graph NNs) are a promising deep learning approach for analyzing graph-structured data. However, it is known that they do not improve (or sometimes worsen) their predictive performance as we pile up many layers and add…

机器学习 · 计算机科学 2021-01-07 Kenta Oono , Taiji Suzuki

Graph Neural Networks (GNNs) have made significant advances on several fundamental inference tasks. As a result, there is a surge of interest in using these models for making potentially important decisions in high-regret applications.…

机器学习 · 计算机科学 2020-02-26 Kaidi Xu , Sijia Liu , Pin-Yu Chen , Mengshu Sun , Caiwen Ding , Bhavya Kailkhura , Xue Lin