English
Related papers

Related papers: GCondNet: A Novel Method for Improving Neural Netw…

200 papers

Graph Neural Networks (GNNs) have emerged as a powerful category of learning architecture for handling graph-structured data. However, existing GNNs typically ignore crucial structural characteristics in node-induced subgraphs, which thus…

Machine Learning · Computer Science 2023-06-13 Kaixuan Chen , Shunyu Liu , Tongtian Zhu , Tongya Zheng , Haofei Zhang , Zunlei Feng , Jingwen Ye , Mingli Song

This study presents a hierarchical mining framework for high-dimensional imbalanced data, leveraging a depth graph model to address the inherent performance limitations of conventional approaches in handling complex, high-dimensional data…

Machine Learning · Computer Science 2025-02-07 Yijiashun Qi , Quanchao Lu , Shiyu Dou , Xiaoxuan Sun , Muqing Li , Yankaiqi Li

Graph convolutional networks (GCNs) are widely used in graph-based applications such as graph classification and segmentation. However, current GCNs have limitations on implementation such as network architectures due to their irregular…

Computer Vision and Pattern Recognition · Computer Science 2021-05-25 Yecheng Lyu , Xinming Huang , Ziming Zhang

Graph Convolutional Networks (GCNs) have made significant advances in semi-supervised learning, especially for classification tasks. However, existing GCN based methods have two main drawbacks. First, to increase the receptive field and…

Computer Vision and Pattern Recognition · Computer Science 2019-11-13 Qikui Zhu , Bo Du , Pingkun Yan

Despite the omnipresence of tensors and tensor operations in modern deep learning, the use of tensor mathematics to formally design and describe neural networks is still under-explored within the deep learning community. To this end, we…

Machine Learning · Computer Science 2023-03-27 Yao Lei Xu , Kriton Konstantinidis , Danilo P. Mandic

In recent years, graph neural networks (GNNs) have been widely applied in tackling combinatorial optimization problems. However, existing methods still suffer from limited accuracy when addressing that on complex graphs and exhibit poor…

Machine Learning · Computer Science 2025-11-13 Yuyao Long

In recent years, graph neural networks (GNNs) have become a popular tool for solving various problems over graphs. In these models, the link structure of the graph is typically exploited and nodes' embeddings are iteratively updated based…

Machine Learning · Computer Science 2024-09-10 Fatemeh Gholamzadeh Nasrabadi , AmirHossein Kashani , Pegah Zahedi , Mostafa Haghir Chehreghani

Recent years have witnessed great success in handling node classification tasks with Graph Neural Networks (GNNs). However, most existing GNNs are based on the assumption that node samples for different classes are balanced, while for many…

Machine Learning · Computer Science 2021-06-22 Lirong Wu , Haitao Lin , Zhangyang Gao , Cheng Tan , Stan. Z. Li

Graph Neural Networks (GNNs), a generalization of deep neural networks on graph data have been widely used in various domains, ranging from drug discovery to recommender systems. However, GNNs on such applications are limited when there are…

Machine Learning · Computer Science 2021-11-09 Debmalya Mandal , Sourav Medya , Brian Uzzi , Charu Aggarwal

Normalization is known to help the optimization of deep neural networks. Curiously, different architectures require specialized normalization methods. In this paper, we study what normalization is effective for Graph Neural Networks (GNNs).…

Machine Learning · Computer Science 2021-06-14 Tianle Cai , Shengjie Luo , Keyulu Xu , Di He , Tie-Yan Liu , Liwei Wang

Deep neural networks are notoriously miscalibrated, i.e., their outputs do not reflect the true probability of the event we aim to predict. While networks for tabular or image data are usually overconfident, recent works have shown that…

Machine Learning · Computer Science 2024-03-11 Erik Nascimento , Diego Mesquita , Samuel Kaski , Amauri H Souza

Graph Neural Networks (GNNs) have been studied through the lens of expressive power and generalization. However, their optimization properties are less well understood. We take the first step towards analyzing GNN training by studying the…

Machine Learning · Computer Science 2021-05-27 Keyulu Xu , Mozhi Zhang , Stefanie Jegelka , Kenji Kawaguchi

Graph Convolutional Networks (GCNs) have emerged as the state-of-the-art method for graph-based learning tasks. However, training GCNs at scale is still challenging, hindering both the exploration of more sophisticated GCN architectures and…

Machine Learning · Computer Science 2022-03-29 Cheng Wan , Youjie Li , Ang Li , Nam Sung Kim , Yingyan Lin

In recent years, Graph Neural Network (GNN) based models have shown promising results in simulating physics of complex systems. However, training dedicated graph network based physics simulators can be costly, as most models are confined to…

Machine Learning · Computer Science 2025-02-12 Siqi Shen , Yu Liu , Daniel Biggs , Omar Hafez , Jiandong Yu , Wentao Zhang , Bin Cui , Jiulong Shan

Deep learning-based approaches have been developed to solve challenging problems in wireless communications, leading to promising results. Early attempts adopted neural network architectures inherited from applications such as computer…

Information Theory · Computer Science 2022-11-07 Yifei Shen , Jun Zhang , S. H. Song , Khaled B. Letaief

Graph convolutional neural networks (GCNNs) have received much attention recently, owing to their capability in handling graph-structured data. Among the existing GCNNs, many methods can be viewed as instances of a neural message passing…

Machine Learning · Computer Science 2021-03-19 Tien Huu Do , Duc Minh Nguyen , Giannis Bekoulis , Adrian Munteanu , Nikos Deligiannis

This paper introduces a tensor neural network (TNN) to address nonparametric regression problems, leveraging its distinct sub-network structure to effectively facilitate variable separation and enhance the approximation of complex,…

Machine Learning · Statistics 2024-09-16 Yongxin Li , Yifan Wang , Zhongshuo Lin , Hehu Xie

Graph neural networks (GNNs) have shown prominent performance on attributed network embedding. However, existing efforts mainly focus on exploiting network structures, while the exploitation of node attributes is rather limited as they only…

Machine Learning · Computer Science 2023-07-25 Qiaoyu Tan , Xin Zhang , Xiao Huang , Hao Chen , Jundong Li , Xia Hu

Graph Convolutional Networks (GCNs) have emerged as the state-of-the-art graph learning model. However, it can be notoriously challenging to inference GCNs over large graph datasets, limiting their application to large real-world graphs and…

Hardware Architecture · Computer Science 2025-03-11 Haoran You , Tong Geng , Yongan Zhang , Ang Li , Yingyan Celine Lin

Graph Neural Networks (GNNs) have received a lot of interest in the recent times. From the early spectral architectures that could only operate on undirected graphs per a transductive learning paradigm to the current state of the art…

Machine Learning · Computer Science 2021-05-18 Pushkar Mishra , Aleksandra Piktus , Gerard Goossen , Fabrizio Silvestri