English
Related papers

Related papers: Neighbor-Sampling Based Momentum Stochastic Method…

200 papers

Graph neural networks (GNN) have recently emerged as a vehicle for applying deep network architectures to graph and relational data. However, given the increasing size of industrial datasets, in many practical situations the message passing…

Machine Learning · Computer Science 2021-11-16 Qingru Zhang , David Wipf , Quan Gan , Le Song

Graph convolutional networks (GCNs) have recently achieved great empirical success in learning graph-structured data. To address its scalability issue due to the recursive embedding of neighboring features, graph topology sampling has been…

Machine Learning · Computer Science 2023-12-12 Hongkang Li , Meng Wang , Sijia Liu , Pin-Yu Chen , Jinjun Xiong

Graph Convolutional Networks (GCNs) have received significant attention from various research fields due to the excellent performance in learning graph representations. Although GCN performs well compared with other methods, it still faces…

Machine Learning · Computer Science 2021-09-06 Xin Liu , Mingyu Yan , Lei Deng , Guoqi Li , Xiaochun Ye , Dongrui Fan

Training a neural network (NN) typically relies on some type of curve-following method, such as gradient descent (GD) (and stochastic gradient descent (SGD)), ADADELTA, ADAM or limited memory algorithms. Convergence for these algorithms…

Machine Learning · Computer Science 2023-05-08 Michael A Kouritzin , Stephen Styles , Beatrice-Helen Vritsiou

Graph Convolutional Networks (GCNs) have become a pivotal method in machine learning for modeling functions over graphs. Despite their widespread success across various applications, their statistical properties (e.g., consistency,…

Machine Learning · Computer Science 2025-04-17 Juntong Chen , Johannes Schmidt-Hieber , Claire Donnat , Olga Klopp

Graph Convolutional Networks (GCNs) have emerged as the state-of-the-art method for graph-based learning tasks. However, training GCNs at scale is still challenging, hindering both the exploration of more sophisticated GCN architectures and…

Machine Learning · Computer Science 2022-03-29 Cheng Wan , Youjie Li , Ang Li , Nam Sung Kim , Yingyan Lin

In recent years, deep learning based methods have shown success in essential medical image analysis tasks such as segmentation. Post-processing and refining the results of segmentation is a common practice to decrease the misclassifications…

Image and Video Processing · Electrical Eng. & Systems 2021-08-29 Ufuk Demir , Atahan Ozer , Yusuf H. Sahin , Gozde Unal

Momentum plays a crucial role in stochastic gradient-based optimization algorithms for accelerating or improving training deep neural networks (DNNs). In deep learning practice, the momentum is usually weighted by a well-calibrated…

Machine Learning · Computer Science 2020-12-04 Bao Wang , Qiang Ye

Stochastic gradient descent (SGD) is the main approach for training deep networks: it moves towards the optimum of the cost function by iteratively updating the parameters of a model in the direction of the gradient of the loss evaluated on…

Machine Learning · Computer Science 2021-03-30 Loris Nanni , Gianluca Maguolo , Alessandra Lumini

In the modern age of social media and networks, graph representations of real-world phenomena have become an incredibly useful source to mine insights. Often, we are interested in understanding how entities in a graph are interconnected.…

Machine Learning · Computer Science 2021-12-16 Aneesh Komanduri , Justin Zhan

In recent years, using a self-supervised learning framework to learn the general characteristics of graphs has been considered a promising paradigm for graph representation learning. The core of self-supervised learning strategies for graph…

Machine Learning · Computer Science 2022-12-09 Jiawei Zhu , Mei Hong , Ronghua Du , Haifeng Li

Graph neural networks (GNNs) are designed to process data associated with graphs. They are finding an increasing range of applications; however, as with other modern machine learning techniques, their theoretical understanding is limited.…

Disordered Systems and Neural Networks · Physics 2026-02-23 O. Duranthon , L. Zdeborová

Recent studies often exploit Graph Convolutional Network (GCN) to model label dependencies to improve recognition accuracy for multi-label image recognition. However, constructing a graph by counting the label co-occurrence possibilities of…

Computer Vision and Pattern Recognition · Computer Science 2020-12-08 Jin Ye , Junjun He , Xiaojiang Peng , Wenhao Wu , Yu Qiao

Graph neural networks (GNNs) model nonlinear representations in graph data with applications in distributed agent coordination, control, and planning among others. Current GNN architectures assume ideal scenarios and ignore link…

Signal Processing · Electrical Eng. & Systems 2021-09-01 Zhan Gao , Elvin Isufi , Alejandro Ribeiro

Many machine learning methods have been proposed to achieve accurate transaction fraud detection, which is essential to the financial security of individuals and banks. However, most existing methods leverage original features only or…

Machine Learning · Computer Science 2023-07-13 Yue Tian , Guanjun Liu , Jiacun Wang , Mengchu Zhou

Graph Neural Networks have shown excellent performance on semi-supervised classification tasks. However, they assume access to a graph that may not be often available in practice. In the absence of any graph, constructing k-Nearest Neighbor…

Machine Learning · Computer Science 2021-02-23 Vijay Lingam , Arun Iyer , Rahul Ragesh

Graph neural networks have shown significant success in the field of graph representation learning. Graph convolutions perform neighborhood aggregation and represent one of the most important graph operations. Nevertheless, one layer of…

Machine Learning · Computer Science 2020-07-21 Meng Liu , Hongyang Gao , Shuiwang Ji

Graph Convolutional Networks (GCNs) have recently become the primary choice for learning from graph-structured data, superseding hash fingerprints in representing chemical compounds. However, GCNs lack the ability to take into account the…

Machine Learning · Computer Science 2020-07-03 Tomasz Danel , Przemysław Spurek , Jacek Tabor , Marek Śmieja , Łukasz Struski , Agnieszka Słowik , Łukasz Maziarka

Forecasting the trajectories of neighbor vehicles is a crucial step for decision making and motion planning of autonomous vehicles. This paper proposes a graph-based spatial-temporal convolutional network (GSTCN) to predict future…

Machine Learning · Computer Science 2022-10-17 Zihao Sheng , Yunwen Xu , Shibei Xue , Dewei Li

Graph Neural Networks (GNNs) have shown expressive performance on graph representation learning by aggregating information from neighbors. Recently, some studies have discussed the importance of modeling neighborhood distribution on the…

Machine Learning · Computer Science 2023-01-31 Wendong Bi , Lun Du , Qiang Fu , Yanlin Wang , Shi Han , Dongmei Zhang