English
Related papers

Related papers: Neighbor-Sampling Based Momentum Stochastic Method…

200 papers

Graph instance contrastive learning has been proved as an effective task for Graph Neural Network (GNN) pre-training. However, one key issue may seriously impede the representative power in existing works: Positive instances created by…

Machine Learning · Computer Science 2022-06-27 Xueyi Liu , Yu Rong , Tingyang Xu , Fuchun Sun , Wenbing Huang , Junzhou Huang

Recent years have witnessed the deployment of adversarial attacks to evaluate the robustness of Neural Networks. Past work in this field has relied on traditional optimization algorithms that ignore the inherent structure of the problem and…

Machine Learning · Computer Science 2021-06-01 Florian Jaeckle , M. Pawan Kumar

Graph Convolutional Network (GCN) is a model that can effectively handle graph data tasks and has been successfully applied. However, for large-scale graph datasets, GCN still faces the challenge of high computational overhead, especially…

Machine Learning · Computer Science 2026-04-15 Guan Wang , Shuyin Xia , Lei Qian , Tao Wu , Guoyin Wang , Yi Wang , Wei Wang

Stochastic gradient descent (SGD) with stochastic momentum is popular in nonconvex stochastic optimization and particularly for the training of deep neural networks. In standard SGD, parameters are updated by improving along the path of the…

Machine Learning · Computer Science 2021-06-08 Jun-Kun Wang , Chi-Heng Lin , Jacob Abernethy

Graph condensation reduces the size of large graphs while preserving performance, addressing the scalability challenges of Graph Neural Networks caused by computational inefficiencies on large datasets. Existing methods often rely on…

Machine Learning · Computer Science 2025-10-10 Lin Wang , Qing Li

The design of deep graph models still remains to be investigated and the crucial part is how to explore and exploit the knowledge from different hops of neighbors in an efficient way. In this paper, we propose a novel RNN-like deep graph…

Machine Learning · Computer Science 2021-03-16 Ke Sun , Zhanxing Zhu , Zhouchen Lin

Stochastic graph neural networks (SGNNs) are information processing architectures that learn representations from data over random graphs. SGNNs are trained with respect to the expected performance, which comes with no guarantee about…

Signal Processing · Electrical Eng. & Systems 2023-03-22 Zhan Gao , Elvin Isufi

We investigate machine learning approaches to approximating the \emph{domination number} of graphs, the minimum size of a dominating set. Exact computation of this parameter is NP-hard, restricting classical methods to small instances. We…

Machine Learning · Computer Science 2025-11-25 Randy Davila , Beyzanur Ispir

Deep neural networks (DNN) are typically optimized using stochastic gradient descent (SGD). However, the estimation of the gradient using stochastic samples tends to be noisy and unreliable, resulting in large gradient variance and bad…

Machine Learning · Computer Science 2021-05-18 Xingyi Yang

Short-term traffic flow prediction is a vital branch of the Intelligent Traffic System (ITS) and plays an important role in traffic management. Graph convolution network (GCN) is widely used in traffic prediction models to better deal with…

Machine Learning · Computer Science 2022-05-11 Zhijun Chen , Zhe Lu , Qiushi Chen , Hongliang Zhong , Yishi Zhang , Jie Xue , Chaozhong Wu

Graph convolution network based approaches have been recently used to model region-wise relationships in region-level prediction problems in urban computing. Each relationship represents a kind of spatial dependency, like region-wise…

Machine Learning · Computer Science 2019-05-29 Xu Geng , Xiyu Wu , Lingyu Zhang , Qiang Yang , Yan Liu , Jieping Ye

We present a new neighbor sampling method on temporal graphs. In a temporal graph, predicting different nodes' time-varying properties can require the receptive neighborhood of various temporal scales. In this work, we propose the TNS…

Social and Information Networks · Computer Science 2021-12-21 Yiwei Wang , Yujun Cai , Yuxuan Liang , Henghui Ding , Changhu Wang , Bryan Hooi

Graph Convolutional Networks (GCNs) have gained great popularity in tackling various analytics tasks on graph and network data. However, some recent studies raise concerns about whether GCNs can optimally integrate node features and…

Machine Learning · Computer Science 2020-07-14 Xiao Wang , Meiqi Zhu , Deyu Bo , Peng Cui , Chuan Shi , Jian Pei

The recent rapid growth in mobile data traffic entails a pressing demand for improving the throughput of the underlying wireless communication networks. Network node deployment has been considered as an effective approach for throughput…

Networking and Internet Architecture · Computer Science 2022-09-16 Yifei Yang , Dongmian Zou , Xiaofan He

Graph Neural Networks (GNNs) are increasingly becoming the favorite method for graph learning. They exploit the semi-supervised nature of deep learning, and they bypass computational bottlenecks associated with traditional graph learning…

Machine Learning · Computer Science 2023-11-08 Mashaan Alshammari , John Stavrakakis , Adel F. Ahmed , Masahiro Takatsuka

We propose a theoretical framework for training Graph Neural Networks (GNNs) on large input graphs via training on small, fixed-size sampled subgraphs. This framework is applicable to a wide range of models, including popular sampling-based…

Machine Learning · Computer Science 2023-10-18 Yeganeh Alimohammadi , Luana Ruiz , Amin Saberi

Training a Convolutional Neural Network (CNN) to be robust against rotation has mostly been done with data augmentation. In this paper, another progressive vision of research direction is highlighted to encourage less dependence on data…

Computer Vision and Pattern Recognition · Computer Science 2021-10-22 Sungwon Hwang , Hyungtae Lim , Hyun Myung

Graph Convolutional Neural Networks (GCNs) has been generally accepted to be an effective tool for node representations learning. An interesting way to understand GCNs is to think of them as a message passing mechanism where each node…

Machine Learning · Computer Science 2022-10-04 Wei Duan , Junyu Xuan , Maoying Qiao , Jie Lu

The vision-based grasp detection method is an important research direction in the field of robotics. However, due to the rectangle metric of the grasp detection rectangle's limitation, a false-positive grasp occurs, resulting in the failure…

Robotics · Computer Science 2022-05-10 Yuanhao Li , Yu Liu , Zhiqiang Ma , Panfeng Huang

Graph-based learning is a rapidly growing sub-field of machine learning with applications in social networks, citation networks, and bioinformatics. One of the most popular models is graph attention networks. They were introduced to allow a…

Machine Learning · Computer Science 2023-05-23 Kimon Fountoulakis , Amit Levi , Shenghao Yang , Aseem Baranwal , Aukosh Jagannath