English
Related papers

Related papers: Always be Pre-Training: Representation Learning fo…

200 papers

Graph Neural Networks (GNNs) have achieved promising performance in various real-world applications. Building a powerful GNN model is not a trivial task, as it requires a large amount of training data, powerful computing resources, and…

Machine Learning · Computer Science 2022-11-15 Jing Xu , Stefanos Koffas , Oguzhan Ersoy , Stjepan Picek

Recently, graph neural networks (GNNs) have shown its unprecedented success in many graph-related tasks. However, GNNs face the label scarcity issue as other neural networks do. Thus, recent efforts try to pre-train GNNs on a large-scale…

Machine Learning · Computer Science 2024-03-04 Zhili Wang , Shimin Di , Lei Chen , Xiaofang Zhou

While the advent of Graph Neural Networks (GNNs) has greatly improved node and graph representation learning in many applications, the neighborhood aggregation scheme exposes additional vulnerabilities to adversaries seeking to extract…

Machine Learning · Computer Science 2021-06-15 Peiyuan Liao , Han Zhao , Keyulu Xu , Tommi Jaakkola , Geoffrey Gordon , Stefanie Jegelka , Ruslan Salakhutdinov

Graph Anomaly Detection (GAD) is a challenging and practical research topic where Graph Neural Networks (GNNs) have recently shown promising results. The effectiveness of existing GNNs in GAD has been mainly attributed to the simultaneous…

Machine Learning · Computer Science 2024-10-25 Jiashun Cheng , Zinan Zheng , Yang Liu , Jianheng Tang , Hongwei Wang , Yu Rong , Jia Li , Fugee Tsung

Graph Neural Networks (GNNs) are recognized as potent tools for processing real-world data organized in graph structures. Especially inductive GNNs, which allow for the processing of graph-structured data without relying on predefined graph…

Machine Learning · Computer Science 2024-11-21 Marcin Podhajski , Jan Dubiński , Franziska Boenisch , Adam Dziedzic , Agnieszka Pregowska , Tomasz P. Michalak

The first provably efficient algorithm for learning graph neural networks (GNNs) with one hidden layer for node information convolution is provided in this paper. Two types of GNNs are investigated, depending on whether labels are attached…

Machine Learning · Computer Science 2020-12-08 Qunwei Li , Shaofeng Zou , Wenliang Zhong

The availability of large labeled datasets has allowed Convolutional Network models to achieve impressive recognition results. However, in many settings manual annotation of the data is impractical; instead our data has noisy labels, i.e.…

Computer Vision and Pattern Recognition · Computer Science 2015-04-13 Sainbayar Sukhbaatar , Joan Bruna , Manohar Paluri , Lubomir Bourdev , Rob Fergus

With the rapid growth of interconnected devices, accurately detecting malicious activities in network traffic has become increasingly challenging. Most existing deep learning-based intrusion detection systems treat network flows as…

Cryptography and Security · Computer Science 2026-03-25 Devashish Chaudhary , Sutharshan Rajasegarar , Shiva Raj Pokhrel

Graph neural networks (GNNs) have attracted considerable attention due to their diverse applications. However, the scarcity and quality limitations of graph data present challenges to their training process in practical settings. To…

Machine Learning · Computer Science 2024-11-07 Hanyang Yuan , Jiarong Xu , Renhong Huang , Mingli Song , Chunping Wang , Yang Yang

Machine learning has shown promise in network intrusion detection systems, yet its performance often degrades due to concept drift and imbalanced data. These challenges are compounded by the labor-intensive process of labeling network…

Networking and Internet Architecture · Computer Science 2025-08-15 Ragini Gupta , Shinan Liu , Ruixiao Zhang , Xinyue Hu , Xiaoyang Wang , Hadjer Benkraouda , Pranav Kommaraju , Phuong Cao , Nick Feamster , Klara Nahrstedt

In the semi-supervised setting where labeled data are largely limited, it remains to be a big challenge for message passing based graph neural networks (GNNs) to learn feature representations for the nodes with the same class label that is…

Machine Learning · Computer Science 2023-05-09 Acong Zhang , Ping Li , Guanrong Chen

Graphs representation learning has been a very active research area in recent years. The goal of graph representation learning is to generate graph representation vectors that capture the structure and features of large graphs accurately.…

Machine Learning · Computer Science 2022-06-16 Shima Khoshraftar , Aijun An

In many machine learning applications, labeled data is scarce and obtaining more labels is expensive. We introduce a new approach to supervising neural networks by specifying constraints that should hold over the output space, rather than…

Artificial Intelligence · Computer Science 2016-09-20 Russell Stewart , Stefano Ermon

The search for new high-performance organic semiconducting molecules is challenging due to the vastness of the chemical space, machine learning methods, particularly deep learning models like graph neural networks (GNNs), have shown…

Chemical Physics · Physics 2021-12-06 Zaixi Zhang , Qi Liu , Shengyu Zhang , Chang-Yu Hsieh , Liang Shi , Chee-Kong Lee

Self-supervised learning has shown its promising capability in graph representation learning in recent work. Most existing pre-training strategies usually choose the popular Graph neural networks (GNNs), which can be seen as a special form…

Machine Learning · Computer Science 2023-06-16 Yilin Ding , Zhen Liu , Hao Hao

Graph Neural Networks (GNNs) are able to achieve high classification accuracy on many important real world datasets, but provide no rigorous notion of predictive uncertainty. Quantifying the confidence of GNN models is difficult due to the…

Machine Learning · Statistics 2024-01-10 Jase Clarkson

Graph-based methods have been demonstrated as one of the most effective approaches for semi-supervised learning, as they can exploit the connectivity patterns between labeled and unlabeled data samples to improve learning performance.…

Machine Learning · Computer Science 2019-07-01 Qimai Li , Xiao-Ming Wu , Han Liu , Xiaotong Zhang , Zhichao Guan

Accurate routing network status estimation is a key component in Software Defined Networking. However, existing deep-learning-based methods for modeling network routing are not able to extrapolate towards unseen feature distributions. Nor…

Networking and Internet Architecture · Computer Science 2024-04-29 Yifei Jin , Marios Daoutis , Sarunas Girdzijauskas , Aristides Gionis

Graph neural networks (GNNs) have become instrumental in diverse real-world applications, offering powerful graph learning capabilities for tasks such as social networks and medical data analysis. Despite their successes, GNNs are…

Machine Learning · Computer Science 2024-06-13 Peizhi Niu , Chao Pan , Siheng Chen , Olgica Milenkovic

This work studies ensemble learning for graph neural networks (GNNs) under the popular semi-supervised setting. Ensemble learning has shown superiority in improving the accuracy and robustness of traditional machine learning by combining…

Machine Learning · Computer Science 2024-05-07 Xin Zhang , Daochen Zha , Qiaoyu Tan