English
Related papers

Related papers: Robust Optimization as Data Augmentation for Large…

200 papers

Out-of-distribution generalization can be categorized into two types: common perturbations arising from natural variations in the real world and adversarial perturbations that are intentionally crafted to deceive neural networks. While deep…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Fatemeh Amerehi , Patrick Healy

Graph Neural Networks (GNNs) are increasingly important given their popularity and the diversity of applications. Yet, existing studies of their vulnerability to adversarial attacks rely on relatively small graphs. We address this gap and…

Machine Learning · Computer Science 2023-05-02 Simon Geisler , Tobias Schmidt , Hakan Şirin , Daniel Zügner , Aleksandar Bojchevski , Stephan Günnemann

Graph neural networks (GNNs) are processing architectures that exploit graph structural information to model representations from network data. Despite their success, GNNs suffer from sub-optimal generalization performance given limited…

Machine Learning · Computer Science 2021-06-08 Zhan Gao , Subhrajit Bhattacharya , Leiming Zhang , Rick S. Blum , Alejandro Ribeiro , Brian M. Sadler

Despite the success of input transformation-based attacks on boosting adversarial transferability, the performance is unsatisfying due to the ignorance of the discrepancy across models. In this paper, we propose a simple but effective…

Computer Vision and Pattern Recognition · Computer Science 2024-07-10 Donghua Wang , Wen Yao , Tingsong Jiang , Xiaohu Zheng , Junqi Wu , Xiaoqian Chen

Graph-level anomaly detection (GLAD) has already gained significant importance and has become a popular field of study, attracting considerable attention across numerous downstream works. The core focus of this domain is to capture and…

Machine Learning · Computer Science 2024-07-17 Zitong Wang , Xuexiong Luo , Enfeng Song , Qiuqing Bai , Fu Lin

Recently, data augmentation in the semi-supervised regime, where unlabeled data vastly outnumbers labeled data, has received a considerable attention. In this paper, we describe an efficient technique for this task, exploiting a recent…

Machine Learning · Statistics 2019-06-21 Indro Spinelli , Simone Scardapane , Michele Scarpiniti , Aurelio Uncini

Graph augmentation with contrastive learning has gained significant attention in the field of recommendation systems due to its ability to learn expressive user representations, even when labeled data is limited. However, directly applying…

Machine Learning · Computer Science 2024-03-26 Qianru Zhang , Lianghao Xia , Xuheng Cai , Siuming Yiu , Chao Huang , Christian S. Jensen

Graph machine learning (GML) has made great progress in node classification, link prediction, graph classification and so on. However, graphs in reality are often structurally imbalanced, that is, only a few hub nodes have a denser local…

Machine Learning · Computer Science 2023-03-27 Zulong Liu , Kejia-Chen , Zheng Liu

Self-supervised learning of graph neural networks (GNN) is in great need because of the widespread label scarcity issue in real-world graph/network data. Graph contrastive learning (GCL), by training GNNs to maximize the correspondence…

Machine Learning · Computer Science 2021-11-04 Susheel Suresh , Pan Li , Cong Hao , Jennifer Neville

Graph classification, which aims to identify the category labels of graphs, plays a significant role in drug classification, toxicity detection, protein analysis etc. However, the limitation of scale in the benchmark datasets makes it easy…

Machine Learning · Computer Science 2021-04-06 Jiajun Zhou , Jie Shen , Shanqing Yu , Guanrong Chen , Qi Xuan

How can we accurately classify graphs? Graph classification is a pivotal task in data mining with applications in social network analysis, web analysis, drug discovery, molecular property prediction, etc. Graph neural networks have achieved…

Machine Learning · Computer Science 2025-03-28 Minjun Kim , Jaehyeon Choi , SeungJoo Lee , Jinhong Jung , U Kang

Models for natural language and images benefit from data scaling behavior: the more data fed into the model, the better they perform. This 'better with more' phenomenon enables the effectiveness of large-scale pre-training on vast amounts…

Machine Learning · Computer Science 2025-10-08 Wenzhuo Tang , Haitao Mao , Danial Dervovic , Ivan Brugere , Saumitra Mishra , Yuying Xie , Jiliang Tang

The latest advancements in large language models (LLMs) have revolutionized the field of natural language processing (NLP). Inspired by the success of LLMs in NLP tasks, some recent work has begun investigating the potential of applying…

Artificial Intelligence · Computer Science 2025-02-25 Shengyin Sun , Yuxiang Ren , Jiehao Chen , Chen Ma

Graph neural networks (GNNs) have achieved impressive impressions for graph-related tasks. However, most GNNs are primarily studied under the cases of signal domain with supervised training, which requires abundant task-specific labels and…

Machine Learning · Computer Science 2025-07-16 Jinhui Pang , Zixuan Wang , Jiliang Tang , Mingyan Xiao , Nan Yin

Data augmentation has recently seen increased interest in graph machine learning given its demonstrated ability to improve model performance and generalization by added training data. Despite this recent surge, the area is still relatively…

Machine Learning · Computer Science 2023-01-20 Tong Zhao , Wei Jin , Yozen Liu , Yingheng Wang , Gang Liu , Stephan Günnemann , Neil Shah , Meng Jiang

We study the problem of semi-supervised learning on graphs, for which graph neural networks (GNNs) have been extensively explored. However, most existing GNNs inherently suffer from the limitations of over-smoothing, non-robustness, and…

Machine Learning · Computer Science 2021-09-22 Wenzheng Feng , Jie Zhang , Yuxiao Dong , Yu Han , Huanbo Luan , Qian Xu , Qiang Yang , Evgeny Kharlamov , Jie Tang

Data augmentation is a powerful technique to improve performance in applications such as image and text classification tasks. Yet, there is little rigorous understanding of why and how various augmentations work. In this work, we consider a…

Machine Learning · Computer Science 2023-07-28 Sen Wu , Hongyang R. Zhang , Gregory Valiant , Christopher Ré

Graph Neural Networks (GNNs) have achieved remarkable performance on graph-based tasks. The key idea for GNNs is to obtain informative representation through aggregating information from local neighborhoods. However, it remains an open…

Machine Learning · Computer Science 2022-06-29 Songtao Liu , Rex Ying , Hanze Dong , Lanqing Li , Tingyang Xu , Yu Rong , Peilin Zhao , Junzhou Huang , Dinghao Wu

Graph augmentation methods play a crucial role in improving the performance and enhancing generalisation capabilities in Graph Neural Networks (GNNs). Existing graph augmentation methods mainly perturb the graph structures, and are usually…

Machine Learning · Computer Science 2024-08-14 Xiangyu Zhao , Zehui Li , Mingzhu Shen , Guy-Bart Stan , Pietro Liò , Yiren Zhao

Previous studies have demonstrated the strong performance of Graph Neural Networks (GNNs) in node classification. However, most existing GNNs adopt a node-centric perspective and rely on global message passing, leading to high computational…

Machine Learning · Computer Science 2026-01-14 Qian Zeng , Xin Lin , Jingyi Gao , Yang Yu