English
Related papers

Related papers: Confidence May Cheat: Self-Training on Graph Neura…

200 papers

Clustering-based methods, which alternate between the generation of pseudo labels and the optimization of the feature extraction network, play a dominant role in both unsupervised learning (USL) and unsupervised domain adaptive (UDA) person…

Computer Vision and Pattern Recognition · Computer Science 2022-06-15 Tianyi Yan , Kuan Zhu , Haiyun guo , Guibo Zhu , Ming Tang , Jinqiao Wang

Evaluating the performance of a well-trained GNN model on real-world graphs is a pivotal step for reliable GNN online deployment and serving. Due to a lack of test node labels and unknown potential training-test graph data distribution…

Machine Learning · Computer Science 2024-03-18 Xin Zheng , Dongjin Song , Qingsong Wen , Bo Du , Shirui Pan

While graph neural networks (GNNs) are widely used for node and graph representation learning tasks, the reliability of GNN uncertainty estimates under distribution shifts remains relatively under-explored. Indeed, while post-hoc…

Machine Learning · Computer Science 2024-12-16 Puja Trivedi , Mark Heimann , Rushil Anirudh , Danai Koutra , Jayaraman J. Thiagarajan

The original design of Graph Convolution Network (GCN) couples feature transformation and neighborhood aggregation for node representation learning. Recently, some work shows that coupling is inferior to decoupling, which supports deep…

Machine Learning · Computer Science 2021-02-16 Hande Dong , Jiawei Chen , Fuli Feng , Xiangnan He , Shuxian Bi , Zhaolin Ding , Peng Cui

Recently, graph Convolutional Neural Networks (graph CNNs) have been widely used for graph data representation and semi-supervised learning tasks. However, existing graph CNNs generally use a fixed graph which may be not optimal for…

Computer Vision and Pattern Recognition · Computer Science 2018-11-27 Bo Jiang , Ziyan Zhang , Doudou Lin , Jin Tang

Graph Convolution Networks (GCNs) are becoming more and more popular for learning node representations on graphs. Though there exist various developments on sampling and aggregation to accelerate the training process and improve the…

Machine Learning · Computer Science 2020-10-30 Xu Zou , Qiuye Jia , Jianwei Zhang , Chang Zhou , Hongxia Yang , Jie Tang

Despite their recent success, deep neural networks continue to perform poorly when they encounter distribution shifts at test time. Many recently proposed approaches try to counter this by aligning the model to the new distribution prior to…

Computer Vision and Pattern Recognition · Computer Science 2022-09-26 Samarth Sinha , Peter Gehler , Francesco Locatello , Bernt Schiele

Recent advances in domain adaptation show that deep self-training presents a powerful means for unsupervised domain adaptation. These methods often involve an iterative process of predicting on target domain and then taking the confident…

Computer Vision and Pattern Recognition · Computer Science 2020-07-16 Yang Zou , Zhiding Yu , Xiaofeng Liu , B. V. K. Vijaya Kumar , Jinsong Wang

We describe a computationally efficient, stochastic graph-regularization technique that can be utilized for the semi-supervised training of deep neural networks in a parallel or distributed setting. We utilize a technique, first described…

Machine Learning · Statistics 2018-05-31 Sunil Thulasidasan , Jeffrey Bilmes , Garrett Kenyon

Deep neural networks often produce overconfident predictions, undermining their reliability in safety-critical applications. This miscalibration is further exacerbated under distribution shift, where test data deviates from the training…

Computer Vision and Pattern Recognition · Computer Science 2025-08-28 Yilin Zhang , Cai Xu , You Wu , Ziyu Guan , Wei Zhao

Out-of-distribution (OOD) generalization has gained increasing attentions for learning on graphs, as graph neural networks (GNNs) often exhibit performance degradation with distribution shifts. The challenge is that distribution shifts on…

Machine Learning · Computer Science 2024-08-19 Qitian Wu , Fan Nie , Chenxiao Yang , Tianyi Bao , Junchi Yan

Semi-supervised learning (SSL) over graph-structured data emerges in many network science applications. To efficiently manage learning over graphs, variants of graph neural networks (GNNs) have been developed recently. By succinctly…

Machine Learning · Computer Science 2021-10-22 Alireza Sadeghi , Meng Ma , Bingcong Li , Georgios B. Giannakis

Graph Neural Networks (GNNs) show promising results for graph tasks. However, existing GNNs' generalization ability will degrade when there exist distribution shifts between testing and training graph data. The cardinal impetus underlying…

Machine Learning · Computer Science 2023-12-21 Zhengyu Chen , Teng Xiao , Kun Kuang , Zheqi Lv , Min Zhang , Jinluan Yang , Chengqiang Lu , Hongxia Yang , Fei Wu

The success of deep learning notoriously requires larger amounts of costly annotated data. This has led to the development of self-supervised learning (SSL) that aims to alleviate this limitation by creating domain specific pretext tasks on…

Machine Learning · Computer Science 2020-06-19 Wei Jin , Tyler Derr , Haochen Liu , Yiqi Wang , Suhang Wang , Zitao Liu , Jiliang Tang

Models capable of leveraging unlabelled data are crucial in overcoming large distribution gaps between the acquired datasets across different imaging devices and configurations. In this regard, self-training techniques based on…

Computer Vision and Pattern Recognition · Computer Science 2023-08-01 Negin Ghamsarian , Javier Gamazo Tejero , Pablo Márquez Neila , Sebastian Wolf , Martin Zinkernagel , Klaus Schoeffmann , Raphael Sznitman

Graph learning (GL) can dynamically capture the distribution structure (graph structure) of data based on graph convolutional networks (GCN), and the learning quality of the graph structure directly influences GCN for semi-supervised…

Computer Vision and Pattern Recognition · Computer Science 2020-06-01 Guangfeng Lin , Xiaobing Kang , Kaiyang Liao , Fan Zhao , Yajun Chen

As the demand for user privacy grows, controlled data removal (machine unlearning) is becoming an important feature of machine learning models for data-sensitive Web applications such as social networks and recommender systems.…

Machine Learning · Computer Science 2023-07-04 Chao Pan , Eli Chien , Olgica Milenkovic

Recently, Graph Convolutional Networks (GCNs) and their variants have been receiving many research interests for learning graph-related tasks. While the GCNs have been successfully applied to this problem, some caveats inherited from…

Machine Learning · Computer Science 2019-11-11 Mustafa Coskun

Graph Neural Networks (GNNs) are powerful tools for learning from graph-structured data, but their scalability is increasingly strained by the size of real-world graphs in domains like recommender systems, fraud detection, and molecular…

Machine Learning · Computer Science 2026-05-22 Mridul Gupta , Samyak Jain , Vansh Ramani , Hariprasad Kodamana , Sayan Ranu

As a specific case of graph transfer learning, unsupervised domain adaptation on graphs aims for knowledge transfer from label-rich source graphs to unlabeled target graphs. However, graphs with topology and attributes usually have…

Machine Learning · Computer Science 2024-10-01 Ziyue Qiao , Xiao Luo , Meng Xiao , Hao Dong , Yuanchun Zhou , Hui Xiong