English
Related papers

Related papers: Distribution Consistency based Self-Training for G…

200 papers

Graph neural networks (GNNs) have been widely used in many graph-based tasks such as node classification, link prediction, and node clustering. However, GNNs gain their performance benefits mainly from performing the feature propagation and…

Machine Learning · Computer Science 2021-07-28 Wentao Zhang , Yuezihan Jiang , Yang Li , Zeang Sheng , Yu Shen , Xupeng Miao , Liang Wang , Zhi Yang , Bin Cui

Graph generative models have been extensively studied in the data mining literature. While traditional techniques are based on generating structures that adhere to a pre-decided distribution, recent techniques have shifted towards learning…

Machine Learning · Computer Science 2020-04-09 Nikhil Goyal , Harsh Vardhan Jain , Sayan Ranu

Deep neural networks are typically trained under a supervised learning framework where a model learns a single task using labeled data. Instead of relying solely on labeled data, practitioners can harness unlabeled or related data to…

Machine Learning · Computer Science 2020-07-03 Huanru Henry Mao

Graph representation learning has attracted lots of attention recently. Existing graph neural networks fed with the complete graph data are not scalable due to limited computation and memory costs. Thus, it remains a great challenge to…

Machine Learning · Computer Science 2020-11-24 Yizhu Jiao , Yun Xiong , Jiawei Zhang , Yao Zhang , Tianqi Zhang , Yangyong Zhu

In this paper, we present a simple and efficient method for training deep neural networks in a semi-supervised setting where only a small portion of training data is labeled. We introduce self-ensembling, where we form a consensus…

Neural and Evolutionary Computing · Computer Science 2017-03-16 Samuli Laine , Timo Aila

Recent semi-supervised learning methods use pseudo supervision as core idea, especially self-training methods that generate pseudo labels. However, pseudo labels are unreliable. Self-training methods usually rely on single model prediction…

Computer Vision and Pattern Recognition · Computer Science 2022-05-12 Zhengyang Feng , Qianyu Zhou , Qiqi Gu , Xin Tan , Guangliang Cheng , Xuequan Lu , Jianping Shi , Lizhuang Ma

Supervised learning algorithms based on Convolutional Neural Networks have become the benchmark for medical image segmentation tasks, but their effectiveness heavily relies on a large amount of labeled data. However, annotating medical…

Image and Video Processing · Electrical Eng. & Systems 2023-11-20 Tao Wang , Yuanbin Chen , Xinlin Zhang , Yuanbo Zhou , Junlin Lan , Bizhe Bai , Tao Tan , Min Du , Qinquan Gao , Tong Tong

Graph convolutional networks produce good predictions of unlabeled samples due to its transductive label propagation. Since samples have different predicted confidences, we take high-confidence predictions as pseudo labels to expand the…

Machine Learning · Computer Science 2020-09-07 Kun Zhan , Chaoxi Niu

Despite the success of text-to-text pre-trained models in various natural language generation (NLG) tasks, the generation performance is largely restricted by the number of labeled data in downstream tasks, particularly in data-to-text…

Computation and Language · Computer Science 2022-06-07 Pei Ke , Haozhe Ji , Zhenyu Yang , Yi Huang , Junlan Feng , Xiaoyan Zhu , Minlie Huang

The graph convolutional network (GCN) is a go-to solution for machine learning on graphs, but its training is notoriously difficult to scale both in terms of graph size and the number of model parameters. Although some work has explored…

Machine Learning · Computer Science 2022-03-15 Cameron R. Wolfe , Jingkang Yang , Arindam Chowdhury , Chen Dun , Artun Bayer , Santiago Segarra , Anastasios Kyrillidis

The Graph Convolutional Networks (GCNs) have achieved excellent results in node classification tasks, but the model's performance at low label rates is still unsatisfactory. Previous studies in Semi-Supervised Learning (SSL) for graph have…

Machine Learning · Computer Science 2023-11-30 Shuhao Shi , Jian Chen , Kai Qiao , Shuai Yang , Linyuan Wang , Bin Yan

In medical image segmentation, supervised deep networks' success comes at the cost of requiring abundant labeled data. While asking domain experts to annotate only one or a few of the cohort's images is feasible, annotating all available…

Computer Vision and Pattern Recognition · Computer Science 2021-10-06 Devavrat Tomar , Behzad Bozorgtabar , Manana Lortkipanidze , Guillaume Vray , Mohammad Saeed Rad , Jean-Philippe Thiran

The pre-training on the graph neural network model can learn the general features of large-scale networks or networks of the same type by self-supervised methods, which allows the model to work even when node labels are missing. However,…

Machine Learning · Computer Science 2022-04-19 Ke-jia Chen , Jiajun Zhang , Linpu Jiang , Yunyun Wang , Yuxuan Dai

Semi-supervised node classification on graphs is an important research problem, with many real-world applications in information retrieval such as content classification on a social network and query intent classification on an e-commerce…

Machine Learning · Computer Science 2022-03-29 Zhihao Wen , Yuan Fang , Zemin Liu

This paper proposes a novel pixel-level distribution regularization scheme (DRSL) for self-supervised domain adaptation of semantic segmentation. In a typical setting, the classification loss forces the semantic segmentation model to…

Computer Vision and Pattern Recognition · Computer Science 2022-06-22 Javed Iqbal , Hamza Rawal , Rehan Hafiz , Yu-Tseh Chi , Mohsen Ali

Graph Neural Networks (GNNs) have been widely employed for semi-supervised node classification tasks on graphs. However, the performance of GNNs is significantly affected by label noise, that is, a small amount of incorrectly labeled nodes…

Machine Learning · Computer Science 2024-11-19 Rui Zhao , Bin Shi , Zhiming Liang , Jianfei Ruan , Bo Dong , Lu Lin

Graph Neural Networks (GNNs) have evolved to understand graph structures through recursive exchanges and aggregations among nodes. To enhance robustness, self-supervised learning (SSL) has become a vital tool for data augmentation.…

Computation and Language · Computer Science 2024-05-08 Jiabin Tang , Yuhao Yang , Wei Wei , Lei Shi , Lixin Su , Suqi Cheng , Dawei Yin , Chao Huang

Due to the difficulty of obtaining labeled data for hyperspectral images (HSIs), cross-scene classification has emerged as a widely adopted approach in the remote sensing community. It involves training a model using labeled data from a…

Computer Vision and Pattern Recognition · Computer Science 2025-02-26 Rong Liu , Junye Liang , Jiaqi Yang , Jiang He , Peng Zhu

Graph few-shot learning is of great importance among various graph learning tasks. Under the few-shot scenario, models are often required to conduct classification given limited labeled samples. Existing graph few-shot learning methods…

Machine Learning · Computer Science 2022-10-24 Song Wang , Chen Chen , Jundong Li

We consider a novel data driven approach for designing learning algorithms that can effectively learn with only a small number of labeled examples. This is crucial for modern machine learning applications where labels are scarce or…

Machine Learning · Computer Science 2021-10-01 Maria-Florina Balcan , Dravyansh Sharma