English
Related papers

Related papers: Multi-task Self-distillation for Graph-based Semi-…

200 papers

For large-scale applications, there is growing interest in replacing Graph Neural Networks (GNNs) with lightweight Multi-Layer Perceptrons (MLPs) via knowledge distillation. However, distilling GNNs for self-supervised graph representation…

Machine Learning · Computer Science 2025-10-07 Seong Jin Ahn , Myoung-Ho Kim

Graphs can inherently model interconnected objects on the Web, thereby facilitating a series of Web applications, such as web analyzing and content recommendation. Recently, Graph Neural Networks (GNNs) have emerged as a mainstream…

Computation and Language · Computer Science 2024-08-27 Xingtong Yu , Chang Zhou , Yuan Fang , Xinming Zhang

Graph-based semi-supervised learning (SSL) algorithms predict labels for all nodes based on provided labels of a small set of seed nodes. Classic methods capture the graph structure through some underlying diffusion process that propagates…

Machine Learning · Computer Science 2017-03-16 Eliav Buchnik , Edith Cohen

The human ability to synchronize the feedback from all their senses inspired recent works in multi-task and multi-modal learning. While these works rely on expensive supervision, our multi-task graph requires only pseudo-labels from expert…

Machine Learning · Computer Science 2021-11-05 Emanuela Haller , Elena Burceanu , Marius Leordeanu

The graph convolution network (GCN) is a widely-used facility to realize graph-based semi-supervised learning, which usually integrates node features and graph topologic information to build learning models. However, as for multi-label…

Machine Learning · Computer Science 2019-07-15 Kaisheng Gao , Jing Zhang , Cangqi Zhou

We present a semi-supervised learning framework based on graph embeddings. Given a graph between instances, we train an embedding for each instance to jointly predict the class label and the neighborhood context in the graph. We develop…

Machine Learning · Computer Science 2016-05-30 Zhilin Yang , William W. Cohen , Ruslan Salakhutdinov

Graph Neural Networks have shown excellent performance on semi-supervised classification tasks. However, they assume access to a graph that may not be often available in practice. In the absence of any graph, constructing k-Nearest Neighbor…

Machine Learning · Computer Science 2021-02-23 Vijay Lingam , Arun Iyer , Rahul Ragesh

Consistency training is a popular method to improve deep learning models in computer vision and natural language processing. Graph neural networks (GNNs) have achieved remarkable performance in a variety of network science learning tasks,…

Machine Learning · Computer Science 2021-10-14 Cole Hawkins , Vassilis N. Ioannidis , Soji Adeshina , George Karypis

Inspired by the extensive success of deep learning, graph neural networks (GNNs) have been proposed to learn expressive node representations and demonstrated promising performance in various graph learning tasks. However, existing endeavors…

Machine Learning · Computer Science 2022-04-05 Kaize Ding , Jianling Wang , James Caverlee , Huan Liu

Modern data analysis pipelines are becoming increasingly complex due to the presence of multi-view information sources. While graphs are effective in modeling complex relationships, in many scenarios a single graph is rarely sufficient to…

Machine Learning · Statistics 2019-04-02 Uday Shankar Shanthamallu , Jayaraman J. Thiagarajan , Huan Song , Andreas Spanias

This paper introduces a cutting-edge method for enhancing recommender systems through the integration of generative self-supervised learning (SSL) with a Residual Graph Transformer. Our approach emphasizes the importance of superior data…

Information Retrieval · Computer Science 2025-04-16 Eya Mhedhbi , Youssef Mourchid , Alice Othmani

Graph representation learning plays a vital role in processing graph-structured data. However, prior arts on graph representation learning heavily rely on labeling information. To overcome this problem, inspired by the recent success of…

Machine Learning · Computer Science 2021-07-19 Ming Jin , Yizhen Zheng , Yuan-Fang Li , Chen Gong , Chuan Zhou , Shirui Pan

Semi-supervised node classification on graphs is an important research problem, with many real-world applications in information retrieval such as content classification on a social network and query intent classification on an e-commerce…

Machine Learning · Computer Science 2022-03-29 Zhihao Wen , Yuan Fang , Zemin Liu

Graph Neural Networks (GNNs) have been a prevailing technique for tackling various analysis tasks on graph data. A key premise for the remarkable performance of GNNs relies on complete and trustworthy initial graph descriptions (i.e., node…

Machine Learning · Computer Science 2022-12-27 Cuiying Huo , Di Jin , Yawen Li , Dongxiao He , Yu-Bin Yang , Lingfei Wu

Graph contrastive learning (GCL) has been widely applied to text classification tasks due to its ability to generate self-supervised signals from unlabeled data, thus facilitating model training. However, existing GCL-based text…

Machine Learning · Computer Science 2024-10-25 Wei Ai , Jianbin Li , Ze Wang , Jiayi Du , Tao Meng , Yuntao Shou , Keqin Li

Graph property prediction tasks are important and numerous. While each task offers a small size of labeled examples, unlabeled graphs have been collected from various sources and at a large scale. A conventional approach is training a model…

Machine Learning · Computer Science 2023-10-13 Gang Liu , Eric Inae , Tong Zhao , Jiaxin Xu , Tengfei Luo , Meng Jiang

Semi-supervised learning on graphs is a widely applicable problem in network science and machine learning. Two standard algorithms -- label propagation and graph neural networks -- both operate by repeatedly passing information along edges,…

Machine Learning · Computer Science 2021-02-02 Junteng Jia , Austin R. Benson

Hypergraphs are a common model for multiway relationships in data, and hypergraph semi-supervised learning is the problem of assigning labels to all nodes in a hypergraph, given labels on just a few nodes. Diffusions and label spreading are…

Machine Learning · Computer Science 2022-02-14 Francesco Tudisco , Konstantin Prokopchik , Austin R. Benson

Transductive graph-based semi-supervised learning methods usually build an undirected graph utilizing both labeled and unlabeled samples as vertices. Those methods propagate label information of labeled samples to neighbors through their…

Machine Learning · Computer Science 2013-12-25 Fengqi Li , Chuang Yu , Nanhai Yang , Feng Xia , Guangming Li , Fatemeh Kaveh-Yazdy

Semi-supervised semantic segmentation relieves the reliance on large-scale labeled data by leveraging unlabeled data. Recent semi-supervised semantic segmentation approaches mainly resort to pseudo-labeling methods to exploit unlabeled…

Computer Vision and Pattern Recognition · Computer Science 2024-04-11 Hui Xiao , Yuting Hong , Li Dong , Diqun Yan , Jiayan Zhuang , Junjie Xiong , Dongtai Liang , Chengbin Peng