English
Related papers

Related papers: When Contrastive Learning Meets Active Learning: A…

200 papers

In recent years, continual learning (CL) techniques have made significant progress in learning from streaming data while preserving knowledge across sequential tasks, particularly in the realm of euclidean data. To foster fair evaluation…

Machine Learning · Computer Science 2024-06-10 Tianqi Zhao , Alan Hanjalic , Megha Khosla

Graph convolutional network (GCN) provides a powerful means for graph-based semi-supervised tasks. However, as a localized first-order approximation of spectral graph convolution, the classic GCN can not take full advantage of unlabeled…

Machine Learning · Computer Science 2018-09-27 Yawei Luo , Tao Guan , Junqing Yu , Ping Liu , Yi Yang

Graph Neural Networks (GNNs) have shown remarkable capabilities in learning from graph-structured data with various applications such as social analysis and bioinformatics. However, the presence of label noise in real scenarios poses a…

Machine Learning · Computer Science 2026-01-27 Wei Ju , Wei Zhang , Siyu Yi , Zhengyang Mao , Yifan Wang , Jingyang Yuan , Zhiping Xiao , Ziyue Qiao , Ming Zhang

Graph contrastive learning (GCL) has attracted a surge of attention due to its superior performance for learning node/graph representations without labels. However, in practice, the underlying class distribution of unlabeled nodes for the…

Machine Learning · Computer Science 2023-05-04 Liang Zeng , Lanqing Li , Ziqi Gao , Peilin Zhao , Jian Li

Graph Neural Networks (GNNs) have been highly successful for the node classification task. GNNs typically assume graphs are homophilic, i.e. neighboring nodes are likely to belong to the same class. However, a number of real-world graphs…

Machine Learning · Computer Science 2024-09-20 Yurui Lai , Taiyan Zhang , Rui Fan

Contrastive learning has emerged as a powerful tool for graph representation learning. However, most contrastive learning methods learn features of graphs with fixed coarse-grained scale, which might underestimate either local or global…

Machine Learning · Computer Science 2022-10-24 Jun Wang , Weixun Li , Changyu Hou , Xin Tang , Yixuan Qiao , Rui Fang , Pengyong Li , Peng Gao , Guotong Xie

Sufficient supervised information is crucial for any machine learning models to boost performance. However, labeling data is expensive and sometimes difficult to obtain. Active learning is an approach to acquire annotations for data from a…

Machine Learning · Computer Science 2019-06-18 Quan Kong , Bin Tong , Martin Klinkigt , Yuki Watanabe , Naoto Akira , Tomokazu Murakami

The field of Natural Language Generation (NLG) suffers from a severe shortage of labeled data due to the extremely expensive and time-consuming process involved in manual annotation. A natural approach for coping with this problem is active…

Computation and Language · Computer Science 2023-10-18 Yotam Perlitz , Ariel Gera , Michal Shmueli-Scheuer , Dafna Sheinwald , Noam Slonim , Liat Ein-Dor

Heterogeneous graph neural networks (HGNNs) have been widely applied in heterogeneous information network tasks, while most HGNNs suffer from poor scalability or weak representation when they are applied to large-scale heterogeneous graphs.…

Machine Learning · Computer Science 2022-11-23 Ziming Wan , Deqing Wang , Xuehua Ming , Fuzhen Zhuang , Chenguang Du , Ting Jiang , Zhengyang Zhao

Graph Neural Networks (GNNs) have emerged as a powerful tool for representation learning on graphs, but they often suffer from overfitting and label noise issues, especially when the data is scarce or imbalanced. Different from the paradigm…

Machine Learning · Computer Science 2023-12-15 Yifan Li , Zhen Tan , Kai Shu , Zongsheng Cao , Yu Kong , Huan Liu

Active learning (AL) combines data labeling and model training to minimize the labeling cost by prioritizing the selection of high value data that can best improve model performance. In pool-based active learning, accessible unlabeled data…

Machine Learning · Computer Science 2020-07-21 Mingfei Gao , Zizhao Zhang , Guo Yu , Sercan O. Arik , Larry S. Davis , Tomas Pfister

Graph Neural Network (GNN) is an emerging technique for graph-based learning tasks such as node classification. In this work, we reveal the vulnerability of GNN to the imbalance of node labels. Traditional solutions for imbalanced…

Machine Learning · Computer Science 2022-02-08 Xiaohe Li , Lijie Wen , Yawen Deng , Fuli Feng , Xuming Hu , Lei Wang , Zide Fan

The promise of active learning (AL) is to reduce labelling costs by selecting the most valuable examples to annotate from a pool of unlabelled data. Identifying these examples is especially challenging with high-dimensional data (e.g.…

Computer Vision and Pattern Recognition · Computer Science 2022-03-15 Amin Parvaneh , Ehsan Abbasnejad , Damien Teney , Reza Haffari , Anton van den Hengel , Javen Qinfeng Shi

Graph classification is a critical research problem in many applications from different domains. In order to learn a graph classification model, the most widely used supervision component is an output layer together with classification loss…

Machine Learning · Computer Science 2021-01-15 Yuxiang Ren , Jiyang Bai , Jiawei Zhang

Active Learning (AL) is increasingly important in a broad range of applications. Two main AL principles to obtain accurate classification with few labeled data are refinement of the current decision boundary and exploration of poorly…

Machine Learning · Computer Science 2012-10-19 Jens Roeder , Boaz Nadler , Kevin Kunzmann , Fred A. Hamprecht

We investigate node representation learning on text-attributed graphs (TAGs), where nodes are associated with text information. Although recent studies on graph neural networks (GNNs) and pretrained language models (PLMs) have exhibited…

Information Retrieval · Computer Science 2024-04-22 Peiyan Zhang , Chaozhuo Li , Liying Kang , Feiran Huang , Senzhang Wang , Xing Xie , Sunghun Kim

Heterogeneous graph neural networks (HGNNs) as an emerging technique have shown superior capacity of dealing with heterogeneous information network (HIN). However, most HGNNs follow a semi-supervised learning manner, which notably limits…

Machine Learning · Computer Science 2021-05-20 Xiao Wang , Nian Liu , Hui Han , Chuan Shi

Semi-supervised node classification on graphs is an important research problem, with many real-world applications in information retrieval such as content classification on a social network and query intent classification on an e-commerce…

Machine Learning · Computer Science 2022-03-29 Zhihao Wen , Yuan Fang , Zemin Liu

Graph Neural Networks (GNNs) are prominent in handling sparse and unstructured data efficiently and effectively. Specifically, GNNs were shown to be highly effective for node classification tasks, where labelled information is available for…

Machine Learning · Computer Science 2022-12-01 Moshe Eliasof , Eldad Haber , Eran Treister

While contrastive self-supervised learning has become the de-facto learning paradigm for graph neural networks, the pursuit of higher task accuracy requires a larger hidden dimensionality to learn informative and discriminative…

Neural and Evolutionary Computing · Computer Science 2024-02-20 Jintang Li , Huizhe Zhang , Ruofan Wu , Zulun Zhu , Baokun Wang , Changhua Meng , Zibin Zheng , Liang Chen