English
Related papers

Related papers: Self-supervised Heterogeneous Graph Pre-training B…

200 papers

Image synthesis and image-to-image translation are two important generative learning tasks. Remarkable progress has been made by learning Generative Adversarial Networks (GANs)~\cite{goodfellow2014generative} and cycle-consistent GANs…

Computer Vision and Pattern Recognition · Computer Science 2019-01-21 Wei Sun , Tianfu Wu

Prototype learning is extensively used for few-shot segmentation. Typically, a single prototype is obtained from the support feature by averaging the global object information. However, using one prototype to represent all the information…

Computer Vision and Pattern Recognition · Computer Science 2021-05-18 Gen Li , Varun Jampani , Laura Sevilla-Lara , Deqing Sun , Jonghyun Kim , Joongkyu Kim

Heterogeneous graph neural networks (HGNNs) have been blossoming in recent years, but the unique data processing and evaluation setups used by each work obstruct a full understanding of their advancements. In this work, we present a…

Machine Learning · Computer Science 2022-01-03 Qingsong Lv , Ming Ding , Qiang Liu , Yuxiang Chen , Wenzheng Feng , Siming He , Chang Zhou , Jianguo Jiang , Yuxiao Dong , Jie Tang

Although well-known large-scale datasets, such as ImageNet, have driven image understanding forward, most of these datasets require extensive manual annotation and are thus not easily scalable. This limits the advancement of image…

Computer Vision and Pattern Recognition · Computer Science 2020-02-07 Jean Lahoud , Bernard Ghanem

Supervised learning for semantic segmentation requires a large number of labeled samples, which is difficult to obtain in the field of remote sensing. Self-supervised learning (SSL), can be used to solve such problems by pre-training a…

Computer Vision and Pattern Recognition · Computer Science 2022-02-01 Haifeng Li , Yi Li , Guo Zhang , Ruoyun Liu , Haozhe Huang , Qing Zhu , Chao Tao

Unsupervised semantic segmentation aims to discover groupings within and across images that capture object and view-invariance of a category without external supervision. Grouping naturally has levels of granularity, creating ambiguity in…

Computer Vision and Pattern Recognition · Computer Science 2022-04-26 Tsung-Wei Ke , Jyh-Jing Hwang , Yunhui Guo , Xudong Wang , Stella X. Yu

Heterogeneous graph neural networks aim to discover discriminative node embeddings and relations from multi-relational networks.One challenge of heterogeneous graph learning is the design of learnable meta-paths, which significantly…

Machine Learning · Computer Science 2023-04-19 Zhaoliang Chen , Zhihao Wu , Luying Zhong , Claudia Plant , Shiping Wang , Wenzhong Guo

The enhanced representational power and broad applicability of deep learning models have attracted significant interest from the research community in recent years. However, these models often struggle to perform effectively under domain…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Ba Hung Ngo , Doanh C. Bui , Nhat-Tuong Do-Tran , Tae Jong Choi

In this work, we propose a simple yet effective meta-learning algorithm in semi-supervised learning. We notice that most existing consistency-based approaches suffer from overfitting and limited model generalization ability, especially when…

Machine Learning · Computer Science 2021-03-18 Xin-Yu Zhang , Taihong Xiao , Haolin Jia , Ming-Ming Cheng , Ming-Hsuan Yang

Graph Neural Networks (GNNs) are powerful in learning semantics of graph data. Recently, a new paradigm "pre-train and prompt" has shown promising results in adapting GNNs to various tasks with less supervised data. The success of such…

Machine Learning · Computer Science 2024-06-04 Qingqing Ge , Zeyuan Zhao , Yiding Liu , Anfeng Cheng , Xiang Li , Shuaiqiang Wang , Dawei Yin

Semi-supervised learning has been an important approach to address challenges in extracting entities and relations from limited data. However, current semi-supervised works handle the two tasks (i.e., Named Entity Recognition and Relation…

Computation and Language · Computer Science 2023-05-26 Yandan Zheng , Anran Hao , Anh Tuan Luu

"Self-training" has become a dominant method for semantic segmentation via unsupervised domain adaptation (UDA). It creates a set of pseudo labels for the target domain to give explicit supervision. However, the pseudo labels are noisy,…

Computer Vision and Pattern Recognition · Computer Science 2021-10-22 Inseop Chung , Jayeon Yoo , Nojun Kwak

This paper looks at semi-supervised learning (SSL) for image-based text recognition. One of the most popular SSL approaches is pseudo-labeling (PL). PL approaches assign labels to unlabeled data before re-training the model with a…

Computer Vision and Pattern Recognition · Computer Science 2022-10-10 Gaurav Patel , Jan Allebach , Qiang Qiu

Self-supervised learning, which learns by constructing artificial labels given only the input signals, has recently gained considerable attention for learning representations with unlabeled datasets, i.e., learning without any…

Machine Learning · Computer Science 2020-06-30 Hankook Lee , Sung Ju Hwang , Jinwoo Shin

This paper describes an end-to-end solution for the relationship prediction task in heterogeneous, multi-relational graphs. We particularly address two building blocks in the pipeline, namely heterogeneous graph representation learning and…

Machine Learning · Computer Science 2021-02-16 Xiao Qin , Nasrullah Sheikh , Berthold Reinwald , Lingfei Wu

Supervised learning-based adversarial attack detection methods rely on a large number of labeled data and suffer significant performance degradation when applying the trained model to new domains. In this paper, we propose a self-supervised…

Computer Vision and Pattern Recognition · Computer Science 2024-07-08 Yi Li , Plamen Angelov , Neeraj Suri

In this paper, we study semi-supervised graph classification, which aims at accurately predicting the categories of graphs in scenarios with limited labeled graphs and abundant unlabeled graphs. Despite the promising capability of graph…

Machine Learning · Computer Science 2024-05-29 Wei Ju , Zhengyang Mao , Siyu Yi , Yifang Qin , Yiyang Gu , Zhiping Xiao , Yifan Wang , Xiao Luo , Ming Zhang

Heterogeneous graph representation learning (HGRL) is essential for modeling complex systems with diverse node and edge types. However, most existing methods are limited to closed-world settings with shared schemas and feature spaces,…

Machine Learning · Computer Science 2026-03-31 Xuanze Chen , Jiajun Zhou , Yadong Li , Shanqing Yu , Qi Xuan

Heterogeneous graph pre-training (HGP) has demonstrated remarkable performance across various domains. However, the issue of heterophily in real-world heterogeneous graphs (HGs) has been largely overlooked. To bridge this research gap, we…

Machine Learning · Computer Science 2025-01-16 Haosen Wang , Chenglong Shi , Can Xu , Surong Yan , Pan Tang

Existing deep embedding clustering works only consider the deepest layer to learn a feature embedding and thus fail to well utilize the available discriminative information from cluster assignments, resulting performance limitation. To this…

Computer Vision and Pattern Recognition · Computer Science 2022-12-27 Zhihao Peng , Hui Liu , Yuheng Jia , Junhui Hou