English
Related papers

Related papers: UGMAE: A Unified Framework for Graph Masked Autoen…

200 papers

Graph autoencoders (Graph-AEs) learn representations of given graphs by aiming to accurately reconstruct them. A notable application of Graph-AEs is graph-level anomaly detection (GLAD), whose objective is to identify graphs with anomalous…

Machine Learning · Computer Science 2024-10-29 Sunwoo Kim , Soo Yong Lee , Fanchen Bu , Shinhwan Kang , Kyungho Kim , Jaemin Yoo , Kijung Shin

Existing foundation models, such as CLIP, aim to learn a unified embedding space for multimodal data, enabling a wide range of downstream web-based applications like search, recommendation, and content classification. However, these models…

Machine Learning · Computer Science 2025-04-28 Yufei He , Yuan Sui , Xiaoxin He , Yue Liu , Yifei Sun , Bryan Hooi

With the rapid growth of graph-structured data in critical domains, unsupervised graph-level anomaly detection (UGAD) has become a pivotal task. UGAD seeks to identify entire graphs that deviate from normal behavioral patterns. However,…

Machine Learning · Computer Science 2025-11-07 Qingfeng Chen , Haojin Zeng , Jingyi Jie , Shichao Zhang , Debo Cheng

Autoencoders are effective deep learning models that can function as generative models and learn latent representations for downstream tasks. The use of graph autoencoders - with both encoder and decoder implemented as message passing…

Machine Learning · Computer Science 2025-03-04 Magnus Cunow , Gerrit Großmann

Graph and hypergraph representation learning has attracted increasing attention from various research fields. Despite the decent performance and fruitful applications of Graph Neural Networks (GNNs), Hypergraph Neural Networks (HGNNs), and…

Machine Learning · Computer Science 2023-11-15 Minhao Zou , Zhongxue Gan , Yutong Wang , Junheng Zhang , Dongyan Sui , Chun Guan , Siyang Leng

Self-supervised representation learning on text-attributed graphs, which aims to create expressive and generalizable representations for various downstream tasks, has received increasing research attention lately. However, existing methods…

Computation and Language · Computer Science 2023-10-24 Yichuan Li , Kaize Ding , Kyumin Lee

Masked image modeling is a promising self-supervised learning method for visual data. It is typically built upon image patches with random masks, which largely ignores the variation of information density between them. The question is: Is…

Computer Vision and Pattern Recognition · Computer Science 2024-01-09 Haijian Chen , Wendong Zhang , Yunbo Wang , Xiaokang Yang

Deep generative models have been praised for their ability to learn smooth latent representation of images, text, and audio, which can then be used to generate new, plausible data. However, current generative models are unable to work with…

Machine Learning · Computer Science 2019-09-09 Bidisha Samanta , Abir De , Gourhari Jana , Pratim Kumar Chattaraj , Niloy Ganguly , Manuel Gomez-Rodriguez

Graph Transformers (GTs) have emerged as a powerful paradigm for graph representation learning due to their ability to model diverse node interactions. However, existing GTs often rely on intricate architectural designs tailored to specific…

Computer Vision and Pattern Recognition · Computer Science 2025-10-22 Yujie Xing , Xiao Wang , Bin Wu , Hai Huang , Chuan Shi

Attributed graph embedding, which learns vector representations from graph topology and node features, is a challenging task for graph analysis. Recently, methods based on graph convolutional networks (GCNs) have made great progress on this…

Machine Learning · Computer Science 2020-07-06 Ganqu Cui , Jie Zhou , Cheng Yang , Zhiyuan Liu

Despite the tremendous progress of Masked Autoencoders (MAE) in developing vision tasks such as image and video, exploring MAE in large-scale 3D point clouds remains challenging due to the inherent irregularity. In contrast to previous 3D…

Computer Vision and Pattern Recognition · Computer Science 2023-03-20 Honghui Yang , Tong He , Jiaheng Liu , Hua Chen , Boxi Wu , Binbin Lin , Xiaofei He , Wanli Ouyang

Graph generation is a crucial task in many fields, including network science and bioinformatics, as it enables the creation of synthetic graphs that mimic the properties of real-world networks for various applications. Graph Generative…

Machine Learning · Computer Science 2026-01-21 Salvatore Romano , Marco Grassia , Giuseppe Mangioni

Network alignment is the task of establishing one-to-one correspondences between the nodes of different graphs. Although finding a plethora of applications in high-impact domains, this task is known to be NP-hard in its general form.…

Machine Learning · Computer Science 2024-11-20 Jiashu He , Charilaos I. Kanatsoulis , Alejandro Ribeiro

Motivation: Molecular interaction networks summarize complex biological processes as graphs, whose structure is informative of biological function at multiple scales. Simultaneously, omics technologies measure the variation or activity of…

Quantitative Methods · Quantitative Biology 2020-12-24 Ramin Hasibi , Tom Michoel

Recent research on the robustness of Graph Neural Networks (GNNs) under noises or attacks has attracted great attention due to its importance in real-world applications. Most previous methods explore a single noise source, recovering…

Machine Learning · Computer Science 2024-08-02 Tianmeng Yang , Jiahao Meng , Min Zhou , Yaming Yang , Yujing Wang , Xiangtai Li , Yunhai Tong

Non-parallel text style transfer has attracted increasing research interests in recent years. Despite successes in transferring the style based on the encoder-decoder framework, current approaches still lack the ability to preserve the…

Computation and Language · Computer Science 2021-02-02 Yukai Shi , Sen Zhang , Chenxing Zhou , Xiaodan Liang , Xiaojun Yang , Liang Lin

Recently, the graph neural network (GNN) has shown great power in matrix completion by formulating a rating matrix as a bipartite graph and then predicting the link between the corresponding user and item nodes. The majority of GNN-based…

Machine Learning · Computer Science 2021-08-26 Wei Shen , Chuheng Zhang , Yun Tian , Liang Zeng , Xiaonan He , Wanchun Dou , Xiaolong Xu

Autoencoders based on Graph Neural Networks (GNNs) have garnered significant attention in recent years for their ability to extract informative latent representations, characterizing the structure of complex topologies, such as graphs.…

Universal graph pre-training has emerged as a key paradigm in graph representation learning, offering a promising way to train encoders to learn transferable representations from unlabeled graphs and to effectively generalize across a wide…

Machine Learning · Computer Science 2026-02-27 Lianze Shan , Jitao Zhao , Dongxiao He , Yongqi Huang , Zhiyong Feng , Weixiong Zhang

Graph autoencoders (GAEs) and graph contrastive learning (GCL) are two major paradigms for self-supervised representation learning on graphs, yet they are often studied in isolation and treated as fundamentally different approaches. In this…

Machine Learning · Computer Science 2026-05-28 Jintang Li , Ruofan Wu , Yuchang Zhu , Huizhe Zhang , Zulun Zhu , Liang Chen