English
Related papers

Related papers: UGMAE: A Unified Framework for Graph Masked Autoen…

200 papers

In this paper, we propose Multiresolution Equivariant Graph Variational Autoencoders (MGVAE), the first hierarchical generative model to learn and generate graphs in a multiresolution and equivariant manner. At each resolution level, MGVAE…

Machine Learning · Computer Science 2022-06-30 Truong Son Hy , Risi Kondor

Graph Neural Networks (GNNs) have received considerable attention on graph-structured data learning for a wide variety of tasks. The well-designed propagation mechanism which has been demonstrated effective is the most fundamental part of…

Machine Learning · Computer Science 2021-01-29 Meiqi Zhu , Xiao Wang , Chuan Shi , Houye Ji , Peng Cui

We introduce a novel self-supervised learning framework that automatically learns representations from input computer-aided design (CAD) models for downstream tasks, including part classification, modeling segmentation, and machining…

Graphics · Computer Science 2026-03-18 Yifei Li , Kang Wu , Wenming Wu , Xiao-Ming Fu

Representation learning on text-attributed graphs (TAGs), where nodes are represented by textual descriptions, is crucial for textual and relational knowledge systems and recommendation systems. Currently, state-of-the-art embedding methods…

Computation and Language · Computer Science 2024-12-24 Yi Fang , Dongzhe Fan , Sirui Ding , Ninghao Liu , Qiaoyu Tan

Masked graph modeling excels in the self-supervised representation learning of molecular graphs. Scrutinizing previous studies, we can reveal a common scheme consisting of three key components: (1) graph tokenizer, which breaks a molecular…

Machine Learning · Computer Science 2024-01-17 Zhiyuan Liu , Yaorui Shi , An Zhang , Enzhi Zhang , Kenji Kawaguchi , Xiang Wang , Tat-Seng Chua

Masked Autoencoders (MAEs) have emerged as a dominant strategy for self-supervised representation learning in natural images, where models are pre-trained to reconstruct masked patches with a pixel-wise mean squared error (MSE) between…

Image and Video Processing · Electrical Eng. & Systems 2025-07-16 Chetan Madan , Aarjav Satia , Soumen Basu , Pankaj Gupta , Usha Dutta , Chetan Arora

Graph autoencoders (GAEs), as a kind of generative self-supervised learning approach, have shown great potential in recent years. GAEs typically rely on distance-based criteria, such as mean-square-error (MSE), to reconstruct the input…

Machine Learning · Computer Science 2024-06-26 Ge Chen , Yulan Hu , Sheng Ouyang , Yong Liu , Cuicui Luo

Invertible transformation of large graphs into fixed dimensional vectors (embeddings) remains a challenge. Its overcoming would reduce any operation on graphs to an operation in a vector space. However, most existing methods are limited to…

Machine Learning · Computer Science 2022-07-12 Adam Małkowski , Jakub Grzechociński , Paweł Wawrzyński

Multi-View Clustering (MVC) has gained significant attention for its ability to leverage complementary information across diverse views. However, existing deep MVC methods often struggle with view-distribution entanglement during cross-view…

Computer Vision and Pattern Recognition · Computer Science 2026-05-18 Xin Zou , Ruimeng Liu , Chang Tang , Zhenglai Li , Xinwang Liu , Kunlun He , Wanqing Li

Graph neural networks (GNNs) are popular weapons for modeling relational data. Existing GNNs are not specified for attribute-incomplete graphs, making missing attribute imputation a burning issue. Until recently, many works notice that GNNs…

Machine Learning · Computer Science 2022-12-01 Ziqi Gao , Yifan Niu , Jiashun Cheng , Jianheng Tang , Tingyang Xu , Peilin Zhao , Lanqing Li , Fugee Tsung , Jia Li

There has been a lot of recent interest in designing neural network models to estimate a distribution from a set of examples. We introduce a simple modification for autoencoder neural networks that yields powerful generative models. Our…

Machine Learning · Computer Science 2015-06-08 Mathieu Germain , Karol Gregor , Iain Murray , Hugo Larochelle

Graph Neural Networks (GNNs) have shown remarkable merit in performing various learning-based tasks in complex networks. The superior performance of GNNs often correlates with the availability and quality of node-level features in the input…

Social and Information Networks · Computer Science 2023-10-20 Anwar Said , Mudassir Shabbir , Tyler Derr , Waseem Abbas , Xenofon Koutsoukos

Heterogeneous Information Networks (HINs), which consist of various types of nodes and edges, have recently demonstrated excellent performance in graph mining. However, most existing heterogeneous graph neural networks (HGNNs) ignore the…

Machine Learning · Computer Science 2024-11-20 Yige Zhao , Jianxiang Yu , Yao Cheng , Chengcheng Yu , Yiding Liu , Xiang Li , Shuaiqiang Wang

Graph foundation models represent a transformative paradigm for learning transferable representations across diverse graph domains. Recent methods leverage large language models to unify graph and text modalities into a shared…

Machine Learning · Computer Science 2025-12-23 Heng Zhang , Tianyi Zhang , Yuling Shi , Xiaodong Gu , Yaomin Shen , Haochen You , Zijian Zhang , Yilei Yuan , Jin Huang

The majority of model-based learned image reconstruction methods in medical imaging have been limited to uniform domains, such as pixelated images. If the underlying model is solved on nonuniform meshes, arising from a finite element method…

Image and Video Processing · Electrical Eng. & Systems 2021-07-12 William Herzberg , Daniel B. Rowe , Andreas Hauptmann , Sarah J. Hamilton

Graph structure learning is a well-established problem that aims at optimizing graph structures adaptive to specific graph datasets to help message passing neural networks (i.e., GNNs) to yield effective and robust node embeddings. However,…

Machine Learning · Computer Science 2023-06-21 Wentao Zhao , Qitian Wu , Chenxiao Yang , Junchi Yan

Graph Neural Networks (GNNs) face a fundamental adaptability challenge: their fixed message-passing architectures struggle with the immense diversity of real-world graphs, where optimal computational strategies vary by local structure and…

Machine Learning · Computer Science 2025-10-27 Yunlong Chu , Minglai Shao , Zengyi Wo , Bing Hao , Yuhang Liu , Ruijie Wang , Jianxin Li

Graph embedding is a powerful method to represent graph neurological data (e.g., brain connectomes) in a low dimensional space for brain connectivity mapping, prediction and classification. However, existing embedding algorithms have two…

Computer Vision and Pattern Recognition · Computer Science 2020-09-25 Alin Banka , Inis Buzi , Islem Rekik

In the graph domain, deep graph networks based on Message Passing Neural Networks (MPNNs) or Graph Transformers often cause over-smoothing of node features, limiting their expressive capacity. Many upsampling techniques involving node and…

Machine Learning · Computer Science 2026-02-03 Xiaotang Wang , Yun Zhu , Haizhou Shi , Yongchao Liu , Yongqi Zhang

Graph learning from data represents a canonical problem that has received substantial attention in the literature. However, insufficient work has been done in incorporating prior structural knowledge onto the learning of underlying…

Machine Learning · Statistics 2019-04-23 Sandeep Kumar , Jiaxi Ying , José Vinícius de M. Cardoso , Daniel Palomar