English
Related papers

Related papers: Hi-GMAE: Hierarchical Graph Masked Autoencoders

200 papers

We introduce graphcodes, a novel multi-scale summary of the topological properties of a dataset that is based on the well-established theory of persistent homology. Graphcodes handle datasets that are filtered along two real-valued scale…

Algebraic Topology · Mathematics 2024-05-24 Michael Kerber , Florian Russold

The graph structure is a commonly used data storage mode, and it turns out that the low-dimensional embedded representation of nodes in the graph is extremely useful in various typical tasks, such as node classification, link prediction ,…

Social and Information Networks · Computer Science 2020-08-03 Xing Li , Wei Wei , Xiangnan Feng , Xue Liu , Zhiming Zheng

Attributed graph embedding, which learns vector representations from graph topology and node features, is a challenging task for graph analysis. Recently, methods based on graph convolutional networks (GCNs) have made great progress on this…

Machine Learning · Computer Science 2020-07-06 Ganqu Cui , Jie Zhou , Cheng Yang , Zhiyuan Liu

This paper studies learning the representations of whole graphs in both unsupervised and semi-supervised scenarios. Graph-level representations are critical in a variety of real-world applications such as predicting the properties of…

Machine Learning · Computer Science 2020-01-20 Fan-Yun Sun , Jordan Hoffmann , Vikas Verma , Jian Tang

Graph representation learning methods are highly effective in handling complex non-Euclidean data by capturing intricate relationships and features within graph structures. However, traditional methods face challenges when dealing with…

Machine Learning · Computer Science 2025-02-25 Hang Gao , Chenhao Zhang , Fengge Wu , Junsuo Zhao , Changwen Zheng , Huaping Liu

Molecular representation learning is vital for various downstream applications, including the analysis and prediction of molecular properties and side effects. While Graph Neural Networks (GNNs) have been a popular framework for modeling…

Machine Learning · Computer Science 2025-02-18 Pengcheng Jiang , Cao Xiao , Tianfan Fu , Parminder Bhatia , Taha Kass-Hout , Jimeng Sun , Jiawei Han

While some powerful neural network architectures (e.g., Transformer, Graph Neural Networks) have achieved improved performance in sequential recommendation with high-order item dependency modeling, they may suffer from poor representation…

Information Retrieval · Computer Science 2023-06-02 Yaowen Ye , Lianghao Xia , Chao Huang

The goal of this work is to address two limitations in autoencoder-based models: latent space interpretability and compatibility with unstructured meshes. This is accomplished here with the development of a novel graph neural network (GNN)…

Machine Learning · Computer Science 2023-02-20 Shivam Barwey , Varun Shankar , Venkatasubramanian Viswanathan , Romit Maulik

The recent development of high-throughput sequencing creates a large collection of multi-omics data, which enables researchers to better investigate cancer molecular profiles and cancer taxonomy based on molecular subtypes. Integrating…

Genomics · Quantitative Biology 2024-01-25 Bingjun Li , Sheida Nabavi

Graph embedding provides an efficient solution for graph analysis by converting the graph into a low-dimensional space which preserves the structure information. In contrast to the graph structure data, the i.i.d. node embedding can be…

Machine Learning · Computer Science 2017-05-16 Hongyun Cai , Vincent W. Zheng , Kevin Chen-Chuan Chang

Masked Autoencoder (MAE) has demonstrated superior performance on various vision tasks via randomly masking image patches and reconstruction. However, effective data augmentation strategies for MAE still remain open questions, different…

Computer Vision and Pattern Recognition · Computer Science 2024-02-08 Kai Chen , Zhili Liu , Lanqing Hong , Hang Xu , Zhenguo Li , Dit-Yan Yeung

This study presents a hierarchical mining framework for high-dimensional imbalanced data, leveraging a depth graph model to address the inherent performance limitations of conventional approaches in handling complex, high-dimensional data…

Machine Learning · Computer Science 2025-02-07 Yijiashun Qi , Quanchao Lu , Shiyu Dou , Xiaoxuan Sun , Muqing Li , Yankaiqi Li

Accurate and efficient prediction of the molecular properties of drugs is one of the fundamental problems in drug research and development. Recent advancements in representation learning have been shown to greatly improve the performance of…

Biomolecules · Quantitative Biology 2022-06-17 Hui Liu , Yibiao Huang , Xuejun Liu , Lei Deng

"Masked Autoencoders (MAE) Are Scalable Vision Learners" revolutionizes the self-supervised learning method in that it not only achieves the state-of-the-art for image pre-training, but is also a milestone that bridges the gap between…

Computer Vision and Pattern Recognition · Computer Science 2022-02-10 Shuhao Cao , Peng Xu , David A. Clifton

In graph self-supervised learning, masked autoencoders (MAE) and contrastive learning (CL) are two prominent paradigms. MAE focuses on reconstructing masked elements, while CL maximizes similarity between augmented graph views. Recent…

Machine Learning · Computer Science 2025-06-10 Di Lin , Wanjing Ren , Xuanbin Li , Rui Zhang

Modern data analysis pipelines are becoming increasingly complex due to the presence of multi-view information sources. While graphs are effective in modeling complex relationships, in many scenarios a single graph is rarely sufficient to…

Machine Learning · Statistics 2019-04-02 Uday Shankar Shanthamallu , Jayaraman J. Thiagarajan , Huan Song , Andreas Spanias

Variational Autoencoders (VAEs) have experienced recent success as data-generating models by using simple architectures that do not require significant fine-tuning of hyperparameters. However, VAEs are known to suffer from…

Machine Learning · Statistics 2020-07-22 Wei Cheng , Gregory Darnell , Sohini Ramachandran , Lorin Crawford

The hematology analytics used for detection and classification of small blood components is a significant challenge. In particular, when objects exists as small pixel-sized entities in a large context of similar objects. Deep learning…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 H. Martin Gillis , Ming Hill , Paul Hollensen , Alan Fine , Thomas Trappenberg

Graph neural networks (GNNs) are popular weapons for modeling relational data. Existing GNNs are not specified for attribute-incomplete graphs, making missing attribute imputation a burning issue. Until recently, many works notice that GNNs…

Machine Learning · Computer Science 2022-12-01 Ziqi Gao , Yifan Niu , Jiashun Cheng , Jianheng Tang , Tingyang Xu , Peilin Zhao , Lanqing Li , Fugee Tsung , Jia Li

Graph autoencoders (AE) and variational autoencoders (VAE) recently emerged as powerful node embedding methods, with promising performances on challenging tasks such as link prediction and node clustering. Graph AE, VAE and most of their…

Machine Learning · Computer Science 2019-10-03 Guillaume Salha , Romain Hennequin , Michalis Vazirgiannis