English
Related papers

Related papers: Is One Token All It Takes? Graph Pooling Tokens fo…

200 papers

Graph Visualization, also known as Graph Drawing, aims to find geometric embeddings of graphs that optimize certain criteria. Stress is a widely used metric; stress is minimized when every pair of nodes is positioned at their shortest path…

Computational Geometry · Computer Science 2024-02-13 Florian Grötschla , Joël Mathys , Robert Veres , Roger Wattenhofer

Hypergraph, an expressive structure with flexibility to model the higher-order correlations among entities, has recently attracted increasing attention from various research domains. Despite the success of Graph Neural Networks (GNNs) for…

Machine Learning · Computer Science 2021-05-04 Jing Huang , Jie Yang

Large Language Models (LLMs) have achieved remarkable success across various domains. However, they still face significant challenges, including high computational costs for training and limitations in solving complex reasoning problems.…

Machine Learning · Computer Science 2025-05-20 Hang Gao , Chenhao Zhang , Tie Wang , Junsuo Zhao , Fengge Wu , Changwen Zheng , Huaping Liu

Current graph neural networks (GNNs) lack generalizability with respect to scales (graph sizes, graph diameters, edge weights, etc..) when solving many graph analysis problems. Taking the perspective of synthesizing graph theory programs,…

Machine Learning · Computer Science 2020-10-27 Hao Tang , Zhiao Huang , Jiayuan Gu , Bao-Liang Lu , Hao Su

Pretrained Language Models (PLMs) benefit from external knowledge stored in graph structures for various downstream tasks. However, bridging the modality gap between graph structures and text remains a significant challenge. Traditional…

Computation and Language · Computer Science 2024-04-11 Shuzhou Yuan , Michael Färber

The integration of multi-omic data is pivotal for understanding complex diseases, but its high dimensionality and noise present significant challenges. Graph Neural Networks (GNNs) offer a robust framework for analyzing large-scale…

Quantitative Methods · Quantitative Biology 2024-12-23 Heming Zhang , Di Huang , Yixin Chen , Fuhai Li

Graph Prompt Learning (GPL) has emerged as a promising paradigm that bridges graph pretraining models and downstream scenarios, mitigating label dependency and the misalignment between upstream pretraining and downstream tasks. Although…

Machine Learning · Computer Science 2025-10-15 Yongqi Huang , Jitao Zhao , Dongxiao He , Xiaobao Wang , Yawen Li , Yuxiao Huang , Di Jin , Zhiyong Feng

Graph Neural Networks (GNNs) have been widely applied to various fields due to their powerful representations of graph-structured data. Despite the success of GNNs, most existing GNNs are designed to learn node representations on the fixed…

Machine Learning · Computer Science 2021-06-14 Seongjun Yun , Minbyul Jeong , Sungdong Yoo , Seunghun Lee , Sean S. Yi , Raehyun Kim , Jaewoo Kang , Hyunwoo J. Kim

Recent work in graph neural networks (GNNs) has led to improvements in molecular activity and property prediction tasks. Unfortunately, GNNs often fail to capture the relative importance of interactions between molecular substructures, in…

Machine Learning · Computer Science 2020-04-03 Emmanuel Noutahi , Dominique Beaini , Julien Horwood , Sébastien Giguère , Prudencio Tossou

Subgraph classification is an emerging field in graph representation learning where the task is to classify a group of nodes (i.e., a subgraph) within a graph. Subgraph classification has applications such as predicting the cellular…

Machine Learning · Computer Science 2023-04-19 Shweta Ann Jacob , Paul Louis , Amirali Salehi-Abari

Graph convolution networks (GCNs) are currently mainstream in learning with irregular data. These models rely on message passing and attention mechanisms that capture context and node-to-node relationships. With multi-head attention, GCNs…

Machine Learning · Computer Science 2022-03-28 Hichem Sahbi

Network representation learning (NRL) is a powerful technique for learning low-dimensional vector representation of high-dimensional and sparse graphs. Most studies explore the structure and metadata associated with the graph using random…

Machine Learning · Computer Science 2020-01-30 Zekarias T. Kefato , Sarunas Girdzijauskas

Graph Neural Networks (GNNs) have become powerful tools for learning from graph-structured data, finding applications across diverse domains. However, as graph sizes and connectivity increase, standard GNN training methods face significant…

Machine Learning · Computer Science 2025-12-01 Eshed Gal , Moshe Eliasof , Carola-Bibiane Schönlieb , Ivan I. Kyrchei , Eldad Haber , Eran Treister

Despite the recent success of graph neural networks (GNN), common architectures often exhibit significant limitations, including sensitivity to oversmoothing, long-range dependencies, and spurious edges, e.g., as can occur as a result of…

Machine Learning · Computer Science 2021-12-06 Yongyi Yang , Tang Liu , Yangkun Wang , Jinjing Zhou , Quan Gan , Zhewei Wei , Zheng Zhang , Zengfeng Huang , David Wipf

Graph Transformers, leveraging the global attention to capture long-range dependencies in graph structures, have significantly advanced graph machine learning, but face prohibitive computational complexity. Tokenized Graph Learning Models…

Machine Learning · Computer Science 2025-05-23 Zhibiao Wang , Yunlong Zhou , Ziwei Zhang , Mengmei Zhang , Shirui Pan , Chunming Hu , Xiao Wang

Graph Neural Networks (GNNs) are powerful tools for graph classification. One important operation for GNNs is the downsampling or pooling that can learn effective embeddings from the node representations. In this paper, we propose a new…

Machine Learning · Computer Science 2024-05-17 Zhehan Zhao , Lu Bai , Lixin Cui , Ming Li , Yue Wang , Lixiang Xu , Edwin R. Hancock

Recent prevailing works on graph machine learning typically follow a similar methodology that involves designing advanced variants of graph neural networks (GNNs) to maintain the superior performance of GNNs on different graphs. In this…

Machine Learning · Computer Science 2024-06-07 Yiran Qiao , Xiang Ao , Yang Liu , Jiarong Xu , Xiaoqian Sun , Qing He

Graph Representation Learning (GRL) has experienced significant progress as a means to extract structural information in a meaningful way for subsequent learning tasks. Current approaches including shallow embeddings and Graph Neural…

Machine Learning · Computer Science 2020-06-19 Antonia Gogoglou , C. Bayan Bruss , Brian Nguyen , Reza Sarshogh , Keegan E. Hines

Graph-structured information offers rich contextual information that can enhance language models by providing structured relationships and hierarchies, leading to more expressive embeddings for various applications such as retrieval,…

Graph Neural Networks achieve state-of-the-art performance on a plethora of graph classification tasks, especially due to pooling operators, which aggregate learned node embeddings hierarchically into a final graph representation. However,…

Machine Learning · Computer Science 2022-09-09 Alexandre Duval , Fragkiskos Malliaros