中文
相关论文

相关论文: Generalizing Graph Transformers Across Diverse Gra…

200 篇论文

Recently, graph neural networks (GNNs) have been shown powerful capacity at modeling structural data. However, when adapted to downstream tasks, it usually requires abundant task-specific labeled data, which can be extremely scarce in…

机器学习 · 计算机科学 2022-03-04 Yupeng Hou , Binbin Hu , Wayne Xin Zhao , Zhiqiang Zhang , Jun Zhou , Ji-Rong Wen

Foundation models like ChatGPT and GPT-4 have revolutionized artificial intelligence, exhibiting remarkable abilities to generalize across a wide array of tasks and applications beyond their initial training objectives. However, graph…

机器学习 · 计算机科学 2025-01-22 Yufei He , Yuan Sui , Xiaoxin He , Bryan Hooi

Node tokenized graph Transformers (GTs) have shown promising performance in node classification. The generation of token sequences is the key module in existing tokenized GTs which transforms the input graph into token sequences,…

机器学习 · 计算机科学 2025-02-13 Jinsong Chen , Chenyang Li , GaiChao Li , John E. Hopcroft , Kun He

Non-local self-similarity is well-known to be an effective prior for the image denoising problem. However, little work has been done to incorporate it in convolutional neural networks, which surpass non-local model-based methods despite…

图像与视频处理 · 电气工程与系统科学 2023-07-19 Diego Valsesia , Giulia Fracastoro , Enrico Magli

Graph Neural Networks (GNNs) have received a lot of interest in the recent times. From the early spectral architectures that could only operate on undirected graphs per a transductive learning paradigm to the current state of the art…

机器学习 · 计算机科学 2021-05-18 Pushkar Mishra , Aleksandra Piktus , Gerard Goossen , Fabrizio Silvestri

Brain motor decoding aims to interpret and translate neural activity into behaviors. Decoding models should generalize across variations, such as recordings from different brain sites, experimental sessions, behavior types, and subjects,…

机器学习 · 计算机科学 2026-04-03 Hao Fang , Ryan A. Canfield , Tomohiro Ouchi , Beatrice Macagno , Eli Shlizerman , Amy L. Orsborn

Graph representation learning has recently been applied to a broad spectrum of problems ranging from computer graphics and chemistry to high energy physics and social media. The popularity of graph neural networks has sparked interest, both…

机器学习 · 计算机科学 2020-11-05 Fabrizio Frasca , Emanuele Rossi , Davide Eynard , Ben Chamberlain , Michael Bronstein , Federico Monti

The principal benefit of unsupervised representation learning is that a pre-trained model can be fine-tuned where data or labels are scarce. Existing approaches for graph representation learning are domain specific, maintaining consistent…

机器学习 · 计算机科学 2024-12-03 Alex O. Davies , Riku W. Green , Nirav S. Ajmeri , Telmo M. Silva Filho

Textual graphs are ubiquitous in real-world applications, featuring rich text information with complex relationships, which enables advanced research across various fields. Textual graph representation learning aims to generate…

机器学习 · 计算机科学 2024-08-22 Wenbin Hu , Huihao Jing , Qi Hu , Haoran Li , Yangqiu Song

Graph Convolutional Networks (GCNs), particularly for large-scale graphs, are crucial across numerous domains. However, training distributed full-batch GCNs on large-scale graphs suffers from inefficient memory access patterns and high…

分布式、并行与集群计算 · 计算机科学 2025-05-27 Chen Zhuang , Lingqi Zhang , Du Wu , Peng Chen , Jiajun Huang , Xin Liu , Rio Yokota , Nikoli Dryden , Toshio Endo , Satoshi Matsuoka , Mohamed Wahib

Graphs provide a powerful means for representing complex interactions between entities. Recently, deep learning approaches are emerging for representing and modeling graph-structured data, although the conventional deep learning methods…

神经与进化计算 · 计算机科学 2016-12-06 Jaekoo Lee , Hyunjae Kim , Jongsun Lee , Sungroh Yoon

There has been a surge of recent interest in learning representations for graph-structured data. Graph representation learning methods have generally fallen into three main categories, based on the availability of labeled data. The first,…

机器学习 · 计算机科学 2022-04-13 Ines Chami , Sami Abu-El-Haija , Bryan Perozzi , Christopher Ré , Kevin Murphy

This paper presents a general graph representation learning framework called DeepGL for learning deep node and edge representations from large (attributed) graphs. In particular, DeepGL begins by deriving a set of base features (e.g.,…

机器学习 · 统计学 2017-10-17 Ryan A. Rossi , Rong Zhou , Nesreen K. Ahmed

Graph Convolutional Networks (GCNs) are extensively utilized for deep learning on graphs. The large data sizes of graphs and their vertex features make scalable training algorithms and distributed memory systems necessary. Since the…

机器学习 · 计算机科学 2022-12-14 Gunduz Vehbi Demirci , Aparajita Haldar , Hakan Ferhatosmanoglu

Graph Transformers (GTs) have emerged as a promising graph learning tool, leveraging their all-pair connected property to effectively capture global information. To address the over-smoothing problem in deep GNNs, global attention was…

机器学习 · 计算机科学 2025-12-17 Chaohao Yuan , Zhenjie Song , Ercan Engin Kuruoglu , Kangfei Zhao , Yang Liu , Deli Zhao , Hong Cheng , Yu Rong

Graph Neural Networks (GNNs) have emerged as a powerful tool for learning from graph-structured data. However, even state-of-the-art architectures have limitations on what structures they can distinguish, imposing theoretical limits on what…

机器学习 · 计算机科学 2023-07-03 Eren Akbiyik , Florian Grötschla , Beni Egressy , Roger Wattenhofer

Recent advances in Graph Convolutional Neural Networks (GCNNs) have shown their efficiency for non-Euclidean data on graphs, which often require a large amount of labeled data with high cost. It it thus critical to learn graph feature…

计算机视觉与模式识别 · 计算机科学 2020-03-20 Xiang Gao , Wei Hu , Guo-Jun Qi

Graph Neural Networks (GNNs) have shown impressive performance in graph representation learning, but they face challenges in capturing long-range dependencies due to their limited expressive power. To address this, Graph Transformers (GTs)…

Graphs can model complex relationships between objects, enabling a myriad of Web applications such as online page/article classification and social recommendation. While graph neural networks(GNNs) have emerged as a powerful tool for graph…

机器学习 · 计算机科学 2023-02-28 Zemin Liu , Xingtong Yu , Yuan Fang , Xinming Zhang

Graphs are ubiquitous in real-world scenarios and encompass a diverse range of tasks, from node-, edge-, and graph-level tasks to transfer learning. However, designing specific tasks for each type of graph data is often costly and lacks…

机器学习 · 计算机科学 2024-03-22 Yulan Hu , Sheng Ouyang , Zhirui Yang , Ge Chen , Junchen Wan , Xiao Wang , Yong Liu