English
Related papers

Related papers: Edgeformers: Graph-Empowered Transformers for Repr…

200 papers

Discrete-Time Dynamic Graphs (DTDGs), which are prevalent in real-world implementations and notable for their ease of data acquisition, have garnered considerable attention from both academic researchers and industry practitioners. The…

Machine Learning · Computer Science 2024-07-29 Xi Chen , Yun Xiong , Siwei Zhang , Jiawei Zhang , Yao Zhang , Shiyang Zhou , Xixi Wu , Mingyang Zhang , Tengfei Liu , Weiqiang Wang

Graph representation learning has made major strides over the past decade. However, in many relational domains, the input data are not suited for simple graph representations as the relationships between entities go beyond pairwise…

Machine Learning · Computer Science 2021-01-20 Balasubramaniam Srinivasan , Da Zheng , George Karypis

Recent studies have highlighted the limitations of message-passing based graph neural networks (GNNs), e.g., limited model expressiveness, over-smoothing, over-squashing, etc. To alleviate these issues, Graph Transformers (GTs) have been…

Machine Learning · Computer Science 2023-03-06 Qiheng Mao , Zemin Liu , Chenghao Liu , Jianling Sun

Representation learning on graphs is a fundamental problem that can be crucial in various tasks. Graph neural networks, the dominant approach for graph representation learning, are limited in their representation power. Therefore, it can be…

Machine Learning · Computer Science 2025-01-17 Zuoyu Yan , Qi Zhao , Ze Ye , Tengfei Ma , Liangcai Gao , Zhi Tang , Yusu Wang , Chao Chen

Representation learning in dynamic graphs is a challenging problem because the topology of graph and node features vary at different time. This requires the model to be able to effectively capture both graph topology information and…

Machine Learning · Computer Science 2021-11-16 Xintao Xiang , Tiancheng Huang , Donglin Wang

Graph are a ubiquitous data representation, as they represent a flexible and compact representation. For instance, the 3D structure of RNA can be efficiently represented as $\textit{2.5D graphs}$, graphs whose nodes are nucleotides and…

Machine Learning · Computer Science 2021-09-21 Vincent Mallet , Carlos G. Oliver , William L. Hamilton

Existing network embedding approaches tackle the problem of learning low-dimensional node representations. However, networks can also be seen in the light of edges interlinking pairs of nodes. The broad goal of this paper is to introduce…

Social and Information Networks · Computer Science 2020-11-12 Giuseppe Pirrò

There has been a surge of recent interest in learning representations for graph-structured data. Graph representation learning methods have generally fallen into three main categories, based on the availability of labeled data. The first,…

Machine Learning · Computer Science 2022-04-13 Ines Chami , Sami Abu-El-Haija , Bryan Perozzi , Christopher Ré , Kevin Murphy

Graph neural networks (GNNs) have significantly improved the representation power for graph-structured data. Despite of the recent success of GNNs, the graph convolution in most GNNs have two limitations. Since the graph convolution is…

Machine Learning · Computer Science 2021-12-30 Jinyoung Park , Sungdong Yoo , Jihwan Park , Hyunwoo J. Kim

Network embedding methods aim at learning low-dimensional latent representation of nodes in a network. While achieving competitive performance on a variety of network inference tasks such as node classification and link prediction, these…

Social and Information Networks · Computer Science 2018-09-17 Haochen Chen , Xiaofei Sun , Yingtao Tian , Bryan Perozzi , Muhao Chen , Steven Skiena

Graphs or networks are a very convenient way to represent data with lots of interaction. Recently, Machine Learning on Graph data has gained a lot of traction. In particular, vertex classification and missing edge detection have very…

Machine Learning · Computer Science 2020-09-07 Simon Brandeis , Adrian Jarret , Pierre Sevestre

Graph representation learning models aim to represent the graph structure and its features into low-dimensional vectors in a latent space, which can benefit various downstream tasks, such as node classification and link prediction. Due to…

Machine Learning · Computer Science 2023-04-27 Thanh Sang Nguyen , Jooho Lee , Van Thuy Hoang , O-Joun Lee

Representation learning on graphs has emerged as a powerful mechanism to automate feature vector generation for downstream machine learning tasks. The advances in representation on graphs have centered on both homogeneous and heterogeneous…

Machine Learning · Statistics 2020-11-23 Piotr Bielak , Kamil Tagowski , Maciej Falkiewicz , Tomasz Kajdanowicz , Nitesh V. Chawla

Textual-edge Graphs (TEGs), characterized by rich text annotations on edges, are increasingly significant in network science due to their ability to capture rich contextual information among entities. Existing works have proposed various…

Social and Information Networks · Computer Science 2024-11-19 Chen Ling , Zhuofeng Li , Yuntong Hu , Zheng Zhang , Zhongyuan Liu , Shuang Zheng , Jian Pei , Liang Zhao

Patterns stored within pre-trained deep neural networks compose large and powerful descriptive languages that can be used for many different purposes. Typically, deep network representations are implemented within vector embedding spaces,…

Neural and Evolutionary Computing · Computer Science 2017-08-10 Dario Garcia-Gasulla , Armand Vilalta , Ferran Parés , Jonatan Moreno , Eduard Ayguadé , Jesus Labarta , Ulises Cortés , Toyotaro Suzumura

Representation learning on graphs has been gaining attention due to its wide applicability in predicting missing links, and classifying and recommending nodes. Most embedding methods aim to preserve certain properties of the original graph…

Social and Information Networks · Computer Science 2019-09-13 Palash Goyal , Di Huang , Sujit Rokka Chhetri , Arquimedes Canedo , Jaya Shree , Evan Patterson

Convolutional neural networks have made significant progresses in edge detection by progressively exploring the context and semantic features. However, local details are gradually suppressed with the enlarging of receptive fields. Recently,…

Computer Vision and Pattern Recognition · Computer Science 2022-03-17 Mengyang Pu , Yaping Huang , Yuming Liu , Qingji Guan , Haibin Ling

Recent advances in Graph Convolutional Neural Networks (GCNNs) have shown their efficiency for non-Euclidean data on graphs, which often require a large amount of labeled data with high cost. It it thus critical to learn graph feature…

Computer Vision and Pattern Recognition · Computer Science 2020-03-20 Xiang Gao , Wei Hu , Guo-Jun Qi

We present a novel edge-level ego-network encoding for learning on graphs that can boost Message Passing Graph Neural Networks (MP-GNNs) by providing additional node and edge features or extending message-passing formats. The proposed…

Machine Learning · Computer Science 2024-05-03 Nurudin Alvarez-Gonzalez , Andreas Kaltenbrunner , Vicenç Gómez

Graph is powerful for representing various types of real-world data. The topology (edges' presence) and edges' features of a graph decides the message passing mechanism among vertices within the graph. While most existing approaches only…

Machine Learning · Computer Science 2022-11-23 Siyang Song , Yuxin Song , Cheng Luo , Zhiyuan Song , Selim Kuzucu , Xi Jia , Zhijiang Guo , Weicheng Xie , Linlin Shen , Hatice Gunes