English
Related papers

Related papers: An end-to-end attention-based approach for learnin…

200 papers

One of the emerging techniques in node classification in heterogeneous graphs is to restrict message aggregation to pre-defined, semantically meaningful structures called metapaths. This work is the first attempt to incorporate attention…

Machine Learning · Computer Science 2024-12-31 Calder Katyal

Graph Representation Learning (GRL) is an influential methodology, enabling a more profound understanding of graph-structured data and aiding graph clustering, a critical task across various domains. The recent incursion of attention…

Machine Learning · Computer Science 2023-08-15 Shuo Han , Jiacheng Liu , Jiayun Wu , Yinan Chen , Li Tao

Graph, as an important data representation, is ubiquitous in many real world applications ranging from social network analysis to biology. How to correctly and effectively learn and extract information from graph is essential for a large…

Machine Learning · Computer Science 2020-10-27 Xiaodong Jiang , Ronghang Zhu , Pengsheng Ji , Sheng Li

The celebrated Sequence to Sequence learning (Seq2Seq) technique and its numerous variants achieve excellent performance on many tasks. However, many machine learning tasks have inputs naturally represented as graphs; existing Seq2Seq…

Artificial Intelligence · Computer Science 2018-12-04 Kun Xu , Lingfei Wu , Zhiguo Wang , Yansong Feng , Michael Witbrock , Vadim Sheinin

Graph transformer has been proven as an effective graph learning method for its adoption of attention mechanism that is capable of capturing expressive representations from complex topological and feature information of graphs. Graph…

Machine Learning · Computer Science 2024-03-26 Dongqi Fu , Zhigang Hua , Yan Xie , Jin Fang , Si Zhang , Kaan Sancak , Hao Wu , Andrey Malevich , Jingrui He , Bo Long

Transformer-based models have recently shown success in representation learning on graph-structured data beyond natural language processing and computer vision. However, the success is limited to small-scale graphs due to the drawbacks of…

Machine Learning · Computer Science 2022-10-05 Jinyoung Park , Seongjun Yun , Hyeonjin Park , Jaewoo Kang , Jisu Jeong , Kyung-Min Kim , Jung-woo Ha , Hyunwoo J. Kim

Graph representation learning has become a crucial task in machine learning and data mining due to its potential for modeling complex structures such as social networks, chemical compounds, and biological systems. Spiking neural networks…

Artificial Intelligence · Computer Science 2024-03-27 Huifeng Yin , Mingkun Xu , Jing Pei , Lei Deng

Graph attention has demonstrated superior performance in graph learning tasks. However, learning from global interactions can be challenging due to the large number of nodes. In this paper, we discover a new phenomenon termed…

Machine Learning · Computer Science 2025-10-27 Junshu Sun , Wanxing Chang , Chenxue Yang , Qingming Huang , Shuhui Wang

Graph autoencoders (GAEs) are powerful tools in representation learning for graph embedding. However, the performance of GAEs is very dependent on the quality of the graph structure, i.e., of the adjacency matrix. In other words, GAEs would…

Machine Learning · Computer Science 2021-03-24 Rui Zhang , Yunxing Zhang , Xuelong Li

Despite their widespread success in various domains, Transformer networks have yet to perform well across datasets in the domain of 3D atomistic graphs such as molecules even when 3D-related inductive biases like translational invariance…

Machine Learning · Computer Science 2023-03-01 Yi-Lun Liao , Tess Smidt

Spectral Graph Neural Networks have demonstrated superior performance in graph representation learning. However, many current methods focus on employing shared polynomial coefficients for all nodes, i.e., learning node-unified filters,…

Machine Learning · Computer Science 2024-07-22 Jiahong Ma , Mingguo He , Zhewei Wei

Graph and hypergraph representation learning has attracted increasing attention from various research fields. Despite the decent performance and fruitful applications of Graph Neural Networks (GNNs), Hypergraph Neural Networks (HGNNs), and…

Machine Learning · Computer Science 2023-11-15 Minhao Zou , Zhongxue Gan , Yutong Wang , Junheng Zhang , Dongyan Sui , Chun Guan , Siyang Leng

Machine learning on graphs is an important and ubiquitous task with applications ranging from drug design to friendship recommendation in social networks. The primary challenge in this domain is finding a way to represent, or encode, graph…

Social and Information Networks · Computer Science 2018-04-11 William L. Hamilton , Rex Ying , Jure Leskovec

Graph Neural Networks (GNNs) are powerful tools for graph classification. One important operation for GNNs is the downsampling or pooling that can learn effective embeddings from the node representations. In this paper, we propose a new…

Machine Learning · Computer Science 2024-05-17 Zhehan Zhao , Lu Bai , Lixin Cui , Ming Li , Yue Wang , Lixiang Xu , Edwin R. Hancock

Graph Transformers (GTs) have demonstrated great effectiveness across various graph analytical tasks. However, the existing GTs focus on training and testing graph data originated from the same distribution, but fail to generalize under…

Machine Learning · Computer Science 2026-03-16 Tianyin Liao , Ziwei Zhang , Yufei Sun , Chunyu Hu , Jianxin Li

Graph neural networks have been extensively studied for learning with inter-connected data. Despite this, recent evidence has revealed GNNs' deficiencies related to over-squashing, heterophily, handling long-range dependencies, edge…

Machine Learning · Computer Science 2023-06-16 Qitian Wu , Wentao Zhao , Zenan Li , David Wipf , Junchi Yan

Recently, graph neural networks have attracted great attention and achieved prominent performance in various research fields. Most of those algorithms have assumed pairwise relationships of objects of interest. However, in many real…

Machine Learning · Computer Science 2020-10-13 Song Bai , Feihu Zhang , Philip H. S. Torr

A graph is a powerful concept for representation of relations between pairs of entities. Data with underlying graph structure can be found across many disciplines and there is a natural desire for understanding such data better. Deep…

Machine Learning · Computer Science 2019-01-25 Martin Simonovsky

Session-based recommendation systems suggest relevant items to users by modeling user behavior and preferences using short-term anonymous sessions. Existing methods leverage Graph Neural Networks (GNNs) that propagate and aggregate…

Information Retrieval · Computer Science 2022-01-10 Sai Mitheran , Abhinav Java , Surya Kant Sahu , Arshad Shaikh

Recently popularized graph neural networks achieve the state-of-the-art accuracy on a number of standard benchmark datasets for graph-based semi-supervised learning, improving significantly over existing approaches. These architectures…

Machine Learning · Statistics 2018-03-13 Kiran K. Thekumparampil , Chong Wang , Sewoong Oh , Li-Jia Li