English
Related papers

Related papers: Enhancing Graph Transformers with Hierarchical Dis…

200 papers

Hyperdimensional Computing (HDC) developed by Kanerva is a computational model for machine learning inspired by neuroscience. HDC exploits characteristics of biological neural systems such as high-dimensionality, randomness and a…

Machine Learning · Computer Science 2022-05-17 Igor Nunes , Mike Heddes , Tony Givargis , Alexandru Nicolau , Alex Veidenbaum

Graph neural networks have been extensively studied for learning with inter-connected data. Despite this, recent evidence has revealed GNNs' deficiencies related to over-squashing, heterophily, handling long-range dependencies, edge…

Machine Learning · Computer Science 2023-06-16 Qitian Wu , Wentao Zhao , Zenan Li , David Wipf , Junchi Yan

Graph embedding algorithms are used to efficiently represent (encode) a graph in a low-dimensional continuous vector space that preserves the most important properties of the graph. One aspect that is often overlooked is whether the graph…

Machine Learning · Computer Science 2020-01-31 Zekarias T. Kefato , Nasrullah Sheikh , Alberto Montresor

Despite being very successful within the pattern recognition and machine learning community, graph-based methods are often unusable because of the lack of mathematical operations defined in graph domain. Graph embedding, which maps graphs…

Computer Vision and Pattern Recognition · Computer Science 2020-01-07 Anjan Dutta , Pau Riba , Josep Lladós , Alicia Fornés

Graph Convolutional Networks (GCNs) gained traction for graph representation learning, with recent attention on improving performance on heterophilic graphs for various real-world applications. The localized feature aggregation in a typical…

Machine Learning · Computer Science 2025-07-30 Garv Kaushik

In this paper, we focus on graph representation learning of heterogeneous information network (HIN), in which various types of vertices are connected by various types of relations. Most of the existing methods conducted on HIN revise…

Machine Learning · Computer Science 2019-12-24 Huiting Hong , Hantao Guo , Yucheng Lin , Xiaoqing Yang , Zang Li , Jieping Ye

Many complex systems involve interactions between more than two agents. Hypergraphs capture these higher-order interactions through hyperedges that may link more than two nodes. We consider the problem of embedding a hypergraph into…

Social and Information Networks · Computer Science 2023-01-06 Xue Gong , Desmond J. Higham , Konstantinos Zygalakis

Many systems comprising entities in interactions can be represented as graphs, whose structure gives significant insights about how these systems work. Network theory has undergone further developments, in particular in relation to…

Data Analysis, Statistics and Probability · Physics 2016-06-14 Ronan Hamon , Pierre Borgnat , Patrick Flandrin , Céline Robardet

Graph representation learning aims to effectively encode high-dimensional sparse graph-structured data into low-dimensional dense vectors, which is a fundamental task that has been widely studied in a range of fields, including machine…

Inferring the graph structure from observed data is a key task in graph machine learning to capture the intrinsic relationship between data entities. While significant advancements have been made in learning the structure of homogeneous…

Machine Learning · Computer Science 2025-03-13 Keyue Jiang , Bohan Tang , Xiaowen Dong , Laura Toni

Machine learning on graphs is an important and ubiquitous task with applications ranging from drug design to friendship recommendation in social networks. The primary challenge in this domain is finding a way to represent, or encode, graph…

Social and Information Networks · Computer Science 2018-04-11 William L. Hamilton , Rex Ying , Jure Leskovec

Graph representation learning has made major strides over the past decade. However, in many relational domains, the input data are not suited for simple graph representations as the relationships between entities go beyond pairwise…

Machine Learning · Computer Science 2021-01-20 Balasubramaniam Srinivasan , Da Zheng , George Karypis

Hypergraph data, which capture multi-way interactions among entities, are increasingly prevalent in the big data era. Generating new hyperlinks from an observed, usually high-dimensional hypergraph is an important yet challenging task with…

Methodology · Statistics 2026-05-14 Shihao Wu , Junyi Yang , Gongjun Xu , Ji Zhu

Dimensionality reduction is crucial both for visualization and preprocessing high dimensional data for machine learning. We introduce a novel method based on a hierarchy built on 1-nearest neighbor graphs in the original space which is used…

Computer Vision and Pattern Recognition · Computer Science 2022-05-31 M. Saquib Sarfraz , Marios Koulakis , Constantin Seibold , Rainer Stiefelhagen

Graph Transformers are popular neural networks that extend the well-known Transformer architecture to the graph domain. These architectures operate by applying self-attention on graph nodes and incorporating graph structure through the use…

Machine Learning · Computer Science 2025-02-04 Linus Bao , Emily Jin , Michael Bronstein , İsmail İlkan Ceylan , Matthias Lanzinger

Encoding a driving scene into vector representations has been an essential task for autonomous driving that can benefit downstream tasks e.g. trajectory prediction. The driving scene often involves heterogeneous elements such as the…

Artificial Intelligence · Computer Science 2023-07-21 Xiaosong Jia , Penghao Wu , Li Chen , Yu Liu , Hongyang Li , Junchi Yan

Recently, Transformers for graph representation learning have become increasingly popular, achieving state-of-the-art performance on a wide-variety of graph datasets, either alone or in combination with message-passing graph neural networks…

Machine Learning · Computer Science 2024-05-07 Ayush Garg

Transformers, adapted from natural language processing, are emerging as a leading approach for graph representation learning. Contemporary graph transformers often treat nodes or edges as separate tokens. This approach leads to…

Machine Learning · Computer Science 2023-10-04 Zihan Pengmei , Zimu Li , Chih-chan Tien , Risi Kondor , Aaron R. Dinner

Graph Transformers (GTs) have made remarkable achievements in graph-level tasks. However, most existing works regard graph structures as a form of guidance or bias for enhancing node representations, which focuses on node-central…

Machine Learning · Computer Science 2024-12-10 Xiaorui Qi , Qijie Bai , Yanlong Wen , Haiwei Zhang , Xiaojie Yuan

The problem of unsupervised learning node embeddings in graphs is one of the important directions in modern network science. In this work we propose a novel framework, which is aimed to find embeddings by \textit{discriminating…

Machine Learning · Statistics 2020-01-24 Stanislav Tsepa , Maxim Panov
‹ Prev 1 3 4 5 6 7 10 Next ›