English
Related papers

Related papers: BrainHGT: A Hierarchical Graph Transformer for Int…

200 papers

Recent neuroimaging studies have highlighted the importance of network-centric brain analysis, particularly with functional magnetic resonance imaging. The emergence of Deep Neural Networks has fostered a substantial interest in predicting…

Neurons and Cognition · Quantitative Biology 2023-09-06 Xuan Kan , Antonio Aodong Chen Gu , Hejie Cui , Ying Guo , Carl Yang

Transformers have revolutionized performance in Natural Language Processing and Vision, paving the way for their integration with Graph Neural Networks (GNNs). One key challenge in enhancing graph transformers is strengthening the…

Machine Learning · Computer Science 2026-01-09 Yun Young Choi , Sun Woo Park , Minho Lee , Youngho Woo

Over the recent years, Graph Neural Networks have become increasingly popular in network analytic and beyond. With that, their architecture noticeable diverges from the classical multi-layered hierarchical organization of the traditional…

Machine Learning · Computer Science 2021-05-17 Stanislav Sobolevsky

Currently, convolutional neural networks (CNN) (e.g., U-Net) have become the de facto standard and attained immense success in medical image segmentation. However, as a downside, CNN based methods are a double-edged sword as they fail to…

Image and Video Processing · Electrical Eng. & Systems 2022-04-01 Reza Azad , Moein Heidari , Yuli Wu , Dorit Merhof

Graph representation learning has made major strides over the past decade. However, in many relational domains, the input data are not suited for simple graph representations as the relationships between entities go beyond pairwise…

Machine Learning · Computer Science 2021-01-20 Balasubramaniam Srinivasan , Da Zheng , George Karypis

In this paper, we propose MGNet, a simple and effective multiplex graph convolutional network (GCN) model for multimodal brain network analysis. The proposed method integrates tensor representation into the multiplex GCN model to extract…

Computer Vision and Pattern Recognition · Computer Science 2021-08-03 Zhaoming Kong , Lichao Sun , Hao Peng , Liang Zhan , Yong Chen , Lifang He

The progress in hyperbolic neural networks (HNNs) research is hindered by their absence of inductive bias mechanisms, which are essential for generalizing to new tasks and facilitating scalable learning over large datasets. In this paper,…

Machine Learning · Computer Science 2023-10-31 Nurendra Choudhary , Nikhil Rao , Chandan K. Reddy

Despite the widespread adoption of transformers in medical applications, the exploration of multi-scale learning through transformers remains limited, while hierarchical representations are considered advantageous for computer-aided medical…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Xiaoya Tang , Bodong Zhang , Man Minh Ho , Beatrice S. Knudsen , Tolga Tasdizen

Real-world graphs naturally exhibit hierarchical or cyclical structures that are unfit for the typical Euclidean space. While there exist graph neural networks that leverage hyperbolic or spherical spaces to learn representations that embed…

Machine Learning · Computer Science 2023-09-11 Sungjun Cho , Seunghyuk Cho , Sungwoo Park , Hankook Lee , Honglak Lee , Moontae Lee

The emerging graph Transformers have achieved impressive performance for graph representation learning over graph neural networks (GNNs). In this work, we regard the self-attention mechanism, the core module of graph Transformers, as a…

Machine Learning · Computer Science 2023-10-18 Jinsong Chen , Gaichao Li , John E. Hopcroft , Kun He

Many real-world data can be represented as heterogeneous graphs with different types of nodes and connections. Heterogeneous graph neural network model aims to embed nodes or subgraphs into low-dimensional vector space for various…

Artificial Intelligence · Computer Science 2024-12-24 Xinjun Cai , Jiaxing Shang , Fei Hao , Dajiang Liu , Linjiang Zheng

We present a hierarchical neuro-symbolic control framework that tightly couples a classical symbolic planner with a transformer-based policy to address long-horizon decision-making under uncertainty. At the high level, the planner assembles…

Artificial Intelligence · Computer Science 2025-05-30 Ali Baheri , Cecilia O. Alm

Most real-world graphs exhibit a hierarchical structure, which is often overlooked by existing graph generation methods. To address this limitation, we propose a novel graph generative network that captures the hierarchical nature of graphs…

Machine Learning · Computer Science 2026-01-01 Mahdi Karami

Session-based recommendation systems suggest relevant items to users by modeling user behavior and preferences using short-term anonymous sessions. Existing methods leverage Graph Neural Networks (GNNs) that propagate and aggregate…

Information Retrieval · Computer Science 2022-01-10 Sai Mitheran , Abhinav Java , Surya Kant Sahu , Arshad Shaikh

For many years now, understanding the brain mechanism has been a great research subject in many different fields. Brain signal processing and especially electroencephalogram (EEG) has recently known a growing interest both in academia and…

Neurons and Cognition · Quantitative Biology 2022-04-18 Victor Delvigne , Hazem Wannous , Jean-Philippe Vandeborre , Laurence Ris , Thierry Dutoit

Transformers flexibly operate over sets of real-valued vectors representing task-specific entities and their attributes, where each vector might encode one word-piece token and its position in a sequence, or some piece of information that…

Machine Learning · Computer Science 2023-03-14 Cameron Diao , Ricky Loynd

Recently, pretraining methods for the Graph Neural Networks (GNNs) have been successful at learning effective representations from unlabeled graph data. However, most of these methods rely on pairwise relations in the graph and do not…

Machine Learning · Computer Science 2023-11-21 Abdalgader Abubaker , Takanori Maehara , Madhav Nimishakavi , Vassilis Plachouras

Heterogeneous graph neural networks (HeteGNNs) have demonstrated strong abilities to learn node representations by effectively extracting complex structural and semantic information in heterogeneous graphs. Most of the prevailing HeteGNNs…

Machine Learning · Computer Science 2025-05-08 Hong Jin , Kaicheng Zhou , Jie Yin , Lan You , Zhifeng Zhou

Major Depressive Disorder (MDD), affecting millions worldwide, exhibits complex pathophysiology manifested through disrupted brain network dynamics. Although graph neural networks that leverage neuroimaging data have shown promise in…

Machine Learning · Computer Science 2025-11-25 Weidao Chen , Yuxiao Yang , Yueming Wang

Graph Transformers (GTs) have emerged as a powerful paradigm for graph representation learning due to their ability to model diverse node interactions. However, existing GTs often rely on intricate architectural designs tailored to specific…

Computer Vision and Pattern Recognition · Computer Science 2025-10-22 Yujie Xing , Xiao Wang , Bin Wu , Hai Huang , Chuan Shi