English
Related papers

Related papers: BrainHGT: A Hierarchical Graph Transformer for Int…

200 papers

We create a reusable Transformer, BrainBERT, for intracranial recordings bringing modern representation learning approaches to neuroscience. Much like in NLP and speech recognition, this Transformer enables classifying complex concepts,…

Machine Learning · Computer Science 2023-03-01 Christopher Wang , Vighnesh Subramaniam , Adam Uri Yaari , Gabriel Kreiman , Boris Katz , Ignacio Cases , Andrei Barbu

The design of Graph Transformers (GTs) generally neglects considerations for fairness, resulting in biased outcomes against certain sensitive subgroups. Since GTs encode graph information without relying on message-passing mechanisms,…

Machine Learning · Computer Science 2024-04-29 Renqiang Luo , Huafei Huang , Shuo Yu , Xiuzhen Zhang , Feng Xia

Graph representation learning for hypergraphs can be used to extract patterns among higher-order interactions that are critically important in many real world problems. Current approaches designed for hypergraphs, however, are unable to…

Machine Learning · Computer Science 2019-11-11 Ruochi Zhang , Yuesong Zou , Jian Ma

Message-Passing Neural Networks (MPNNs) are extensively employed in graph learning tasks but suffer from limitations such as the restricted scope of information exchange, by being confined to neighboring nodes during each round of message…

Machine Learning · Computer Science 2024-08-30 Carlos Vonessen , Florian Grötschla , Roger Wattenhofer

Graph neural networks (GNN) have been proven to be mature enough for handling graph-structured data on node-level graph representation learning tasks. However, the graph pooling technique for learning expressive graph-level representation…

Machine Learning · Computer Science 2021-04-14 Ning Liu , Songlei Jian , Dongsheng Li , Yiming Zhang , Zhiquan Lai , Hongzuo Xu

Recent graph neural networks (GNNs) with the attention mechanism have historically been limited to small-scale homogeneous graphs (HoGs). However, GNNs handling heterogeneous graphs (HeGs), which contain several entity and relation types,…

Machine Learning · Computer Science 2023-04-25 Roshni G. Iyer , Wei Wang , Yizhou Sun

The context-aware emotional reasoning ability of AI systems, especially in conversations, is of vital importance in applications such as online opinion mining from social media and empathetic dialogue systems. Due to the implicit nature of…

Computation and Language · Computer Science 2023-08-10 Kailai Yang , Tianlin Zhang , Shaoxiong Ji , Sophia Ananiadou

Recent advancements in computer vision have highlighted the scalability of Vision Transformers (ViTs) across various tasks, yet challenges remain in balancing adaptability, computational efficiency, and the ability to model higher-order…

Computer Vision and Pattern Recognition · Computer Science 2025-04-14 Joshua Fixelle

With higher-order neighborhood information of graph network, the accuracy of graph representation learning classification can be significantly improved. However, the current higher order graph convolutional network has a large number of…

Machine Learning · Computer Science 2019-08-05 FangYuan Lei , Xun Liu , QingYun Dai , Bingo Wing-Kuen Ling , Huimin Zhao , Yan Liu

Electroencephalography (EEG) serves as a reliable and objective signal for emotion recognition in affective brain-computer interfaces, offering unique advantages through its high temporal resolution and ability to capture authentic…

Computer Vision and Pattern Recognition · Computer Science 2025-08-20 Yueyang Li , Shengyu Gong , Weiming Zeng , Nizhuan Wang , Wai Ting Siok

Interpretable graph neural networks (XGNNs ) are widely adopted in various scientific applications involving graph-structured data. Existing XGNNs predominantly adopt the attention-based mechanism to learn edge or node importance for…

Machine Learning · Computer Science 2024-06-13 Yongqiang Chen , Yatao Bian , Bo Han , James Cheng

Group convolution works well with many deep convolutional neural networks (CNNs) that can effectively compress the model by reducing the number of parameters and computational cost. Using this operation, feature maps of different group…

Computer Vision and Pattern Recognition · Computer Science 2019-06-11 Xukai Xie , Yuan Zhou , Sun-Yuan Kung

Graph Neural Networks (GNNs) have emerged as promising solutions for collaborative filtering (CF) through the modeling of user-item interaction graphs. The nucleus of existing GNN-based recommender systems involves recursive message passing…

Machine Learning · Computer Science 2024-05-21 Peiyan Zhang , Yuchen Yan , Xi Zhang , Chaozhuo Li , Senzhang Wang , Feiran Huang , Sunghun Kim

Graph Transformers (GTs) have demonstrated their advantages across a wide range of tasks. However, the self-attention mechanism in GTs overlooks the graph's inductive biases, particularly biases related to structure, which are crucial for…

Machine Learning · Computer Science 2024-04-25 Chuang Liu , Zelin Yao , Yibing Zhan , Xueqi Ma , Shirui Pan , Wenbin Hu

The hippocampus plays a vital role in the diagnosis and treatment of many neurological disorders. Recent years, deep learning technology has made great progress in the field of medical image segmentation, and the performance of related…

Computer Vision and Pattern Recognition · Computer Science 2022-11-16 Heyu Huang , Runmin Cong , Lianhe Yang , Ling Du , Cong Wang , Sam Kwong

Point cloud completion is essential for robotic perception, object reconstruction and supporting downstream tasks like grasp planning, obstacle avoidance, and manipulation. However, incomplete geometry caused by self-occlusion and sensor…

Robotics · Computer Science 2025-09-18 Yadan Zeng , Jiadong Zhou , Xiaohan Li , I-Ming Chen

Memory is an important cognitive function for humans. How a brain with such a small power can complete such a complex memory function, the working mechanism behind this is undoubtedly fascinating. Engram theory views memory as the…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-07-13 Hui Wei , Weihua Miao , Fushun Li

Existing Graph Neural Networks (GNNs) follow the message-passing mechanism that conducts information interaction among nodes iteratively. While considerable progress has been made, such node interaction paradigms still have the following…

Machine Learning · Computer Science 2023-04-14 Jie Chen , Zilong Li , Yin Zhu , Junping Zhang , Jian Pu

Graph Transformers (GTs) have recently demonstrated remarkable performance across diverse domains. By leveraging attention mechanisms, GTs are capable of modeling long-range dependencies and complex structural relationships beyond local…

Machine Learning · Computer Science 2025-06-06 Jiachen Tang , Zhonghao Wang , Sirui Chen , Sheng Zhou , Jiawei Chen , Jiajun Bu

Graph Neural Networks (GNNs) excel in delineating graph structures in diverse domains, including community analysis and recommendation systems. As the interpretation of GNNs becomes increasingly important, the demand for robust baselines…

Machine Learning · Computer Science 2024-05-30 Ming-Yi Hong , Yi-Hsiang Huang , Shao-En Lin , You-Chen Teng , Chih-Yu Wang , Che Lin