English
Related papers

Related papers: SVDformer: Direction-Aware Spectral Graph Embeddin…

200 papers

The capability of generalization is a cornerstone for the success of modern learning systems. For non-Euclidean data, e.g., graphs, that particularly involves topological structures, one important aspect neglected by prior studies is how…

Machine Learning · Computer Science 2025-06-24 Qitian Wu , Chenxiao Yang , Kaipeng Zeng , Michael Bronstein

Graph Transformers (GTs) have demonstrated a strong capability in modeling graph structures by addressing the intrinsic limitations of graph neural networks (GNNs), such as over-smoothing and over-squashing. Recent studies have proposed…

Machine Learning · Computer Science 2025-02-28 Chaohao Yuan , Kangfei Zhao , Ercan Engin Kuruoglu , Liang Wang , Tingyang Xu , Wenbing Huang , Deli Zhao , Hong Cheng , Yu Rong

Node representation learning for directed graphs is critically important to facilitate many graph mining tasks. To capture the directed edges between nodes, existing methods mostly learn two embedding vectors for each node, source vector…

Social and Information Networks · Computer Science 2021-05-25 Shijie Zhu , Jianxin Li , Hao Peng , Senzhang Wang , Lifang He

In this paper, we propose a novel model called SGFormer, Semantic Graph TransFormer for point cloud-based 3D scene graph generation. The task aims to parse a point cloud-based scene into a semantic structural graph, with the core challenge…

Computer Vision and Pattern Recognition · Computer Science 2023-12-21 Changsheng Lv , Mengshi Qi , Xia Li , Zhengyuan Yang , Huadong Ma

Depth completion aims to predict dense depth maps with sparse depth measurements from a depth sensor. Currently, Convolutional Neural Network (CNN) based models are the most popular methods applied to depth completion tasks. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-09-13 Jian Qian , Miao Sun , Ashley Lee , Jie Li , Shenglong Zhuo , Patrick Yin Chiang

Graphs are central to modeling complex systems in domains such as social networks, molecular chemistry, and neuroscience. While Graph Neural Networks, particularly Graph Convolutional Networks, have become standard tools for graph learning,…

Machine Learning · Computer Science 2025-11-03 Angelica Liguori , Ettore Ritacco , Pietro Sabatino , Annalisa Socievole

Session-based recommendation systems suggest relevant items to users by modeling user behavior and preferences using short-term anonymous sessions. Existing methods leverage Graph Neural Networks (GNNs) that propagate and aggregate…

Information Retrieval · Computer Science 2022-01-10 Sai Mitheran , Abhinav Java , Surya Kant Sahu , Arshad Shaikh

Despite their widespread success in various domains, Transformer networks have yet to perform well across datasets in the domain of 3D atomistic graphs such as molecules even when 3D-related inductive biases like translational invariance…

Machine Learning · Computer Science 2023-03-01 Yi-Lun Liao , Tess Smidt

The growing use of deep learning necessitates efficient network design and deployment, making neural predictors vital for estimating attributes such as accuracy and latency. Recently, Graph Neural Networks (GNNs) and transformers have shown…

Machine Learning · Computer Science 2025-07-02 Ruihan Xu , Haokui Zhang , Yaowei Wang , Wei Zeng , Shiliang Zhang

Graph neural networks (GNNs) have shown remarkable performance on homophilic graph data while being far less impressive when handling non-homophilic graph data due to the inherent low-pass filtering property of GNNs. In general, since…

Machine Learning · Computer Science 2023-10-27 Shuai Zheng , Zhenfeng Zhu , Zhizhe Liu , Youru Li , Yao Zhao

We introduce a transformer-based GNN model, named UGformer, to learn graph representations. In particular, we present two UGformer variants, wherein the first variant (publicized in September 2019) is to leverage the transformer on a set of…

Machine Learning · Computer Science 2022-03-09 Dai Quoc Nguyen , Tu Dinh Nguyen , Dinh Phung

Graph Neural Networks (GNNs) have been widely applied to various fields due to their powerful representations of graph-structured data. Despite the success of GNNs, most existing GNNs are designed to learn node representations on the fixed…

Machine Learning · Computer Science 2021-06-14 Seongjun Yun , Minbyul Jeong , Sungdong Yoo , Seunghun Lee , Sean S. Yi , Raehyun Kim , Jaewoo Kang , Hyunwoo J. Kim

Temporal graph classification plays a critical role in applications such as cybersecurity, brain connectivity analysis, social dynamics, and traffic monitoring. Despite its significance, this problem remains underexplored compared to…

Machine Learning · Computer Science 2025-11-26 Md. Joshem Uddin , Soham Changani , Baris Coskunuzer

Recently, graph-based and Transformer-based deep learning networks have demonstrated excellent performances on various point cloud tasks. Most of the existing graph methods are based on static graph, which take a fixed input to establish…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Wei Zhou , Qian Wang , Weiwei Jin , Xinzhe Shi , Ying He

The dominant graph-to-sequence transduction models employ graph neural networks for graph representation learning, where the structural information is reflected by the receptive field of neurons. Unlike graph neural networks that restrict…

Computation and Language · Computer Science 2019-12-03 Deng Cai , Wai Lam

Graph Neural Networks (GNNs) have shown remarkable performance in structured data modeling tasks such as node classification. However, mainstream approaches generally rely on a large number of trainable parameters and fixed aggregation…

Machine Learning · Computer Science 2026-02-17 Mingyue Kong , Yinglong Zhang , Chengda Xu , Xuewen Xia , Xing Xu

Cross-spectral image guided denoising has shown its great potential in recovering clean images with rich details, such as using the near-infrared image to guide the denoising process of the visible one. To obtain such image pairs, a…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Runmin Zhang , Zhu Yu , Zehua Sheng , Jiacheng Ying , Si-Yuan Cao , Shu-Jie Chen , Bailin Yang , Junwei Li , Hui-Liang Shen

Graph Convolutional Networks (GCNs) have been widely used due to their outstanding performance in processing graph-structured data. However, the undirected graphs limit their application scope. In this paper, we extend spectral-based graph…

Machine Learning · Computer Science 2020-04-30 Zekun Tong , Yuxuan Liang , Changsheng Sun , David S. Rosenblum , Andrew Lim

Recently the Transformer structure has shown good performances in graph learning tasks. However, these Transformer models directly work on graph nodes and may have difficulties learning high-level information. Inspired by the vision…

Machine Learning · Computer Science 2023-04-11 Han Gao , Xu Han , Jiaoyang Huang , Jian-Xun Wang , Li-Ping Liu

Graph representation learning has become a crucial task in machine learning and data mining due to its potential for modeling complex structures such as social networks, chemical compounds, and biological systems. Spiking neural networks…

Artificial Intelligence · Computer Science 2024-03-27 Huifeng Yin , Mingkun Xu , Jing Pei , Lei Deng