English
Related papers

Related papers: Supercharging Graph Transformers with Advective Di…

200 papers

Diffusion models have shown remarkable performance on many generative tasks. Despite recent success, most diffusion models are restricted in that they only allow linear transformation of the data distribution. In contrast, broader family of…

Machine Learning · Computer Science 2024-06-04 Grigory Bartosh , Dmitry Vetrov , Christian A. Naesseth

A prominent paradigm for graph neural networks is based on the message-passing framework. In this framework, information communication is realized only between neighboring nodes. The challenge of approaches that use this paradigm is to…

Machine Learning · Computer Science 2023-09-18 Maysam Behmanesh , Maximilian Krahn , Maks Ovsjanikov

Transformers have become widely used in various tasks, such as natural language processing and machine vision. This paper proposes Gransformer, an algorithm based on Transformer for generating graphs. We modify the Transformer encoder to…

Machine Learning · Computer Science 2024-06-03 Ahmad Khajenezhad , Seyed Ali Osia , Mahmood Karimian , Hamid Beigy

Large-scale graphs with node attributes are increasingly common in various real-world applications. Creating synthetic, attribute-rich graphs that mirror real-world examples is crucial, especially for sharing graph data for analysis and…

Machine Learning · Computer Science 2024-10-17 Mufei Li , Eleonora Kreačić , Vamsi K. Potluru , Pan Li

Graph diffusion models, dominant in graph generative modeling, remain underexplored for graph-to-graph translation tasks like chemical reaction prediction. We demonstrate that standard permutation equivariant denoisers face fundamental…

Machine Learning · Computer Science 2025-06-10 Najwa Laabid , Severi Rissanen , Markus Heinonen , Arno Solin , Vikas Garg

Traditional machine learning methods heavily rely on the independent and identically distribution assumption, which imposes limitations when the test distribution deviates from the training distribution. To address this crucial issue,…

Machine Learning · Computer Science 2024-03-26 Qin Tian , Wenjun Wang , Chen Zhao , Minglai Shao , Wang Zhang , Dong Li

Rearranging deformable objects is a long-standing challenge in robotic manipulation for the high dimensionality of configuration space and the complex dynamics of deformable objects. We present a novel framework, Graph-Transporter, for…

Robotics · Computer Science 2023-02-22 Yuhong Deng , Chongkun Xia , Xueqian Wang , Lipeng Chen

Graph foundation models represent a transformative paradigm for learning transferable representations across diverse graph domains. Recent methods leverage large language models to unify graph and text modalities into a shared…

Machine Learning · Computer Science 2025-12-23 Heng Zhang , Tianyi Zhang , Yuling Shi , Xiaodong Gu , Yaomin Shen , Haochen You , Zijian Zhang , Yilei Yuan , Jin Huang

We propose a generalization of transformer neural network architecture for arbitrary graphs. The original transformer was designed for Natural Language Processing (NLP), which operates on fully connected graphs representing all connections…

Machine Learning · Computer Science 2021-01-26 Vijay Prakash Dwivedi , Xavier Bresson

Graph transformers are the state-of-the-art for learning from graph-structured data and are empirically known to avoid several pitfalls of message-passing architectures. However, there is limited theoretical analysis on why these models…

Machine Learning · Statistics 2026-03-19 Nil Ayday , Lingchu Yang , Debarghya Ghoshdastidar

Adversarial evasion attacks pose significant threats to graph learning, with lines of studies that have improved the robustness of Graph Neural Networks (GNNs). However, existing works rely on priors about clean graphs or attacking…

Machine Learning · Computer Science 2025-02-10 Jiayi Luo , Qingyun Sun , Haonan Yuan , Xingcheng Fu , Jianxin Li

Recently, diffusion-based recommendation methods have achieved impressive results. However, existing approaches predominantly treat each user's historical interactions as independent training samples, overlooking the potential of…

Social and Information Networks · Computer Science 2025-04-08 Xuan Zhang , Xiang Deng , Hongxing Yuan , Chunyu Wei , Yushun Fan

Edges in many real-world social/information networks are associated with rich text information (e.g., user-user communications or user-product reviews). However, mainstream network representation learning models focus on propagating and…

Machine Learning · Computer Science 2023-02-23 Bowen Jin , Yu Zhang , Yu Meng , Jiawei Han

Diffusion-based graph generative models have recently obtained promising results for graph generation. However, existing diffusion-based graph generative models are mostly one-shot generative models that apply Gaussian diffusion in the…

Artificial Intelligence · Computer Science 2023-07-19 Lingkai Kong , Jiaming Cui , Haotian Sun , Yuchen Zhuang , B. Aditya Prakash , Chao Zhang

Temporal graph classification plays a critical role in applications such as cybersecurity, brain connectivity analysis, social dynamics, and traffic monitoring. Despite its significance, this problem remains underexplored compared to…

Machine Learning · Computer Science 2025-11-26 Md. Joshem Uddin , Soham Changani , Baris Coskunuzer

We provide a general framework for learning diffusion bridges that transport prior to target distributions. It includes existing diffusion models for generative modeling, but also underdamped versions with degenerate diffusion matrices,…

Machine Learning · Computer Science 2025-08-14 Denis Blessing , Julius Berner , Lorenz Richter , Gerhard Neumann

Diffusion models have emerged as powerful generative frameworks by progressively adding noise to data through a forward process and then reversing this process to generate realistic samples. While these models have achieved strong…

Machine Learning · Computer Science 2025-03-04 Xingzhuo Guo , Yu Zhang , Baixu Chen , Haoran Xu , Jianmin Wang , Mingsheng Long

Diffusion models are central to generative modeling and have been adapted to graphs by diffusing adjacency matrix representations. The challenge of having up to $n!$ such representations for graphs with $n$ nodes is only partially mitigated…

Graph Neural Networks (GNNs) have achieved remarkable success across diverse applications, yet they remain limited by oversmoothing and poor performance on heterophilic graphs. To address these challenges, we introduce a novel framework…

Machine Learning · Computer Science 2025-11-19 Cristina López Amado , Tassilo Schwarz , Yu Tian , Renaud Lambiotte

The discovery of new molecules based on the original chemical molecule distributions is of great importance in medicine. The graph transformer, with its advantages of high performance and scalability compared to traditional graph networks,…

Machine Learning · Computer Science 2025-04-30 Ji Shi , Chengxun Xie , Zhonghao Li , Xinming Zhang , Miao Zhang