English
Related papers

Related papers: GNN-MoE: Context-Aware Patch Routing using GNNs fo…

200 papers

A common practice in heterogeneous graph neural networks (HGNNs) is to condition parameters on node/edge types, assuming types reflect semantic roles. However, this can cause overreliance on surface-level labels and impede cross-type…

Machine Learning · Computer Science 2026-01-23 Georgiy Shakirov , Albert Arakelov

We introduce the framework of continuous-depth graph neural networks (GNNs). Neural graph differential equations (Neural GDEs) are formalized as the counterpart to GNNs where the input-output relationship is determined by a continuum of GNN…

Machine Learning · Computer Science 2021-06-23 Michael Poli , Stefano Massaroli , Clayton M. Rabideau , Junyoung Park , Atsushi Yamashita , Hajime Asama , Jinkyoo Park

This thesis presents a local-to-global perspective on graph neural networks (GNN), the leading architecture to process graph-structured data. After categorizing GNN into local Message Passing Neural Networks (MPNN) and global Graph…

Machine Learning · Computer Science 2023-06-21 Chen Cai

Fine-tuning large pretrained vision-language models (VLMs) has emerged as a prevalent paradigm for downstream adaptation, yet it faces a critical trade-off between domain specificity and domain generalization (DG) ability. Current methods…

Computer Vision and Pattern Recognition · Computer Science 2026-03-13 Xinyao Li , Yinjie Min , Hongbo Chen , Zhekai Du , Fengling Li , Jingjing Li

Due to domain shifts, machine learning systems typically struggle to generalize well to new domains that differ from those of training data, which is what domain generalization (DG) aims to address. Although a variety of DG methods have…

Machine Learning · Computer Science 2023-11-15 Jingang Qu , Thibault Faney , Ze Wang , Patrick Gallinari , Soleiman Yousef , Jean-Charles de Hemptinne

Mixture-of-Experts (MoE) benefits from a dynamic routing mechanism among their specialized experts, which existing Parameter- Efficient Fine-Tuning (PEFT) strategies fail to leverage. This motivates us to investigate whether adaptation…

Machine Learning · Computer Science 2025-08-05 Yilun Liu , Yunpu Ma , Yuetian Lu , Shuo Chen , Zifeng Ding , Volker Tresp

Multi-agent coordination is crucial for reliable multi-robot navigation in shared spaces such as automated warehouses. In regions of dense robot traffic, local coordination methods may fail to find a deadlock-free solution. In these…

Robotics · Computer Science 2025-03-06 Yue Meng , Nathalie Majcherczyk , Wenliang Liu , Scott Kiesel , Chuchu Fan , Federico Pecora

Unified image generation and editing models suffer from severe task interference in dense diffusion transformers architectures, where a shared parameter space must compromise between conflicting objectives (e.g., local editing v.s.…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 Yu Xu , Hongbin Yan , Juan Cao , Yiji Cheng , Tiankai Hang , Runze He , Zijin Yin , Shiyi Zhang , Yuxin Zhang , Jintao Li , Chunyu Wang , Qinglin Lu , Tong-Yee Lee , Fan Tang

Link prediction, which aims to forecast unseen connections in graphs, is a fundamental task in graph machine learning. Heuristic methods, leveraging a range of different pairwise measures such as common neighbors and shortest paths, often…

Machine Learning · Computer Science 2025-01-03 Li Ma , Haoyu Han , Juanhui Li , Harry Shomer , Hui Liu , Xiaofeng Gao , Jiliang Tang

Graph neural networks (GNNs) have achieved remarkable success in various domains, yet they often struggle with domain adaptation due to significant structural distribution shifts and insufficient exploration of transferable patterns. One of…

Machine Learning · Computer Science 2025-10-16 Haoyu Zhang , Yuxuan Cheng , Wenqi Fan , Yulong Chen , Yifan Zhang

Graph neural networks (GNNs) have achieved impressive impressions for graph-related tasks. However, most GNNs are primarily studied under the cases of signal domain with supervised training, which requires abundant task-specific labels and…

Machine Learning · Computer Science 2025-07-16 Jinhui Pang , Zixuan Wang , Jiliang Tang , Mingyan Xiao , Nan Yin

Mixture-of-Experts (MoE) offers flexible graph reasoning by combining multiple views of a graph through a learned router. We investigate routing-aware explanations for MoE graph models in malware detection using control flow graphs (CFGs).…

Cryptography and Security · Computer Science 2026-02-24 Hossein Shokouhinejad , Roozbeh Razavi-Far , Griffin Higgins , Ali. A Ghorbani

Deep neural network (DNN) models have shown remarkable success in many real-world scenarios, such as object detection and classification. Unfortunately, these models are not yet widely adopted in health monitoring due to exceptionally high…

Machine Learning · Computer Science 2025-03-14 Johnson Loh , Lyubov Dudchenko , Justus Viga , Tobias Gemmeke

Graph Neural Networks (GNNs) have emerged as a powerful tool to capture intricate network patterns, achieving success across different domains. However, existing GNNs require careful domain-specific architecture designs and training from…

Machine Learning · Computer Science 2025-05-30 Jingzhe Liu , Haitao Mao , Zhikai Chen , Bingheng Li , Wenqi Fan , Mingxuan Ju , Tong Zhao , Neil Shah , Jiliang Tang

Fine-tuning pre-trained models has recently yielded remarkable performance gains in graph neural networks (GNNs). In addition to pre-training techniques, inspired by the latest work in the natural language fields, more recent work has…

Machine Learning · Computer Science 2023-12-12 Shengrui Li , Xueting Han , Jing Bai

Graph neural networks (GNNs) are widely used in domains like social networks and biological systems. However, the locality assumption of GNNs, which limits information exchange to neighboring nodes, hampers their ability to capture…

Machine Learning · Computer Science 2023-07-04 Tingting Dan , Jiaqi Ding , Ziquan Wei , Shahar Z Kovalsky , Minjeong Kim , Won Hwa Kim , Guorong Wu

Pre-trained graph neural networks (GNNs) transfer well, but adapting them to downstream tasks remains challenging due to mismatches between pre-training objectives and task requirements. Graph prompt tuning offers a parameter-efficient…

Machine Learning · Computer Science 2026-02-06 Long D. Nguyen , Binh P. Nguyen

Graph Neural Networks (GNNs) have been widely applied to various fields due to their powerful representations of graph-structured data. Despite the success of GNNs, most existing GNNs are designed to learn node representations on the fixed…

Machine Learning · Computer Science 2021-06-14 Seongjun Yun , Minbyul Jeong , Sungdong Yoo , Seunghun Lee , Sean S. Yi , Raehyun Kim , Jaewoo Kang , Hyunwoo J. Kim

Reinforcement Learning (RL) methods used for solving real-world optimization problems often involve dynamic state-action spaces, larger scale, and sparse rewards, leading to significant challenges in convergence, scalability, and efficient…

Machine Learning · Computer Science 2025-09-29 Stavros Orfanoudakis , Nanda Kishor Panda , Peter Palensky , Pedro P. Vergara

Multi-source unsupervised domain adaptation aims to leverage labeled data from multiple source domains for training a machine learning model to generalize well on a target domain without labels. Source domain selection plays a crucial role…

Machine Learning · Computer Science 2024-11-12 Yao Ma , Samuel Louvan , Zhunxuan Wang