English
Related papers

Related papers: GNN-MoE: Context-Aware Patch Routing using GNNs fo…

200 papers

Graph Neural Networks (GNNs) are a powerful tool for handling structured graph data and addressing tasks such as node classification, graph classification, and clustering. However, the sparse nature of GNN computation poses new challenges…

Machine Learning · Computer Science 2023-08-24 Julia Bazinska , Andrei Ivanov , Tal Ben-Nun , Nikoli Dryden , Maciej Besta , Siyuan Shen , Torsten Hoefler

Cross-scene generalizable NeRF models, which can directly synthesize novel views of unseen scenes, have become a new spotlight of the NeRF field. Several existing attempts rely on increasingly end-to-end "neuralized" architectures, i.e.,…

Computer Vision and Pattern Recognition · Computer Science 2023-08-24 Wenyan Cong , Hanxue Liang , Peihao Wang , Zhiwen Fan , Tianlong Chen , Mukund Varma , Yi Wang , Zhangyang Wang

Sparse Mixture of Experts (sMoE) has become a pivotal approach for scaling large vision-language models, offering substantial capacity while maintaining computational efficiency through dynamic, sparse activation of experts. However,…

Machine Learning · Computer Science 2025-10-21 Yongxiang Hua , Haoyu Cao , Zhou Tao , Bocheng Li , Zihao Wu , Chaohu Liu , Linli Xu

Low-light enhancement has wide applications in autonomous driving, 3D reconstruction, remote sensing, surveillance, and so on, which can significantly improve information utilization. However, most existing methods lack generalization and…

Computer Vision and Pattern Recognition · Computer Science 2026-01-13 Minwen Liao , Hao Bo Dong , Xinyi Wang , Kurban Ubul , Yihua Shao , Ziyang Yan

Object detection and data association are critical components in multi-object tracking (MOT) systems. Despite the fact that the two components are dependent on each other, prior works often design detection and data association modules…

Computer Vision and Pattern Recognition · Computer Science 2021-04-06 Yongxin Wang , Kris Kitani , Xinshuo Weng

Graph neural networks (GNNs) are a well-regarded tool for learned control of networked dynamical systems due to their ability to be deployed in a distributed manner. However, current distributed GNN architectures assume that all nodes in…

Machine Learning · Computer Science 2026-04-06 Samuel Honor , Mohamed Abdelnaby , Kevin Leahy

Graph neural networks (GNNs) have become compelling models designed to perform learning and inference on graph-structured data. However, little work has been done to understand the fundamental limitations of GNNs for scaling to larger…

Machine Learning · Computer Science 2023-10-27 Hyungeun Lee , Kijung Yoon

Graph Neural Networks (GNNs) is an architecture for structural data, and has been adopted in a mass of tasks and achieved fabulous results, such as link prediction, node classification, graph classification and so on. Generally, for a…

Machine Learning · Computer Science 2022-05-12 Ye Tang , Xuesong Yang , Xinrui Liu , Xiwei Zhao , Zhangang Lin , Changping Peng

We present a general technique for constructing Graph Neural Networks (GNNs) capable of using multi-relational domain knowledge. The technique is based on mode-directed inverse entailment (MDIE) developed in Inductive Logic Programming…

Machine Learning · Computer Science 2021-11-22 Tirtharaj Dash , Ashwin Srinivasan , A Baskar

We introduce the framework of continuous--depth graph neural networks (GNNs). Graph neural ordinary differential equations (GDEs) are formalized as the counterpart to GNNs where the input-output relationship is determined by a continuum of…

Machine Learning · Computer Science 2021-06-23 Michael Poli , Stefano Massaroli , Junyoung Park , Atsushi Yamashita , Hajime Asama , Jinkyoo Park

We present Gradient Gating (G$^2$), a novel framework for improving the performance of Graph Neural Networks (GNNs). Our framework is based on gating the output of GNN layers with a mechanism for multi-rate flow of message passing…

Due to the exponential rise in IoT-based botnet attacks, researchers have explored various advanced techniques for both dimensionality reduction and attack detection to enhance IoT security. Among these, Variational Autoencoders (VAE),…

Computer Vision and Pattern Recognition · Computer Science 2025-05-26 Hassan Wasswa , Hussein Abbass , Timothy Lynar

Graph neural networks (GNNs) have been widely used in representation learning on graphs and achieved state-of-the-art performance in tasks such as node classification and link prediction. However, most existing GNNs are designed to learn…

Machine Learning · Computer Science 2020-02-06 Seongjun Yun , Minbyul Jeong , Raehyun Kim , Jaewoo Kang , Hyunwoo J. Kim

Mixture-of-Experts (MoE) models have emerged as a promising direction for scaling vision architectures efficiently. Among them, Soft MoE improves training stability by assigning each token to all experts via continuous dispatch weights.…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Chengxi Min , Wei Wang , Yahui Liu , Weixin Ye , Enver Sangineto , Qi Wang , Yao Zhao

Recently, fine-tuning large-scale pre-trained GNNs has yielded remarkable attention in adapting pre-trained GNN models for downstream graph learning tasks. One representative fine-tuning method is to exploit adapter (termed AdapterGNN)…

Machine Learning · Computer Science 2025-11-25 Bo Jiang , Weijun Zhao , Beibei Wang , Xiao Wang , Jin Tang

Graph Neural Networks (GNNs) have been extensively used for mining graph-structured data with impressive performance. However, because these traditional GNNs do not distinguish among various downstream tasks, embeddings embedded by them are…

Machine Learning · Computer Science 2024-09-20 Jianpeng Chen , Yujing Wang , Ming Zeng , Zongyi Xiang , Bitan Hou , Yunhai Tong , Ole J. Mengshoel , Yazhou Ren

Graph neural networks (GNNs) have become an indispensable tool for analyzing relational data. Classical GNNs are broadly classified into three variants: convolutional, attentional, and message-passing. While the standard message-passing…

Machine Learning · Computer Science 2026-01-09 Brian Godwin Lim , Galvin Brice Lim , Renzo Roel Tan , Irwin King , Kazushi Ikeda

Rule-based fine-grained IP geolocation methods are hard to generalize in computer networks which do not follow hypothetical rules. Recently, deep learning methods, like multi-layer perceptron (MLP), are tried to increase generalization…

Machine Learning · Computer Science 2023-04-18 Shichang Ding , Xiangyang Luo , Jinwei Wang , Xiaoming Fu

Modeling multivariate time series has long been a subject that has attracted researchers from a diverse range of fields including economics, finance, and traffic. A basic assumption behind multivariate time series forecasting is that its…

Machine Learning · Computer Science 2020-05-26 Zonghan Wu , Shirui Pan , Guodong Long , Jing Jiang , Xiaojun Chang , Chengqi Zhang

Graph Neural Networks (GNNs) are vital for learning from graph-structured data, enabling applications in network analysis, recommendation systems, and speech analytics. Deploying them on edge devices like client PCs and laptops enhances…

Machine Learning · Computer Science 2025-02-14 Arghadip Das , Shamik Kundu , Arnab Raha , Soumendu Ghosh , Deepak Mathaikutty , Vijay Raghunathan