English
Related papers

Related papers: Multiscale Neural Operators for Solving Time-Indep…

200 papers

We explore graph rewiring methods that optimise commute time. Recent graph rewiring approaches facilitate long-range interactions in sparse graphs, making such rewirings commute-time-optimal on average. However, when an expert prior exists…

Social and Information Networks · Computer Science 2024-09-06 Igor Sterner , Shiye Su , Petar Veličković

Neural operators (NOs) struggle with high-contrast multiscale partial differential equations (PDEs), where fine-scale heterogeneities cause large errors. To address this, we use the Generalized Multiscale Finite Element Method (GMsFEM) that…

Message-passing graph neural networks (MPNNs) emerged as powerful tools for processing graph-structured input. However, they operate on a fixed input graph structure, ignoring potential noise and missing information. Furthermore, their…

Machine Learning · Computer Science 2024-03-27 Chendi Qian , Andrei Manolache , Kareem Ahmed , Zhe Zeng , Guy Van den Broeck , Mathias Niepert , Christopher Morris

In this paper, we show a physics-informed neural network solver for the time-dependent surface PDEs. Unlike the traditional numerical solver, no extension of PDE and mesh on the surface is needed. We show a simplified prior estimate of the…

Machine Learning · Computer Science 2021-03-26 Zhiwei Fang , Justin Zhang , Xiu Yang

Improving the resilience of a network is a fundamental problem in network science, which protects the underlying system from natural disasters and malicious attacks. This is traditionally achieved via successive degree-preserving edge…

Machine Learning · Computer Science 2022-05-24 Shanchao Yang , Kaili Ma , Baoxiang Wang , Tianshu Yu , Hongyuan Zha

In this paper, we explore a novel model reusing task tailored for graph neural networks (GNNs), termed as "deep graph reprogramming". We strive to reprogram a pre-trained GNN, without amending raw node features nor model parameters, to…

Computer Vision and Pattern Recognition · Computer Science 2023-05-01 Yongcheng Jing , Chongbin Yuan , Li Ju , Yiding Yang , Xinchao Wang , Dacheng Tao

Current graph neural networks (GNNs) lack generalizability with respect to scales (graph sizes, graph diameters, edge weights, etc..) when solving many graph analysis problems. Taking the perspective of synthesizing graph theory programs,…

Machine Learning · Computer Science 2020-10-27 Hao Tang , Zhiao Huang , Jiayuan Gu , Bao-Liang Lu , Hao Su

Partial differential equations (PDEs) play a dominant role in the mathematical modeling of many complex dynamical processes. Solving these PDEs often requires prohibitively high computational costs, especially when multiple evaluations must…

Machine Learning · Computer Science 2022-09-07 Muhammad I. Zafar , Jiequn Han , Xu-Hui Zhou , Heng Xiao

Evolving relations in real-world networks are often modelled by temporal graphs. Temporal Graph Neural Networks (TGNNs) emerged to model evolutionary behaviour of such graphs by leveraging the message passing primitive at the core of Graph…

Machine Learning · Computer Science 2024-10-23 Katarina Petrović , Shenyang Huang , Farimah Poursafaei , Petar Veličković

Surface partial differential equations arise in numerous scientific and engineering applications. Their numerical solution on static and evolving surfaces remains challenging due to geometric complexity and, for evolving geometries, the…

Numerical Analysis · Mathematics 2026-03-03 Jingbo Sun , Fei Wang

This paper introduces PDEformer, a neural solver for partial differential equations (PDEs) capable of simultaneously addressing various types of PDEs. We propose to represent the PDE in the form of a computational graph, facilitating the…

Numerical Analysis · Mathematics 2025-01-28 Zhanhong Ye , Xiang Huang , Leheng Chen , Hongsheng Liu , Zidong Wang , Bin Dong

Graph neural networks (GNNs) leverage message passing mechanisms to learn the topological features of graph data. Traditional GNNs learns node features in a spatial domain unrelated to the topology, which can hardly ensure topological…

Machine Learning · Computer Science 2025-05-30 Juwei Yue , Haikuo Li , Jiawei Sheng , Xiaodong Li , Taoyu Su , Tingwen Liu , Li Guo

This paper explores sparsification methods as a form of regularization in Graph Neural Networks (GNNs) to address high memory usage and computational costs in large-scale graph applications. Using techniques from Network Science and Machine…

Machine Learning · Computer Science 2026-02-12 Charlotte Cambier van Nooten , Christos Aronis , Yuliya Shapovalova , Lucia Cavallaro

Information over-squashing is a phenomenon of inefficient information propagation between distant nodes on networks. It is an important problem that is known to significantly impact the training of graph neural networks (GNNs), as the…

Machine Learning · Statistics 2022-07-19 Jakub Bober , Anthea Monod , Emil Saucan , Kevin N. Webster

Multivariate time series is prevalent in many scientific and industrial domains. Modeling multivariate signals is challenging due to their long-range temporal dependencies and intricate interactions--both direct and indirect. To confront…

Machine Learning · Computer Science 2023-12-01 Juhyeon Kim , Hyungeun Lee , Seungwon Yu , Ung Hwang , Wooyul Jung , Miseon Park , Kijung Yoon

Graph neural network (GNN) is a promising approach to learning and predicting physical phenomena described in boundary value problems, such as partial differential equations (PDEs) with boundary conditions. However, existing models…

Machine Learning · Computer Science 2023-03-24 Masanobu Horie , Naoto Mitsume

Despite the great promise of the physics-informed neural networks (PINNs) in solving forward and inverse problems, several technical challenges are present as roadblocks for more complex and realistic applications. First, most existing…

Computational Engineering, Finance, and Science · Computer Science 2022-01-26 Han Gao , Matthew J. Zahr , Jian-Xun Wang

We propose a novel multi-scale message passing neural network algorithm for learning the solutions of time-dependent PDEs. Our algorithm possesses both temporal and spatial multi-scale resolution features by incorporating multi-scale…

Machine Learning · Computer Science 2023-02-08 Léonard Equer , T. Konstantin Rusch , Siddhartha Mishra

Message-passing graph neural networks (MPNNs) have emerged as a powerful paradigm for graph-based machine learning. Despite their effectiveness, MPNNs face challenges such as under-reaching and over-squashing, where limited receptive fields…

Machine Learning · Computer Science 2024-12-03 Chendi Qian , Andrei Manolache , Christopher Morris , Mathias Niepert

Graph Neural Networks (GNNs) have demonstrated remarkable success in modeling complex relationships in graph-structured data. A recent innovation in this field is the family of Differential Equation-Inspired Graph Neural Networks (DE-GNNs),…

Machine Learning · Computer Science 2024-01-23 Moshe Eliasof , Eldad Haber , Eran Treister , Carola-Bibiane Schönlieb