English
Related papers

Related papers: Multi-Scale Message Passing Neural PDE Solvers

200 papers

Message passing plays a vital role in graph neural networks (GNNs) for effective feature learning. However, the over-reliance on input topology diminishes the efficacy of message passing and restricts the ability of GNNs. Despite efforts to…

Machine Learning · Computer Science 2024-12-03 Junshu Sun , Chenxue Yang , Xiangyang Ji , Qingming Huang , Shuhui Wang

Deep features have been proven powerful in building accurate dense semantic correspondences in various previous works. However, the multi-scale and pyramidal hierarchy of convolutional neural networks has not been well studied to learn…

Computer Vision and Pattern Recognition · Computer Science 2021-08-30 Dongyang Zhao , Ziyang Song , Zhenghao Ji , Gangming Zhao , Weifeng Ge , Yizhou Yu

As the dimension of a system increases, traditional methods for control and differential games rapidly become intractable, making the design of safe autonomous agents challenging in complex or team settings. Deep-learning approaches avoid…

Optimization and Control · Mathematics 2025-04-29 William Sharpless , Zeyuan Feng , Somil Bansal , Sylvia Herbert

Recent machine learning algorithms dedicated to solving semi-linear PDEs are improved by using different neural network architectures and different parameterizations. These algorithms are compared to a new one that solves a fixed point…

Machine Learning · Computer Science 2018-12-11 Quentin Chan-Wai-Nam , Joseph Mikael , Xavier Warin

We present a general and scalable framework for the automated discovery of optimal meta-solvers for the solution of time-dependent nonlinear partial differential equations after appropriate discretization. By integrating classical numerical…

Numerical Analysis · Mathematics 2025-07-02 Youngkyu Lee , Shanqing Liu , Jerome Darbon , George Em Karniadakis

The recent proliferation of 3D content that can be consumed on hand-held devices necessitates efficient tools for transmitting large geometric data, e.g., 3D meshes, over the Internet. Detailed high-resolution assets can pose a challenge to…

Computer Vision and Pattern Recognition · Computer Science 2023-08-11 Yun-Chun Chen , Vladimir G. Kim , Noam Aigerman , Alec Jacobson

We propose a novel distributed resource allocation scheme for the up-link of a cellular multi-carrier system based on the message passing (MP) algorithm. In the proposed approach each transmitter iteratively sends and receives information…

Information Theory · Computer Science 2008-10-27 Andrea Abrardo , Paolo Detti , Marco Moretti

Clustering algorithms have wide applications and play an important role in data analysis fields including time series data analysis. However, in time series analysis, most of the algorithms used signal shape features or the initial value of…

Machine Learning · Statistics 2020-04-30 Daisuke Kaji , Kazuho Watanabe , Masahiro Kobayashi

We propose a framework for training neural networks that are coupled with partial differential equations (PDEs) in a parallel computing environment. Unlike most distributed computing frameworks for deep neural networks, our focus is to…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-11-25 Kailai Xu , Weiqiang Zhu , Eric Darve

Strategies to improve the predicting performance of Message-Passing Neural-Networks for molecular property predictions can be achieved by simplifying how the message is passed and by using descriptors that capture multiple aspects of…

Machine Learning · Computer Science 2025-10-22 Alma C. Castaneda-Leautaud , Rommie E. Amaro

We present a novel method for learning the weights of an artificial neural network - a Message Passing Learning Protocol (MPLP). In MPLP, we abstract every operations occurring in ANNs as independent agents. Each agent is responsible for…

Machine Learning · Computer Science 2020-07-06 Ettore Randazzo , Eyvind Niklasson , Alexander Mordvintsev

A recent line of work in the machine learning community addresses the problem of predicting high-dimensional spatiotemporal phenomena by leveraging specific tools from the differential equations theory. Following this direction, we propose…

Machine Learning · Computer Science 2021-03-24 Jérémie Donà , Jean-Yves Franceschi , Sylvain Lamprier , Patrick Gallinari

Probabilistic forecasting of high dimensional multivariate time series is a notoriously challenging task, both in terms of computational burden and distribution modeling. Most previous work either makes simple distribution assumptions or…

Machine Learning · Computer Science 2021-01-27 Nam Nguyen , Brian Quanz

In the theory and practice of inverse problems for partial differential equations (PDEs) much attention is paid to the problem of the identification of coefficients from some additional information. This work deals with the problem of…

Numerical Analysis · Computer Science 2013-04-23 P. N. Vabishchevich , V. I. Vasil'ev

In this paper, we develop a class of robust numerical methods for solving dynamical systems with multiple time scales. We first represent the solution of a multiscale dynamical system as a transformation of a slowly varying solution. Then,…

Numerical Analysis · Mathematics 2019-09-11 Thomas Y. Hou , Zhongjian Wang , Zhiwen Zhang

In recent years, deep learning has led to impressive results in many fields. In this paper, we introduce a multi-scale artificial neural network for high-dimensional non-linear maps based on the idea of hierarchical nested bases in the fast…

Numerical Analysis · Mathematics 2019-02-27 Yuwei Fan , Jordi Feliu-Faba , Lin Lin , Lexing Ying , Leonardo Zepeda-Nunez

High-dimensional partial differential equations (PDE) appear in a number of models from the financial industry, such as in derivative pricing models, credit valuation adjustment (CVA) models, or portfolio optimization models. The PDEs in…

Numerical Analysis · Mathematics 2020-07-15 Christian Beck , Weinan E , Arnulf Jentzen

In this paper, we consider the eigenvalue PDE problem of the infinitesimal generators of metastable diffusion processes. We propose a numerical algorithm based on training artificial neural networks for solving the leading eigenvalues and…

Optimization and Control · Mathematics 2022-07-13 Wei Zhang , Tiejun Li , Christof Schütte

Multi-task learning solves multiple correlated tasks. However, conflicts may exist between them. In such circumstances, a single solution can rarely optimize all the tasks, leading to performance trade-offs. To arrive at a set of optimized…

Artificial Intelligence · Computer Science 2024-03-26 Lu Bai , Abhishek Gupta , Yew-Soon Ong

Partitioning large networks into stable clusters of synchronized nodes is a challenging task. Recent approaches based on spectral analysis can provide exact results on specific dynamics but remain unfeasible for very large networks.…

Physics and Society · Physics 2026-01-23 Massimo Ostilli