English
Related papers

Related papers: Transolver++: An Accurate Neural Solver for PDEs o…

200 papers

The computational complexity of classical numerical methods for solving Partial Differential Equations (PDE) scales significantly as the resolution increases. As an important example, climate predictions require fine spatio-temporal…

Machine Learning · Computer Science 2022-10-12 Oussama Boussif , Dan Assouline , Loubna Benabbou , Yoshua Bengio

We combine concepts from multilevel solvers for partial differential equations (PDEs) with neural network based deep learning and propose a new methodology for the efficient numerical solution of high-dimensional parametric PDEs. An…

Machine Learning · Computer Science 2023-04-05 Cosmas Heiß , Ingo Gühring , Martin Eigel

The convergence behavior of classical iterative solvers for parametric partial differential equations (PDEs) is often highly sensitive to the domain and specific discretization of PDEs. Previously, we introduced hybrid solvers by combining…

Machine Learning · Computer Science 2025-12-17 Youngkyu Lee , Francesc Levrero Florencio , Jay Pathak , George Em Karniadakis

The large-scale simulation of dynamical systems is critical in numerous scientific and engineering disciplines. However, traditional numerical solvers are limited by the choice of step sizes when estimating integration, resulting in a…

Computational Engineering, Finance, and Science · Computer Science 2023-09-21 Zhongzhan Huang , Senwei Liang , Hong Zhang , Haizhao Yang , Liang Lin

Recently, neural networks have been extensively employed to solve partial differential equations (PDEs) in physical system modeling. While major studies focus on learning system evolution on predefined static mesh discretizations, some…

Machine Learning · Computer Science 2024-02-20 Peiyan Hu , Yue Wang , Zhi-Ming Ma

Finding accurate solutions to partial differential equations (PDEs) is a crucial task in all scientific and engineering disciplines. It has recently been shown that machine learning methods can improve the solution accuracy by correcting…

Computational Physics · Physics 2021-01-06 Kiwon Um , Robert Brand , Yun , Fei , Philipp Holl , Nils Thuerey

Memory bound applications such as solvers for large sparse systems of equations remain a challenge for GPUs. Fast solvers should be based on numerically efficient algorithms and implemented such that global memory access is minimised. To…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-06-01 Eike Hermann Müller , Robert Scheichl , Eero Vainikko

Solving partial differential equations is difficult. Recently proposed neural resolution-invariant models, despite their effectiveness and efficiency, usually require equispaced spatial points of data. However, sampling in spatial domain is…

Machine Learning · Computer Science 2023-03-21 Haitao Lin , Lirong Wu , Yongjie Xu , Yufei Huang , Siyuan Li , Guojiang Zhao , Stan Z. Li

We present GeoTransolver, a Multiscale Geometry-Aware Physics Attention Transformer for CAE that replaces standard attention with GALE, coupling physics-aware self-attention on learned state slices with cross-attention to a shared…

Machine Learning · Computer Science 2025-12-25 Corey Adams , Rishikesh Ranade , Ram Cherukuri , Sanjay Choudhry

Partial differential equations (PDEs) underpin the modeling of many natural and engineered systems. It can be convenient to express such models as neural PDEs rather than using traditional numerical PDE solvers by replacing part or all of…

Machine Learning · Computer Science 2025-09-26 Sanket Jantre , Deepak Akhare , Zhiyuan Wang , Xiaoning Qian , Nathan M. Urban

Deep models have achieved impressive progress in solving partial differential equations (PDEs). A burgeoning paradigm is learning neural operators to approximate the input-output mappings of PDEs. While previous deep models have explored…

Machine Learning · Computer Science 2023-05-30 Haixu Wu , Tengge Hu , Huakun Luo , Jianmin Wang , Mingsheng Long

Solving partial differential equations (PDE) is an indispensable part of many branches of science as many processes can be modelled in terms of PDEs. However, recent numerical solvers require manual discretization of the underlying equation…

We present a new framework for computing fine-scale solutions of multiscale Partial Differential Equations (PDEs) using operator learning tools. Obtaining fine-scale solutions of multiscale PDEs can be challenging, but there are many…

Numerical Analysis · Mathematics 2023-08-29 Zecheng Zhang , Christian Moya , Wing Tat Leung , Guang Lin , Hayden Schaeffer

The multiscale complexity of modern problems in computational science and engineering can prohibit the use of traditional numerical methods in multi-dimensional simulations. Therefore, novel algorithms are required in these situations to…

Numerical Analysis · Mathematics 2021-06-15 Cale Harnish , Luke Dalessandro , Karel Matous , Daniel Livescu

The solution for non-linear, complex partial differential Equations (PDEs) is achieved through numerical approximations, which yield a linear system of equations. This approach is prevalent in Computational Fluid Dynamics (CFD), but it…

Fluid Dynamics · Physics 2024-09-06 Ferdin Sagai Don Bosco , Dhamotharan S , Rut Lineswala , Abhishek Chopra

Fast and accurate solution of time-dependent partial differential equations (PDEs) is of key interest in many research fields including physics, engineering, and biology. Generally, implicit schemes are preferred over the explicit ones for…

Numerical Analysis · Mathematics 2019-11-28 Suprosanna Shit , Abinav Ravi Venkatakrishnan , Ivan Ezhov , Jana Lipkova , Marie Piraud , Bjoern Menze

Partial differential equations (PDEs) are ubiquitous in the world around us, modelling phenomena from heat and sound to quantum systems. Recent advances in deep learning have resulted in the development of powerful neural solvers; however,…

Artificial Intelligence · Computer Science 2023-11-13 Yolanne Yi Ran Lee

In scenarios with limited available data, training the function-to-function neural PDE solver in an unsupervised manner is essential. However, the efficiency and accuracy of existing methods are constrained by the properties of numerical…

Machine Learning · Computer Science 2025-03-12 Rui Zhang , Qi Meng , Rongchan Zhu , Yue Wang , Wenlei Shi , Shihua Zhang , Zhi-Ming Ma , Tie-Yan Liu

We demonstrate a high-performance vendor-agnostic method for massively parallel solving of ensembles of ordinary differential equations (ODEs) and stochastic differential equations (SDEs) on GPUs. The method is integrated with a widely used…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-11-20 Utkarsh Utkarsh , Valentin Churavy , Yingbo Ma , Tim Besard , Prakitr Srisuma , Tim Gymnich , Adam R. Gerlach , Alan Edelman , George Barbastathis , Richard D. Braatz , Christopher Rackauckas

Recent progress in scientific machine learning (SciML) has opened up the possibility of training novel neural network architectures that solve complex partial differential equations (PDEs). Several (nearly data free) approaches have been…