English
Related papers

Related papers: Transolver: A Fast Transformer Solver for PDEs on …

200 papers

Differentiable physics is a powerful approach to learning and control problems that involve physical objects and environments. While notable progress has been made, the capabilities of differentiable physics solvers remain limited. We…

Machine Learning · Computer Science 2020-07-07 Yi-Ling Qiao , Junbang Liang , Vladlen Koltun , Ming C. Lin

Over the last few decades, existing Partial Differential Equation (PDE) solvers have demonstrated a tremendous success in solving complex, non-linear PDEs. Although accurate, these PDE solvers are computationally costly. With the advances…

Computational Physics · Physics 2020-05-19 Rishikesh Ranade , Chris Hill , Jay Pathak

Solving Partial Differential Equations (PDEs) is the core of many fields of science and engineering. While classical approaches are often prohibitively slow, machine learning models often fail to incorporate complete system information.…

Machine Learning · Computer Science 2024-02-13 Cooper Lorsung , Zijie Li , Amir Barati Farimani

DeepONet has recently been proposed as a representative framework for learning nonlinear mappings between function spaces. However, when it comes to approximating solution operators of partial differential equations (PDEs) with…

Numerical Analysis · Mathematics 2024-08-09 Yameng Zhu , Jingrun Chen , Weibing Deng

We propose a nonlinear manifold learning technique based on deep convolutional autoencoders that is appropriate for model order reduction of physical systems in complex geometries. Convolutional neural networks have proven to be highly…

Computational Physics · Physics 2021-07-19 John Tencer , Kevin Potter

Triangulated meshes have become ubiquitous discrete-surface representations. In this paper we address the problem of how to maintain the manifold properties of a surface while it undergoes strong deformations that may cause topological…

Computer Vision and Pattern Recognition · Computer Science 2020-12-11 Andrei Zaharescu , Edmond Boyer , Radu Horaud

Many important problems in science and engineering require solving the so-called parametric partial differential equations (PDEs), i.e., PDEs with different physical parameters, boundary conditions, shapes of computation domains, etc.…

Machine Learning · Computer Science 2022-11-22 Xiang Huang , Zhanhong Ye , Hongsheng Liu , Beiji Shi , Zidong Wang , Kang Yang , Yang Li , Bingya Weng , Min Wang , Haotian Chu , Fan Yu , Bei Hua , Lei Chen , Bin Dong

In certain practical engineering applications, there is an urgent need to perform repetitive solving of partial differential equations (PDEs) in a short period. This paper primarily considers three scenarios requiring extensive repetitive…

Numerical Analysis · Mathematics 2025-08-06 Bo Yang , Xingquan Li , Jie Zhao , Ying Jiang

Partial differential equations (PDEs) are central to scientific modeling. Modern workflows increasingly rely on learning-based components to support model reuse, inference, and integration across large computational processes. Despite the…

Machine Learning · Computer Science 2026-02-20 Yilong Dai , Shengyu Chen , Ziyi Wang , Xiaowei Jia , Yiqun Xie , Vipin Kumar , Runlong Yu

Transformer models have consistently achieved remarkable results in various domains such as natural language processing and computer vision. However, despite ongoing research efforts to better understand these models, the field still lacks…

Machine Learning · Computer Science 2024-10-18 Ilya Kaufman , Omri Azencot

Numerical discretisations of partial differential equations (PDEs) can be written as discrete convolutions, which, themselves, are a key tool in AI libraries and used in convolutional neural networks (CNNs). We therefore propose to…

Fluid Dynamics · Physics 2025-11-06 Boyang Chen , Claire E. Heaney , Christopher C. Pain

The Transformer and its variants have been proven to be efficient sequence learners in many different domains. Despite their staggering success, a critical issue has been the enormous number of parameters that must be trained (ranging from…

Machine Learning · Computer Science 2021-10-28 Subhabrata Dutta , Tanya Gautam , Soumen Chakrabarti , Tanmoy Chakraborty

The quest for analytical solutions to differential equations has traditionally been constrained by the need for extensive mathematical expertise. Machine learning methods like genetic algorithms have shown promise in this domain, but are…

Machine Learning · Computer Science 2025-07-22 Shu Wei , Yanjie Li , Lina Yu , Weijun Li , Min Wu , Linjun Sun , Jingyi Liu , Hong Qin , Yusong Deng , Jufeng Han , Yan Pang

The numerical solution of partial differential equations (PDEs) is difficult, having led to a century of research so far. Recently, there have been pushes to build neural--numerical hybrid solvers, which piggy-backs the modern trend towards…

Machine Learning · Computer Science 2023-03-21 Johannes Brandstetter , Daniel Worrall , Max Welling

Predicting outcomes and planning interactions with the physical world are long-standing goals for machine learning. A variety of such tasks involves continuous physical systems, which can be described by partial differential equations…

Machine Learning · Computer Science 2020-01-22 Philipp Holl , Vladlen Koltun , Nils Thuerey

Deep models have achieved impressive progress in solving partial differential equations (PDEs). A burgeoning paradigm is learning neural operators to approximate the input-output mappings of PDEs. While previous deep models have explored…

Machine Learning · Computer Science 2023-05-30 Haixu Wu , Tengge Hu , Huakun Luo , Jianmin Wang , Mingsheng Long

Transfer learning for partial differential equations (PDEs) is to develop a pre-trained neural network that can be used to solve a wide class of PDEs. Existing transfer learning approaches require much information of the target PDEs such as…

Numerical Analysis · Mathematics 2023-01-30 Zezhong Zhang , Feng Bao , Lili Ju , Guannan Zhang

Many processes in science and engineering can be described by partial differential equations (PDEs). Traditionally, PDEs are derived by considering first principles of physics to derive the relations between the involved physical quantities…

Machine Learning · Statistics 2019-03-27 Jens Berg , Kaj Nyström

Enhancing neural networks with knowledge of physical equations has become an efficient way of solving various physics problems, from fluid flow to electromagnetism. Graph neural networks show promise in accurately representing irregularly…

Machine Learning · Computer Science 2022-04-01 Mike Y. Michelis , Robert K. Katzschmann

The analysis of deforming 3D surface meshes is accelerated by autoencoders since the low-dimensional embeddings can be used to visualize underlying dynamics. But, state-of-the-art mesh convolutional autoencoders require a fixed connectivity…

Computer Vision and Pattern Recognition · Computer Science 2021-10-22 Sara Hahner , Jochen Garcke