English
Related papers

Related papers: Metamizer: a versatile neural optimizer for fast a…

200 papers

Physics-informed neural networks (PINNs) as a means of discretizing partial differential equations (PDEs) are garnering much attention in the Computational Science and Engineering (CS&E) world. At least two challenges exist for PINNs at…

Computational Physics · Physics 2023-01-23 Michael Penwarden , Shandian Zhe , Akil Narayan , Robert M. Kirby

Aquatic locomotion is a classic fluid-structure interaction (FSI) problem of interest to biologists and engineers. Solving the fully coupled FSI equations for incompressible Navier-Stokes and finite elasticity is computationally expensive.…

The numerical approximation of solutions to the compressible Euler and Navier-Stokes equations is a crucial but challenging task with relevance in various fields of science and engineering. Recently, methods from deep learning have been…

Fluid Dynamics · Physics 2024-01-30 Simon Wassing , Stefan Langer , Philipp Bekemeyer

Physical systems commonly exhibit spatially varying complexity, presenting a significant challenge for neural PDE solvers. While Graph Neural Networks can handle the irregular meshes required for complex geometries and boundary conditions,…

Machine Learning · Computer Science 2025-11-25 Winfried van den Dool , Maksim Zhdanov , Yuki M. Asano , Max Welling

Constrained optimization problems appear in a wide variety of challenging real-world problems, where constraints often capture the physics of the underlying system. Classic methods for solving these problems rely on iterative algorithms…

Systems and Control · Electrical Eng. & Systems 2023-06-13 Meiyi Li , Soheil Kolouri , Javad Mohammadi

Gradient-based meta-learning methods have primarily been applied to classical machine learning tasks such as image classification. Recently, PDE-solving deep learning methods, such as neural operators, are starting to make an important…

Machine Learning · Computer Science 2023-02-06 Lu Zhang , Huaiqian You , Tian Gao , Mo Yu , Chung-Hao Lee , Yue Yu

We address the challenge of optimizing meta-parameters (hyperparameters) in machine learning, a key factor for efficient training and high model performance. Rather than relying on expensive meta-parameter search methods, we introduce…

Machine Learning · Computer Science 2025-07-10 Arsalan Sharifnassab , Saber Salehkaleybar , Richard Sutton

Metasurfaces have become a promising means for manipulating optical wavefronts in flat and high-performance optical devices. Conventional metasurface device design relies on trial-and-error methods to obtain target electromagnetic (EM)…

Numerical simulation is indispensable in industrial design processes. It can replace expensive experiments and even reduce the need for prototypes. While products designed with the aid of numerical simulation undergo continuous improvement,…

Numerical Analysis · Mathematics 2020-06-04 Henning Wessels , Christian Weißenfels , Peter Wriggers

In various engineering and applied science applications, repetitive numerical simulations of partial differential equations (PDEs) for varying input parameters are often required (e.g., aircraft shape optimization over many design…

Machine Learning · Computer Science 2023-10-17 Woojin Cho , Kookjin Lee , Donsub Rim , Noseong Park

Multiscale modeling is an effective approach for investigating multiphysics systems with largely disparate size features, where models with different resolutions or heterogeneous descriptions are coupled together for predicting the system's…

Computational Engineering, Finance, and Science · Computer Science 2022-12-07 Minglang Yin , Enrui Zhang , Yue Yu , George Em Karniadakis

Many scientific and industrial applications require solving Partial Differential Equations (PDEs) to describe the physical phenomena of interest. Some examples can be found in the fields of aerodynamics, astrodynamics, combustion and many…

Computational Physics · Physics 2019-12-11 Juan B. Pedro , Juan Maroñas , Roberto Paredes

Partial differential equations (PDEs) are widely used across the physical and computational sciences. Decades of research and engineering went into designing fast iterative solution methods. Existing solvers are general purpose, but may be…

Numerical Analysis · Mathematics 2024-09-23 Jun-Ting Hsieh , Shengjia Zhao , Stephan Eismann , Lucia Mirabella , Stefano Ermon

Deep learning has emerged as a transformative tool for the neural surrogate modeling of partial differential equations (PDEs), known as neural PDE solvers. However, scaling these solvers to industrial-scale geometries with over $10^8$ cells…

Machine Learning · Computer Science 2026-02-06 Hang Zhou , Haixu Wu , Haonan Shangguan , Yuezhou Ma , Huikun Weng , Jianmin Wang , Mingsheng Long

Recent advances in deep learning have allowed neural networks (NNs) to successfully replace traditional numerical solvers in many applications, thus enabling impressive computing gains. One such application is time domain simulation, which…

Machine Learning · Computer Science 2021-12-09 Samuel Chevalier , Jochen Stiasny , Spyros Chatzivasileiadis

Solving inverse problems in physics is central to understanding complex systems and advancing technologies in various fields. Iterative optimization algorithms, commonly used to solve these problems, often encounter local minima, chaos, or…

Machine Learning · Computer Science 2025-01-29 Girnar Goyal , Philipp Holl , Sweta Agrawal , Nils Thuerey

Metaheuristic algorithms are methods devised to efficiently solve computationally challenging optimization problems. Researchers have taken inspiration from various natural and physical processes alike to formulate meta-heuristics that have…

Artificial Intelligence · Computer Science 2022-02-01 Soumitri Chattopadhyay , Aritra Marik , Rishav Pramanik

Deep neural networks have become a foundational tool for addressing imaging inverse problems. They are typically trained for a specific task, with a supervised loss to learn a mapping from the observations to the image to recover. However,…

Computer Vision and Pattern Recognition · Computer Science 2023-12-01 Matthieu Terris , Thomas Moreau

Deep models have recently emerged as promising tools to solve partial differential equations (PDEs), known as neural PDE solvers. While neural solvers trained from either simulation data or physics-informed loss can solve PDEs reasonably…

Machine Learning · Computer Science 2025-09-05 Hang Zhou , Yuezhou Ma , Haixu Wu , Haowen Wang , Mingsheng Long

We investigate the impact of tokeniser pretraining on the accuracy and efficiency of physics emulation. Modern high-resolution simulations produce vast volumes of data spanning diverse physical regimes and scales. Training foundation models…

Machine Learning · Computer Science 2026-03-13 Hadi Sotoudeh , Payel Mukhopadhyay , Ruben Ohana , Michael McCabe , Neil D. Lawrence , Shirley Ho , Miles Cranmer