English
Related papers

Related papers: Linear Supervision for Nonlinear, High-Dimensional…

200 papers

High-dimensional partial differential equations (PDEs) pose significant challenges for numerical computation due to the curse of dimensionality, which limits the applicability of traditional mesh-based methods. Since 2017, the Deep BSDE…

Numerical Analysis · Mathematics 2025-05-26 Jiequn Han , Arnulf Jentzen , Weinan E

We combine concepts from multilevel solvers for partial differential equations (PDEs) with neural network based deep learning and propose a new methodology for the efficient numerical solution of high-dimensional parametric PDEs. An…

Machine Learning · Computer Science 2023-04-05 Cosmas Heiß , Ingo Gühring , Martin Eigel

Dimensionality reduction is an effective method for learning high-dimensional data, which can provide better understanding of decision boundaries in human-readable low-dimensional subspace. Linear methods, such as principal component…

Machine Learning · Computer Science 2020-07-09 Koji Maruhashi , Heewon Park , Rui Yamaguchi , Satoru Miyano

Learning-based control methods for industrial processes leverage the repetitive nature of the underlying process to learn optimal inputs for the system. While many works focus on linear systems, real-world problems involve nonlinear…

Systems and Control · Electrical Eng. & Systems 2023-07-25 Samuel Balula , Efe C. Balta , Dominic Liao-McPherson , Alisa Rupenyan , John Lygeros

Recent work has shown that reinforcement learning (RL) is a promising approach to control dynamical systems described by partial differential equations (PDE). This paper shows how to use RL to tackle more general PDE control problems that…

Machine Learning · Computer Science 2018-06-20 Yangchen Pan , Amir-massoud Farahmand , Martha White , Saleh Nabi , Piyush Grover , Daniel Nikovski

Neural PDE solvers used for scientific simulation often violate governing equation constraints. While linear constraints can be projected cheaply, many constraints are nonlinear, complicating projection onto the feasible set. Dynamical PDEs…

Machine Learning · Computer Science 2025-11-24 Omer Rochman , Gilles Louppe

Solving partial differential equations (PDE) is an indispensable part of many branches of science as many processes can be modelled in terms of PDEs. However, recent numerical solvers require manual discretization of the underlying equation…

We propose a new algorithm for solving parabolic partial differential equations (PDEs) and backward stochastic differential equations (BSDEs) in high dimension, by making an analogy between the BSDE and reinforcement learning with the…

Numerical Analysis · Mathematics 2020-07-14 Weinan E , Jiequn Han , Arnulf Jentzen

We present a nonlinear non-convex model predictive control approach to solving a real-world labyrinth game. We introduce adaptive nonlinear constraints, representing the non-convex obstacles within the labyrinth. Our method splits the…

Robotics · Computer Science 2025-02-11 Johannes Gaber , Thomas Bi , Raffaello D'Andrea

Understanding the behavior of stochastic gradient methods is a central problem in modern machine learning. Recent work has highlighted diagonal linear networks as a simplified yet expressive setting for analyzing the optimization and…

Optimization and Control · Mathematics 2026-05-19 Begoña García Malaxechebarría , Courtney Paquette , Maryam Fazel , Dmitriy Drusvyatskiy

The combination of Monte Carlo methods and deep learning has recently led to efficient algorithms for solving partial differential equations (PDEs) in high dimensions. Related learning problems are often stated as variational formulations…

Machine Learning · Computer Science 2022-08-08 Lorenz Richter , Julius Berner

In this paper, we propose a deep learning framework for solving high-dimensional partial integro-differential equations (PIDEs) based on the temporal difference learning. We introduce a set of Levy processes and construct a corresponding…

Numerical Analysis · Mathematics 2024-04-01 Liwei Lu , Hailong Guo , Xu Yang , Yi Zhu

We propose a neural network-based meta-learning method to efficiently solve partial differential equation (PDE) problems. The proposed method is designed to meta-learn how to solve a wide variety of PDE problems, and uses the knowledge for…

Machine Learning · Statistics 2023-10-23 Tomoharu Iwata , Yusuke Tanaka , Naonori Ueda

The evolution of dynamical systems is generically governed by nonlinear partial differential equations (PDEs), whose solution, in a simulation framework, requires vast amounts of computational resources. In this work, we present a novel…

Machine Learning · Computer Science 2023-09-01 Michael Rotman , Amit Dekel , Ran Ilan Ber , Lior Wolf , Yaron Oz

Recent work on Path-Dependent Partial Differential Equations (PPDEs) has shown that PPDE solutions can be approximated by a probabilistic representation, implemented in the literature by the estimation of conditional expectations using…

Machine Learning · Computer Science 2022-10-05 Jiang Yu Nguwi , Nicolas Privault

Developing effective world models is crucial for creating artificial agents that can reason about and navigate complex environments. In this paper, we investigate a deep supervision technique for encouraging the development of a world model…

Artificial Intelligence · Computer Science 2025-04-08 Andrii Zahorodnii

Nonlinear partial differential equations (PDEs) are used to model dynamical processes in a large number of scientific fields, ranging from finance to biology. In many applications standard local models are not sufficient to accurately…

Numerical Analysis · Mathematics 2022-05-10 Victor Boussange , Sebastian Becker , Arnulf Jentzen , Benno Kuckuck , Loïc Pellissier

In recent years, there has been a growing interest in leveraging deep learning and neural networks to address scientific problems, particularly in solving partial differential equations (PDEs). However, many neural network-based methods…

Machine Learning · Computer Science 2024-04-24 Adrian Celaya , Keegan Kirk , David Fuentes , Beatrice Riviere

Fast and accurate solution of time-dependent partial differential equations (PDEs) is of key interest in many research fields including physics, engineering, and biology. Generally, implicit schemes are preferred over the explicit ones for…

Numerical Analysis · Mathematics 2019-11-28 Suprosanna Shit , Abinav Ravi Venkatakrishnan , Ivan Ezhov , Jana Lipkova , Marie Piraud , Bjoern Menze

Machine learning for scientific applications faces the challenge of limited data. We propose a framework that leverages a priori known physics to reduce overfitting when training on relatively small datasets. A deep neural network is…

Machine Learning · Computer Science 2019-11-22 Jonathan B. Freund , Jonathan F. MacArt , Justin Sirignano