English
Related papers

Related papers: Linear Supervision for Nonlinear, High-Dimensional…

200 papers

Differential equations (DE) constrained optimization plays a critical role in numerous scientific and engineering fields, including energy systems, aerospace engineering, ecology, and finance, where optimal configurations or control…

Machine Learning · Computer Science 2024-10-03 Vincenzo Di Vito , Mostafa Mohammadian , Kyri Baker , Ferdinando Fioretto

We present a deep reinforcement learning (deep RL) algorithm that consists of learning-based motion planning and imitation to tackle challenging control problems. Deep RL has been an effective tool for solving many high-dimensional…

Robotics · Computer Science 2023-03-02 Nitish Sontakke , Sehoon Ha

In this paper, we introduce PDE-LEARN, a novel deep learning algorithm that can identify governing partial differential equations (PDEs) directly from noisy, limited measurements of a physical system of interest. PDE-LEARN uses a Rational…

Machine Learning · Computer Science 2023-02-13 Robert Stephany , Christopher Earls

The field of Optimal Control under Partial Differential Equations (PDE) constraints is rapidly changing under the influence of Deep Learning and the accompanying automatic differentiation libraries. Novel techniques like Physics-Informed…

Machine Learning · Computer Science 2023-10-05 Roussel Desmond Nzoyem , David A. W. Barton , Tom Deakin

A large class of hyperbolic and advection-dominated PDEs can have solutions with discontinuities. This paper investigates, both theoretically and empirically, the operator learning of PDEs with discontinuous solutions. We rigorously prove,…

Machine Learning · Computer Science 2022-10-04 Samuel Lanthaler , Roberto Molinaro , Patrik Hadorn , Siddhartha Mishra

Neural networks are one tool for approximating non-linear differential equations used in scientific computing tasks such as surrogate modeling, real-time predictions, and optimal control. PDE foundation models utilize neural networks to…

Machine Learning · Computer Science 2025-02-11 Elisa Negrini , Yuxuan Liu , Liu Yang , Stanley J. Osher , Hayden Schaeffer

Recent successes of game-theoretic formulations in ML have caused a resurgence of research interest in differentiable games. Overwhelmingly, that research focuses on methods and upper bounds on their speed of convergence. In this work, we…

Machine Learning · Computer Science 2020-09-16 Adam Ibrahim , Waïss Azizian , Gauthier Gidel , Ioannis Mitliagkas

We introduce Deep Linear Discriminant Analysis (DeepLDA) which learns linearly separable latent representations in an end-to-end fashion. Classic LDA extracts features which preserve class separability and is used for dimensionality…

Machine Learning · Computer Science 2016-02-18 Matthias Dorfer , Rainer Kelz , Gerhard Widmer

Classical numerical methods for solving partial differential equations suffer from the curse dimensionality mainly due to their reliance on meticulously generated spatio-temporal grids. Inspired by modern deep learning based techniques for…

Machine Learning · Statistics 2018-04-20 Maziar Raissi

Linear mixed models (LMMs) are used extensively to model dependecies of observations in linear regression and are used extensively in many application areas. Parameter estimation for LMMs can be computationally prohibitive on big data.…

Machine Learning · Statistics 2019-03-08 Zilong Tan , Kimberly Roche , Xiang Zhou , Sayan Mukherjee

When simulating multiscale stochastic differential equations (SDEs) in high-dimensions, separation of timescales, stochastic noise and high-dimensionality can make simulations prohibitively expensive. The computational cost is dictated by…

Dynamical Systems · Mathematics 2015-10-13 Miles Crosskey , Mauro Maggioni

We present a differentiable predictive control (DPC) methodology for learning constrained control laws for unknown nonlinear systems. DPC poses an approximate solution to multiparametric programming problems emerging from explicit nonlinear…

Systems and Control · Electrical Eng. & Systems 2021-07-27 Jan Drgona , Aaron Tuor , Soumya Vasisht , Elliott Skomski , Draguna Vrabie

Ensuring robust decision-making in multi-agent systems is challenging when agents have distinct, possibly conflicting objectives and lack full knowledge of each other's strategies. This is apparent in safety-critical applications such as…

Systems and Control · Electrical Eng. & Systems 2025-10-20 Francesco Bianchin , Robert Lefringhausen , Elisa Gaetan , Samuel Tesfazgi , Sandra Hirche

In the context of classification problems, Deep Learning (DL) approaches represent state of art. Many DL approaches are based on variations of standard multi-layer feed-forward neural networks. These are also referred to as deep networks.…

Machine Learning · Computer Science 2023-11-21 Andrea Apicella , Francesco Isgrò , Roberto Prevete

This work presents a physics-informed deep learning-based super-resolution framework to enhance the spatio-temporal resolution of the solution of time-dependent partial differential equations (PDE). Prior works on deep learning-based…

Machine Learning · Computer Science 2022-12-09 Rajat Arora , Ankit Shrivastava

Constructing fast numerical solvers for partial differential equations (PDEs) is crucial for many scientific disciplines. A leading technique for solving large-scale PDEs is using multigrid methods. At the core of a multigrid solver is the…

Numerical Analysis · Mathematics 2019-08-07 Daniel Greenfeld , Meirav Galun , Ron Kimmel , Irad Yavneh , Ronen Basri

Decision rules offer a rich and tractable framework for solving certain classes of multistage adaptive optimization problems. Recent literature has shown the promise of using linear and nonlinear decision rules in which wait-and-see…

Optimization and Control · Mathematics 2022-11-24 Said Rahal , Dimitri J. Papageorgiou , Zukui Li

Optimal control of diffusion processes is intimately connected to the problem of solving certain Hamilton-Jacobi-Bellman equations. Building on recent machine learning inspired approaches towards high-dimensional PDEs, we investigate the…

Optimization and Control · Mathematics 2023-01-31 Nikolas Nüsken , Lorenz Richter

Partial differential equations frequently appear in the natural sciences and related disciplines. Solving them is often challenging, particularly in high dimensions, due to the "curse of dimensionality". In this work, we explore the…

Quantum Physics · Physics 2023-05-30 Lukas Mouton , Florentin Reiter , Ying Chen , Patrick Rebentrost

In this paper, we propose a numerical methodology for finding the closed-loop Nash equilibrium of stochastic delay differential games through deep learning. These games are prevalent in finance and economics where multi-agent interaction…

Optimization and Control · Mathematics 2023-07-14 Robert Balkin , Hector D. Ceniceros , Ruimeng Hu