English
Related papers

Related papers: Optimization with learning-informed differential e…

200 papers

Constrained optimization problems appear in a wide variety of challenging real-world problems, where constraints often capture the physics of the underlying system. Classic methods for solving these problems rely on iterative algorithms…

Systems and Control · Electrical Eng. & Systems 2023-06-13 Meiyi Li , Soheil Kolouri , Javad Mohammadi

In most machine learning applications, classification accuracy is not the primary metric of interest. Binary classifiers which face class imbalance are often evaluated by the $F_\beta$ score, area under the precision-recall curve, Precision…

Machine Learning · Computer Science 2018-03-02 Alan Mackey , Xiyang Luo , Elad Eban

Constructing first-principles models is usually a challenging and time-consuming task due to the complexity of the real-life processes. On the other hand, data-driven modeling, and in particular neural network models often suffer from…

Optimization and Control · Mathematics 2023-02-03 Ece S. Koksal , Erdal Aydin

This paper presents machine learning techniques and deep reinforcement learningbased algorithms for the efficient resolution of nonlinear partial differential equations and dynamic optimization problems arising in investment decisions and…

Optimization and Control · Mathematics 2021-04-19 Maximilien Germain , Huyên Pham , Xavier Warin

Finding tight bounds on the optimal solution is a critical element of practical solution methods for discrete optimization problems. In the last decade, decision diagrams (DDs) have brought a new perspective on obtaining upper and lower…

Artificial Intelligence · Computer Science 2019-02-28 Quentin Cappart , Emmanuel Goutierre , David Bergman , Louis-Martin Rousseau

Deep neural networks (DNN) have been used to model nonlinear relations between physical quantities. Those DNNs are embedded in physical systems described by partial differential equations (PDE) and trained by minimizing a loss function that…

Numerical Analysis · Mathematics 2020-02-26 Kailai Xu , Eric Darve

We perform a comprehensive numerical study of the effect of approximation-theoretical results for neural networks on practical learning problems in the context of numerical analysis. As the underlying model, we study the…

Numerical Analysis · Mathematics 2020-04-28 Moritz Geist , Philipp Petersen , Mones Raslan , Reinhold Schneider , Gitta Kutyniok

In this paper we deal with stochastic optimization problems where the data distributions change in response to the decision variables. Traditionally, the study of optimization problems with decision-dependent distributions has assumed…

Optimization and Control · Mathematics 2023-10-05 Zifan Wang , Changxin Liu , Thomas Parisini , Michael M. Zavlanos , Karl H. Johansson

Many real-life optimization problems frequently contain one or more constraints or objectives for which there are no explicit formulas. If data is however available, these data can be used to learn the constraints. The benefits of this…

Machine Learning · Computer Science 2022-09-23 Adejuyigbe Fajemisin , Donato Maragno , Dick den Hertog

We derive novel algorithms for optimization problems constrained by partial differential equations describing multiscale particle dynamics, including non-local integral terms representing interactions between particles. In particular, we…

Numerical Analysis · Mathematics 2021-09-09 Mildred Aduamoah , Benjamin D. Goddard , John W. Pearson , Jonna C. Roden

The solution to partial differential equations using deep learning approaches has shown promising results for several classes of initial and boundary-value problems. However, their ability to surpass, particularly in terms of accuracy,…

Numerical Analysis · Mathematics 2023-08-23 Ziad Aldirany , Régis Cottereau , Marc Laforest , Serge Prudhomme

Recent work has shown a variety of ways in which machine learning can be used to accelerate the solution of constrained optimization problems. Increasing demand for real-time decision-making capabilities in applications such as artificial…

Machine Learning · Computer Science 2024-04-02 Ethan King , James Kotary , Ferdinando Fioretto , Jan Drgona

In this paper we study the optimal control of a class of semilinear elliptic partial differential equations which have nonlinear constituents that are only accessible by data and are approximated by nonsmooth ReLU neural networks. The…

Optimization and Control · Mathematics 2022-10-24 Guozhi Dong , Michael Hintermüller , Kostas Papafitsoros , Kathrin Völkner

Recent research has used deep learning to develop partial differential equation (PDE) models in science and engineering. The functional form of the PDE is determined by a neural network, and the neural network parameters are calibrated to…

Machine Learning · Computer Science 2023-10-17 Justin Sirignano , Jonathan MacArt , Konstantinos Spiliopoulos

Classically, to solve differential equation problems, it is necessary to specify sufficient initial and/or boundary conditions so as to allow the existence of a unique solution. Well-posedness of differential equation problems thus involves…

This work proposes a solution for the problem of training physics-informed networks under partial integro-differential equations. These equations require an infinite or a large number of neural evaluations to construct a single residual for…

Machine Learning · Computer Science 2024-06-12 Ehsan Saleh , Saba Ghaffari , Timothy Bretl , Luke Olson , Matthew West

We demonstrate that embedding physics-driven constraints into machine learning process can dramatically improve accuracy and generalizability of the resulting model. Physics-informed learning is illustrated on the example of analysis of…

Computational Physics · Physics 2021-12-16 Abantika Ghosh , Mohannad Elhamod , Jie Bu , Wei-Cheng Lee , Anuj Karpatne , Viktor A Podolskiy

We overview a series of recent works addressing numerical simulations of partial differential equations in the presence of some elements of randomness. The specific equations manipulated are linear elliptic, and arise in the context of…

Numerical Analysis · Mathematics 2016-04-19 Claude Le Bris , Frederic Legoll

The numerical methods for differential equation solution allow obtaining a discrete field that converges towards the solution if the method is applied to the correct problem. Nevertheless, the numerical methods have the restricted class of…

Numerical Analysis · Mathematics 2023-07-03 Alexander Hvatov , Tatiana Tikhonova

We consider optimization problems constrained by partial differential equations (PDEs) with additional constraints placed on the solution of the PDEs. We develop a general and versatile framework using infinite-valued penalization functions…

Optimization and Control · Mathematics 2013-02-28 Richard Barnard