English
Related papers

Related papers: Deep learning as optimal control problems: models …

200 papers

In this paper we explore the relation between distributionally robust learning and different forms of regularization to enforce robustness of deep neural networks. In particular, starting from a concrete min-max distributionally robust…

Optimization and Control · Mathematics 2022-03-29 Camilo Garcia Trillos , Nicolas Garcia Trillos

This paper studies the problem of steering the distribution of a discrete-time dynamical system from an initial distribution to a target distribution in finite time. The formulation is fully nonlinear, allowing the use of general control…

Systems and Control · Electrical Eng. & Systems 2024-09-05 George Rapakoulias , Panagiotis Tsiotras

Neural networks have been very successful in many applications; we often, however, lack a theoretical understanding of what the neural networks are actually learning. This problem emerges when trying to generalise to new data sets. The…

Classical Analysis and ODEs · Mathematics 2022-11-22 Matthew Thorpe , Yves van Gennip

This work discusses the finite element discretization of an optimal control problem for the linear wave equation with time-dependent controls of bounded variation. The main focus lies on the convergence analysis of the discretization…

Optimization and Control · Mathematics 2019-07-26 Sebastian Engel , Philip Trautmann , Boris Vexler

We analyze discrete optimal control problems and their connection with back propagation and deep learning. We consider in particular the symmetric representation of the discrete rigid body equations developed via optimal control analysis…

Optimization and Control · Mathematics 2024-04-11 Anthony M. Bloch , Peter E. Crouch , Tudor S. Ratiu

Most recent advances in machine learning and analytics for process control pose the question of how to naturally integrate new data-driven methods with classical process models and control. We propose a process modeling framework enabling…

Neural and Evolutionary Computing · Computer Science 2025-08-08 Michael R. Wartmann , B. Erik Ydstie

The present paper deals with the data-driven design of regularizers in the form of artificial neural networks, for solving certain inverse problems formulated as optimal control problems. These regularizers aim at improving accuracy,…

Optimization and Control · Mathematics 2023-03-06 Sebastien Court

The paper is devoted to deriving necessary optimality conditions in a general optimal control problem for dynamical systems governed by controlled sweeping processes with hard-constrained control actions entering both polyhedral moving sets…

Optimization and Control · Mathematics 2021-03-17 Tan H. Cao , Giovanni Colombo , Boris S. Mordukhovich , Dao Nguyen

We study an optimal control problem in which both the objective function and the dynamic constraint contain an uncertain parameter. Since the distribution of this uncertain parameter is not exactly known, the objective function is taken as…

Optimization and Control · Mathematics 2016-11-29 Jianxiong Ye , Lei Wang , Changzhi Wu , Jie Sun , Kok Lay Teo , Xiangyu Wang

Finding tight bounds on the optimal solution is a critical element of practical solution methods for discrete optimization problems. In the last decade, decision diagrams (DDs) have brought a new perspective on obtaining upper and lower…

Artificial Intelligence · Computer Science 2019-02-28 Quentin Cappart , Emmanuel Goutierre , David Bergman , Louis-Martin Rousseau

Differential equations on metric graphs can describe many phenomena in the physical world but also the spread of information on social media. To efficiently compute the solution is a hard task in numerical analysis. Solving a design…

Optimization and Control · Mathematics 2019-07-19 Martin Stoll , Max Winkler

Neural networks have been applied to control problems, typically by combining data, differential equation residuals, and objective costs in the training loss or by incorporating auxiliary architectural components. Instead, we propose a…

Optimization and Control · Mathematics 2026-04-10 Oliver G. S. Lundqvist , Fabricio Oliveira

An optimal control problem driven by an ordinary differential equation under continuous state constraints is considered in this study. From an operational point of view, we introduce a discrete state constraints optimal control problem and…

Optimization and Control · Mathematics 2018-12-04 Shuzhen Yang

Neural networks with physical governing equations as constraints have recently created a new trend in machine learning research. In line with such efforts, a deep learning model for one-dimensional consolidation where the governing equation…

Computational Engineering, Finance, and Science · Computer Science 2025-02-26 Yared W. Bekele

We consider a continuous time stochastic optimal control problem under both equality and inequality constraints on the expectation of some functionals of the controlled process. Under a qualification condition, we show that the problem is…

Optimization and Control · Mathematics 2021-07-09 Laurent Pfeiffer , Xiaolu Tan , Yulong Zhou

It has been recently established that a deterministic infinite horizon discounted optimal control problem in discrete time is closely related to a certain infinite dimensional linear programming problem and its dual. In the present paper,…

Optimization and Control · Mathematics 2018-02-19 Vladimir Gaitsgory , Alex Parkinson , Ilya Shvartsman

Current physics-informed (standard or deep operator) neural networks still rely on accurately learning the initial and/or boundary conditions of the system of differential equations they are solving. In contrast, standard numerical methods…

Machine Learning · Computer Science 2024-06-25 Rüdiger Brecht , Dmytro R. Popovych , Alex Bihlo , Roman O. Popovych

A general setup for deterministic system identification problems on graphs with Dirichlet and Neumann boundary conditions is introduced. When control nodes are available along the boundary, we apply a discretize-then-optimize method to…

Machine Learning · Computer Science 2024-02-21 Mehdi Garrousian , Amirhossein Nouranizadeh

Interpretation of Deep Neural Networks (DNNs) training as an optimal control problem with nonlinear dynamical systems has received considerable attention recently, yet the algorithmic development remains relatively limited. In this work, we…

Machine Learning · Computer Science 2021-06-14 Guan-Horng Liu , Tianrong Chen , Evangelos A. Theodorou

In this paper, optimal control problems governed by diffusion equations with Dirichlet and Neumann boundary conditions are investigated in the framework of the gradient discretisation method. Gradient schemes are defined for the optimality…

Numerical Analysis · Mathematics 2018-10-09 Jerome Droniou , Neela Nataraj , Devika Shylaja