English
Related papers

Related papers: Deep Learning Approximation of Diffeomorphisms via…

200 papers

It has been recently established that a deterministic infinite horizon discounted optimal control problem in discrete time is closely related to a certain infinite dimensional linear programming problem and its dual. In the present paper,…

Optimization and Control · Mathematics 2018-02-19 Vladimir Gaitsgory , Alex Parkinson , Ilya Shvartsman

A promising approach to optimal control of nonlinear systems involves iteratively linearizing the system and solving an optimization problem at each time instant to determine the optimal control input. Since this approach relies on online…

Optimization and Control · Mathematics 2025-01-30 Anran Li , John P. Swensen , Mehdi Hosseinzadeh

Most stochastic gradient descent algorithms can optimize neural networks that are sub-differentiable in their parameters; however, this implies that the neural network's activation function must exhibit a degree of continuity which limits…

Neural and Evolutionary Computing · Computer Science 2021-12-16 Anastasis Kratsios , Behnoosh Zamanlooy

We establish an algorithm to learn feedback maps from data for a class of robust model predictive control (MPC) problems. The algorithm accounts for the approximation errors due to the learning directly at the synthesis stage, ensuring…

Optimization and Control · Mathematics 2025-10-16 Siddhartha Ganguly , Shubham Gupta , Debasish Chatterjee

Decentralized optimization is a powerful paradigm that finds applications in engineering and learning design. This work studies decentralized composite optimization problems with non-smooth regularization terms. Most existing gradient-based…

Optimization and Control · Mathematics 2019-10-29 Sulaiman A. Alghunaim , Kun Yuan , Ali H. Sayed

The interpretation of deep learning as a dynamical system has gained a considerable attention in recent years as it provides a promising framework. It allows for the use of existing ideas from established fields of mathematics for studying…

Optimization and Control · Mathematics 2021-06-09 Nader Ganaba

We introduce a new numerical method to approximate the solution of a finite horizon deterministic optimal control problem. We exploit two Hamilton-Jacobi-Bellman PDE, arising by considering the dynamics in forward and backward time. This…

Optimization and Control · Mathematics 2023-04-21 Marianne Akian , Stéphane Gaubert , Shanqing Liu

In this paper, we consider the problems of approximating uncertainties and feedback control for a class of nonlinear systems without full-known states, and two approximation methods are proposed: universal approximation using integral-chain…

Systems and Control · Computer Science 2011-02-15 Xinhua Wang

The links between optimal control of dynamical systems and neural networks have proved beneficial both from a theoretical and from a practical point of view. Several researchers have exploited these links to investigate the stability of…

Optimization and Control · Mathematics 2019-02-08 Panos Parpas , Corey Muir

Considering its advantages in dealing with high-dimensional visual input and learning control policies in discrete domain, Deep Q Network (DQN) could be an alternative method of traditional auto-focus means in the future. In this paper,…

Computer Vision and Pattern Recognition · Computer Science 2018-09-11 Xiaofan Yu , Runze Yu , Jingsong Yang , Xiaohui Duan

This paper deals with a class of neural SDEs and studies the limiting behavior of the associated sampled optimal control problems as the sample size grows to infinity. The neural SDEs with $N$ samples can be linked to the $N$-particle…

Optimization and Control · Mathematics 2025-06-19 Huafu Liao , Alpár R. Mészáros , Chenchen Mou , Chao Zhou

We study an explicit mirror-descent method for finite-horizon deterministic optimal control problems. The method is motivated by Pontryagin's maximum principle: at each iteration, one solves the state and adjoint equations and updates the…

Optimization and Control · Mathematics 2026-05-05 Ye Feng , Jianfeng Lu

Deep Neural Networks (DNNs) are increasingly used in control applications due to their powerful function approximation capabilities. However, many existing formulations focus primarily on tracking error convergence, often neglecting the…

Systems and Control · Electrical Eng. & Systems 2025-05-19 Rebecca G. Hart , Omkar Sudhir Patil , Zachary I. Bell , Warren E. Dixon

Training deep neural networks (DNNs) can be difficult due to the occurrence of vanishing/exploding gradients during weight optimization. To avoid this problem, we propose a class of DNNs stemming from the time discretization of Hamiltonian…

Machine Learning · Computer Science 2021-04-28 Clara L. Galimberti , Liang Xu , Giancarlo Ferrari Trecate

Hamiltonian systems with multiple timescales arise in molecular dynamics, classical mechanics, and theoretical physics. Long-time numerical integration of such systems requires resolving fast dynamics with very small time steps, which…

Numerical Analysis · Mathematics 2025-10-30 Rui Fang , Richard Tsai

Real-world problems of operations research are typically high-dimensional and combinatorial. Linear programs are generally used to formulate and efficiently solve these large decision problems. However, in multi-period decision problems, we…

Machine Learning · Computer Science 2019-02-27 Wouter van Heeswijk , Han La Poutré

This letter studies deep learning (DL) approaches to optimize beamforming vectors in downlink multi-user multi-antenna systems that can be universally applied to arbitrarily given transmit power limitation at a base station. We exploit the…

Information Theory · Computer Science 2020-07-10 Junbeom Kim , Hoon Lee , Seung-Eun Hong , Seok-Hwan Park

Without exact knowledge of the true system dynamics, optimal control of non-linear continuous-time systems requires careful treatment under epistemic uncertainty. In this work, we translate a probabilistic interpretation of the Pontryagin…

Machine Learning · Computer Science 2025-09-03 David Leeftink , Çağatay Yıldız , Steffen Ridderbusch , Max Hinne , Marcel van Gerven

Unsupervised learning of feature representations is a challenging yet important problem for analyzing a large collection of multimedia data that do not have semantic labels. Recently proposed neural network-based unsupervised learning…

Computer Vision and Pattern Recognition · Computer Science 2022-11-15 Takahiko Furuya , Ryutarou Ohbuchi

We present an approach for solving optimal Dirichlet boundary control problems of nonlinear optics by using deep learning. For computing high resolution approximations of the solution to the nonlinear wave model, we propose higher order…

Numerical Analysis · Mathematics 2023-12-27 Nils Margenberg , Franz X. Kärtner , Markus Bause