English
Related papers

Related papers: Algorithms of Data Development For Deep Learning a…

200 papers

Efficient deep learning computing requires algorithm and hardware co-design to enable specialization: we usually need to change the algorithm to reduce memory footprint and improve energy efficiency. However, the extra degree of freedom…

Machine Learning · Computer Science 2019-04-25 Song Han , Han Cai , Ligeng Zhu , Ji Lin , Kuan Wang , Zhijian Liu , Yujun Lin

In this paper, we propose Q-learning algorithms for continuous-time deterministic optimal control problems with Lipschitz continuous controls. Our method is based on a new class of Hamilton-Jacobi-Bellman (HJB) equations derived from…

Machine Learning · Computer Science 2020-10-28 Jeongho Kim , Jaeuk Shin , Insoon Yang

In this paper, we present a scalable deep learning approach to solve opinion dynamics stochastic optimal control problems with mean field term coupling in the dynamics and cost function. Our approach relies on the probabilistic…

Multiagent Systems · Computer Science 2022-04-19 Tianrong Chen , Ziyi Wang , Evangelos A. Theodorou

Traditional simulations on High-Performance Computing (HPC) systems typically involve modeling very large domains and/or very complex equations. HPC systems allow running large models, but limits in performance increase that have become…

A gradient-enhanced functional tensor train cross approximation method for the resolution of the Hamilton-Jacobi-Bellman (HJB) equations associated to optimal feedback control of nonlinear dynamics is presented. The procedure uses samples…

Numerical Analysis · Mathematics 2023-02-23 Sergey Dolgov , Dante Kalise , Luca Saluzzi

Convex Q-learning is a recent approach to reinforcement learning, motivated by the possibility of a firmer theory for convergence, and the possibility of making use of greater a priori knowledge regarding policy or value function structure.…

Optimization and Control · Mathematics 2022-10-18 Fan Lu , Joel Mathias , Sean Meyn , Karanjit Kalsi

This paper studies deep neural networks for solving extremely large linear systems arising from highdimensional problems. Because of the curse of dimensionality, it is expensive to store both the solution and right-hand side vector in such…

Numerical Analysis · Mathematics 2023-03-07 Yiqi Gu , Michael K. Ng

A methodology is developed to learn a feedback linearization (i.e., nonlinear change of coordinates and input transformation) using a data-driven approach for a single input control-affine nonlinear system with unknown dynamics. We employ…

Systems and Control · Electrical Eng. & Systems 2023-05-23 Raktim Gautam Goswami , Prashanth Krishnamurthy , Farshad Khorrami

Optimal designs are usually model-dependent and likely to be sub-optimal if the postulated model is not correctly specified. In practice, it is common that a researcher has a list of candidate models at hand and a design has to be found…

Statistics Theory · Mathematics 2023-03-29 Mingyao Ai , Holger Dette , Zhengfu Liu , Jun Yu

Neural network approaches that parameterize value functions have succeeded in approximating high-dimensional optimal feedback controllers when the Hamiltonian admits explicit formulas. However, many practical problems, such as the space…

Optimization and Control · Mathematics 2025-10-08 Eric Gelphman , Deepanshu Verma , Nicole Tianjiao Yang , Stanley Osher , Samy Wu Fung

We consider the problem of discounted optimal state-feedback regulation for general unknown deterministic discrete-time systems. It is well known that open-loop instability of systems, non-quadratic cost functions and complex nonlinear…

Systems and Control · Electrical Eng. & Systems 2020-03-31 Alexandros Tanzanakis , John Lygeros

The Dynamic Programming approach allows to compute a feedback control for nonlinear problems, but suffers from the curse of dimensionality. The computation of the control relies on the resolution of a nonlinear PDE, the…

Numerical Analysis · Mathematics 2019-11-14 Alessandro Alla , Luca Saluzzi

The objective of designing a control system is to steer a dynamical system with a control signal, guiding it to exhibit the desired behavior. The Hamilton-Jacobi-Bellman (HJB) partial differential equation offers a framework for optimal…

Machine Learning · Computer Science 2025-10-22 Jostein Barry-Straume , Adwait D. Verulkar , Arash Sarshar , Andrey A. Popov , Adrian Sandu

We develop dynamical programming methods for the purpose of optimal control of quantum states with convex constraints and concave cost and bequest functions of the quantum state. We consider both open loop and feedback control schemes,…

Quantum Physics · Physics 2009-03-06 Viacheslav P. Belavkin , Antonio Negretti , Klaus Molmer

We propose a novel data-driven neural network (NN) optimization framework for solving an optimal stochastic control problem under stochastic constraints. Customized activation functions for the output layers of the NN are applied, which…

Optimization and Control · Mathematics 2023-06-21 Marc Chen , Mohammad Shirazi , Peter A. Forsyth , Yuying Li

It is argued that deep learning is efficient for data that is generated from hierarchal generative models. Examples of such generative models include wavelet scattering networks, functions of compositional structure, and deep rendering…

Machine Learning · Computer Science 2018-09-06 Elchanan Mossel

We revisit the linear programming approach to deterministic, continuous time, infinite horizon discounted optimal control problems. In the first part, we relax the original problem to an infinite-dimensional linear program over a measure…

Optimization and Control · Mathematics 2017-06-08 Angeliki Kamoutsi , Tobias Sutter , Peyman Mohajerin Esfahani , John Lygeros

Recent work linking deep neural networks and dynamical systems opened up new avenues to analyze deep learning. In particular, it is observed that new insights can be obtained by recasting deep learning as an optimal control problem on…

Optimization and Control · Mathematics 2020-07-21 Weinan E , Jiequn Han , Qianxiao Li

The interpretation of deep learning as a dynamical system has gained a considerable attention in recent years as it provides a promising framework. It allows for the use of existing ideas from established fields of mathematics for studying…

Optimization and Control · Mathematics 2021-06-09 Nader Ganaba

The physical design of a robot and the policy that controls its motion are inherently coupled, and should be determined according to the task and environment. In an increasing number of applications, data-driven and learning-based…

Robotics · Computer Science 2018-09-18 Charles Schaff , David Yunis , Ayan Chakrabarti , Matthew R. Walter