English
Related papers

Related papers: DDPNOpt: Differential Dynamic Programming Neural O…

200 papers

This letter presents a method to reduce the computational demands of including second-order dynamics sensitivity information into the Differential Dynamic Programming (DDP) trajectory optimization algorithm. An approach to DDP is developed…

Robotics · Computer Science 2022-07-01 John N. Nganga , Patrick M. Wensing

We present a stochastic first-order optimization method specialized for deep neural networks (DNNs), ECCO-DNN. This method models the optimization variable trajectory as a dynamical system and develops a discretization algorithm that…

Machine Learning · Computer Science 2023-10-24 Carmel Fiscko , Aayushya Agarwal , Yihan Ruan , Soummya Kar , Larry Pileggi , Bruno Sinopoli

For the past couple of decades, numerical optimization has played a central role in addressing wireless resource management problems such as power control and beamformer design. However, optimization algorithms often entail considerable…

Information Theory · Computer Science 2018-09-18 Haoran Sun , Xiangyi Chen , Qingjiang Shi , Mingyi Hong , Xiao Fu , Nicholas D. Sidiropoulos

Neural networks have been applied to control problems, typically by combining data, differential equation residuals, and objective costs in the training loss or by incorporating auxiliary architectural components. Instead, we propose a…

Optimization and Control · Mathematics 2026-04-10 Oliver G. S. Lundqvist , Fabricio Oliveira

Deep Neural Networks (DNNs) are becoming an important tool in modern computing applications. Accelerating their training is a major challenge and techniques range from distributed algorithms to low-level circuit design. In this survey, we…

Machine Learning · Computer Science 2018-09-18 Tal Ben-Nun , Torsten Hoefler

Despite the efficacy on a variety of computer vision tasks, deep neural networks (DNNs) are vulnerable to adversarial attacks, limiting their applications in security-critical systems. Recent works have shown the possibility of generating…

Computer Vision and Pattern Recognition · Computer Science 2018-12-21 Ziang Yan , Yiwen Guo , Changshui Zhang

First-order optimization methods remain the standard for training deep neural networks (DNNs). Optimizers like Adam incorporate limited curvature information by preconditioning the stochastic gradient with a diagonal matrix. Despite the…

Machine Learning · Computer Science 2025-04-30 Damien Martins Gomes

Differential Dynamic Programming is an optimal control technique often used for trajectory generation. Many variations of this algorithm have been developed in the literature, including algorithms for stochastic dynamics or state and input…

Optimization and Control · Mathematics 2022-05-26 Dennis Gramlich , Carsten W. Scherer , Christian Ebenbauer

Complex design problems are common in the scientific and industrial fields. In practice, objective functions or constraints of these problems often do not have explicit formulas, and can be estimated only at a set of sampling points through…

Optimization and Control · Mathematics 2022-10-12 Lulu Zhang , Zhi-Qin John Xu , Yaoyu Zhang

Deep neural networks (DNNs) are powerful machine learning models and have succeeded in various artificial intelligence tasks. Although various architectures and modules for the DNNs have been proposed, selecting and designing the…

Neural and Evolutionary Computing · Computer Science 2018-01-24 Shinichi Shirakawa , Yasushi Iwata , Youhei Akimoto

To better understand and improve the behavior of neural networks, a recent line of works bridged the connection between ordinary differential equations (ODEs) and deep neural networks (DNNs). The connections are made in two folds: (1) View…

Machine Learning · Computer Science 2019-11-05 Xinshi Chen

In this work, we propose an effective scheme (called DP-Net) for compressing the deep neural networks (DNNs). It includes a novel dynamic programming (DP) based algorithm to obtain the optimal solution of weight quantization and an…

Machine Learning · Computer Science 2020-03-24 Dingcheng Yang , Wenjian Yu , Ao Zhou , Haoyuan Mu , Gary Yao , Xiaoyi Wang

Advances in optical and electrophysiological recording technologies have made it possible to record the dynamics of thousands of neurons, opening up new possibilities for interpreting and controlling large neural populations in behaving…

Neurons and Cognition · Quantitative Biology 2023-11-20 Fatih Dinc , Adam Shai , Mark Schnitzer , Hidenori Tanaka

Recently, deep neural networks (DNNs) have shown advantages in accelerating optimization algorithms. One approach is to unfold finite number of iterations of conventional optimization algorithms and to learn parameters in the algorithms.…

Machine Learning · Computer Science 2021-04-23 Byung Hyun Lee , Se Young Chun

Deep Neural Networks (DNNs) are typically trained by backpropagation in a batch learning setting, which requires the entire training data to be made available prior to the learning task. This is not scalable for many real-world scenarios…

Machine Learning · Computer Science 2017-11-13 Doyen Sahoo , Quang Pham , Jing Lu , Steven C. H. Hoi

This paper investigates reinforcement learning with constraints, which are indispensable in safety-critical environments. To drive the constraint violation monotonically decrease, we take the constraints as Lyapunov functions and impose new…

Machine Learning · Computer Science 2021-05-07 Chuangchuang Sun , Dong-Ki Kim , Jonathan P. How

Deep Neural Networks (DNNs) approaches for the Optimal Power Flow (OPF) problem received considerable attention recently. A key challenge of these approaches lies in ensuring the feasibility of the predicted solutions to physical system…

Systems and Control · Electrical Eng. & Systems 2020-09-08 Tianyu Zhao , Xiang Pan , Minghua Chen , Andreas Venzke , Steven H. Low

Deep Neural Networks (DNNs) are increasingly used in control applications due to their powerful function approximation capabilities. However, many existing formulations focus primarily on tracking error convergence, often neglecting the…

Systems and Control · Electrical Eng. & Systems 2025-05-19 Rebecca G. Hart , Omkar Sudhir Patil , Zachary I. Bell , Warren E. Dixon

Though many compilation and runtime systems have been developed for DNNs in recent years, the focus has largely been on static DNNs. Dynamic DNNs, where tensor shapes and sizes and even the set of operators used are dependent upon the input…

Machine Learning · Computer Science 2024-03-04 Wei Niu , Gagan Agrawal , Bin Ren

Differential Dynamic Programming (DDP) is an efficient computational tool for solving nonlinear optimal control problems. It was originally designed as a single shooting method and thus is sensitive to the initial guess supplied. This work…

Robotics · Computer Science 2023-09-29 He Li , Wenhao Yu , Tingnan Zhang , Patrick M. Wensing