English
Related papers

Related papers: Optimal Control Theoretic Neural Optimizer: From B…

200 papers

Deep sequence models have achieved notable success in time-series analysis, such as interpolation and forecasting. Recent advances move beyond discrete-time architectures like Recurrent Neural Networks (RNNs) toward continuous-time…

Machine Learning · Computer Science 2025-08-05 Haoran Li , Muhao Guo , Yang Weng , Hanghang Tong

Deep Neural Networks (DNNs) are typically trained by backpropagation in a batch learning setting, which requires the entire training data to be made available prior to the learning task. This is not scalable for many real-world scenarios…

Machine Learning · Computer Science 2017-11-13 Doyen Sahoo , Quang Pham , Jing Lu , Steven C. H. Hoi

Optimal Power Flow (OPF) is a fundamental problem in power systems. It is computationally challenging and a recent line of research has proposed the use of Deep Neural Networks (DNNs) to find OPF approximations at vastly reduced runtimes…

Machine Learning · Computer Science 2021-11-23 My H. Dinh , Ferdinando Fioretto , Mostafa Mohammadian , Kyri Baker

With the accumulation of resources in the era of big data and the rise of pre-trained models in deep learning, optimizing neural networks for various tasks often involves different strategies for fine-tuning pre-trained models versus…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Xin Ning , Qiankun Li , Xiaolong Huang , Qiupu Chen , Feng He , Weijun Li , Prayag Tiwari , Xinwang Liu

We develop DeepOPF as a Deep Neural Network (DNN) approach for solving security-constrained direct current optimal power flow (SC-DCOPF) problems, which are critical for reliable and cost-effective power system operation.DeepOPF is inspired…

Systems and Control · Electrical Eng. & Systems 2020-09-24 Xiang Pan , Tianyu Zhao , Minghua Chen , Shengyu Zhang

This paper introduced the space mission DikpolaSat Mission, how this research fits into the mission, and the importance of having a trained DNN model instead of the usual GN&C functionality. This paper shows how the controller demonstration…

Robotics · Computer Science 2021-06-02 Manuel Ntumba , Saurabh Gore , Jean Baptiste Awanyo

In the paper, we propose solving optimization problems (OPs) and understanding the Newton method from the optimal control view. We propose a new optimization algorithm based on the optimal control problem (OCP). The algorithm features…

Optimization and Control · Mathematics 2025-04-01 Huanshui Zhang , Hongxia Wang

This paper presents a novel, mathematically rigorous framework for autoencoder-type deep neural networks that combines optimal control theory and low-rank tensor methods to yield memory-efficient training and automated architecture…

Optimization and Control · Mathematics 2025-09-11 Ratna Khatri , Anthony Kolshorn , Colin Olson , Harbir Antil

Optimization theory serves as a pivotal scientific instrument for achieving optimal system performance, with its origins in economic applications to identify the best investment strategies for maximizing benefits. Over the centuries, from…

Machine Learning · Computer Science 2024-09-10 Yuhan Ma , Dan Sun , Erdi Gao , Ningjing Sang , Iris Li , Guanming Huang

Continuous-depth neural networks, such as Neural ODEs, have refashioned the understanding of residual neural networks in terms of non-linear vector-valued optimal control problems. The common solution is to use the adjoint sensitivity…

Machine Learning · Computer Science 2022-02-16 Andrew Corbett , Dmitry Kangin

Koopman operator theory, a powerful framework for discovering the underlying dynamics of nonlinear dynamical systems, was recently shown to be intimately connected with neural network training. In this work, we take the first steps in…

Neural and Evolutionary Computing · Computer Science 2021-10-08 Akshunna S. Dogra , William T Redman

A deep neural network (DNN) based power control method is proposed, which aims at solving the non-convex optimization problem of maximizing the sum rate of a multi-user interference channel. Towards this end, we first present PCNet, which…

Signal Processing · Electrical Eng. & Systems 2019-03-12 Fei Liang , Cong Shen , Wei Yu , Feng Wu

A promising approach to optimal control of nonlinear systems involves iteratively linearizing the system and solving an optimization problem at each time instant to determine the optimal control input. Since this approach relies on online…

Optimization and Control · Mathematics 2025-01-30 Anran Li , John P. Swensen , Mehdi Hosseinzadeh

High percentage penetrations of renewable energy generations introduce significant uncertainty into power systems. It requires grid operators to solve alternative current optimal power flow (AC-OPF) problems more frequently for economical…

Systems and Control · Electrical Eng. & Systems 2022-07-04 Xiang Pan , Minghua Chen , Tianyu Zhao , Steven H. Low

Precise soft landings on asteroids are central to many deep space missions for surface exploration and resource exploitation. To improve the autonomy and intelligence of landing control, a real-time optimal control approach is proposed…

Optimization and Control · Mathematics 2020-02-19 Lin Cheng , Zhenbo Wang , Yu Song , Fanghua Jiang

Most existing neural network-based approaches for solving stochastic optimal control problems using the associated backward dynamic programming principle rely on the ability to simulate the underlying state variables. However, in some…

Machine Learning · Statistics 2024-01-30 Christian Yeo

For the past couple of decades, numerical optimization has played a central role in addressing wireless resource management problems such as power control and beamformer design. However, optimization algorithms often entail considerable…

Information Theory · Computer Science 2018-09-18 Haoran Sun , Xiangyi Chen , Qingjiang Shi , Mingyi Hong , Xiao Fu , Nicholas D. Sidiropoulos

This work proposes a novel neural network architecture, called the Dynamically Controlled Recurrent Neural Network (DCRNN), specifically designed to model dynamical systems that are governed by ordinary differential equations (ODEs). The…

Neural and Evolutionary Computing · Computer Science 2019-11-04 Yiwei Fu , Samer Saab , Asok Ray , Michael Hauser

Emerging artificial intelligence applications across the domains of computer vision, natural language processing, graph processing, and sequence prediction increasingly rely on deep neural networks (DNNs). These DNNs require significant…

Hardware Architecture · Computer Science 2024-08-01 Sudeep Pasricha

Extracting physical laws from observation data is a central challenge in many diverse areas of science and engineering. We propose Optimal Control Neural Networks (OCN) to learn the laws of vector fields in dynamical systems, with no…

Dynamical Systems · Mathematics 2023-12-05 Xuping Tian , Baskar Ganapathysubramanian , Hailiang Liu