English
Related papers

Related papers: A Novel Entropy-Maximizing TD3-based Reinforcement…

200 papers

The thermal system of battery electric vehicles demands advanced control. Its thermal management needs to effectively control active components across varying operating conditions. While robust control function parametrization is required,…

Machine Learning · Computer Science 2024-08-06 Thomas Rudolf , Philip Muhl , Sören Hohmann , Lutz Eckstein

Integrating unmanned aerial vehicles into daily use requires controllers that ensure stable flight, efficient energy use, and reduced noise. Proportional integral derivative controllers remain standard but are highly sensitive to gain…

Systems and Control · Electrical Eng. & Systems 2025-09-23 Andrea Vaiuso , Gabriele Immordino , Ludovica Onofri , Giuliano Coppotelli , Marcello Righi

Data-enabled predictive control (DeePC) leverages system measurements in characterizing system dynamics for optimal control. The performance of DeePC relies on optimizing its hyperparameters, especially in noisy systems where the optimal…

Optimization and Control · Mathematics 2025-06-02 Jinbao Wang , Shiliang Zhang , Jun Liu , Xuehui Ma , Haolin Liu

Control theory provides engineers with a multitude of tools to design controllers that manipulate the closed-loop behavior and stability of dynamical systems. These methods rely heavily on insights about the mathematical model governing the…

Systems and Control · Electrical Eng. & Systems 2020-09-24 Simen Theie Havenstrøm , Camilla Sterud , Adil Rasheed , Omer San

This paper presents novel methods for tuning inverter controller gains using deep reinforcement learning (DRL). A Simulink-developed inverter model is converted into a dynamic link library (DLL) and integrated with a Python-based RL…

Systems and Control · Electrical Eng. & Systems 2024-11-05 Shuvangkar Chandra Das , Tuyen Vu , Deepak Ramasubramanian , Evangelos Farantatos , Jianhua Zhang , Thomas Ortmeyer

In actor-critic-based reinforcement learning algorithms such as Twin Delayed Deep Deterministic policy gradient (TD3), insufficient exploration of the spatial space can result in suboptimal policies when controlling 7-DOF robotic arms. To…

Robotics · Computer Science 2024-08-27 Wen-Han Hsieh , Jen-Yuan Chang

Proportional-integral-derivative (PID) control is the most widely used in industrial control, robot control and other fields. However, traditional PID control is not competent when the system cannot be accurately modeled and the operating…

Robotics · Computer Science 2021-07-13 Xinyi Yu , Yuehai Fan , Siyu Xu , Linlin Ou

This paper proposes a reinforcement learning (RL) framework for controlling and stabilizing the Twin Rotor Aerodynamic System (TRAS) at specific pitch and azimuth angles and tracking a given trajectory. The complex dynamics and non-linear…

Robotics · Computer Science 2025-12-16 Zeyad Gamal , Youssef Mahran , Ayman El-Badawy

This article proposes an improved trajectory optimization approach for stochastic optimal control of dynamical systems affected by measurement noise by combining optimal control with maximum likelihood techniques to improve the reduction of…

Systems and Control · Electrical Eng. & Systems 2023-12-25 Prakash Mallick , Zhiyong Chen

This paper explores the impact of dynamic entropy tuning in Reinforcement Learning (RL) algorithms that train a stochastic policy. Its performance is compared against algorithms that train a deterministic one. Stochastic policies optimize a…

Robotics · Computer Science 2025-12-23 Youssef Mahran , Zeyad Gamal , Ayman El-Badawy

Deep reinforcement learning (RL) has shown immense potential for learning to control systems through data alone. However, one challenge deep RL faces is that the full state of the system is often not observable. When this is the case, the…

Machine Learning · Computer Science 2023-10-27 Ian Char , Jeff Schneider

Value-based deep Reinforcement Learning (RL) algorithms suffer from the estimation bias primarily caused by function approximation and temporal difference (TD) learning. This problem induces faulty state-action value estimates and therefore…

Machine Learning · Computer Science 2021-11-15 Dogan C. Cicek , Enes Duran , Baturay Saglam , Kagan Kaya , Furkan B. Mutlu , Suleyman S. Kozat

Long-term training of large language models (LLMs) requires maintaining stable exploration to prevent the model from collapsing into sub-optimal behaviors. Entropy is crucial in this context, as it controls exploration and helps avoid…

Machine Learning · Computer Science 2026-02-03 Kai Yang , Xin Xu , Yangkun Chen , Weijie Liu , Jiafei Lyu , Zichuan Lin , Deheng Ye , Saiyong Yang

Proportional-integral-derivative (PID) control, the most common control strategy in the industry, always suffers from health problems resulting from external disturbances, improper tuning, etc. Therefore, there have been many studies on…

Systems and Control · Electrical Eng. & Systems 2021-08-03 Wei Zhang , He Dong , Yunlang Xu , Xiaoping Li

The overestimation phenomenon caused by function approximation is a well-known issue in value-based reinforcement learning algorithms such as deep Q-networks and DDPG, which could lead to suboptimal policies. To address this issue, TD3…

Machine Learning · Computer Science 2023-11-07 Qiang He , Xinwen Hou

This work investigates the formal policy synthesis of continuous-state stochastic dynamic systems given high-level specifications in linear temporal logic. To learn an optimal policy that maximizes the satisfaction probability, we take a…

Artificial Intelligence · Computer Science 2023-04-21 Lening Li , Zhentian Qian

Policy gradient methods are an appealing approach in reinforcement learning because they directly optimize the cumulative reward and can straightforwardly be used with nonlinear function approximators such as neural networks. The two main…

Machine Learning · Computer Science 2018-10-23 John Schulman , Philipp Moritz , Sergey Levine , Michael Jordan , Pieter Abbeel

Control of batch processes is a difficult task due to their complex nonlinear dynamics and unsteady-state operating conditions within batch and batch-to-batch. It is expected that some of these challenges can be addressed by developing…

Systems and Control · Electrical Eng. & Systems 2021-09-20 Tanuja Joshi , Shikhar Makker , Hariprasad Kodamana , Harikumar Kandath

Finding tight bounds on the optimal solution is a critical element of practical solution methods for discrete optimization problems. In the last decade, decision diagrams (DDs) have brought a new perspective on obtaining upper and lower…

Artificial Intelligence · Computer Science 2019-02-28 Quentin Cappart , Emmanuel Goutierre , David Bergman , Louis-Martin Rousseau

Deep reinforcement learning (RL) is an optimization-driven framework for producing control strategies for general dynamical systems without explicit reliance on process models. Good results have been reported in simulation. Here we…

Systems and Control · Electrical Eng. & Systems 2022-01-14 Nathan P. Lawrence , Michael G. Forbes , Philip D. Loewen , Daniel G. McClement , Johan U. Backstrom , R. Bhushan Gopaluni