Related papers: The Heuristic Dynamic Programming Approach in Boos…
The paper develops the Adaptive Dynamic Programming Toolbox (ADPT), which solves optimal control problems for continuous-time nonlinear systems. Based on the adaptive dynamic programming technique, the ADPT computes optimal feedback…
This paper presents a new technique for the design of approximate reasoning based controllers for dynamic physical systems with interacting goals. In this approach, goals are achieved based on a hierarchy defined by a control knowledge base…
Differential dynamic programming (DDP) is a direct single shooting method for trajectory optimization. Its efficiency derives from the exploitation of temporal structure (inherent to optimal control problems) and explicit…
In this paper, we deal with the power regulation of tethered-wing systems and demonstrate advantages of variable-pitch control in mitigating the dynamic mechanical loads and power fluctuations. The proposed scheme is based on a strategy…
Hybrid AC/DC transmission grids incorporate Modular Multilevel Converters functioning as Interconnecting Power Converters (IPCs). The control role assigned to each converter significantly influences grid dynamics. Traditionally, these…
In this paper, an optimal approach based on on-off controller is used to optimally control a DC-DC step-down converter. It is shown that the conventional controller techniques of DC-DC converters based on a linearized averaging model have…
Differential Dynamic Programming is an optimal control technique often used for trajectory generation. Many variations of this algorithm have been developed in the literature, including algorithms for stochastic dynamics or state and input…
This paper studies the dynamic programming principle using the measurable selection method for stochastic control of continuous processes. The novelty of this work is to incorporate intermediate expectation constraints on the canonical…
Acting to complete tasks in stochastic partially observable domains is an important problem in artificial intelligence, and is often formulated as a goal-based POMDP. Goal-based POMDPs can be solved using the RTDP-BEL algorithm, that…
This paper addresses the numerical optimization of proportional-integral-derivative (PID) controllers for linear time-invariant systems with delays, where the derivative action is implemented using a low-pass filter. While performance…
Data-driven control offers a viable option for control scenarios where constructing a system model is expensive or time-consuming. Nonetheless, many of these algorithms are not entirely automated, often necessitating the adjustment of…
The design of control engineering applications usually requires a model that accurately represents the dynamics of the real system. In addition to classical physical modeling, powerful data-driven approaches are increasingly used. However,…
Wind farms can increase annual energy production (AEP) with advanced control algorithms by coordinating the set points of individual turbine controllers across the farm. However, it remains a significant challenge to achieve performance…
In this paper, modification of the classical PID controller and development of open-loop control mechanisms to improve stability and robustness of a differential wheeled robot are discussed. To deploy the algorithm, a test platform has been…
Model predictive control (MPC) is an optimal control strategy where control input calculation is based on minimizing the predicted tracking error over a finite horizon that moves with time. This strategy has an advantage over conventional…
This work presents an extended framework for learning-based bipedal locomotion that incorporates a heuristic step-planning strategy guided by desired torso velocity tracking. The framework enables precise interaction between a humanoid…
Wind farm control using dynamic concepts is a research topic that is receiving an increasing amount of interest. The main concept of this approach is that dynamic variations of the wind turbine control settings lead to higher wake…
This paper systematically introduces dynamic extensions for the boundary control of general heterodirectional hyperbolic PDE systems. These extensions, which are well known in the finite-dimensional setting, constitute the dynamics of state…
Modern applications of robotics typically involve a robot control system with an inner PI (proportional-integral) or PID (proportional-integral-derivative) control loop and an outer user-specified control loop. The existing outer loop…
Standard H2 optimal control of networked dynamic systems tend to become unscalable with network size. Structural constraints can be imposed on the design to counteract this problem albeit at the risk of making the solution non-convex. In…