English
Related papers

Related papers: Model-Free versus Model-Based Reinforcement Learni…

200 papers

This work developed a meta-learning approach that adapts the control policy on the fly to different changing conditions for robust locomotion. The proposed method constantly updates the interaction model, samples feasible sequences of…

Robotics · Computer Science 2021-01-20 Timothée Anne , Jack Wilkinson , Zhibin Li

Autopilots for fixed-wing aircraft are typically designed based on linearized aerodynamic models consisting of stability and control derivatives obtained from wind-tunnel testing. The resulting local controllers are then pieced together…

Systems and Control · Electrical Eng. & Systems 2024-02-02 Riley J. Richards , Juan A. Paredes , Dennis S. Bernstein

The control and modeling of robot dynamics have increasingly adopted model-free control strategies using machine learning. Given the non-linear elastic nature of bionic robotic systems, learning-based methods provide reliable alternatives…

Robotics · Computer Science 2024-10-08 Po-Yu Hsieh , June-Hao Hou

This study presents a transformer-based approach for fault-tolerant control in fixed-wing Unmanned Aerial Vehicles (UAVs), designed to adapt in real time to dynamic changes caused by structural damage or actuator failures. Unlike…

Robotics · Computer Science 2025-03-10 Francisco Giral , Ignacio Gómez , Ricardo Vinuesa , Soledad Le Clainche

Fixed-frequency control in robotics imposes a trade-off between the efficiency of low-frequency control and the robustness of high-frequency control, a limitation not seen in adaptable biological systems. We address this with a…

Robotics · Computer Science 2025-10-28 Arnav Sukhija , Lenart Treven , Jin Cheng , Florian Dörfler , Stelian Coros , Andreas Krause

The experience gained with numerous successful applications permits to revisit some points of model-free control. The numerical differentiation of noisy signals may be replaced by a real time parameter identification which is much simpler.…

Optimization and Control · Mathematics 2011-04-01 Michel Fliess , Cédric Join , Samer Riachy

Efficient real-time trajectory planning and control for fixed-wing unmanned aerial vehicles is challenging due to their non-holonomic nature, complex dynamics, and the additional uncertainties introduced by unknown aerodynamic effects. In…

Model-Free Reinforcement Learning has achieved meaningful results in stable environments but, to this day, it remains problematic in regime changing environments like financial markets. In contrast, model-based RL is able to capture some…

Machine Learning · Computer Science 2021-04-23 Eric Benhamou , David Saltiel , Serge Tabachnik , Sui Kai Wong , François Chareyron

We consider the problem of designing scalable and portable controllers for unmanned aerial vehicles (UAVs) to reach time-varying formations as quickly as possible. This brief confirms that deep reinforcement learning can be used in a…

Robotics · Computer Science 2017-06-06 Ronny Conde , José Ramón Llata , Carlos Torre-Ferrero

Overactuated omnidirectional flying vehicles are capable of generating force and torque in any direction, which is important for applications such as contact-based industrial inspection. This comes at the price of an increase in model…

Robotics · Computer Science 2020-06-24 Weixuan Zhang , Maximilian Brunner , Lionel Ott , Mina Kamel , Roland Siegwart , Juan Nieto

Wind affects the stability and maneuverability of UAVs, which can be particularly dangerous when operating near obstacles or each other. In order to test the effectiveness of formation control laws and the impact of windy environments on…

Optimization and Control · Mathematics 2019-05-27 Kenan Cole , Adam Wickenheiser

This paper presents a reinforcement learning-based path-following controller for a fixed-wing small uncrewed aircraft system (sUAS) that is robust to certain actuator failures. The controller is conditioned on a parameterization of actuator…

Systems and Control · Electrical Eng. & Systems 2026-04-08 Dennis Marquis , Mazen Farhood

Model bias is an inherent limitation of the current dominant approach to optimal quantum control, which relies on a system simulation for optimization of control policies. To overcome this limitation, we propose a circuit-based approach for…

Quantum Physics · Physics 2022-03-31 V. V. Sivak , A. Eickbusch , H. Liu , B. Royer , I. Tsioutsios , M. H. Devoret

The ability to learn and execute optimal control policies safely is critical to realization of complex autonomy, especially where task restarts are not available and/or the systems are safety-critical. Safety requirements are often…

Systems and Control · Electrical Eng. & Systems 2021-10-06 S M Nahid Mahmud , Moad Abudia , Scott A Nivison , Zachary I. Bell , Rushikesh Kamalapurkar

This study aims to design a motion/force controller for an aerial manipulator which guarantees the tracking of time-varying motion/force trajectories as well as the stability during the transition between free and contact motions. To this…

Robotics · Computer Science 2023-01-20 Jeonghyun Byun , Byeongjun Kim , Changhyeon Kim , Donggeon David Oh , H. Jin Kim

Learning has propelled the cutting edge of performance in robotic control to new heights, allowing robots to operate with high performance in conditions that were previously unimaginable. The majority of the work, however, assumes that the…

Robotics · Computer Science 2018-03-13 Christopher D. McKinnon , Angela P. Schoellig

We consider the problem of controlling an invasive mechanical ventilator for pressure-controlled ventilation: a controller must let air in and out of a sedated patient's lungs according to a trajectory of airway pressures specified by a…

We propose a novel adaptive reinforcement learning control approach for fault tolerant control of degrading systems that is not preceded by a fault detection and diagnosis step. Therefore, \textit{a priori} knowledge of faults that may…

Systems and Control · Electrical Eng. & Systems 2020-08-12 Ibrahim Ahmed , Marcos Quiñones-Grueiro , Gautam Biswas

When environmental interaction is expensive, model-based reinforcement learning offers a solution by planning ahead and avoiding costly mistakes. Model-based agents typically learn a single-step transition model. In this paper, we propose a…

Machine Learning · Computer Science 2018-11-02 Kavosh Asadi , Evan Cater , Dipendra Misra , Michael L. Littman

This paper addresses design, modeling and dynamic-compensation PID (dc-PID) control of a novel type of fully-actuated aerial manipulation (AM) system. Firstly, design of novel mechanical structure of the AM is presented. Secondly,…

Robotics · Computer Science 2017-09-26 Le Ma , Dong Wang , Zixu Hao , Jie Liu , Jiasen Sun , Siyu Wang
‹ Prev 1 3 4 5 6 7 10 Next ›