English
Related papers

Related papers: Model-Free versus Model-Based Reinforcement Learni…

200 papers

In this paper, an offset-free bilinear model predictive control approach for wind turbines is presented. State-of-the-art controllers employ different control loops for pitch angle and generator torque which switch depending on wind…

Systems and Control · Electrical Eng. & Systems 2024-01-30 Arnold Sterle , Aaron Grapentin , Christian A. Hans , Jörg Raisch

Aerial manipulators undergo rapid, configuration-dependent changes in inertial coupling forces and aerodynamic forces, making accurate dynamics modeling a core challenge for reliable control. Analytical models lose fidelity under these…

This paper proposes a framework for adaptively learning a feedback linearization-based tracking controller for an unknown system using discrete-time model-free policy-gradient parameter update rules. The primary advantage of the scheme over…

Machine Learning · Computer Science 2020-04-07 Tyler Westenbroek , Eric Mazumdar , David Fridovich-Keil , Valmik Prabhu , Claire J. Tomlin , S. Shankar Sastry

Quadrotors are highly nonlinear dynamical systems that require carefully tuned controllers to be pushed to their physical limits. Recently, learning-based control policies have been proposed for quadrotors, as they would potentially allow…

Robotics · Computer Science 2022-02-23 Elia Kaufmann , Leonard Bauersfeld , Davide Scaramuzza

This paper addresses the design and application controller for a small-size unmanned aerial vehicle (UAV). In this work, the main objective is to study the modeling and attitude controller design for a small size helicopter. Based on a…

Robotics · Computer Science 2021-01-26 Miaolei He , Jilin He

Faults are endemic to all systems. Adaptive fault-tolerant control maintains degraded performance when faults occur as opposed to unsafe conditions or catastrophic events. In systems with abrupt faults and strict time constraints, it is…

Machine Learning · Computer Science 2020-12-14 Ibrahim Ahmed , Marcos Quinones-Grueiro , Gautam Biswas

We study the problem of learning safe control policies that are also effective; i.e., maximizing the probability of satisfying a linear temporal logic (LTL) specification of a task, and the discounted reward capturing the (classic) control…

Robotics · Computer Science 2026-04-07 Alper Kamil Bozkurt , Yu Wang , Miroslav Pajic

The process of robot design is a complex task and the majority of design decisions are still based on human intuition or tedious manual tuning. A more informed way of facing this task is computational design methods where design parameters…

Robotics · Computer Science 2022-10-07 Álvaro Belmonte-Baeza , Joonho Lee , Giorgio Valsecchi , Marco Hutter

Model-based reinforcement learning approaches carry the promise of being data efficient. However, due to challenges in learning dynamics models that sufficiently match the real-world dynamics, they struggle to achieve the same asymptotic…

Machine Learning · Computer Science 2018-09-17 Ignasi Clavera , Jonas Rothfuss , John Schulman , Yasuhiro Fujita , Tamim Asfour , Pieter Abbeel

Robots and automated systems are increasingly being introduced to unknown and dynamic environments where they are required to handle disturbances, unmodeled dynamics, and parametric uncertainties. Robust and adaptive control strategies are…

Robotics · Computer Science 2018-08-03 Karime Pereida , Angela Schoellig

The effectiveness of model-based versus model-free methods is a long-standing question in reinforcement learning (RL). Motivated by recent empirical success of RL on continuous control tasks, we study the sample complexity of popular…

Machine Learning · Computer Science 2019-02-05 Stephen Tu , Benjamin Recht

Autonomous racing with scaled race cars has gained increasing attention as an effective approach for developing perception, planning and control algorithms for safe autonomous driving at the limits of the vehicle's handling. To train agile…

Robotics · Computer Science 2023-05-30 Xiatao Sun , Mingyan Zhou , Zhijun Zhuang , Shuo Yang , Johannes Betz , Rahul Mangharam

Aerial manipulator, which is composed of an UAV (Unmanned Aerial Vehicle) and a multi-link manipulator and can perform aerial manipulation, has shown great potential of applications. However, dynamic coupling between the UAV and the…

Robotics · Computer Science 2024-01-12 Guangyu Zhang , Yuqing He , Bo Dai , Feng Gu , Jianda Han , Guangjun Liu

Model-based Reinforcement Learning and Control have demonstrated great potential in various sequential decision making problem domains, including in robotics settings. However, real-world robotics systems often present challenges that limit…

Machine Learning · Computer Science 2023-10-24 Achkan Salehi , Steffen Rühl , Stephane Doncieux

In recent years, increasing attention has been directed to leveraging pre-trained vision models for motor control. While existing works mainly emphasize the importance of this pre-training phase, the arguably equally important role played…

Computer Vision and Pattern Recognition · Computer Science 2023-06-21 Yingdong Hu , Renhao Wang , Li Erran Li , Yang Gao

In this paper, we present a methodology for constructing data-driven maneuver generation models for agile aircraft that can generalize across a wide range of trim conditions and aircraft model parameters. Maneuver generation models play a…

Artificial Intelligence · Computer Science 2024-01-18 Gulay Goktas Sever , Umut Demir , Abdullah Sadik Satir , Mustafa Cagatay Sahin , Nazim Kemal Ure

With the goal of increasing the speed and efficiency in robotic manipulation, a control approach is presented that aims to utilize intentional simultaneous impacts to its advantage. This approach exploits the concept of the time-invariant…

Robotics · Computer Science 2024-11-18 Jari van Steen , Nathan van de Wouw , Alessandro Saccon

In recent years, unmanned aerial vehicle (UAV) related technology has expanded knowledge in the area, bringing to light new problems and challenges that require solutions. Furthermore, because the technology allows processes usually carried…

Artificial Intelligence · Computer Science 2022-12-08 Cristian Millán-Arias , Ruben Contreras , Francisco Cruz , Bruno Fernandes

Reinforcement learning holds tremendous promise in accelerator controls. The primary goal of this paper is to show how this approach can be utilised on an operational level on accelerator physics problems. Despite the success of model-free…

Machine Learning · Computer Science 2022-01-27 Simon Hirlaender , Niky Bruchon

A new "model-free" control methodology is applied to a boost power converter. The properties of the boost converter allow to evaluate the performances of the model-free strategy in the case of switching nonlinear transfer functions,…

Systems and Control · Computer Science 2013-10-10 Loïc Michel , Wim Michiels , Xavier Boucher