English
Related papers

Related papers: Model-Free versus Model-Based Reinforcement Learni…

200 papers

We present a control method for improved repetitive path following for a ground vehicle that is geared towards long-term operation where the operating conditions can change over time and are initially unknown. We use weighted Bayesian…

Robotics · Computer Science 2019-04-10 Christopher D. McKinnon , Angela P. Schoellig

Learning-based techniques have become popular in both model predictive control (MPC) and reinforcement learning (RL). Probabilistic ensemble (PE) models offer a promising approach for modelling system dynamics, showcasing the ability to…

Machine Learning · Computer Science 2024-05-07 Yuan Zhang , Jasper Hoffmann , Joschka Boedecker

Recently, adaptive control systems with relaxed persistent excitation (PE) conditions have been proposed to guarantee true parameter convergence and improve the transient response. However, in some cases, sufficient control performance and…

Systems and Control · Electrical Eng. & Systems 2025-03-03 Satoshi Tsuruhara , Kazuhisa Ito

Deep reinforcement learning (RL) has shown immense potential for learning to control systems through data alone. However, one challenge deep RL faces is that the full state of the system is often not observable. When this is the case, the…

Machine Learning · Computer Science 2023-10-27 Ian Char , Jeff Schneider

Learning for model based control can be sample-efficient and generalize well, however successfully learning models and controllers that represent the problem at hand can be challenging for complex tasks. Using inaccurate models for learning…

Robotics · Computer Science 2020-11-10 Sarah Bechtle , Bilal Hammoud , Akshara Rai , Franziska Meier , Ludovic Righetti

Hybrid unmanned aerial vehicles (UAVs) integrate the efficient forward flight of fixed-wing and vertical takeoff and landing (VTOL) capabilities of multicopter UAVs. This paper presents the modeling, control and simulation of a new type of…

Robotics · Computer Science 2026-01-27 Quan Quan , Wang Shuai , Gao Wenhan

Model-free approaches for reinforcement learning (RL) and continuous control find policies based only on past states and rewards, without fitting a model of the system dynamics. They are appealing as they are general purpose and easy to…

Machine Learning · Computer Science 2018-10-09 Yasin Abbasi-Yadkori , Nevena Lazic , Csaba Szepesvari

Take-off and landing are the most important maneuvers for an aircraft's flight. Deployment for small fixed-wing aircraft is usually made by hand but when payload increases, take-off, and landing maneuvers are then performed on a runway…

Systems and Control · Electrical Eng. & Systems 2020-06-24 Andres Montes de Oca , Gerardo Flores

Many state-of-the art robotic applications utilize series elastic actuators (SEAs) with closed-loop force control to achieve complex tasks such as walking, lifting, and manipulation. Model-free PID control methods are more prone to…

Machine Learning · Computer Science 2025-07-30 Ruturaj Sambhus , Aydin Gokce , Stephen Welch , Connor W. Herron , Alexander Leonessa

This paper presents an agile Unmanned Aerial Vehicle (UAV) landing control by considering the effect of ship's oscillations and moving, and also disturbance (i.e., crosswind) is considered. The presented control system can make the…

Systems and Control · Electrical Eng. & Systems 2024-11-11 James Mordaunt , Xinhua Wang

Sliding mode control of a launch vehicle during its atmospheric flight phase is studied in the presence of unmatched disturbances. Linear time-varying dynamics of the aerospace vehicle is converted into a systematic formula and then dynamic…

Systems and Control · Computer Science 2016-11-18 Mohammad Reza Saniee

Model-based reinforcement learning methods learn a dynamics model with real data sampled from the environment and leverage it to generate simulated data to derive an agent. However, due to the potential distribution mismatch between…

Machine Learning · Computer Science 2020-10-29 Jian Shen , Han Zhao , Weinan Zhang , Yong Yu

Real-time adaptation is imperative to the control of robots operating in complex, dynamic environments. Adaptive control laws can endow even nonlinear systems with good trajectory tracking performance, provided that any uncertain dynamics…

Robotics · Computer Science 2021-06-22 Spencer M. Richards , Navid Azizan , Jean-Jacques Slotine , Marco Pavone

Accurately predicting the dynamics of robotic systems is crucial for model-based control and reinforcement learning. The most common way to estimate dynamics is by fitting a one-step ahead prediction model and using it to recursively…

Machine Learning · Computer Science 2021-09-02 Nathan O. Lambert , Albert Wilcox , Howard Zhang , Kristofer S. J. Pister , Roberto Calandra

Reinforcement learning is an effective way to solve the decision-making problems. It is a meaningful and valuable direction to investigate autonomous air combat maneuver decision-making method based on reinforcement learning. However, when…

Artificial Intelligence · Computer Science 2023-02-14 Yu-Jie Wei , Hong-Peng Zhang , Chang-Qiang Huang

This paper presents the comparison of two non-linear model-based control strategies for autonomous cars. A control oriented model of vehicle based on a bicycle model is used. The two control strategies use a model reference approach. Using…

Systems and Control · Computer Science 2017-10-11 Eugenio Alcalá , Laura Sellart , Vicenç Puig , Joseba Quevedo , Jordi Saludes , David Vázquez , Antonio López

Underwater vehicles are employed in the exploration of dynamic environments where tuning of a specific controller for each task would be time-consuming and unreliable as the controller depends on calculated mathematical coefficients in…

Systems and Control · Electrical Eng. & Systems 2021-01-14 Wilmer Ariza Ramirez , Zhi Q. Leong , Hung D. Nguyen , S. G. Jayasinghe

Model-based reinforcement learning (RL) is anticipated to exhibit higher sample efficiency compared to model-free RL by utilizing a virtual environment model. However, it is challenging to obtain sufficiently accurate representations of the…

Artificial Intelligence · Computer Science 2026-01-19 Zihao Sheng , Zilin Huang , Sikai Chen

Improving wind turbine efficiency is essential for reducing the costs of energy production. The highly nonlinear dynamics of the wind turbines and their uncertain operating conditions have posed many challenges for their control methods. In…

Systems and Control · Electrical Eng. & Systems 2021-06-15 Ammar Al-Jodah , Marwah Alwan

This work provides a rigorous framework for studying continuous time control problems in uncertain environments. The framework considered models uncertainty in state dynamics as a measure on the space of functions. This measure is…

Optimization and Control · Mathematics 2018-02-22 Ryan Murray , Michele Palladino
‹ Prev 1 8 9 10 Next ›