English
Related papers

Related papers: Training Efficient Controllers via Analytic Policy…

200 papers

In reinforcement learning, reward shaping is an efficient way to guide the learning process of an agent, as the reward can indicate the optimal policy of the task. The potential-based reward shaping framework was proposed to guarantee…

Robotics · Computer Science 2024-02-08 Yifei Chen , Lambert Schomaker , Francisco Cruz

General-purpose robots require diverse repertoires of behaviors to complete challenging tasks in real-world unstructured environments. To address this issue, goal-conditioned reinforcement learning aims to acquire policies that can reach…

Robotics · Computer Science 2023-04-19 Kuan Fang , Patrick Yin , Ashvin Nair , Sergey Levine

Large Language Model (LLM) based multi-agent systems have shown remarkable performance in various tasks, especially when enhanced through collaborative communication. However, current methods often rely on a fixed number of agents and…

Computation and Language · Computer Science 2025-07-24 Boyi Li , Zhonghan Zhao , Der-Horng Lee , Gaoang Wang

An unmanned aerial vehicle (UAV)-aided mobile edge computing (MEC) framework is proposed, where several UAVs having different trajectories fly over the target area and support the user equipments (UEs) on the ground. We aim to jointly…

Signal Processing · Electrical Eng. & Systems 2020-09-24 Liang Wang , Kezhi Wang , Cunhua Pan , Wei Xu , Nauman Aslam , Lajos Hanzo

Accurate dynamics models are critical for the design of predictive controller for autonomous mobile robots. Physics-based models are often too simple to capture relevant real-world effects, while data-driven models are data-intensive and…

Robotics · Computer Science 2026-04-07 Abdullah Altawaitan , Nikolay Atanasov

In this paper, near optimal tracking of a class of nonlinear systems is addressed. Adaptive (approximate) dynamic programming approach is used to calculate the optimal control in closed form. ADP (Adaptive (approximate) dynamic programming)…

Optimization and Control · Mathematics 2021-09-22 Farshid Asadi , Ali Heydari

Aggregators have emerged as crucial tools for the coordination of distributed, controllable loads. To be used effectively, an aggregator must be able to communicate the available flexibility of the loads they control, as known as the…

Optimization and Control · Mathematics 2022-06-01 Tongxin Li , Bo Sun , Yue Chen , Zixin Ye , Steven H. Low , Adam Wierman

Robots and automated systems are increasingly being introduced to unknown and dynamic environments where they are required to handle disturbances, unmodeled dynamics, and parametric uncertainties. Robust and adaptive control strategies are…

Robotics · Computer Science 2018-08-03 Karime Pereida , Angela Schoellig

Human error is a substantial factor in marine accidents, accounting for 85% of all reported incidents. By reducing the need for human intervention in vessel navigation, AI-based methods can potentially reduce the risk of accidents. AI…

Systems and Control · Electrical Eng. & Systems 2023-10-24 Joel Jose , Md Shadab Alam , Abhilash Sharma Somayajula

Model-free reinforcement learning algorithms such as Deep Deterministic Policy Gradient (DDPG) often require additional exploration strategies, especially if the actor is of deterministic nature. This work evaluates the use of model-based…

Machine Learning · Computer Science 2019-11-19 Kevin Sebastian Luck , Mel Vecerik , Simon Stepputtis , Heni Ben Amor , Jonathan Scholz

Gradient-based methods have been widely used for system design and optimization in diverse application domains. Recently, there has been a renewed interest in studying theoretical properties of these methods in the context of control and…

Optimization and Control · Mathematics 2022-10-11 Bin Hu , Kaiqing Zhang , Na Li , Mehran Mesbahi , Maryam Fazel , Tamer Başar

Direct optimization is an appealing framework that replaces integration with optimization of a random objective for approximating gradients in models with discrete random variables. A$^\star$ sampling is a framework for optimizing such…

Machine Learning · Computer Science 2020-10-26 Guy Lorberbom , Chris J. Maddison , Nicolas Heess , Tamir Hazan , Daniel Tarlow

Model Predictive Control (MPC) is a versatile approach capable of accommodating diverse control requirements that holds significant promise for a broad spectrum of industrial applications. Noteworthy challenges associated with MPC include…

Systems and Control · Electrical Eng. & Systems 2025-04-28 Ryuta Moriyasu , Sho Kawaguchi , Kenji Kashima

We study online algorithms to tune the parameters of a robot controller in a setting where the dynamics, policy class, and optimality objective are all time-varying. The system follows a single trajectory without episodes or state resets,…

Robotics · Computer Science 2025-07-16 James A. Preiss , Fengze Xie , Yiheng Lin , Adam Wierman , Yisong Yue

Accurate and agile trajectory tracking in sub-gram Micro Aerial Vehicles (MAVs) is challenging, as the small scale of the robot induces large model uncertainties, demanding robust feedback controllers, while the fast dynamics and…

Offline reinforcement learning (RL) has emerged as a promising framework for addressing robot social navigation challenges. However, inherent uncertainties in pedestrian behavior and limited environmental interaction during training often…

Robotics · Computer Science 2025-10-02 Run Su , Hao Fu , Shuai Zhou , Yingao Fu

Incorporating demonstration data into reinforcement learning (RL) can greatly accelerate learning, but existing approaches often assume demonstrations are optimal and fully aligned with the target task. In practice, demonstrations are…

Machine Learning · Computer Science 2026-01-28 Finn Rietz , Pedro Zuidberg dos Martires , Johannes Andreas Stork

In this paper, we propose the Model Reference Adaptive Control & Reinforcement Learning (MRAC-RL) approach to developing online policies for systems in which modeling errors occur in real-time. Although reinforcement learning (RL)…

Systems and Control · Electrical Eng. & Systems 2021-10-20 Anubhav Guha , Anuradha Annaswamy

Driving simulators have been used in the automotive industry for many years because of their ability to perform tests in a safe, reproducible and controlled immersive virtual environment. The improved performance of the simulator and its…

Robotics · Computer Science 2023-04-07 Akhil Chadha , Vishrut Jain , Andrea Michelle Rios Lazcano , Barys Shyrokau

Reinforcement Learning (RL) robot controllers usually aggregate many task objectives into one scalar reward. While large-scale proximal policy optimisation (PPO) has enabled impressive results such as robust robot locomotion in the real…

Robotics · Computer Science 2025-09-19 Humphrey Munn , Brendan Tidd , Peter Böhm , Marcus Gallagher , David Howard