English
Related papers

Related papers: SCAPE: Learning Stiffness Control from Augmented P…

200 papers

Flexible-joint manipulators are governed by complex nonlinear dynamics, defining a challenging control problem. In this work, we propose an approach to learn an outer-loop joint trajectory tracking controller with deep reinforcement…

Robotics · Computer Science 2022-03-15 Dmytro Pavlichenko , Sven Behnke

A data-efficient learning-based control design method is proposed in this paper. It is based on learning a system dynamics model that is then leveraged in a two-level procedure. On the higher level, a simple but powerful optimization…

Systems and Control · Electrical Eng. & Systems 2026-02-03 Ludvig Svedlund , Constantin Cronrath , Jonas Fredriksson , Bengt Lennartson

While reinforcement learning has made great improvements, state-of-the-art algorithms can still struggle with seemingly simple set-point feedback control problems. One reason for this is that the learned controller may not be able to excite…

Systems and Control · Electrical Eng. & Systems 2023-04-21 Ruoqi Zhang , Per Mattsson , Torbjörn Wigren

This paper investigates how to incorporate expert observations (without explicit information on expert actions) into a deep reinforcement learning setting to improve sample efficiency. First, we formulate an augmented policy loss combining…

Machine Learning · Computer Science 2025-02-28 Erhan Can Ozcan , Vittorio Giammarino , James Queeney , Ioannis Ch. Paschalidis

Model-free algorithms are brought into the control system's research with the emergence of reinforcement learning algorithms. However, there are two practical challenges of reinforcement learning-based methods. First, learning by…

Systems and Control · Electrical Eng. & Systems 2024-09-18 Mi Zhou , Erik Verriest , Chaouki Abdallah

Control systems are at the core of every real-world robot. They are deployed in an ever-increasing number of applications, ranging from autonomous racing and search-and-rescue missions to industrial inspections and space exploration. To…

Robotics · Computer Science 2024-07-03 Yunlong Song , Davide Scaramuzza

Robust reinforcement learning agents using high-dimensional observations must be able to identify relevant state features amidst many exogeneous distractors. A representation that captures controllability identifies these state elements by…

Machine Learning · Computer Science 2024-06-25 Max Rudolph , Caleb Chuck , Kevin Black , Misha Lvovsky , Scott Niekum , Amy Zhang

Common approaches to providing feedback in reinforcement learning are the use of hand-crafted rewards or full-trajectory expert demonstrations. Alternatively, one can use examples of completed tasks, but such an approach can be extremely…

Robotics · Computer Science 2025-09-16 Trevor Ablett , Bryan Chan , Jayce Haoran Wang , Jonathan Kelly

When applying imitation learning techniques to fit a policy from expert demonstrations, one can take advantage of prior stability/robustness assumptions on the expert's policy and incorporate such control-theoretic prior knowledge…

Optimization and Control · Mathematics 2021-03-25 Aaron Havens , Bin Hu

Motion cueing algorithms (MCA) are used to control the movement of motion simulation platforms (MSP) to reproduce the motion perception of a real vehicle driver as accurately as possible without exceeding the limits of the workspace of the…

Operating directly from raw high dimensional sensory inputs like images is still a challenge for robotic control. Recently, Reinforcement Learning methods have been proposed to solve specific tasks end-to-end, from pixels to torques.…

Machine Learning · Computer Science 2019-01-07 Carlos Florensa , Jonas Degrave , Nicolas Heess , Jost Tobias Springenberg , Martin Riedmiller

Classical policy search algorithms for robotics typically require performing extensive explorations, which are time-consuming and expensive to implement with real physical platforms. To facilitate the efficient learning of robot…

Robotics · Computer Science 2023-04-25 Shengzeng Huo , Anqing Duan , Lijun Han , Luyin Hu , Hesheng Wang , David Navarro-Alarcon

The sit-to-stand movement is a key feature for wide adoption of powered lower limb orthoses for patients with complete paraplegia. In this paper we study the control of the ascending phase of the sit-to-stand movement for a minimally…

Systems and Control · Computer Science 2020-11-26 Octavio Narvaez-Aroche , Pierre-Jean Meyer , Stephen Tu , Andrew Packard , Murat Arcak

Despite recent remarkable achievements in quadruped control, it remains challenging to ensure robust and compliant locomotion in the presence of unforeseen external disturbances. Existing methods prioritize locomotion robustness over…

Robotics · Computer Science 2025-07-04 Xiang Zhou , Xinyu Zhang , Qingrui Zhang

Policy iteration is one of the classical frameworks of reinforcement learning, which requires a known initial stabilizing control. However, finding the initial stabilizing control depends on the known system model. To relax this requirement…

Systems and Control · Electrical Eng. & Systems 2025-03-20 Dongdong Li , Jiuxiang Dong

Mastering robotic manipulation skills through reinforcement learning (RL) typically requires the design of shaped reward functions. Recent developments in this area have demonstrated that using sparse rewards, i.e. rewarding the agent only…

Machine Learning · Computer Science 2021-11-12 Ozsel Kilinc , Giovanni Montana

Imitation learning is a promising approach to end-to-end training of autonomous vehicle controllers. Typically the driving process with such approaches is entirely automatic and black-box, although in practice it is desirable to control the…

Robotics · Computer Science 2020-11-23 Renhao Wang , Adam Scibior , Frank Wood

Robotic manipulation in dynamic environments often requires seamless transitions between different grasp types to maintain stability and efficiency. However, achieving smooth and adaptive grasp transitions remains a challenge, particularly…

Robotics · Computer Science 2025-09-24 Kuanqi Cai , Chunfeng Wang , Zeqi Li , Haowen Yao , Weinan Chen , Luis Figueredo , Aude Billard , Arash Ajoudani

Understanding physical phenomena is a key component of human intelligence and enables physical interaction with previously unseen environments. In this paper, we study how an artificial agent can autonomously acquire this intuition through…

Robotics · Computer Science 2017-11-23 Wenbin Li , Jeannette Bohg , Mario Fritz

We present a general, two-stage reinforcement learning approach to create robust policies that can be deployed on real robots without any additional training using a single demonstration generated by trajectory optimization. The…

Robotics · Computer Science 2022-01-25 Miroslav Bogdanovic , Majid Khadiv , Ludovic Righetti