English
Related papers

Related papers: PPO-based Dynamic Control of Uncertain Floating Pl…

200 papers

The combination of policy search and deep neural networks holds the promise of automating a variety of decision-making tasks. Model Predictive Control (MPC) provides robust solutions to robot control tasks by making use of a dynamical model…

Robotics · Computer Science 2021-05-11 Yunlong Song , Davide Scaramuzza

Task-space quadratic programming (QP) is an elegant approach for controlling robots subject to constraints. Yet, in the case of kinematic-controlled (i.e., high-gains position or velocity) robots, closed-loop QP control scheme can be prone…

Robotics · Computer Science 2023-07-28 Mohamed Djeha , Pierre Gergondet , Abderrahmane Kheddar

Vision-based robotic cloth unfolding has made great progress recently. However, prior works predominantly rely on value learning and have not fully explored policy-based techniques. Recently, the success of reinforcement learning on the…

Computer Vision and Pattern Recognition · Computer Science 2024-05-09 Libing Yang , Yang Li , Long Chen

A major challenge in robotics is to design robust policies which enable complex and agile behaviors in the real world. On one end of the spectrum, we have model-free reinforcement learning (MFRL), which is incredibly flexible and general…

Robotics · Computer Science 2024-10-01 Jacob Sacks , Rwik Rana , Kevin Huang , Alex Spitzer , Guanya Shi , Byron Boots

We propose a novel flexible-step model predictive control algorithm for unknown linear time-invariant discrete-time systems. The goal is to asymptotically stabilize the system without relying on a pre-collected dataset that describes its…

Optimization and Control · Mathematics 2025-10-02 Markus Pietschner , Christian Ebenbauer , Bahman Gharesifard , Raik Suttner

The integration of various power sources, including renewables and electric vehicles, into smart grids is expanding, introducing uncertainties that can result in issues like voltage imbalances, load fluctuations, and power losses. These…

Systems and Control · Electrical Eng. & Systems 2024-03-26 Qi Li , Ye Shi , Yuning Jiang , Yuanming Shi , Haoyu Wang , H. Vincent Poor

High-precision manipulation has always been a developmental goal for aerial manipulators. This paper investigates the kinematic coordinate control issue in aerial manipulators. We propose a predictive kinematic coordinate control method,…

Robotics · Computer Science 2025-03-05 Zhengzhen Li , Jiahao Shen , Mengyu Ji , Huazi Cao , Shiyu Zhao

In this paper we present a framework for risk-sensitive model predictive control (MPC) of linear systems affected by stochastic multiplicative uncertainty. Our key innovation is to consider a time-consistent, dynamic risk evaluation of the…

Optimization and Control · Mathematics 2018-04-26 Sumeet Singh , Yin-Lam Chow , Anirudha Majumdar , Marco Pavone

Model Predictive Control (MPC) has shown to be a successful method for many applications that require control. Especially in the presence of prediction uncertainty, various types of MPC offer robust or efficient control system behavior. For…

Systems and Control · Electrical Eng. & Systems 2021-06-17 Tim Brüdigam , Jie Zhan , Dirk Wollherr , Marion Leibold

This paper proposes a finite-horizon optimal control strategy for set-point tracking using a nonlinear model predictive control framework with integrated avoidance capabilities. The formulation employs a smooth point-to-cloud distance…

Systems and Control · Electrical Eng. & Systems 2026-05-05 Brener G. Ferreira , Vinicius M. Gonçalves , Marcelo A. Santos , Guilherme V. Raffo

A core strength of Model Predictive Control (MPC) for quadrupedal locomotion has been its ability to enforce constraints and provide interpretability of the sequence of commands over the horizon. However, despite being able to plan, MPC…

Robotics · Computer Science 2025-04-16 Aditya Shirwatkar , Naman Saxena , Kishore Chandra , Shishir Kolathaya

Proximal Policy Optimization (PPO) is a popular model-free reinforcement learning algorithm, esteemed for its simplicity and efficacy. However, due to its inherent on-policy nature, its proficiency in harnessing data from disparate policies…

Machine Learning · Computer Science 2024-06-07 Yaozhong Gan , Renye Yan , Xiaoyang Tan , Zhe Wu , Junliang Xing

Model-based reinforcement learning approaches carry the promise of being data efficient. However, due to challenges in learning dynamics models that sufficiently match the real-world dynamics, they struggle to achieve the same asymptotic…

Machine Learning · Computer Science 2018-09-17 Ignasi Clavera , Jonas Rothfuss , John Schulman , Yasuhiro Fujita , Tamim Asfour , Pieter Abbeel

The autonomous operation of flexible-wing aircraft is technically challenging and has never been presented within literature. The lack of an exact modeling framework is due to the complex nonlinear aerodynamic relationships governed by the…

Systems and Control · Electrical Eng. & Systems 2021-03-31 Mohammed Abouheaf , Nathaniel Mailhot , Wail Gueaieb , Davide Spinello

We propose a scalable cooperative control approach which coordinates a group of rigidly connected autonomous surface vessels to track desired trajectories in a planar water environment as a single floating modular structure. Our approach…

Robotics · Computer Science 2020-07-27 Wei Wang , Zijian Wang , Luis Mateos , Kuan Wei Huang , Mac Schwager , Carlo Ratti , Daniela Rus

This work presents the coordinated motion control and obstacle-crossing problem for the four wheel-leg independent motor-driven robotic systems via a model predictive control (MPC) approach based on an event-triggering mechanism. The…

Robotics · Computer Science 2021-11-24 Dongchen Liu , Junzheng Wang , Shoukun Wang

A generic data-assisted control architecture within the port-Hamiltonian framework is proposed, introducing a physically meaningful observable that links conservative dynamics to all actuation, dissipation, and disturbance channels. A…

Systems and Control · Electrical Eng. & Systems 2025-09-12 Mostafa Eslami , Maryam Babazadeh

Cloud robotics enables robots to offload high-dimensional motion planning and reasoning to remote servers. However, for continuous manipulation tasks requiring high-frequency control, network latency and jitter can severely destabilize the…

Robotics · Computer Science 2026-03-23 Chanh Nguyen , Shutong Jin , Florian T. Pokorny , Erik Elmroth

Optimal control for switch-based dynamical systems is a challenging problem in the process control literature. In this study, we model these systems as hybrid dynamical systems with finite number of unknown switching points and reformulate…

Optimization and Control · Mathematics 2025-05-28 Saif R. Kazi , Kexin Wang , Lorenz T. Biegler

This paper proposes a stabilising model predictive control (MPC) scheme with preview information of disturbance for nonlinear systems. The proposed MPC algorithm is able to not only reject disturbance by making use of disturbance preview…

Systems and Control · Electrical Eng. & Systems 2022-02-28 Xing Fang , Wen-Hua Chen