English
Related papers

Related papers: Reference-Augmented Learning for Precise Tracking …

200 papers

Real-world quadruped navigation is constrained by a scale mismatch between high-level navigation decisions and low-level gait execution, as well as by instabilities under out-of-distribution environmental changes. Such variations challenge…

Robotics · Computer Science 2026-03-09 Sijia Li , Haoyu Wang , Shenghai Yuan , Yizhuo Yang , Thien-Minh Nguyen

The symmetry of dynamical systems can be exploited for state-transition prediction and to facilitate control policy optimization. This paper leverages system symmetry to develop sample-efficient offline reinforcement learning (RL)…

Machine Learning · Computer Science 2026-05-06 Yifei Li , Erik-Jan van Kampen

Tracking controllers enable robotic systems to accurately follow planned reference trajectories. In particular, reinforcement learning (RL) has shown promise in the synthesis of controllers for systems with complex dynamics and modest…

Robotics · Computer Science 2025-05-05 Jake Welde , Nishanth Rao , Pratik Kunapuli , Dinesh Jayaraman , Vijay Kumar

Reinforcement learning (RL) can be formulated as a sequence modeling problem, where models predict future actions based on historical state-action-reward sequences. Current approaches typically require long trajectory sequences to model the…

Machine Learning · Computer Science 2024-12-23 Hemant Kumawat , Saibal Mukhopadhyay

On-policy imitation learning algorithms such as DAgger evolve a robot control policy by executing it, measuring performance (loss), obtaining corrective feedback from a supervisor, and generating the next policy. As the loss between…

Robotics · Computer Science 2019-07-10 Jonathan N. Lee , Michael Laskey , Ajay Kumar Tanwani , Anil Aswani , Ken Goldberg

Deep reinforcement learning (DRL), acting as a novel and powerful paradigm for quantum optimal control, offers transformative opportunities for advancing neutral-atom quantum computing. In this work, we theoretically demonstrate a DRL-based…

Quantum Physics · Physics 2026-05-07 Yue Cai , Hanlin Zhang , Keye Zhang , Jing Qian

We propose a deep reinforcement learning (DRL) methodology for the tracking, obstacle avoidance, and formation control of nonholonomic robots. By separating vision-based control into a perception module and a controller module, we can train…

Robotics · Computer Science 2019-11-19 Yanlin Zhou , Fan Lu , George Pu , Xiyao Ma , Runhan Sun , Hsi-Yuan Chen , Xiaolin Li , Dapeng Wu

In task-based inverse dynamics control, reference accelerations used to follow a desired plan can be broken down into feedforward and feedback trajectories. The feedback term accounts for tracking errors that are caused from inaccurate…

Robotics · Computer Science 2021-06-30 Andrej Gams , Sean A. Mason , Aleš Ude , Stefan Schaal , Ludovic Righetti

To avoid complex constraints of the traditional nonlinear method for tethered space robot (TSR) deployment, this paper proposes a data-driven optimal control framework with an improved deep learning based Koopman operator that could be…

Systems and Control · Electrical Eng. & Systems 2024-10-22 Ao Jin , Fan Zhang , Panfeng Huang

Lane-change maneuvers are commonly executed by drivers to follow a certain routing plan, overtake a slower vehicle, adapt to a merging lane ahead, etc. However, improper lane change behaviors can be a major cause of traffic flow disruptions…

Machine Learning · Computer Science 2020-05-22 Fei Ye , Xuxin Cheng , Pin Wang , Ching-Yao Chan , Jiucai Zhang

Voxel-grid reinforcement learning is widely adopted for path planning in redundant manipulators due to its simplicity and reproducibility. However, direct execution through point-wise numerical inverse kinematics on 7-DoF arms often yields…

Robotics · Computer Science 2026-04-30 Teng Yan , Yue Yu , Yihan Liu , Bingzhuo Zhong

The autonomous control of flippers plays an important role in enhancing the intelligent operation of tracked robots within complex environments. While existing methods mainly rely on hand-crafted control models, in this paper, we introduce…

Robotics · Computer Science 2023-06-21 Hainan Pan , Bailiang Chen , Kaihong Huang , Junkai Ren , Xieyuanli Chen , Huimin Lu

This paper presents a nonlinear control design for highly underactuated balance robots, which possess more numbers of unactuated degree-of-freedom (DOF) than actuated ones. To address the challenge of simultaneously trajectory tracking of…

Robotics · Computer Science 2023-10-03 Feng Han , Jingang Yi

This paper presents a novel trajectory tracker for autonomous quadrotor navigation in dynamic and complex environments. The proposed framework integrates a distributional Reinforcement Learning (RL) estimator for unknown aerodynamic effects…

Systems and Control · Electrical Eng. & Systems 2023-01-02 Yanran Wang , James O'Keeffe , Qiuchen Qian , David Boyle

Although acrobatic flight control has been studied extensively, one key limitation of the existing methods is that they are usually restricted to specific maneuver tasks and cannot change flight pattern parameters online. In this work, we…

Robotics · Computer Science 2026-05-18 Zikang Yin , Canlun Zheng , Shiliang Guo , Zhikun Wang , Shiyu Zhao

As a strategy to reduce travel delay and enhance energy efficiency, platooning of connected and autonomous vehicles (CAVs) at non-signalized intersections has become increasingly popular in academia. However, few studies have attempted to…

Machine Learning · Computer Science 2022-06-28 Duowei Li , Jianping Wu , Feng Zhu , Tianyi Chen , Yiik Diew Wong

Although deep reinforcement learning (DRL) has shown promising results for autonomous navigation in interactive traffic scenarios, existing work typically adopts a fixed behavior policy to control social vehicles in the training…

Robotics · Computer Science 2023-07-20 Kanghoon Lee , Jiachen Li , David Isele , Jinkyoo Park , Kikuo Fujimura , Mykel J. Kochenderfer

Robots which make use of soft or compliant inter- actions often leverage tendon-driven actuation which enables actuators to be placed more flexibly, and compliance to be maintained. However, controlling complex tendon systems is…

Robotics · Computer Science 2026-03-05 Valentin Yuryev , Josie Hughes

Quadruped robots have strong adaptability to extreme environments but may also experience faults. Once these faults occur, robots must be repaired before returning to the task, reducing their practical feasibility. One prevalent concern…

Robotics · Computer Science 2024-01-01 Xinyuan Wu , Wentao Dong , Hang Lai , Yong Yu , Ying Wen

In this paper, the tracking control problem of a class of Euler-Lagrange systems subjected to unknown uncertainties is addressed and an adaptive-robust control strategy, christened as Time-Delayed Adaptive Robust Control (TARC) is…

Systems and Control · Computer Science 2018-05-10 Spandan Roy , Indra Narayan Kar