English
Related papers

Related papers: Redundancy-aware Action Spaces for Robot Learning

200 papers

Extended Reality (XR) provides a more intuitive interaction method for teleoperating robots compared to traditional 2D controls. Recent studies have laid the groundwork for usable teleoperation with XR, but it fails in tasks requiring rapid…

Robotics · Computer Science 2024-09-25 Ziliang Zhang , Cong Liu , Hyoseung Kim

Trajectory generation in confined environment is crucial for wide adoption of intelligent robot manipulators. In this paper, we propose a novel motion planning approach for redundant robot arms that uses a hybrid optimization framework to…

Robotics · Computer Science 2023-04-20 Yifan Sun , Weiye Zhao , Changliu Liu

Controlling robotic manipulators with high-dimensional action spaces for dexterous tasks is a challenging problem. Inspired by human manipulation, researchers have studied generating and using postural synergies for robot hands to…

Robotics · Computer Science 2022-06-30 Zhanpeng He , Matei Ciocarlie

We propose a novel reinforcement learning (RL) design to optimize the charging strategy for autonomous mobile robots in large-scale block stacking warehouses. RL design involves a wide array of choices that can mostly only be evaluated…

Artificial Intelligence · Computer Science 2025-05-19 Janik Bischoff , Alexandru Rinciog , Anne Meyer

Safe and compliant control of dynamic systems in interaction with the environment, e.g., in shared workspaces, continues to represent a major challenge. Mismatches in the dynamic model of the robots, numerical singularities, and the…

Robotics · Computer Science 2023-11-28 Carlo Tiseo , Wolfgang Merkt , Wouter Wolfslag , Sethu Vijayakumar , Michael Mistry

Nowadays, robots are applied in dynamic environments. For a robust operation, the motion planning module must consider other tasks besides reaching a specified pose: (self) collision avoidance, joint limit avoidance, keeping an advantageous…

Robotics · Computer Science 2023-12-19 Jonas Wittmann , Daniel Hornung , Korbinian Griesbauer , Daniel Rixen

The specification of the action space plays a pivotal role in imitation-based robotic manipulation policy learning, fundamentally shaping the optimization landscape of policy learning. While recent advances have focused heavily on scaling…

Robotics · Computer Science 2026-04-24 Yuchun Feng , Jinliang Zheng , Zhihao Wang , Dongxiu Liu , Jianxiong Li , Jiangmiao Pang , Tai Wang , Xianyuan Zhan

Low-cost distributed robots suffer from limited onboard computing power, resulting in excessive computation time when navigating in cluttered environments. This paper presents Edge Accelerated Robot Navigation (EARN), to achieve real-time…

Robotics · Computer Science 2024-06-26 Guoliang Li , Ruihua Han , Shuai Wang , Fei Gao , Yonina C. Eldar , Chengzhong Xu

Intelligent decision-making within large and redundant action spaces remains challenging in deep reinforcement learning. Considering similar but ineffective actions at each step can lead to repetitive and unproductive trials. Existing…

Machine Learning · Computer Science 2025-01-27 Wenzhang Liu , Lianjun Jin , Lu Ren , Chaoxu Mu , Changyin Sun

Robots have limited adaptation ability compared to humans and animals in the case of damage. However, robot damages are prevalent in real-world applications, especially for robots deployed in extreme environments. The fragility of robots…

Robotics · Computer Science 2020-12-01 Fan Yang , Chao Yang , Di Guo , Huaping Liu , Fuchun Sun

While reinforcement learning has achieved considerable successes in recent years, state-of-the-art models are often still limited by the size of state and action spaces. Model-free reinforcement learning approaches use some form of state…

Machine Learning · Computer Science 2021-08-23 Paul J. Pritz , Liang Ma , Kin K. Leung

The combination of deep neural network models and reinforcement learning algorithms can make it possible to learn policies for robotic behaviors that directly read in raw sensory inputs, such as camera images, effectively subsuming both…

Machine Learning · Computer Science 2019-05-17 Avi Singh , Larry Yang , Kristian Hartikainen , Chelsea Finn , Sergey Levine

Robotic tasks, like reaching a pre-grasp configuration, are specified in the end effector space or task space, whereas, robot motion is controlled in joint space. Because of inherent actuation errors in joint space, robots cannot achieve…

Robotics · Computer Science 2019-10-25 Anirban Sinha , Nilanjan Chakraborty

The ABB YuMi is a 7-DOF collaborative robot arm with a complex, redundant kinematic structure. Path planning for the YuMi is challenging, especially with joint limits considered. The redundant degree of freedom is parameterized by the…

Robotics · Computer Science 2025-05-30 Alexander J. Elias , John T. Wen

This paper presents redundancy resolution and disturbance rejection via torque optimization in Hybrid Cable-Driven Robots (HCDRs). To begin with, we initiate a redundant HCDR for nonlinear whole-body system modeling and model reduction.…

Robotics · Computer Science 2024-10-30 Ronghuai Qi , Amir Khajepour , William W. Melek

Learning from Demonstration is increasingly used for transferring operator manipulation skills to robots. In practice, it is important to cater for limited data and imperfect human demonstrations, as well as underlying safety constraints.…

Robotics · Computer Science 2020-04-03 Ya-Yen Tsai , Bo Xiao , Edward Johns , Guang-Zhong Yang

Recent research using Reinforcement Learning (RL) to learn autonomous control for spacecraft operations has shown great success. However, a recent study showed their performance could be improved by changing the action space, i.e. control…

Machine Learning · Computer Science 2025-01-13 Nathaniel Hamilton , Kyle Dunlap , Kerianne L Hobbs

Optimal execution is a sequential decision-making problem for cost-saving in algorithmic trading. Studies have found that reinforcement learning (RL) can help decide the order-splitting sizes. However, a problem remains unsolved: how to…

Trading and Market Microstructure · Quantitative Finance 2022-07-25 Feiyang Pan , Tongzhe Zhang , Ling Luo , Jia He , Shuoling Liu

We present a generalized version of the Saturation in the Null Space (SNS) algorithm for the task control of redundant robots when hard inequality constraints are simultaneously present both in the joint and in the Cartesian space. These…

Robotics · Computer Science 2024-10-28 Amirhossein Kazemipour , Maram Khatib , Khaled Al Khudir , Claudio Gaz , Alessandro De Luca

Skill-based reinforcement learning (RL) has emerged as a promising strategy to leverage prior knowledge for accelerated robot learning. Skills are typically extracted from expert demonstrations and are embedded into a latent space from…

Robotics · Computer Science 2022-11-07 Krishan Rana , Ming Xu , Brendan Tidd , Michael Milford , Niko Sünderhauf