English
Related papers

Related papers: Safe Navigation for Robotic Digestive Endoscopy vi…

200 papers

Proximal policy optimization (PPO) algorithm is a deep reinforcement learning algorithm with outstanding performance, especially in continuous control tasks. But the performance of this method is still affected by its exploration ability.…

Machine Learning · Computer Science 2020-11-12 Junwei Zhang , Zhenghao Zhang , Shuai Han , Shuai Lü

Proximal policy optimization (PPO) is one of the most popular deep reinforcement learning (RL) methods, achieving state-of-the-art performance across a wide range of challenging tasks. However, as a model-free RL method, the success of PPO…

Machine Learning · Computer Science 2019-11-11 Yuhui Wang , Hao He , Xiaoyang Tan , Yaozhong Gan

For many applications of reinforcement learning it can be more convenient to specify both a reward function and constraints, rather than trying to design behavior through the reward function. For example, systems that physically interact…

Machine Learning · Computer Science 2017-05-31 Joshua Achiam , David Held , Aviv Tamar , Pieter Abbeel

Autonomous ultrasound (US) acquisition is an important yet challenging task, as it involves interpretation of the highly complex and variable images and their spatial relationships. In this work, we propose a deep reinforcement learning…

Robotics · Computer Science 2024-10-28 Keyu Li , Jian Wang , Yangxin Xu , Hao Qin , Dongsheng Liu , Li Liu , Max Q. -H. Meng

Deep reinforcement learning (RL) uses model-free techniques to optimize task-specific control policies. Despite having emerged as a promising approach for complex problems, RL is still hard to use reliably for real-world applications. Apart…

Robotics · Computer Science 2020-02-25 Siddhant Gangapurwala , Alexander Mitchell , Ioannis Havoutis

Recently, mobile robots have become important tools in various industries, especially in logistics. Deep reinforcement learning emerged as an alternative planning method to replace overly conservative approaches and promises more efficient…

Robotics · Computer Science 2021-09-27 Linh Kästner , Teham Buiyan , Xinlin Zhao , Lei Jiao , Zhengcheng Shen , Jens Lambrecht

The deployment of humanoid robots in unstructured, human-centric environments requires navigation capabilities that extend beyond simple locomotion to include robust perception, provable safety, and socially aware behavior. Current…

Robotics · Computer Science 2025-08-12 Zifan Wang , Xun Yang , Jianzhuang Zhao , Jiaming Zhou , Teli Ma , Ziyao Gao , Arash Ajoudani , Junwei Liang

Safe autonomous navigation in unknown environments is an important problem for mobile robots. This paper proposes techniques to learn the dynamics model of a mobile robot from trajectory data and synthesize a tracking controller with safety…

Robotics · Computer Science 2022-04-11 Zhichao Li , Thai Duong , Nikolay Atanasov

Seamless loco-manipulation in unstructured environments requires robots to leverage autonomous exploration alongside whole-body control for physical interaction. In this work, we introduce HANDO (Hierarchical Autonomous Navigation and…

Robotics · Computer Science 2025-10-13 Jingyuan Sun , Chaoran Wang , Mingyu Zhang , Cui Miao , Hongyu Ji , Zihan Qu , Han Sun , Bing Wang , Qingyi Si

Micro robotics is quickly emerging to be a promising technological solution to many medical treatments with focus on targeted drug delivery. They are effective when working in swarms whose individual control is mostly infeasible owing to…

Robotics · Computer Science 2023-07-03 Akshatha Jagadish , Manoj Varma

Proximal Policy Optimization (PPO) is a highly popular policy-based deep reinforcement learning (DRL) approach. However, we observe that the homogeneous exploration process in PPO could cause an unexpected stability issue in the training…

Machine Learning · Computer Science 2022-12-14 Qisheng Zhang , Zhen Guo , Audun Jøsang , Lance M. Kaplan , Feng Chen , Dong H. Jeong , Jin-Hee Cho

The navigation of robots in dynamic urban environments, requires elaborated anticipative strategies for the robot to avoid collisions with dynamic objects, like bicycles or pedestrians, and to be human aware. We have developed and analyzed…

Robotics · Computer Science 2022-10-18 Óscar Gil , Alberto Sanfeliu

Reinforcement learning is of increasing importance in the field of robot control and simulation plays a~key role in this process. In the unmanned aerial vehicles (UAVs, drones), there is also an increase in the number of published…

Robotics · Computer Science 2023-07-27 Pawel Miera , Hubert Szolc , Tomasz Kryjak

This paper addresses the challenge of human-guided navigation for mobile collaborative robots under simultaneous proximity regulation and safety constraints. We introduce Adaptive Reinforcement and Model Predictive Control Switching (ARMS),…

Robotics · Computer Science 2026-01-26 Ning Liu , Sen Shen , Zheng Li , Matthew D'Souza , Jen Jen Chung , Thomas Braunl

The challenges to solving the collision avoidance problem lie in adaptively choosing optimal robot velocities in complex scenarios full of interactive obstacles. In this paper, we propose a distributed approach for multi-robot navigation…

Robotics · Computer Science 2022-03-22 Ruihua Han , Shengduo Chen , Shuaijun Wang , Zeqing Zhang , Rui Gao , Qi Hao , Jia Pan

Magnetic adhesion tracked wall-climbing robots face potential risks of overturning during high-altitude operations, making their stability crucial for ensuring safety. This study presents a dynamic feature selection method based on Proximal…

Robotics · Computer Science 2025-03-25 Zhen Ma , He Xu , Jielong Dou , Yi Qin , Xueyu Zhang

Rigid robots were extensively researched, whereas soft robotics remains an underexplored field. Utilizing soft-legged robots in performing tasks as a replacement for human beings is an important stride to take, especially under harsh and…

Objective: This paper describes the development of hybrid artificial intelligence strategies for drone navigation. Methods: The navigation module combines a deep learning model with a rule-based engine depending on the agent state. The deep…

Artificial Intelligence · Computer Science 2025-01-09 Rubén San-Segundo , Lucía Angulo , Manuel Gil-Martín , David Carramiñana , Ana M. Bernardos

Previous studies on automatic berthing systems based on artificial neural network (ANN) showed great berthing performance by training the ANN with ship berthing data as training data. However, because the ANN requires a large amount of…

Machine Learning · Computer Science 2021-12-06 Daesoo Lee

Intelligent navigation among social crowds is an essential aspect of mobile robotics for applications such as delivery, health care, or assistance. Deep Reinforcement Learning emerged as an alternative planning method to conservative…

Robotics · Computer Science 2021-09-24 Linh Kästner , Junhui Li , Zhengcheng Shen , Jens Lambrecht