中文
相关论文

相关论文: Surgical Task Automation Using Actor-Critic Framew…

200 篇论文

Active imitation learning (AIL) combats covariate shift by querying an expert during training. However, expert action labeling often dominates the cost, especially in GPU-intensive simulators, human-in-the-loop settings, and robot fleets…

机器人学 · 计算机科学 2025-12-02 Arad Firouzkouhi , Omid Mirzaeedodangeh , Lars Lindemann

Continual Imitation Learning (CiL) involves extracting and accumulating task knowledge from demonstrations across multiple stages and tasks to achieve a multi-task policy. With recent advancements in foundation models, there has been a…

机器学习 · 计算机科学 2025-01-22 Daehee Lee , Minjong Yoo , Woo Kyung Kim , Wonje Choi , Honguk Woo

Adversarial Imitation Learning (AIL) is a class of popular state-of-the-art Imitation Learning algorithms commonly used in robotics. In AIL, an artificial adversary's misclassification is used as a reward signal that is optimized by any…

机器学习 · 计算机科学 2022-12-01 Ankur Deka , Changliu Liu , Katia Sycara

Automated vehicle control using reinforcement learning (RL) has attracted significant attention due to its potential to learn driving policies through environment interaction. However, RL agents often face training challenges in sample…

机器人学 · 计算机科学 2025-09-08 Zhihao Zhang , Chengyang Peng , Ekim Yurtsever , Keith A. Redmill

Model-free deep reinforcement learning (RL) algorithms have been successfully applied to a range of challenging sequential decision making and control tasks. However, these methods typically suffer from two major challenges: high sample…

While combining imitation learning (IL) and reinforcement learning (RL) is a promising way to address poor sample efficiency in autonomous behavior acquisition, methods that do so typically assume that the requisite behavior demonstrations…

机器学习 · 计算机科学 2025-08-19 Caroline Wang , Garrett Warnell , Peter Stone

Imitation learning (IL) and reinforcement learning (RL) each offer distinct advantages for robotics policy learning: IL provides stable learning from demonstrations, and RL promotes generalization through exploration. While existing robot…

Deep reinforcement learning (DRL) is a promising way to achieve human-like autonomous driving. However, the low sample efficiency and difficulty of designing reward functions for DRL would hinder its applications in practice. In light of…

机器人学 · 计算机科学 2021-10-29 Zhiyu Huang , Jingda Wu , Chen Lv

Despite advancements in robotic-assisted surgery, automating complex tasks like suturing remain challenging due to the need for adaptability and precision. Learning-based approaches, particularly reinforcement learning (RL) and imitation…

机器人学 · 计算机科学 2025-02-12 Jin Wu , Haoying Zhou , Peter Kazanzides , Adnan Munawar , Anqi Liu

Imitation learning (IL) algorithms have shown promising results for robots to learn skills from expert demonstrations. However, they need multi-task demonstrations to be provided at once for acquiring diverse skills, which is difficult in…

机器人学 · 计算机科学 2021-10-19 Chongkai Gao , Haichuan Gao , Shangqi Guo , Tianren Zhang , Feng Chen

Robot-assisted surgical systems have demonstrated significant potential in enhancing surgical precision and minimizing human errors. However, existing systems cannot accommodate individual surgeons' unique preferences and requirements.…

机器人学 · 计算机科学 2024-08-13 Amr Gomaa , Bilal Mahdy , Niko Kleer , Antonio Krüger

Robot Imitation Learning (IL) is a widely used method for training robots to perform manipulation tasks that involve mimicking human demonstrations to acquire skills. However, its practicality has been limited due to its requirement that…

机器人学 · 计算机科学 2024-03-22 Yue Yang , Bryce Ikeda , Gedas Bertasius , Daniel Szafir

In recent years, the development of robotics and artificial intelligence (AI) systems has been nothing short of remarkable. As these systems continue to evolve, they are being utilized in increasingly complex and unstructured environments,…

机器学习 · 计算机科学 2024-10-28 Maryam Zare , Parham M. Kebria , Abbas Khosravi , Saeid Nahavandi

Purpose: This paper focuses on an automated analysis of surgical motion profiles for objective skill assessment and task recognition in robot-assisted surgery. Existing techniques heavily rely on conventional statistic measures or shallow…

计算机视觉与模式识别 · 计算机科学 2019-01-09 Ziheng Wang , Ann Majewicz Fey

Reinforcement learning (RL) provides a naturalistic framing for learning through trial and error, which is appealing both because of its simplicity and effectiveness and because of its resemblance to how humans and animals acquire skills…

机器学习 · 计算机科学 2022-08-09 Archit Sharma , Kelvin Xu , Nikhil Sardana , Abhishek Gupta , Karol Hausman , Sergey Levine , Chelsea Finn

Autonomous surgical execution relieves tedious routines and surgeon's fatigue. Recent learning-based methods, especially reinforcement learning (RL) based methods, achieve promising performance for dexterous manipulation, which usually…

机器人学 · 计算机科学 2021-08-31 Jiaqi Xu , Bin Li , Bo Lu , Yun-Hui Liu , Qi Dou , Pheng-Ann Heng

Multi-Agent Reinforcement Learning (MARL) algorithms are widely adopted in tackling complex tasks that require collaboration and competition among agents in dynamic Multi-Agent Systems (MAS). However, learning such tasks from scratch is…

人工智能 · 计算机科学 2024-02-14 Ayesha Siddika Nipu , Siming Liu , Anthony Harris

Learning visuomotor policies for agile quadrotor flight presents significant difficulties, primarily from inefficient policy exploration caused by high-dimensional visual inputs and the need for precise and low-latency control. To address…

机器人学 · 计算机科学 2024-11-13 Jiaxu Xing , Angel Romero , Leonard Bauersfeld , Davide Scaramuzza

Existing Class Incremental Learning (CIL) methods are based on a supervised classification framework sensitive to data labels. When updating them based on the new class data, they suffer from catastrophic forgetting: the model cannot…

机器学习 · 计算机科学 2021-11-23 Zixuan Ni , Siliang Tang , Yueting Zhuang

Reinforcement learning for multi-goal robot manipulation tasks poses significant challenges due to the diversity and complexity of the goal space. Techniques such as Hindsight Experience Replay (HER) have been introduced to improve learning…

机器人学 · 计算机科学 2025-06-17 Yingyi Kuang , Luis J. Manso , George Vogiatzis