English
Related papers

Related papers: Anatomical Landmark-Guided Deep Reinforcement Lear…

200 papers

We present a robust deep learning based 6 degrees-of-freedom (DoF) localization system for endoscopic capsule robots. Our system mainly focuses on localization of endoscopic capsule robots inside the GI tract using only visual information…

Computer Vision and Pattern Recognition · Computer Science 2017-05-17 Mehmet Turan , Yasin Almalioglu , Ender Konukoglu , Metin Sitti

In the gastrointestinal (GI) tract endoscopy field, ingestible wireless capsule endoscopy is considered as a minimally invasive novel diagnostic technology to inspect the entire GI tract and to diagnose various diseases and pathologies.…

Computer Vision and Pattern Recognition · Computer Science 2017-11-27 Mehmet Turan , Yasin Almalioglu , Helder Araujo , Ender Konukoglu , Metin Sitti

Purpose: Autonomous navigation of catheters and guidewires can enhance endovascular surgery safety and efficacy, reducing procedure times and operator radiation exposure. Integrating tele-operated robotics could widen access to…

Machine Learning · Computer Science 2024-06-19 Harry Robertshaw , Lennart Karstensen , Benjamin Jackson , Alejandro Granados , Thomas C. Booth

Deep learning has a great potential for estimating biomarkers in diffusion weighted magnetic resonance imaging (dMRI). Atlases, on the other hand, are a unique tool for modeling the spatio-temporal variability of biomarkers. In this paper,…

Medical Physics · Physics 2022-05-09 Davood Karimi , Ali Gholipour

Despite the increasing adoption of Deep Reinforcement Learning (DRL) for Autonomous Surface Vehicles (ASVs), there still remain challenges limiting real-world deployment. In this paper, we first integrate buoyancy and hydrodynamics models…

Wireless Capsule Endoscope (WCE) is an innovative imaging device that permits physicians to examine all the areas of the Gastrointestinal (GI) tract. It is especially important for the small intestine, where traditional invasive endoscopies…

Computer Vision and Pattern Recognition · Computer Science 2015-04-24 Isabel N. Figueiredo , Carlos Leal , Luís Pinto , Pedro N. Figueiredo , Richard Tsai

This paper presents a Pre-Training Deep Reinforcement Learning(DRL) for avoidance navigation without map for mobile robots which map raw sensor data to control variable and navigate in an unknown environment. The efficient offline training…

Robotics · Computer Science 2023-08-04 Yang Wenkai Ji Ruihang Zhang Yuxiang Lei Hao , Zhao Zijie

Purpose: To accelerate radially sampled diffusion weighted spin-echo (Rad-DW-SE) acquisition method for generating high quality apparent diffusion coefficient (ADC) maps. Methods: A deep learning method was developed to generate accurate…

Image and Video Processing · Electrical Eng. & Systems 2023-08-15 Yuemeng Li , Miguel Romanello Joaquim , Stephen Pickup , Hee Kwon Song , Rong Zhou , Yong Fan

Autonomous visual navigation is an essential element in robot autonomy. Reinforcement learning (RL) offers a promising policy training paradigm. However existing RL methods suffer from high sample complexity, poor sim-to-real transfer, and…

Robotics · Computer Science 2025-07-31 Qianzhong Chen , Jiankai Sun , Naixiang Gao , JunEn Low , Timothy Chen , Mac Schwager

Wireless Capsule Endoscopy (WCE) presented in 2001 as one of the key approaches to observe the entire gastrointestinal (GI) tract, generally the small bowels. It has been used to detect diseases in the gastrointestinal tract. Endoscopic…

Image and Video Processing · Electrical Eng. & Systems 2021-02-12 Rezvan Ezatian , Donya Khaledyan , Kian Jafari , Morteza Heidari , Abolfazl Zargari Khuzani , Najmeh Mashhadi

In this paper, we study the application of DRL algorithms in the context of local navigation problems, in which a robot moves towards a goal location in unknown and cluttered workspaces equipped only with limited-range exteroceptive…

Robotics · Computer Science 2025-06-17 Victor R. F. Miranda , Armando A. Neto , Gustavo M. Freitas , Leonardo A. Mozelli

Reconfigurable Intelligent Surfaces (RIS) are pivotal for next-generation smart radio environments, yet their practical deployment is severely bottlenecked by the intractable computational overhead of Channel State Information (CSI)…

Artificial Intelligence · Computer Science 2026-04-08 Hieu Le , Oguz Bedir , Mostafa Ibrahim , Jian Tao , Sabit Ekin

Autonomous racing without prebuilt maps is a grand challenge for embedded robotics that requires kinodynamic planning from instantaneous sensor data at the acceleration and tire friction limits. Out-Of-Distribution (OOD) generalization to…

A major challenge in modern reinforcement learning (RL) is efficient control of dynamical systems from high-dimensional sensory observations. Learning controllable embedding (LCE) is a promising approach that addresses this challenge by…

Machine Learning · Computer Science 2020-06-25 Brandon Cui , Yinlam Chow , Mohammad Ghavamzadeh

This paper presents a novel deep reinforcement learning (DRL)-based control strategy for achieving precise and robust output voltage regulation in LCC-S resonant converters, specifically designed for wireless power transfer applications.…

Systems and Control · Electrical Eng. & Systems 2025-05-06 Reza Safari , Mohsen Hamzeh , Nima Mahdian Dehkordi

This study introduces TRANS: Terrain-aware Reinforcement learning for Agile Navigation under Social interactions, a deep reinforcement learning (DRL) framework for quadrupedal social navigation over unstructured terrains. Conventional…

Robotics · Computer Science 2026-04-01 Wei Zhu , Irfan Tito Kurniawan , Ye Zhao , Mitsuhiro Hayashibe

The main objective of this paper is to introduce a transfer learning-enhanced deep reinforcement learning (DRL) methodology that is able to optimise the geometry of any airfoil based on concomitant aerodynamic and structural integrity…

Machine Learning · Computer Science 2025-08-04 David Ramos , Lucas Lacasa , Eusebio Valero , Gonzalo Rubio

Purpose: Autonomous systems in mechanical thrombectomy (MT) hold promise for reducing procedure times, minimizing radiation exposure, and enhancing patient safety. However, current reinforcement learning (RL) methods only reach the carotid…

Hybrid reconfigurable intelligent surfaces (HRIS) enhance wireless systems by combining passive reflection with active signal amplification. However, jointly optimizing the transmit beamforming with the HRIS reflection and amplification…

Signal Processing · Electrical Eng. & Systems 2026-04-13 Phuong Nam Tran , Nhan Thanh Nguyen , Markku Juntti

Attitude control of fixed-wing unmanned aerial vehicles (UAVs) is a difficult control problem in part due to uncertain nonlinear dynamics, actuator constraints, and coupled longitudinal and lateral motions. Current state-of-the-art…

Systems and Control · Electrical Eng. & Systems 2023-04-20 Eivind Bøhn , Erlend M. Coates , Dirk Reinhardt , Tor Arne Johansen