English
Related papers

Related papers: Anatomical Landmark-Guided Deep Reinforcement Lear…

200 papers

In endoscopy, many applications (e.g., surgical navigation) would benefit from a real-time method that can simultaneously track the endoscope and reconstruct the dense 3D geometry of the observed anatomy from a monocular endoscopic video.…

Computer Vision and Pattern Recognition · Computer Science 2022-02-23 Xingtong Liu , Zhaoshuo Li , Masaru Ishii , Gregory D. Hager , Russell H. Taylor , Mathias Unberath

Traditional Wireless Sensor Networks (WSNs) typically rely on pre-analysis of the target area, network size, and sensor coverage to determine initial deployment. This often results in significant overlap to ensure continued network…

Networking and Internet Architecture · Computer Science 2025-08-21 Parham Soltani , Mehrshad Eskandarpour , Sina Heidari , Farnaz Alizadeh , Hossein Soleimani

A reliable, real-time simultaneous localization and mapping (SLAM) method is crucial for the navigation of actively controlled capsule endoscopy robots. These robots are an emerging, minimally invasive diagnostic and therapeutic technology…

Computer Vision and Pattern Recognition · Computer Science 2017-11-07 Mehmet Turan , Yasin Almalioglu , Hunter Gilbert , Helder Araujo , Ender Konukoglu , Metin Sitti

Fluid antenna systems (FAS) enable dynamic antenna positioning, offering new opportunities to enhance integrated sensing and communication (ISAC) performance. However, existing studies primarily focus on communication enhancement or…

Signal Processing · Electrical Eng. & Systems 2025-01-03 Shunxing Yang , Junteng Yao , Jie Tang , Tuo Wu , Maged Elkashlan , Chau Yuen , Merouane Debbah , Hyundong Shin , Matthew Valenti

Deep Reinforcement Learning (DRL) is a viable solution for automating repetitive surgical subtasks due to its ability to learn complex behaviours in a dynamic environment. This task automation could lead to reduced surgeon's cognitive…

Deep reinforcement learning (DRL) has been proven to be a powerful paradigm for learning complex control policy autonomously. Numerous recent applications of DRL in robotic grasping have successfully trained DRL robotic agents end-to-end,…

Robotics · Computer Science 2020-07-03 Zhixin Chen , Mengxiang Lin , Zhixin Jia , Shibo Jian

Deep Reinforcement Learning (DRL) is hugely successful due to the availability of realistic simulated environments. However, performance degradation during simulation to real-world transfer still remains a challenging problem for the…

Robotics · Computer Science 2022-05-20 Kasun Weerakoon , Adarsh Jagan Sathyamoorthy , Dinesh Manocha

In this paper we introduce the first reinforcement learning (RL) based robotic navigation method which utilizes ultrasound (US) images as an input. Our approach combines state-of-the-art RL techniques, specifically deep Q-networks (DQN)…

Reconfigurable intelligent surface (RIS) has recently gained popularity as a promising solution for improving the signal transmission quality of wireless communications with less hardware cost and energy consumption. This letter offers a…

Signal Processing · Electrical Eng. & Systems 2022-05-19 Wangyang Xu , Jiancheng An , Chongwen Huang , Lu Gan , Chau Yuen

Learning-based adaptive control methods hold the premise of enabling autonomous agents to reduce the effect of process variations with minimal human intervention. However, its application to autonomous underwater vehicles (AUVs) has so far…

Autonomous mechanical thrombectomy (MT) presents substantial challenges due to highly variable vascular geometries and the requirements for accurate, real-time control. While reinforcement learning (RL) has emerged as a promising paradigm…

In the last decade, many medical companies and research groups have tried to convert passive capsule endoscopes as an emerging and minimally invasive diagnostic technology into actively steerable endoscopic capsule robots which will provide…

Wireless Capsule Endoscopy (WCE) helps physicians examine the gastrointestinal (GI) tract noninvasively. There are few studies that address pathological assessment of endoscopy images in multiclass classification and most of them are based…

Computer Vision and Pattern Recognition · Computer Science 2021-08-23 Mohammad Reza Mohebbian , Khan A. Wahid , Paul Babyn

Wireless capsule endoscopy (WCE) is fundamentally constrained by limited wireless bandwidth, resulting in low imaging resolution and frame rate, which can cause motion blur and missed lesions. Although adaptive frame-rate schemes have been…

Systems and Control · Electrical Eng. & Systems 2026-01-28 Ziyao Zhou , Zhuoran Sun , Chen Shen , Xinyi Shen , Zhehao Lu , Sikkandar , Hen-Wei Huang

This paper presents the use of Multi-Agent Reinforcement Learning (MARL) to perform navigation in 3D anatomical volumes from medical imaging. We utilize Neural Style Transfer to create synthetic Computed Tomography (CT) agent gym…

Image and Video Processing · Electrical Eng. & Systems 2021-11-08 Cesare Magnetti , Hadrien Reynaud , Bernhard Kainz

Deep reinforcement learning (DRL) algorithms are rapidly making inroads into fluid mechanics, following the remarkable achievements of these techniques in a wide range of science and engineering applications. In this paper, a deep…

Fluid Dynamics · Physics 2020-12-21 M. A. Elhawary

Real-time localization of prostate gland in trans-rectal ultrasound images is a key technology that is required to automate the ultrasound guided prostate biopsy procedures. In this paper, we propose a new deep learning based approach which…

Computer Vision and Pattern Recognition · Computer Science 2018-05-29 Ahmet Tuysuzoglu , Jeremy Tan , Kareem Eissa , Atilla P. Kiraly , Mamadou Diallo , Ali Kamen

This paper proposes an end-to-end deep reinforcement learning approach for mobile robot navigation with dynamic obstacles avoidance. Using experience collected in a simulation environment, a convolutional neural network (CNN) is trained to…

Robotics · Computer Science 2020-02-12 Guangda Chen , Lifan Pan , Yu'an Chen , Pei Xu , Zhiqiang Wang , Peichen Wu , Jianmin Ji , Xiaoping Chen

Active Simultaneous Localization and Mapping (Active SLAM) involves the strategic planning and precise control of a robotic system's movement in order to construct a highly accurate and comprehensive representation of its surrounding…

Robotics · Computer Science 2025-11-19 Yizhen Yin , Yuhua Qi , Dapeng Feng , Hongbo Chen , Hongjun Ma , Jin Wu , Yi Jiang

This paper proposes a realistic modularized framework for controlling autonomous surface vehicles (ASVs) on inland waterways (IWs) based on deep reinforcement learning (DRL). The framework improves operational safety and comprises two…

Systems and Control · Electrical Eng. & Systems 2024-08-22 Martin Waltz , Niklas Paulig , Ostap Okhrin
‹ Prev 1 3 4 5 6 7 10 Next ›