English
Related papers

Related papers: Anatomical Landmark-Guided Deep Reinforcement Lear…

200 papers

The Pickup and Delivery Problem (PDP) is a fundamental and challenging variant of the Vehicle Routing Problem, characterized by tightly coupled pickup--delivery pairs, precedence constraints, and spatial layouts that often exhibit…

Machine Learning · Computer Science 2026-03-12 Wentao Wang , Lifeng Han , Guangyu Zou

Flow control is key to maximize energy efficiency in a wide range of applications. However, traditional flow-control methods face significant challenges in addressing non-linear systems and high-dimensional data, limiting their application…

Machine Learning · Computer Science 2024-10-28 Joongoo Jeon , Jean Rabault , Joel Vasanth , Francisco Alcántara-Ávila , Shilaj Baral , Ricardo Vinuesa

Wireless capsule endoscopy (WCE) is an effective mean for diagnosis of gastrointestinal disorders. Detection of informative scenes in WCE video could reduce the length of transmitted videos and help the diagnosis procedure. In this paper,…

Computer Vision and Pattern Recognition · Computer Science 2018-08-24 Mohsen Hajabdollahi , Reza Esfandiarpoor , Pejman Khadivi , S. M. Reza Soroushmehr , Nader Karimi , Kayvan Najarian , Shadrokh Samavi

Purpose : Because functional MRI (fMRI) data sets are in general small, we sought a data efficient approach to resting state fMRI classification of autism spectrum disorder (ASD) versus neurotypical (NT) controls. We hypothesized that a…

Neurons and Cognition · Quantitative Biology 2022-06-23 Joseph Stember , Danielle Stember , Luca Pasquini , Jenabi Merhnaz , Andrei Holodny , Hrithwik Shalu

Reinforcement learning for training end-to-end autonomous driving models in closed-loop simulations is gaining growing attention. However, most simulation environments differ significantly from real-world conditions, creating a substantial…

Computer Vision and Pattern Recognition · Computer Science 2025-08-22 Chaojun Ni , Guosheng Zhao , Xiaofeng Wang , Zheng Zhu , Wenkang Qin , Xinze Chen , Guanghong Jia , Guan Huang , Wenjun Mei

Engineering electron correlations in quantum dot arrays demands navigation of high-dimensional, non-convex parameter spaces where hole doping fundamentally alters the physics. We present a comparative study of two control paradigms for the…

Strongly Correlated Electrons · Physics 2025-12-09 Shivanshu Dwivedi , Kalum Palandage

Purpose: The treatment of cardiovascular diseases requires complex and challenging navigation of a guidewire and catheter. This often leads to lengthy interventions during which the patient and clinician are exposed to X-ray radiation. Deep…

Machine Learning · Computer Science 2024-03-06 Valentina Scarponi , Michel Duprez , Florent Nageotte , Stéphane Cotin

Deep reinforcement learning (DRL) has exhibited considerable promise in the training of control agents for mapless robot navigation. However, DRL-trained agents are limited to the specific robot dimensions used during training, hindering…

Robotics · Computer Science 2024-10-30 Wei Zhang , Yunfeng Zhang , Ning Liu , Kai Ren

Although deep reinforcement learning (DRL) algorithms have made important achievements in many control tasks, they still suffer from the problems of sample inefficiency and unstable training process, which are usually caused by sparse…

Robotics · Computer Science 2020-02-28 Ke Lin , Liang Gong , Xudong Li , Te Sun , Binhao Chen , Chengliang Liu , Zhengfeng Zhang , Jian Pu , Junping Zhang

This paper presents a hierarchical decision-making framework for autonomous navigation in four-wheel independent steering and driving (4WISD) systems. The proposed approach integrates deep reinforcement learning (DRL) for high-level…

Robotics · Computer Science 2025-08-25 Yizhi Wang , Degang Xu , Yongfang Xie , Shuzhong Tan , Xianan Zhou , Peng Chen

This paper proposes a novel Reinforcement Learning (RL) approach for sim-to-real policy transfer of Vertical Take-Off and Landing Unmanned Aerial Vehicle (VTOL-UAV). The proposed approach is designed for VTOL-UAV landing on offshore docking…

Robotics · Computer Science 2024-08-01 Ali M. Ali , Aryaman Gupta , Hashim A. Hashim

Ultrasound (US) is one of the most common medical imaging modalities since it is radiation-free, low-cost, and real-time. In freehand US examinations, sonographers often navigate a US probe to visualize standard examination planes with rich…

Image and Video Processing · Electrical Eng. & Systems 2022-05-16 Yuan Bi , Zhongliang Jiang , Yuan Gao , Thomas Wendler , Angelos Karlas , Nassir Navab

Path planning and optimization for unmanned aerial vehicles (UAVs)-assisted next-generation wireless networks is critical for mobility management and ensuring UAV safety and ubiquitous connectivity, especially in dense urban environments…

Networking and Internet Architecture · Computer Science 2025-04-04 Achilles Kiwanuka Machumilane , Alberto Gotta , Pietro Cassarà

Precise camera tracking, high-fidelity 3D tissue reconstruction, and real-time online visualization are critical for intrabody medical imaging devices such as endoscopes and capsule robots. However, existing SLAM (Simultaneous Localization…

Computer Vision and Pattern Recognition · Computer Science 2024-03-25 Kailing Wang , Chen Yang , Yuehao Wang , Sikuang Li , Yan Wang , Qi Dou , Xiaokang Yang , Wei Shen

Lane change decision-making for autonomous vehicles is a complex but high-reward behavior. In this paper, we propose a hybrid input based deep reinforcement learning (DRL) algorithm, which realizes abstract lane change decisions and lane…

Robotics · Computer Science 2025-09-03 Ziteng Gao , Jiaqi Qu , Chaoyu Chen

We present a novel Deep Reinforcement Learning (DRL) based policy to compute dynamically feasible and spatially aware velocities for a robot navigating among mobile obstacles. Our approach combines the benefits of the Dynamic Window…

Robotics · Computer Science 2020-11-30 Utsav Patel , Nithish Kumar , Adarsh Jagan Sathyamoorthy , Dinesh Manocha

This paper introduces novel deep reinforcement learning (Deep-RL) techniques using parallel distributional actor-critic networks for navigating terrestrial mobile robots. Our approaches use laser range findings, relative distance, and angle…

The uplink of 5G networks allows selecting the transmit waveform between cyclic prefix orthogonal frequency division multiplexing (CP-OFDM) and discrete Fourier transform spread OFDM (DFT-S-OFDM), which is appealing for cell-edge users…

Indirect simultaneous positioning (ISP), where internal tissue points are placed at desired locations indirectly through the manipulation of boundary points, is a type of subtask frequently performed in robotic surgeries. Although…

Robotics · Computer Science 2023-06-27 Yafei Ou , Mahdi Tavakoli

This paper proposes a deep reinforcement learning (DRL)-based event-triggered controller design for networked artificial pancreas (AP) systems. Although existing DRL-based AP controllers typically assume periodic control updates, networked…

Systems and Control · Electrical Eng. & Systems 2026-05-18 Junya Ikemoto , Satoshi Maruyama , Kazumune Hashimoto