English
Related papers

Related papers: VesNet-RL: Simulation-based Reinforcement Learning…

200 papers

There is an increasing demand for using Unmanned Aerial Vehicle (UAV), known as drones, in different applications such as packages delivery, traffic monitoring, search and rescue operations, and military combat engagements. In all of these…

Robotics · Computer Science 2022-08-29 Fadi AlMahamid , Katarina Grolinger

3D ultrasound (US) is widely used due to its rich diagnostic information, portability and low cost. Automated standard plane (SP) localization in US volume not only improves efficiency and reduces user-dependence, but also boosts 3D US…

Computer Vision and Pattern Recognition · Computer Science 2020-07-31 Yuhao Huang , Xin Yang , Rui Li , Jikuan Qian , Xiaoqiong Huang , Wenlong Shi , Haoran Dou , Chaoyu Chen , Yuanji Zhang , Huanjia Luo , Alejandro Frangi , Yi Xiong , Dong Ni

Bees are among the master navigators of the insect world. Despite impressive advances in robot navigation research, the performance of these insects is still unrivaled by any artificial system in terms of training efficiency and…

Neurons and Cognition · Quantitative Biology 2024-07-25 Stephan Lochner , Daniel Honerkamp , Abhinav Valada , Andrew D. Straw

Autonomous navigation of Unmanned Surface Vehicles (USVs) that is safe and compliant with the International Regulations for Preventing Collisions at Sea (COLREGs) remains a formidable challenge in dynamic maritime environments, particularly…

Robotics · Computer Science 2026-05-29 Yuhang Zhang , Shuqi Chai , Yukang Zhang , Liusha Yang , Mingchuan Zhang , Wei Wang , Qingjiang Shi , Quanbo Ge

To enhance the cross-target and cross-scene generalization of target-driven visual navigation based on deep reinforcement learning (RL), we introduce an information-theoretic regularization term into the RL objective. The regularization…

Robotics · Computer Science 2022-05-10 Qiaoyun Wu , Kai Xu , Jun Wang , Mingliang Xu , Xiaoxi Gong , Dinesh Manocha

We investigate the feasibility of deploying reinforcement learning (RL) policies for constrained crowd navigation using a low-fidelity simulator. We introduce a representation of the dynamic environment, separating human and obstacle…

Robotics · Computer Science 2024-05-29 Shuijing Liu , Kaiwen Hong , Neeloy Chakraborty , Katherine Driggs-Campbell

Training robots to perform complex control tasks from high-dimensional pixel input using reinforcement learning (RL) is sample-inefficient, because image observations are comprised primarily of task-irrelevant information. By contrast,…

Robotics · Computer Science 2024-10-22 Anthony Liang , Jesse Thomason , Erdem Bıyık

Navigating the ultrasound (US) probe to the standardized imaging plane (SIP) for image acquisition is a critical but operator-dependent task in conventional freehand diagnostic US. Robotic US systems (RUSS) offer the potential to enhance…

Robotics · Computer Science 2024-12-11 Xihan Ma , Mingjie Zeng , Jeffrey C. Hill , Beatrice Hoffmann , Ziming Zhang , Haichong K. Zhang

Ultrasound (US) imaging is one of the most commonly used non-invasive imaging techniques. However, US image acquisition requires simultaneous guidance of the transducer and interpretation of images, which is a highly challenging task that…

Computer Vision and Pattern Recognition · Computer Science 2020-07-14 Simona Treivase , Alberto Gomez , Jacqueline Matthew , Emily Skelton , Julia A. Schnabel , Nicolas Toussaint

The study of vision-and-language navigation (VLN) has typically relied on expert trajectories, which may not always be available in real-world situations due to the significant effort required to collect them. On the other hand, existing…

Computer Vision and Pattern Recognition · Computer Science 2024-03-28 Valay Bundele , Mahesh Bhupati , Biplab Banerjee , Aditya Grover

Most prior methods for learning navigation policies require access to simulation environments, as they need online policy interaction and rely on ground-truth maps for rewards. However, building simulators is expensive (requires manual…

Computer Vision and Pattern Recognition · Computer Science 2021-10-25 Meera Hahn , Devendra Chaplot , Shubham Tulsiani , Mustafa Mukadam , James M. Rehg , Abhinav Gupta

Most deep neural networks (DNNs) based ultrasound (US) medical image analysis models use pretrained backbones (e.g., ImageNet) for better model generalization. However, the domain gap between natural and medical images causes an inevitable…

Computer Vision and Pattern Recognition · Computer Science 2021-09-03 Yixiong Chen , Chunhui Zhang , Li Liu , Cheng Feng , Changfeng Dong , Yongfang Luo , Xiang Wan

A cognitive beamforming algorithm for colocated MIMO radars, based on Reinforcement Learning (RL) framework, is proposed. We analyse an RL-based optimization protocol that allows the MIMO radar, i.e. the \textit{agent}, to iteratively sense…

Signal Processing · Electrical Eng. & Systems 2018-11-07 Li Wang , Stefano Fortunati , Maria Sabrina Greco , Fulvio Gini

Intelligent video summarization algorithms allow to quickly convey the most relevant information in videos through the identification of the most essential and explanatory content while removing redundant video frames. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2022-02-16 Tianrui Liu , Qingjie Meng , Jun-Jie Huang , Athanasios Vlontzos , Daniel Rueckert , Bernhard Kainz

Ensuring safe decision-making in autonomous vehicles remains a fundamental challenge despite rapid advances in end-to-end learning approaches. Traditional reinforcement learning (RL) methods rely on manually engineered rewards or sparse…

Robotics · Computer Science 2026-03-20 Zilin Huang , Zihao Sheng , Zhengyang Wan , Yansong Qu , Junwei You , Sicong Jiang , Sikai Chen

The growing need for autonomous on-orbit services such as inspection, maintenance, and situational awareness calls for intelligent spacecraft capable of complex maneuvers around large orbital targets. Traditional control systems often fall…

Robotics · Computer Science 2025-10-28 Matteo El-Hariry , Andrej Orsula , Matthieu Geist , Miguel Olivares-Mendez

Safe navigation is essential for autonomous systems operating in hazardous environments. Traditional planning methods excel at long-horizon tasks but rely on a predefined graph with fixed distance metrics. In contrast, safe Reinforcement…

Robotics · Computer Science 2025-09-12 Meng Feng , Viraj Parimi , Brian Williams

Autonomous navigation of Unmanned Surface Vehicles (USV) in marine environments with current flows is challenging, and few prior works have addressed the sensorbased navigation problem in such environments under no prior knowledge of the…

Robotics · Computer Science 2023-08-01 Xi Lin , John McConnell , Brendan Englot

In order for autonomous mobile robots to navigate in human spaces, they must abide by our social norms. Reinforcement learning (RL) has emerged as an effective method to train sequential decision-making policies that are able to respect…

Robotics · Computer Science 2024-03-01 Adam Sigal , Hsiu-Chin Lin , AJung Moon

We present Revel, a partially neural reinforcement learning (RL) framework for provably safe exploration in continuous state and action spaces. A key challenge for provably safe deep RL is that repeatedly verifying neural networks within a…

Machine Learning · Computer Science 2020-10-27 Greg Anderson , Abhinav Verma , Isil Dillig , Swarat Chaudhuri