English
Related papers

Related papers: VesNet-RL: Simulation-based Reinforcement Learning…

200 papers

Safe reinforcement learning (RL) agents accomplish given tasks while adhering to specific constraints. Employing constraints expressed via easily-understandable human language offers considerable potential for real-world applications due to…

Machine Learning · Computer Science 2024-05-16 Xingzhou Lou , Junge Zhang , Ziyan Wang , Kaiqi Huang , Yali Du

Vision-language navigation (VLN) is the task of navigating an embodied agent to carry out natural language instructions inside real 3D environments. In this paper, we study how to address three critical challenges for this task: the…

Computer Vision and Pattern Recognition · Computer Science 2019-04-09 Xin Wang , Qiuyuan Huang , Asli Celikyilmaz , Jianfeng Gao , Dinghan Shen , Yuan-Fang Wang , William Yang Wang , Lei Zhang

Reinforcement learning (RL) in the real world necessitates the development of procedures that enable agents to explore without causing harm to themselves or others. The most successful solutions to the problem of safe RL leverage offline…

Machine Learning · Computer Science 2025-01-09 Alexander Quessy , Thomas Richardson , Sebastian East

The electromagnetic inverse problem has long been a research hotspot. This study aims to reverse radar view angles in synthetic aperture radar (SAR) images given a target model. Nonetheless, the scarcity of SAR data, combined with the…

Machine Learning · Computer Science 2024-01-03 Yanni Wang , Hecheng Jia , Shilei Fu , Huiping Lin , Feng Xu

Autonomous underwater vehicle (AUV) plays an increasingly important role in ocean exploration. Existing AUVs are usually not fully autonomous and generally limited to pre-planning or pre-programming tasks. Reinforcement learning (RL) and…

Artificial Intelligence · Computer Science 2020-01-13 Qilei Zhang , Jinying Lin , Qixin Sha , Bo He , Guangliang Li

Deep reinforcement learning (DRL) augments the reinforcement learning framework, which learns a sequence of actions that maximizes the expected reward, with the representative power of deep neural networks. Recent works have demonstrated…

Image and Video Processing · Electrical Eng. & Systems 2021-03-10 S. Kevin Zhou , Hoang Ngan Le , Khoa Luu , Hien V. Nguyen , Nicholas Ayache

For deep reinforcement learning (RL) from pixels, learning effective state representations is crucial for achieving high performance. However, in practice, limited experience and high-dimensional inputs prevent effective representation…

Machine Learning · Computer Science 2022-10-11 Tao Yu , Zhizheng Zhang , Cuiling Lan , Yan Lu , Zhibo Chen

We propose a novel deep-learning framework for super-resolution ultrasound images and videos in terms of spatial resolution and line reconstruction. We up-sample the acquired low-resolution image through a vision-based interpolation method;…

Computer Vision and Pattern Recognition · Computer Science 2023-05-03 Simone Cammarasana , Paolo Nicolardi , Giuseppe Patanè

Learning effective representations in image-based environments is crucial for sample efficient Reinforcement Learning (RL). Unfortunately, in RL, representation learning is confounded with the exploratory experience of the agent -- learning…

Machine Learning · Computer Science 2021-07-21 Denis Yarats , Rob Fergus , Alessandro Lazaric , Lerrel Pinto

Cellular-connected unmanned aerial vehicle (UAV) is a promising technology to unlock the full potential of UAVs in the future. However, how to achieve ubiquitous three-dimensional (3D) communication coverage for the UAVs in the sky is a new…

Signal Processing · Electrical Eng. & Systems 2020-03-18 Yong Zeng , Xiaoli Xu , Shi Jin , Rui Zhang

Three-dimensional (3D) ultrasound (US) aims to provide sonographers with the spatial relationships of anatomical structures, playing a crucial role in clinical diagnosis. Recently, deep-learning-based freehand 3D US has made significant…

Image and Video Processing · Electrical Eng. & Systems 2025-06-23 Mingyuan Luo , Xin Yang , Zhongnuo Yan , Yan Cao , Yuanji Zhang , Xindi Hu , Jin Wang , Haoxuan Ding , Wei Han , Litao Sun , Dong Ni

Ultrasound (US) imaging is widely used for biometric measurement and diagnosis of internal organs due to the advantages of being real-time and radiation-free. However, due to inter-operator variations, resulting images highly depend on the…

Robotics · Computer Science 2023-11-30 Zhongliang Jiang , Yuan Bi , Mingchuan Zhou , Ying Hu , Michael Burke , Nassir Navab

Demonstration-guided reinforcement learning (RL) is a promising approach for learning complex behaviors by leveraging both reward feedback and a set of target task demonstrations. Prior approaches for demonstration-guided RL treat every new…

Machine Learning · Computer Science 2021-07-22 Karl Pertsch , Youngwoon Lee , Yue Wu , Joseph J. Lim

The 3D scene graph models spatial relationships between objects, enabling the agent to efficiently navigate in a partially observable environment and predict the location of the target object.This paper proposes an original framework named…

Robotics · Computer Science 2025-06-06 Nikita Oskolkov , Huzhenyu Zhang , Dmitry Makarov , Dmitry Yudin , Aleksandr Panov

Offline reinforcement learning (RL) enables policy optimization using static datasets, avoiding the risks and costs of extensive real-world exploration. However, it struggles with suboptimal offline behaviors and inaccurate value estimation…

Machine Learning · Computer Science 2025-05-20 Minting Pan , Yitao Zheng , Jiajian Li , Yunbo Wang , Xiaokang Yang

3D ultrasound (US) has become prevalent due to its rich spatial and diagnostic information not contained in 2D US. Moreover, 3D US can contain multiple standard planes (SPs) in one shot. Thus, automatically localizing SPs in 3D US has the…

Computer Vision and Pattern Recognition · Computer Science 2021-05-25 Xin Yang , Yuhao Huang , Ruobing Huang , Haoran Dou , Rui Li , Jikuan Qian , Xiaoqiong Huang , Wenlong Shi , Chaoyu Chen , Yuanji Zhang , Haixia Wang , Yi Xiong , Dong Ni

Learning-based approaches, such as reinforcement learning (RL) and imitation learning (IL), have indicated superiority over rule-based approaches in complex urban autonomous driving environments, showing great potential to make intelligent…

Robotics · Computer Science 2022-05-31 Haochen Liu , Zhiyu Huang , Jingda Wu , Chen Lv

Underwater target localization using range-only and single-beacon (ROSB) techniques with autonomous vehicles has been used recently to improve the limitations of more complex methods, such as long baseline and ultra-short baseline systems.…

Robotics · Computer Science 2023-01-18 Ivan Masmitja , Mario Martin , Kakani Katija , Spartacus Gomariz , Joan Navarro

We propose a reinforcement learning (RL) framework for the dynamic selection of the filter parameter in Evolve-Filter (EF) regularization strategies for incompressible turbulent flows. Instead of prescribing the filter radius heuristically,…

Numerical Analysis · Mathematics 2026-03-03 Anna Ivagnes , Maria Strazzullo , Gianluigi Rozza

Reinforcement learning (RL) is promising for complicated stochastic nonlinear control problems. Without using a mathematical model, an optimal controller can be learned from data evaluated by certain performance criteria through…

Systems and Control · Electrical Eng. & Systems 2020-11-16 Minghao Han , Yuan Tian , Lixian Zhang , Jun Wang , Wei Pan