English
Related papers

Related papers: A Multifidelity Sim-to-Real Pipeline for Verifiabl…

200 papers

Many roboticists dream of presenting a robot with a task in the evening and returning the next morning to find the robot capable of solving the task. What is preventing us from achieving this? Sim-to-real reinforcement learning (RL) has…

Robotics · Computer Science 2024-07-24 Younghyo Park , Gabriel B. Margolis , Pulkit Agrawal

Humans commonly solve complex problems by decomposing them into easier subproblems and then combining the subproblem solutions. This type of compositional reasoning permits reuse of the subproblem solutions when tackling future tasks that…

Machine Learning · Computer Science 2022-07-04 Jorge A. Mendez , Harm van Seijen , Eric Eaton

Optimizing a reinforcement learning (RL) policy typically requires extensive interactions with a high-fidelity simulator of the environment, which are often costly or impractical. Offline RL addresses this problem by allowing training from…

Machine Learning · Computer Science 2025-09-19 Houssem Sifaou , Osvaldo Simeone

Deep Reinforcement Learning (DRL) has shown remarkable success in solving complex tasks across various research fields. However, transferring DRL agents to the real world is still challenging due to the significant discrepancies between…

Machine Learning · Computer Science 2024-10-22 Dianzhao Li , Ostap Okhrin

Reinforcement learning (RL) has shown promise in robotics, but deploying RL on real vehicles remains challenging due to the complexity of vehicle dynamics and the mismatch between simulation and reality. Factors such as tire…

Robotics · Computer Science 2025-11-11 Thomas Steinecker , Alexander Bienemann , Denis Trescher , Thorsten Luettel , Mirko Maehlisch

This paper proposes a novel Reinforcement Learning (RL) approach for sim-to-real policy transfer of Vertical Take-Off and Landing Unmanned Aerial Vehicle (VTOL-UAV). The proposed approach is designed for VTOL-UAV landing on offshore docking…

Robotics · Computer Science 2024-08-01 Ali M. Ali , Aryaman Gupta , Hashim A. Hashim

As autonomy becomes prevalent in many applications, ranging from recommendation systems to fully autonomous vehicles, there is an increased need to provide safety guarantees for such systems. The problem is difficult, as these are large,…

Artificial Intelligence · Computer Science 2018-10-22 Corina S. Pasareanu , Divya Gopinath , Huafeng Yu

Navigating fluently around pedestrians is a necessary capability for mobile robots deployed in human environments, such as buildings and homes. While research on social navigation has focused mainly on the scalability with the number of…

In this work, we present a lightweight pipeline for robust behavioral cloning of a human driver using end-to-end imitation learning. The proposed pipeline was employed to train and deploy three distinct driving behavior models onto a…

Robotics · Computer Science 2021-10-19 Tanmay Vilas Samak , Chinmay Vilas Samak , Sivanathan Kandhasamy

Reinforcement Learning (RL) is essentially a trial-and-error learning procedure which may cause unsafe behavior during the exploration-and-exploitation process. This hinders the application of RL to real-world control problems, especially…

Machine Learning · Computer Science 2021-05-03 Yutong Li , Nan Li , H. Eric Tseng , Anouck Girard , Dimitar Filev , Ilya Kolmanovsky

We focus on the problem of reliably training Reinforcement Learning (RL) models (agents) for stable low-level control in embedded systems and test our methods on a high-performance, custom-built quadrotor platform. A common but often…

Robotics · Computer Science 2021-10-14 Siddharth Mysore , Bassel Mabsout , Kate Saenko , Renato Mancuso

Millimeter-wave (mmWave) and terahertz (THz) massive MIMO systems often rely on predefined beamforming codebooks, which are usually suboptimal in Non-Line-of-Sight (NLoS) conditions and for hardware-limited transceivers. Reinforcement…

Information Theory · Computer Science 2026-03-23 Anouar Nechi , Rainer Buchty , Mladen Berekovic , Saleh Mulhem

Robots must integrate multiple sensory modalities to act effectively in the real world. Yet, learning such multimodal policies at scale remains challenging. Simulation offers a viable solution, but while vision has benefited from…

We propose a computationally efficient approach to safe reinforcement learning (RL) for frequency regulation in power systems with high levels of variable renewable energy resources. The approach draws on set-theoretic control techniques to…

Systems and Control · Electrical Eng. & Systems 2022-03-24 Daniel Tabas , Baosen Zhang

As hardware and software systems have grown in complexity, formal methods have been indispensable tools for rigorously specifying acceptable behaviors, synthesizing programs to meet these specifications, and validating the correctness of…

Robotics · Computer Science 2026-02-10 Anastasios Manganaris , Vittorio Giammarino , Ahmed H. Qureshi , Suresh Jagannathan

Many production lines require active control mechanisms, such as adaptive routing, worker reallocation, and rescheduling, to maintain optimal performance. However, designing these control systems is challenging for various reasons, and…

Machine Learning · Computer Science 2025-05-13 Kai Müller , Martin Wenzel , Tobias Windisch

Designing effective embodied multi-agent systems is critical for solving complex real-world tasks across domains. Due to the complexity of multi-agent embodied systems, existing methods fail to automatically generate safe and efficient…

Robotics · Computer Science 2025-03-21 Yiran Qin , Li Kang , Xiufeng Song , Zhenfei Yin , Xiaohong Liu , Xihui Liu , Ruimao Zhang , Lei Bai

The application of reinforcement learning to safety-critical systems is limited by the lack of formal methods for verifying the robustness and safety of learned policies. This paper introduces a novel framework that addresses this gap by…

Artificial Intelligence · Computer Science 2025-08-22 Ahmed Nasir , Abdelhafid Zenati

In robotic vision, a de-facto paradigm is to learn in simulated environments and then transfer to real-world applications, which poses an essential challenge in bridging the sim-to-real domain gap. While mainstream works tackle this problem…

Computer Vision and Pattern Recognition · Computer Science 2024-04-08 Xingyu Liu , Chenyangguang Zhang , Gu Wang , Ruida Zhang , Xiangyang Ji

In some high-precision industrial applications, robots are deployed to perform precision assembly tasks on mass batches of manufactured pegs and holes. If the peg and hole are designed with transition fit, machining errors may lead to…

Robotics · Computer Science 2026-03-11 Bin Wang , Jiwen Zhang , Song Wang , Dan Wu