English
Related papers

Related papers: Towards Sim2Real Transfer of Autonomy Algorithms u…

200 papers

We report results obtained and insights gained while answering the following question: how effective is it to use a simulator to establish path following control policies for an autonomous ground robot? While the quality of the simulator…

Simulation-based data synthesis has emerged as a powerful paradigm for advancing real-world robotic manipulation. Yet existing datasets remain insufficient for robust bimanual manipulation due to (1) the lack of scalable task generation…

The simulation of a physical system in a virtual replica, known as a digital twin, is a useful way to interrogate the system non-invasively, providing the ability to perform predictive maintenance and surveillance, and to investigate…

When a mobile robot lacks high onboard computing or networking capabilities, it can rely on remote computing architecture for its control and autonomy. This paper introduces a novel collaborative Simulation Twin (ST) strategy for control…

Robotics · Computer Science 2023-03-14 Nazish Tahir , Ramviyas Parasuraman

For driver observation frameworks, clean datasets collected in controlled simulated environments often serve as the initial training ground. Yet, when deployed under real driving conditions, such simulator-trained models quickly face the…

Computer Vision and Pattern Recognition · Computer Science 2023-08-01 Walter Morales-Alvarez , Novel Certad , Alina Roitberg , Rainer Stiefelhagen , Cristina Olaverri-Monreal

Autonomous ground vehicle (UGV) navigation has the potential to revolutionize the transportation system by increasing accessibility to disabled people, ensure safety and convenience of use. However, UGV requires extensive and efficient…

Robotics · Computer Science 2024-03-25 Kabirat Olayemi , Mien Van , Sean McLoone , Yuzhu Sun , Jack Close , Nguyen Minh Nhat , Stephen McIlvanna

LiDAR-based perception in intelligent transportation systems (ITS) relies on deep neural networks trained with large-scale labeled datasets. However, creating such datasets is expensive, time-consuming, and labor-intensive, limiting the…

Computer Vision and Pattern Recognition · Computer Science 2025-10-15 Muhammad Shahbaz , Shaurya Agarwal

The robotics field is evolving towards data-driven, end-to-end learning, inspired by multimodal large models. However, reliance on expensive real-world data limits progress. Simulators offer cost-effective alternatives, but the gap between…

Robotics · Computer Science 2025-12-23 Hongwei Fan , Hang Dai , Jiyao Zhang , Jinzhou Li , Qiyang Yan , Yujie Zhao , Mingju Gao , Jinghang Wu , Hao Tang , Hao Dong

Autonomous vehicles (AVs) are being rapidly introduced into our lives. However, public misunderstanding and mistrust have become prominent issues hindering the acceptance of these driverless technologies. The primary objective of this study…

Human-Computer Interaction · Computer Science 2023-02-20 Zhijie Qiao , Helen Loeb , Venkata Gurrla , Matt Lebermann , Johannes Betz , Rahul Mangharam

Despite promising progress in reinforcement learning (RL), developing algorithms for autonomous driving (AD) remains challenging: one of the critical issues being the absence of an open-source platform capable of training and effectively…

Machine Learning · Computer Science 2021-11-16 Parth Kothari , Christian Perone , Luca Bergamini , Alexandre Alahi , Peter Ondruska

Simulation can and should play a critical role in the development and testing of algorithms for autonomous agents. What might reduce its impact is the ``sim2real'' gap -- the algorithm response differs between operation in simulated versus…

The use of Digital Twins in the industry has become a growing trend in recent years, allowing to improve the lifecycle of any process by taking advantage of the relationship between the physical and the virtual world. Existing literature…

Computers and Society · Computer Science 2023-09-25 Javier Conde , Andrés Munoz-Arcentales , Álvaro Alonso , Sonsoles López-Pernas , Joaquín Salvachúa

Smart ecosystems are the drivers of modern society. They control infrastructures of socio-techno-economic importance, ensuring their stable and sustainable operation. Smart ecosystems are governed by digital twins -- real-time virtual…

Software Engineering · Computer Science 2024-08-21 Judith Michael , Istvan David , Dominik Bork

Deep Reinforcement Learning has proved to be able to solve many control tasks in different fields, but the behavior of these systems is not always as expected when deployed in real-world scenarios. This is mainly due to the lack of domain…

Robotics · Computer Science 2021-04-29 Alessandro Paolo Capasso , Giulio Bacchiani , Alberto Broggi

Virtual testing is a crucial task to ensure safety in autonomous driving, and sensor simulation is an important task in this domain. Most current LiDAR simulations are very simplistic and are mainly used to perform initial tests, while the…

Computer Vision and Pattern Recognition · Computer Science 2022-08-08 Richard Marcus , Niklas Knoop , Bernhard Egger , Marc Stamminger

Advancements in graphics technology has increased the use of simulated data for training machine learning models. However, the simulated data often differs from real-world data, creating a distribution gap that can decrease the efficacy of…

Computer Vision and Pattern Recognition · Computer Science 2023-03-24 Charles Y Zhang , Ashish Shrivastava

Simulators are indispensable for research in autonomous systems such as self-driving cars, autonomous robots, and drones. Despite significant progress in various simulation aspects, such as graphical realism, an evident gap persists between…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Stefanos Pasios , Nikos Nikolaidis

Existing research on autonomous driving primarily focuses on urban driving, which is insufficient for characterising the complex driving behaviour underlying high-speed racing. At the same time, existing racing simulation frameworks…

Digital twin (DT) systems aim to create virtual replicas of physical objects that are updated in real time with their physical counterparts and evolve alongside the physical assets throughout its lifecycle. Transportation systems are poised…

Computers and Society · Computer Science 2022-12-27 Muhammad Sami Irfan , Sagar Dasgupta , Mizanur Rahman

In order to mitigate the sample complexity of real-world reinforcement learning, common practice is to first train a policy in a simulator where samples are cheap, and then deploy this policy in the real world, with the hope that it…

Machine Learning · Computer Science 2024-10-29 Andrew Wagenmaker , Kevin Huang , Liyiming Ke , Byron Boots , Kevin Jamieson , Abhishek Gupta