English
Related papers

Related papers: Vid2Sim: Realistic and Interactive Simulation from…

200 papers

High-resolution optical tactile sensors are increasingly used in robotic learning environments due to their ability to capture large amounts of data directly relating to agent-environment interaction. However, there is a high barrier of…

Robotics · Computer Science 2022-07-28 Yijiong Lin , John Lloyd , Alex Church , Nathan F. Lepora

Simulation offers a promising approach for cheaply scaling training data for generalist policies. To scalably generate data from diverse and realistic tasks, existing algorithms either rely on large language models (LLMs) that may…

Robotics · Computer Science 2025-02-17 Weirui Ye , Fangchen Liu , Zheng Ding , Yang Gao , Oleh Rybkin , Pieter Abbeel

Realizing the potential gains of large-scale MIMO systems requires the accurate estimation of their channels or the fine adjustment of their narrow beams. This, however, is typically associated with high channel acquisition/beam sweeping…

Signal Processing · Electrical Eng. & Systems 2023-01-19 Shuaifeng Jiang , Ahmed Alkhateeb

Modeling and simulation of autonomous vehicles plays a crucial role in achieving enterprise-scale realization that aligns with technical, business and regulatory requirements. Contemporary trends in digital lifecycle treatment have proven…

Robotics · Computer Science 2024-02-23 Chinmay Vilas Samak , Tanmay Vilas Samak

Deep reinforcement learning has recently seen huge success across multiple areas in the robotics domain. Owing to the limitations of gathering real-world data, i.e., sample inefficiency and the cost of collecting it, simulation environments…

Machine Learning · Computer Science 2021-07-09 Wenshuai Zhao , Jorge Peña Queralta , Tomi Westerlund

The future robots are expected to work in a shared physical space with humans [1], however, the presence of humans leads to a dynamic environment that is challenging for mobile robots to navigate. The path planning algorithms designed to…

Robotics · Computer Science 2022-02-09 Prabhjot Kaur , Zichuan Liu , Weisong Shi

We train embodied neural networks to plan and navigate unseen complex 3D environments, emphasising real-world deployment. Rather than requiring prior knowledge of the agent or environment, the planner learns to model the state transitions…

Robotics · Computer Science 2022-06-03 Shu Ishida , João F. Henriques

Virtual testing is a crucial task to ensure safety in autonomous driving, and sensor simulation is an important task in this domain. Most current LiDAR simulations are very simplistic and are mainly used to perform initial tests, while the…

Computer Vision and Pattern Recognition · Computer Science 2022-08-08 Richard Marcus , Niklas Knoop , Bernhard Egger , Marc Stamminger

LiDAR-based perception in intelligent transportation systems (ITS) relies on deep neural networks trained with large-scale labeled datasets. However, creating such datasets is expensive, time-consuming, and labor-intensive, limiting the…

Computer Vision and Pattern Recognition · Computer Science 2025-10-15 Muhammad Shahbaz , Shaurya Agarwal

As robots increasingly enter human-centered environments, they must not only be able to navigate safely around humans, but also adhere to complex social norms. Humans often rely on non-verbal communication through gestures and facial…

Synthetic data and novel rendering techniques have greatly influenced computer vision research in tasks like target tracking and human pose estimation. However, robotics research has lagged behind in leveraging it due to the limitations of…

Robotics · Computer Science 2024-08-23 Elia Bonetto , Chenghao Xu , Aamir Ahmad

Mobile robots have gained increased importance within industrial tasks such as commissioning, delivery or operation in hazardous environments. The ability to autonomously navigate safely especially within dynamic environments, is paramount…

Robotics · Computer Science 2020-08-04 Linh Kästner , Cornelius Marx , Jens Lambrecht

Driving simulators play a large role in developing and testing new intelligent vehicle systems. The visual fidelity of the simulation is critical for building vision-based algorithms and conducting human driver experiments. Low visual…

Computer Vision and Pattern Recognition · Computer Science 2022-07-22 Ekim Yurtsever , Dongfang Yang , Ibrahim Mert Koc , Keith A. Redmill

We present a robot navigation system that uses an imitation learning framework to successfully navigate in complex environments. Our framework takes a pre-built 3D scan of a real environment and trains an agent from pre-generated expert…

Robotics · Computer Science 2020-09-28 David Watkins-Valls , Jingxi Xu , Nicholas Waytowich , Peter Allen

Learning to navigate in dynamic and complex open-world environments is a critical yet challenging capability for autonomous robots. Existing approaches often rely on cascaded modular frameworks, which require extensive hyperparameter tuning…

Robotics · Computer Science 2025-12-25 Wenzhe Cai , Jiaqi Peng , Yuqiang Yang , Yujian Zhang , Meng Wei , Hanqing Wang , Yilun Chen , Tai Wang , Jiangmiao Pang

Recent advances in deep reinforcement learning (RL) based techniques combined with training in simulation have offered a new approach to developing robust controllers for legged robots. However, the application of such approaches to real…

Robotics · Computer Science 2023-08-08 Rohan Pratap Singh , Zhaoming Xie , Pierre Gergondet , Fumio Kanehiro

Autonomous learning of dexterous, long-horizon robotic skills has been a longstanding pursuit of embodied AI. Recent advances in robotic reinforcement learning (RL) have demonstrated remarkable performance and robustness in real-world…

Navigating dynamic urban environments presents significant challenges for embodied agents, requiring advanced spatial reasoning and adherence to common-sense norms. Despite progress, existing visual navigation methods struggle in map-free…

Computer Vision and Pattern Recognition · Computer Science 2025-04-23 Xinhao Liu , Jintong Li , Yicheng Jiang , Niranjan Sujay , Zhicheng Yang , Juexiao Zhang , John Abanes , Jing Zhang , Chen Feng

Underwater robotic surveys can be costly due to the complex working environment and the need for various sensor modalities. While underwater simulators are essential, many existing simulators lack sufficient rendering quality, restricting…

This paper studies the problem of image-goal navigation which involves navigating to the location indicated by a goal image in a novel previously unseen environment. To tackle this problem, we design topological representations for space…

Computer Vision and Pattern Recognition · Computer Science 2020-06-01 Devendra Singh Chaplot , Ruslan Salakhutdinov , Abhinav Gupta , Saurabh Gupta