English
Related papers

Related papers: LychSim: A Controllable and Interactive Simulation…

200 papers

Simulation engines are widely adopted in robotics. However, they lack either full simulation control, ROS integration, realistic physics, or photorealism. Recently, synthetic data generation and realistic rendering has advanced tasks like…

Robotics · Computer Science 2023-05-29 Elia Bonetto , Chenghao Xu , Aamir Ahmad

One core aspect of immersive visualization labs is to develop and provide powerful tools and applications that allow for efficient analysis and exploration of scientific data. As the requirements for such applications are often diverse and…

Human-Computer Interaction · Computer Science 2024-11-05 Marcel Krüger , David Gilbert , Torsten Wolfgang Kuhlen , Tim Gerrits

Simulation stands as a cornerstone for safe and efficient autonomous driving development. At its core a simulation system ought to produce realistic, reactive, and controllable traffic patterns. In this paper, we propose ProSim, a…

Computer Vision and Pattern Recognition · Computer Science 2024-09-10 Shuhan Tan , Boris Ivanovic , Yuxiao Chen , Boyi Li , Xinshuo Weng , Yulong Cao , Philipp Krähenbühl , Marco Pavone

We tackle the problem of producing realistic simulations of LiDAR point clouds, the sensor of preference for most self-driving vehicles. We argue that, by leveraging real data, we can simulate the complex world more realistically compared…

Computer Vision and Pattern Recognition · Computer Science 2020-06-17 Sivabalan Manivasagam , Shenlong Wang , Kelvin Wong , Wenyuan Zeng , Mikita Sazanovich , Shuhan Tan , Bin Yang , Wei-Chiu Ma , Raquel Urtasun

We introduce DiffPhysCam, a differentiable camera simulator designed to support robotics and embodied AI applications by enabling gradient-based optimization in visual perception pipelines. Generating synthetic images that closely mimic…

Graphics · Computer Science 2025-08-13 Bo-Hsun Chen , Nevindu M. Batagoda , Dan Negrut

Simulation is pivotal in evaluating the performance of autonomous driving systems due to the advantages of high efficiency and low cost compared to on-road testing. Bridging the gap between simulation and the real world requires realistic…

Robotics · Computer Science 2025-06-17 Haojie Xin , Xiaodong Zhang , Renzhi Tang , Songyang Yan , Qianrui Zhao , Chunze Yang , Wen Cui , Zijiang Yang

Unmanned Aerial Vehicle (UAV) swarms offer versatile applications in logistics, agriculture, and surveillance, yet controlling them requires expert knowledge for safety and feasibility. Traditional static methods limit adaptability, while…

Robotics · Computer Science 2026-02-03 Aditya Shibu , Marah Saleh , Mohamed Al-Musleh , Nidhal Abdulaziz

Existing evaluation paradigms for Autonomous Vehicles (AVs) face critical limitations. Real-world evaluation is often challenging due to safety concerns and a lack of reproducibility, whereas closed-loop simulation can face insufficient…

Realistic simulation is key to enabling safe and scalable development of % self-driving vehicles. A core component is simulating the sensors so that the entire autonomy system can be tested in simulation. Sensor simulation involves modeling…

Computer Vision and Pattern Recognition · Computer Science 2023-11-03 Jingkang Wang , Sivabalan Manivasagam , Yun Chen , Ze Yang , Ioan Andrei Bârsan , Anqi Joyce Yang , Wei-Chiu Ma , Raquel Urtasun

Generative models trained on internet data have revolutionized how text, image, and video content can be created. Perhaps the next milestone for generative models is to simulate realistic experience in response to actions taken by humans,…

Artificial Intelligence · Computer Science 2024-09-27 Sherry Yang , Yilun Du , Kamyar Ghasemipour , Jonathan Tompson , Leslie Kaelbling , Dale Schuurmans , Pieter Abbeel

In this work, we introduce \textbf{XSIM}, a sensor simulation framework for autonomous driving. XSIM extends 3DGUT splatting with a generalized rolling-shutter modeling tailored for autonomous driving applications. Our framework provides a…

Computer Vision and Pattern Recognition · Computer Science 2026-02-06 Nikolay Patakin , Arsenii Shirokov , Anton Konushin , Dmitry Senushkin

Vision-aided wireless sensing is emerging as a cornerstone of 6G mobile computing. While data-driven approaches have advanced rapidly, establishing a precise geometric correspondence between ego-centric visual data and radio propagation…

Signal Processing · Electrical Eng. & Systems 2026-01-28 Yingzhe Mao , Chao Zou , Yanqun Tang

Pretraining robust vision or multimodal foundation models (e.g., CLIP) relies on large-scale datasets that may be noisy, potentially misaligned, and have long-tail distributions. Previous works have shown promising results in augmenting…

Computer Vision and Pattern Recognition · Computer Science 2024-10-17 Qingqing Cao , Mahyar Najibi , Sachin Mehta

Robotic applications involving people often require advanced perception systems to better understand complex real-world scenarios. To address this challenge, photo-realistic and physics simulators are gaining popularity as a means of…

User simulation is a valuable methodology for evaluation in Information Retrieval (IR), enabling low-cost experimentation and counterfactual analysis. However, existing simulation frameworks are primarily code-centric libraries that require…

Information Retrieval · Computer Science 2026-04-28 Saber Zerhoudi , Adam Roegiest , Michael Granitzer

Simulators are an essential tool for behavioural and interaction research on driving, due to the safety, cost, and experimental control issues of on-road driving experiments. The most advanced simulators use expensive 360 degree projections…

Human-Computer Interaction · Computer Science 2022-01-10 Gustavo Silvera , Abhijat Biswas , Henny Admoni

To enable robots to comprehend high-level human instructions and perform complex tasks, a key challenge lies in achieving comprehensive scene understanding: interpreting and interacting with the 3D environment in a meaningful way. This…

Multi-objective optimization is now a core paradigm in engineering design and scientific discovery. Yet mainstream evolutionary frameworks, including \textit{pymoo}, still depend on imperative coding for problem definition, algorithm…

Software Engineering · Computer Science 2026-03-03 Thiago Santos , Sebastiao Xavier , Luiz Gustavo de Oliveira Carneiro , Gustavo de Souza

In unmanned aerial vehicle (UAV) networks, communication protocols and algorithms are essential for cooperation and collaboration between UAVs. Simulation provides a cost-effective solution for prototyping, debugging, and analyzing…

Networking and Internet Architecture · Computer Science 2025-07-15 Zihao Zhou , Zipeng Dai , Linyi Huang , Cui Yang , Youjun Xiang , Jie Tang , Kai-kit Wong

Realistic simulation is critical for applications ranging from robotics to animation. Learned simulators have emerged as a possibility to capture real world physics directly from video data, but very often require privileged information…

Graphics · Computer Science 2025-08-12 Mikel Zhobro , Andreas René Geist , Georg Martius