English
Related papers

Related papers: Perception Imitation: Towards Synthesis-free Simul…

200 papers

Imitation learning is an effective approach for autonomous systems to acquire control policies when an explicit reward function is unavailable, using supervision provided as demonstrations from an expert, typically a human operator.…

Machine Learning · Computer Science 2018-06-20 YuXuan Liu , Abhishek Gupta , Pieter Abbeel , Sergey Levine

While automated driving technology has achieved a tremendous progress, the scalable and rigorous testing and verification of safe automated and autonomous driving vehicles remain challenging. This paper proposes a learning-based…

Robotics · Computer Science 2021-01-27 Andrea Favrin , Vladislav Nenchev , Angelo Cenedese

We describe a shared control methodology that can, without knowledge of the task, be used to improve a human's control of a dynamic system, be used as a training mechanism, and be used in conjunction with Imitation Learning to generate…

Robotics · Computer Science 2019-05-28 Alexander Broad , Todd Murphey , Brenna Argall

Recent advancements in computer graphics technology allow more realistic ren-dering of car driving environments. They have enabled self-driving car simulators such as DeepGTA-V and CARLA (Car Learning to Act) to generate large amounts of…

Computer Vision and Pattern Recognition · Computer Science 2022-07-04 Minh Cao , Ramin Ramezani

With the increasing safety validation requirements for the release of a self-driving car, alternative approaches, such as simulation-based testing, are emerging in addition to conventional real-world testing. In order to rely on virtual…

Robotics · Computer Science 2021-06-22 Anthony Ngo , Max Paul Bauer , Michael Resch

In this work, we present a simple end-to-end trainable machine learning system capable of realistically simulating driving experiences. This can be used for the verification of self-driving system performance without relying on expensive…

As perception models continue to develop, the need for large-scale datasets increases. However, data annotation remains far too expensive to effectively scale and meet the demand. Synthetic datasets provide a solution to boost model…

Computer Vision and Pattern Recognition · Computer Science 2025-06-23 Arpit Jadon , Haoran Wang , Phillip Thomas , Michael Stanley , S. Nathaniel Cibik , Rachel Laurat , Omar Maher , Lukas Hoyer , Ozan Unal , Dengxin Dai

Motivated by vision-based control of autonomous vehicles, we consider the problem of controlling a known linear dynamical system for which partial state information, such as vehicle position, is extracted from complex and nonlinear data,…

Optimization and Control · Mathematics 2019-12-24 Sarah Dean , Nikolai Matni , Benjamin Recht , Vickie Ye

In autonomous driving, perception systems are piv otal as they interpret sensory data to understand the envi ronment, which is essential for decision-making and planning. Ensuring the safety of these perception systems is fundamental for…

Robotics · Computer Science 2024-11-19 Urvishkumar Bharti , Vikram Shahapur

We present an integrated approach for perception and control for an autonomous vehicle and demonstrate this approach in a high-fidelity urban driving simulator. Our approach first builds a model for the environment, then trains a policy…

Systems and Control · Electrical Eng. & Systems 2020-03-19 Ali Baheri , Ilya Kolmanovsky , Anouck Girard , H. Eric Tseng , Dimitar Filev

We present an overview and evaluation of a new, systematic approach for generation of highly realistic, annotated synthetic data for training of deep neural networks in computer vision tasks. The main contribution is a procedural world…

Computer Vision and Pattern Recognition · Computer Science 2017-10-19 Apostolia Tsirikoglou , Joel Kronander , Magnus Wrenninge , Jonas Unger

With growing complexity and criticality of automated driving functions in road traffic and their operational design domains (ODD), there is increasing demand for covering significant proportions of development, validation, and verification…

Recent advancements in driving world models enable controllable generation of high-quality RGB videos or multimodal videos. Existing methods primarily focus on metrics related to generation quality and controllability. However, they often…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Kai Zeng , Zhanqian Wu , Kaixin Xiong , Xiaobao Wei , Xiangyu Guo , Zhenxin Zhu , Kalok Ho , Lijun Zhou , Bohan Zeng , Ming Lu , Haiyang Sun , Bing Wang , Guang Chen , Hangjun Ye , Wentao Zhang

Autonomous vehicles are increasingly introduced into our lives. Yet, people's misunderstanding and mistrust have become the major obstacles to the use of these technologies. In response to this problem, proper work must be done to increase…

Human-Computer Interaction · Computer Science 2023-02-20 Zhijie Qiao , Xiatao Sun , Helen Loeb , Rahul Mangharam

Interactive traffic simulation is crucial to autonomous driving systems by enabling testing for planners in a more scalable and safe way compared to real-world road testing. Existing approaches learn an agent model from large-scale driving…

Robotics · Computer Science 2022-10-27 Qiao Sun , Xin Huang , Brian C. Williams , Hang Zhao

Strategies that include the generation of synthetic data are beginning to be viable as obtaining real data can be logistically complicated, very expensive or slow. Not only the capture of the data can lead to complications, but also its…

Computer Vision and Pattern Recognition · Computer Science 2022-05-16 Paola Natalia Canas , Juan Diego Ortega , Marcos Nieto , Oihana Otaegui

End-to-end autonomous driving aims to build a fully differentiable system that takes raw sensor data as inputs and directly outputs the planned trajectory or control signals of the ego vehicle. State-of-the-art methods usually follow the…

Robotics · Computer Science 2023-08-29 Xiaosong Jia , Yulu Gao , Li Chen , Junchi Yan , Patrick Langechuan Liu , Hongyang Li

In this paper, the early design of our self-organized agent-based simulation model for exploration of synaptic connections that faithfully generates what is observed in natural situation is given. While we take inspiration from…

Neural and Evolutionary Computing · Computer Science 2012-07-17 Önder Gürcan , Carole Bernon , Kemal S. Türker

The viability of automated driving is heavily dependent on the performance of perception systems to provide real-time accurate and reliable information for robust decision-making and maneuvers. These systems must perform reliably not only…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Apostol Vassilev , Munawar Hasan , Edward Griffor , Honglan Jin , Pavel Piliptchak , Mahima Arora , Thoshitha Gamage

In this paper we introduce a general estimation methodology for learning a model of human perception and control in a sensorimotor control task based upon a finite set of demonstrations. The model's structure consists of i the agent's…

Machine Learning · Computer Science 2025-05-02 Ran Wei , Anthony D. McDonald , Alfredo Garcia , Gustav Markkula , Johan Engstrom , Matthew O'Kelly