English
Related papers

Related papers: Pre-training on Synthetic Driving Data for Traject…

200 papers

Models trained on synthetic images often face degraded generalization to real data. As a convention, these models are often initialized with ImageNet pre-trained representation. Yet the role of ImageNet knowledge is seldom discussed despite…

Machine Learning · Computer Science 2020-07-15 Wuyang Chen , Zhiding Yu , Zhangyang Wang , Anima Anandkumar

The study of trajectories is often a core task in several research fields. In environmental modelling, trajectories are crucial to study fluid pollution, animal migrations, oil slick patterns or land movements. In this contribution, we…

Computation · Statistics 2022-09-23 A. Reyes , G. Viera-López , J. J. Morgado-Vega , E. Altshuler

We investigate the use of randomly generated data for the sake of pre-training a model. We justify this approach theoretically from the perspective of algorithmic complexity, building on recent research that shows that sequence models can…

Machine Learning · Computer Science 2025-06-26 Peter Bloem

Predicting the future trajectories of on-road vehicles is critical for autonomous driving. In this paper, we introduce a novel prediction framework called PRIME, which stands for Prediction with Model-based Planning. Unlike recent…

Computer Vision and Pattern Recognition · Computer Science 2021-10-22 Haoran Song , Di Luan , Wenchao Ding , Michael Yu Wang , Qifeng Chen

Synthetic data is widely adopted in embedding models to ensure diversity in training data distributions across dimensions such as difficulty, length, and language. However, existing prompt-based synthesis methods struggle to capture…

Computation and Language · Computer Science 2025-12-05 Haoran Li , Zhiming Su , Junyan Yao , Enwei Zhang , Yang Ji , Yan Chen , Kan Zhou , Chao Feng , Jiao Ran

The finding that very large networks can be trained efficiently and reliably has led to a paradigm shift in computer vision from engineered solutions to learning formulations. As a result, the research challenge shifts from devising…

Computer Vision and Pattern Recognition · Computer Science 2018-03-23 Nikolaus Mayer , Eddy Ilg , Philipp Fischer , Caner Hazirbas , Daniel Cremers , Alexey Dosovitskiy , Thomas Brox

As the potential for autonomous vehicles to be integrated on a large scale into modern traffic systems continues to grow, ensuring safe navigation in dynamic environments is crucial for smooth integration. To guarantee safety and prevent…

Motion prediction is critical for autonomous vehicles to effectively navigate complex environments and accurately anticipate the behaviors of other traffic participants. As autonomous driving continues to evolve, the need to assimilate new…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Boqi Li , Haojie Zhu , Henry X. Liu

Limited real-world data severely impacts model performance in many computer vision domains, particularly for samples that are underrepresented in training. Synthetically generated images are a promising solution, but 1) it remains unclear…

Computer Vision and Pattern Recognition · Computer Science 2025-04-04 Nitish Mital , Simon Malzard , Richard Walters , Celso M. De Melo , Raghuveer Rao , Victoria Nockles

Data for pretraining machine learning models often consists of collections of heterogeneous datasets. Although training on their union is reasonable in agnostic settings, it might be suboptimal when the target domain -- where the model will…

Machine Learning · Computer Science 2023-06-13 Jiaojiao Fan , David Alvarez-Melis

Synthetic-to-real transfer learning is a framework in which a synthetically generated dataset is used to pre-train a model to improve its performance on real vision tasks. The most significant advantage of using synthetic images is that the…

Machine Learning · Computer Science 2021-10-12 Hiroaki Mikami , Kenji Fukumizu , Shogo Murai , Shuji Suzuki , Yuta Kikuchi , Taiji Suzuki , Shin-ichi Maeda , Kohei Hayashi

We present a method for synthesizing naturally looking images of multiple people interacting in a specific scenario. These images benefit from the advantages of synthetic data: being fully controllable and fully annotated with any type of…

Computer Vision and Pattern Recognition · Computer Science 2020-06-04 Igor Kviatkovsky , Nadav Bhonker , Gerard Medioni

The unavailability of training data is a permanent source of much frustration in research, especially when it is due to privacy concerns. This is particularly true for location data since previous techniques all suffer from the inherent…

Cryptography and Security · Computer Science 2022-03-15 Szilvia Lestyán , Gergely Ács , Gergely Biczók

This paper addresses the problem of short-term traffic prediction for signalized traffic operations management. Specifically, we focus on predicting sensor states in high-resolution (second-by-second). This contrasts with traditional…

Optimization and Control · Mathematics 2022-04-12 Wenqing Li , Chuhan Yang , Saif Eddin Jabari

In this work, we explore self-supervised visual pre-training on images from diverse, in-the-wild videos for real-world robotic tasks. Like prior work, our visual representations are pre-trained via a masked autoencoder (MAE), frozen, and…

Robotics · Computer Science 2022-10-07 Ilija Radosavovic , Tete Xiao , Stephen James , Pieter Abbeel , Jitendra Malik , Trevor Darrell

Masked auto-encoder pre-training has emerged as a prevalent technique for initializing and enhancing dense retrieval systems. It generally utilizes additional Transformer decoder blocks to provide sustainable supervision signals and…

Information Retrieval · Computer Science 2024-04-23 Guangyuan Ma , Xing Wu , Zijia Lin , Songlin Hu

This paper presents a global trajectory optimization framework for minimizing lap time in autonomous racing under uncertain vehicle dynamics. Optimizing the trajectory over the full racing horizon is computationally expensive, and tracking…

Robotics · Computer Science 2026-01-30 Youngim Nam , Jungbin Kim , Kyungtae Kang , Cheolhyeon Kwon

Ensuring the reliability of autonomous driving perception systems requires extensive environment-based testing, yet real-world execution is often impractical. Synthetic datasets have therefore emerged as a promising alternative, offering…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Dingyi Yao , Xinyao Han , Ruibo Ming , Zhihang Song , Lihui Peng , Jianming Hu , Danya Yao , Yi Zhang

Spatio-temporal deep learning models aims to utilize useful patterns in such data to support tasks like prediction. However, previous deep learning models designed for specific tasks typically require separate training for each use case,…

As a safety critical task, autonomous driving requires accurate predictions of road users' future trajectories for safe motion planning, particularly under challenging conditions. Yet, many recent deep learning methods suffer from a…

Computer Vision and Pattern Recognition · Computer Science 2024-05-01 Junrui Zhang , Mozhgan Pourkeshavarz , Amir Rasouli