English
Related papers

Related papers: Contrastive Syn-to-Real Generalization

200 papers

Synthetic data is being used lately for training deep neural networks in computer vision applications such as object detection, object segmentation and 6D object pose estimation. Domain randomization hereby plays an important role in…

Computer Vision and Pattern Recognition · Computer Science 2024-05-13 Parth Rawal , Mrunal Sompura , Wolfgang Hintze

In image-to-image translation, each patch in the output should reflect the content of the corresponding patch in the input, independent of domain. We propose a straightforward method for doing so -- maximizing mutual information between the…

Computer Vision and Pattern Recognition · Computer Science 2020-08-21 Taesung Park , Alexei A. Efros , Richard Zhang , Jun-Yan Zhu

Learning on synthetic data and transferring the resulting properties to their real counterparts is an important challenge for reducing costs and increasing safety in machine learning. In this work, we focus on autoencoder architectures and…

Computer Vision and Pattern Recognition · Computer Science 2022-04-04 Steve Dias Da Cruz , Bertram Taetz , Thomas Stifter , Didier Stricker

While developing perception based deep learning models, the benefit of synthetic data is enormous. However, performance of networks trained with synthetic data for certain computer vision tasks degrade significantly when tested on real…

Computer Vision and Pattern Recognition · Computer Science 2023-02-09 Koustav Mullick , Harshil Jain , Sanchit Gupta , Amit Arvind Kale

Driving scene parsing is critical for autonomous vehicles to operate reliably in complex real-world traffic environments. To reduce the reliance on costly pixel-level annotations, synthetic datasets with automatically generated labels have…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Jiahe Fan , Xiao Ma , Sergey Vityazev , George Giakos , Shaolong Shu , Rui Fan

We present a method to improve the visual realism of low-quality, synthetic images, e.g. OpenGL renderings. Training an unpaired synthetic-to-real translation network in image space is severely under-constrained and produces visible…

Computer Vision and Pattern Recognition · Computer Science 2020-03-31 Sai Bi , Kalyan Sunkavalli , Federico Perazzi , Eli Shechtman , Vladimir Kim , Ravi Ramamoorthi

Performance on benchmark datasets has drastically improved with advances in deep learning. Still, cross-dataset generalization performance remains relatively low due to the domain shift that can occur between two different datasets. This…

Computer Vision and Pattern Recognition · Computer Science 2019-01-08 Alexandra Carlson , Katherine A. Skinner , Ram Vasudevan , Matthew Johnson-Roberson

The goal of text-to-image synthesis is to generate a visually realistic image that matches a given text description. In practice, the captions annotated by humans for the same image have large variance in terms of contents and the choice of…

Machine Learning · Computer Science 2021-11-30 Hui Ye , Xiulong Yang , Martin Takac , Rajshekhar Sunderraman , Shihao Ji

Deep neural networks have largely failed to effectively utilize synthetic data when applied to real images due to the covariate shift problem. In this paper, we show that by applying a straightforward modification to an existing…

Computer Vision and Pattern Recognition · Computer Science 2018-07-26 Aysegul Dundar , Ming-Yu Liu , Ting-Chun Wang , John Zedlewski , Jan Kautz

We present a system for training deep neural networks for object detection using synthetic images. To handle the variability in real-world data, the system relies upon the technique of domain randomization, in which the parameters of the…

Computer Vision and Pattern Recognition · Computer Science 2018-04-25 Jonathan Tremblay , Aayush Prakash , David Acuna , Mark Brophy , Varun Jampani , Cem Anil , Thang To , Eric Cameracci , Shaad Boochoon , Stan Birchfield

Synthetic-to-real transfer learning is a framework in which a synthetically generated dataset is used to pre-train a model to improve its performance on real vision tasks. The most significant advantage of using synthetic images is that the…

Machine Learning · Computer Science 2021-10-12 Hiroaki Mikami , Kenji Fukumizu , Shogo Murai , Shuji Suzuki , Yuta Kikuchi , Taiji Suzuki , Shin-ichi Maeda , Kohei Hayashi

In the context of single domain generalisation, the objective is for models that have been exclusively trained on data from a single domain to demonstrate strong performance when confronted with various unfamiliar domains. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2024-03-18 Anastasios Arsenos , Dimitrios Kollias , Evangelos Petrongonas , Christos Skliros , Stefanos Kollias

Contrastive pretraining can substantially increase model generalisation and downstream performance. However, the quality of the learned representations is highly dependent on the data augmentation strategy applied to generate positive…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Mélanie Roschewitz , Fabio De Sousa Ribeiro , Tian Xia , Galvin Khara , Ben Glocker

Due to the high cost of collection and labeling, there are relatively few datasets for camouflaged object detection (COD). In particular, for certain specialized categories, the available image dataset is insufficiently populated. Synthetic…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Zhihao Luo , Luojun Lin , Zheng Lin

Domain generalization (DG) aims to learn a robust model from source domains that generalize well on unseen target domains. Recent studies focus on generating novel domain samples or features to diversify distributions complementary to…

Computer Vision and Pattern Recognition · Computer Science 2023-08-17 Chenming Li , Daoan Zhang , Wenjian Huang , Jianguo Zhang

While deep Embedding Learning approaches have witnessed widespread success in multiple computer vision tasks, the state-of-the-art methods for representing natural images need not necessarily perform well on images from other domains, such…

Computer Vision and Pattern Recognition · Computer Science 2022-08-23 Ujjal Kr Dutta

Contrastive Self-supervised Learning (CSL) is a practical solution that learns meaningful visual representations from massive data in an unsupervised approach. The ordinary CSL embeds the features extracted from neural networks onto…

Computer Vision and Pattern Recognition · Computer Science 2022-08-19 Shentong Mo , Zhun Sun , Chao Li

During the past decade, deep neural networks have led to fast-paced progress and significant achievements in computer vision problems, for both academia and industry. Yet despite their success, state-of-the-art image classification…

Computer Vision and Pattern Recognition · Computer Science 2024-05-13 Aristotelis Ballas , Christos Diou

Contrastive pretraining is well-known to improve downstream task performance and model generalisation, especially in limited label settings. However, it is sensitive to the choice of augmentation pipeline. Positive pairs should preserve…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Melanie Roschewitz , Fabio De Sousa Ribeiro , Tian Xia , Galvin Khara , Ben Glocker

Performance achievable by modern deep learning approaches are directly related to the amount of data used at training time. Unfortunately, the annotation process is notoriously tedious and expensive, especially for pixel-wise tasks like…

Computer Vision and Pattern Recognition · Computer Science 2018-10-16 Pierluigi Zama Ramirez , Alessio Tonioni , Luigi Di Stefano