English
Related papers

Related papers: Synthetic Privileged Information Enhances Medical …

200 papers

As information exists in various modalities in real world, effective interaction and fusion among multimodal information plays a key role for the creation and perception of multimodal data in computer vision and deep learning research. With…

Computer Vision and Pattern Recognition · Computer Science 2023-08-25 Fangneng Zhan , Yingchen Yu , Rongliang Wu , Jiahui Zhang , Shijian Lu , Lingjie Liu , Adam Kortylewski , Christian Theobalt , Eric Xing

In this paper, we address a fundamental gap between pre-training and fine-tuning of deep neural networks: while pre-training has shifted from unimodal to multimodal learning with enhanced visual understanding, fine-tuning predominantly…

Computer Vision and Pattern Recognition · Computer Science 2026-01-30 Shohei Enomoto , Shin'ya Yamaguchi

We investigate the potential of learning visual representations using synthetic images generated by text-to-image models. This is a natural question in the light of the excellent performance of such models in generating high-quality images.…

Computer Vision and Pattern Recognition · Computer Science 2023-10-27 Yonglong Tian , Lijie Fan , Phillip Isola , Huiwen Chang , Dilip Krishnan

Multimodal representation learning seeks to relate and decompose information inherent in multiple modalities. By disentangling modality-specific information from information that is shared across modalities, we can improve interpretability…

Machine Learning · Computer Science 2025-03-18 Chenyu Wang , Sharut Gupta , Xinyi Zhang , Sana Tonekaboni , Stefanie Jegelka , Tommi Jaakkola , Caroline Uhler

In order to reduce overfitting, neural networks are typically trained with data augmentation, the practice of artificially generating additional training data via label-preserving transformations of existing training examples. While these…

Computer Vision and Pattern Recognition · Computer Science 2019-01-23 Cecilia Summers , Michael J. Dinneen

Insufficient training data is a major bottleneck for most deep learning practices, not least in medical imaging where data is difficult to collect and publicly available datasets are scarce due to ethics and privacy. This work investigates…

Computer Vision and Pattern Recognition · Computer Science 2021-04-27 Gabriel Eilertsen , Apostolia Tsirikoglou , Claes Lundström , Jonas Unger

With promising empirical performance across a wide range of applications, synthetic data augmentation appears a viable solution to data scarcity and the demands of increasingly data-intensive models. Its effectiveness lies in expanding the…

Machine Learning · Computer Science 2026-02-02 Zixuan Wu , So Won Jeong , Yating Liu , Yeo Jin Jung , Claire Donnat

We present a method for synthesizing naturally looking images of multiple people interacting in a specific scenario. These images benefit from the advantages of synthetic data: being fully controllable and fully annotated with any type of…

Computer Vision and Pattern Recognition · Computer Science 2020-06-04 Igor Kviatkovsky , Nadav Bhonker , Gerard Medioni

Facial recognition has become a widely used method for authentication and identification, with applications for secure access and locating missing persons. Its success is largely attributed to deep learning, which leverages large datasets…

Computer Vision and Pattern Recognition · Computer Science 2025-12-08 Pedro Vidal , Bernardo Biesseck , Luiz E. L. Coelho , Roger Granada , David Menotti

State-of-the-art techniques of artificial intelligence, in particular deep learning, are mostly data-driven. However, collecting and manually labeling a large scale dataset is both difficult and expensive. A promising alternative is to…

Computer Vision and Pattern Recognition · Computer Science 2018-07-31 Qi Chen , Weichao Qiu , Yi Zhang , Lingxi Xie , Alan Yuille

Self-supervised learning is an efficient pre-training method for medical image analysis. However, current research is mostly confined to specific-modality data pre-training, consuming considerable time and resources without achieving…

Computer Vision and Pattern Recognition · Computer Science 2023-12-01 Yiwen Ye , Yutong Xie , Jianpeng Zhang , Ziyang Chen , Qi Wu , Yong Xia

Algorithms learn rules and associations based on the training data that they are exposed to. Yet, the very same data that teaches machines to understand and predict the world, contains societal and historic biases, resulting in biased…

Machine Learning · Computer Science 2021-04-08 Paul Tiwald , Alexandra Ebert , Daniel T. Soukup

Recent work has focused on generating synthetic imagery to increase the size and variability of training data for learning visual tasks in urban scenes. This includes increasing the occurrence of occlusions or varying environmental and…

Computer Vision and Pattern Recognition · Computer Science 2018-10-03 Alexandra Carlson , Katherine A. Skinner , Ram Vasudevan , Matthew Johnson-Roberson

Synthetic data offers a scalable solution for vision-language pre-training, yet current state-of-the-art methods typically rely on scaling up a single generative backbone, which introduces generator-specific spectral biases and limits…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Leonardo Brusini , Cristian Sbrolli , Eugenio Lomurno , Toshihiko Yamasaki , Matteo Matteucci

Real-world deployment of AI vision models is both fueled and limited by the data available for training and testing. Real datasets are sparse and uneven: long-tailed or unbalanced distributions hinder generalization, and the low number of…

Computer Vision and Pattern Recognition · Computer Science 2026-05-22 Valeria Pais , Malena Mendilaharzu , Daniele Faccio , Luis Oala , Christoph Clausen , Bruno Sanguinetti

Modern deep learning models in computer vision require large datasets of real images, which are difficult to curate and pose privacy and legal concerns, limiting their commercial use. Recent works suggest synthetic data as an alternative,…

Computer Vision and Pattern Recognition · Computer Science 2025-06-25 Farnood Salehi , Vandit Sharma , Amirhossein Askari Farsangi , Tunç Ozan Aydın

This paper investigates the use of synthetic face data to enhance Single-Morphing Attack Detection (S-MAD), addressing the limitations of availability of large-scale datasets of bona fide images due to privacy concerns. Various morphing…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 David Benavente-Rios , Juan Ruiz Rodriguez , Gustavo Gatica

Multi-modality imaging improves disease diagnosis and reveals distinct deviations in tissues with anatomical properties. The existence of completely aligned and paired multi-modality neuroimaging data has proved its effectiveness in brain…

Image and Video Processing · Electrical Eng. & Systems 2023-09-26 Guoyang Xie , Yawen Huang , Jinbao Wang , Jiayi Lyu , Feng Zheng , Yefeng Zheng , Yaochu Jin

Many recent methods for unsupervised or self-supervised representation learning train feature extractors by maximizing an estimate of the mutual information (MI) between different views of the data. This comes with several immediate…

Machine Learning · Computer Science 2020-01-24 Michael Tschannen , Josip Djolonga , Paul K. Rubenstein , Sylvain Gelly , Mario Lucic

Synthetic data has been proposed as a solution to address the issue of high-quality data scarcity in the training of large language models (LLMs). Studies have shown that synthetic data can effectively improve the performance of LLMs on…

Computation and Language · Computer Science 2024-06-19 Jie Chen , Yupeng Zhang , Bingning Wang , Wayne Xin Zhao , Ji-Rong Wen , Weipeng Chen