English
Related papers

Related papers: PolyGen: Fully Synthetic Vision-Language Training …

200 papers

With recent advances in speech synthesis, synthetic data is becoming a viable alternative to real data for training speech recognition models. However, machine learning with synthetic data is not trivial due to the gap between the synthetic…

Audio and Speech Processing · Electrical Eng. & Systems 2021-10-25 Ting-Yao Hu , Mohammadreza Armandpour , Ashish Shrivastava , Jen-Hao Rick Chang , Hema Koppula , Oncel Tuzel

In this paper, we present an efficient and effective single-stage framework (DiverGAN) to generate diverse, plausible and semantically consistent images according to a natural-language description. DiverGAN adopts two novel word-level…

Computer Vision and Pattern Recognition · Computer Science 2022-05-10 Zhenxing Zhang , Lambert Schomaker

One-shot fine-grained visual recognition often suffers from the problem of training data scarcity for new fine-grained classes. To alleviate this problem, an off-the-shelf image generator can be applied to synthesize additional training…

Computer Vision and Pattern Recognition · Computer Science 2019-11-19 Satoshi Tsutsui , Yanwei Fu , David Crandall

Lenses are programs that can be run both "front to back" and "back to front," allowing updates to either their source or their target data to be transferred in both directions. Lenses have been extensively studied, extended, and applied.…

Programming Languages · Computer Science 2019-06-26 Anders Miltner , Solomon Maina , Kathleen Fisher , Benjamin C. Pierce , David Walker , Steve Zdancewic

In syntax-guided synthesis (SyGuS), a synthesizer's goal is to automatically generate a program belonging to a grammar of possible implementations that meets a logical specification. We investigate a common limitation across…

Programming Languages · Computer Science 2019-06-11 Saswat Padhi , Todd Millstein , Aditya Nori , Rahul Sharma

Deep learning in medical imaging is often limited by scarce and imbalanced annotated data. We present SSGNet, a unified framework that combines class specific generative modeling with iterative semisupervised pseudo labeling to enhance both…

Computer Vision and Pattern Recognition · Computer Science 2025-10-08 Mosong Ma , Tania Stathaki , Michalis Lazarou

Even though Deep Neural Networks are extremely powerful for image restoration tasks, they have several limitations. They are poorly understood and suffer from strong biases inherited from the training sets. One way to address these…

Computer Vision and Pattern Recognition · Computer Science 2025-12-24 Raphael Achddou , Yann Gousseau , Saïd Ladjal , Sabine Süsstrunk

Synthetic population is an increasingly important material used in numerous areas such as urban and transportation analysis. Traditional methods such as iterative proportional fitting (IPF) is not capable of generating high-quality data…

Computers and Society · Computer Science 2025-08-14 Hai Yang , Hongying Wu , Linfei Yuan , Xiyuan Ren , Joseph Y. J. Chow , Jinqin Gao , Kaan Ozbay

The development of generalizable Novel View Synthesis (NVS) models is critically limited by the scarcity of large-scale training data featuring diverse and precise camera trajectories. While real-world captures are photorealistic, they are…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Chenhan Jiang , Yu Chen , Qingwen Zhang , Jifei Song , Songcen Xu , Dit-Yan Yeung , Jiankang Deng

The acquisition of large-scale and diverse demonstration data are essential for improving robotic imitation learning generalization. However, generating such data for complex manipulations is challenging in real-world settings. We introduce…

Robotics · Computer Science 2025-03-18 Wensheng Wang , Ning Tan

Synthetic data is useful only when the added samples fill missing parts of the training distribution that matter for the downstream task. We introduce LiBaGS, a lightweight, generator-agnostic method for targeted synthetic training data…

Machine Learning · Computer Science 2026-05-14 Abhishek Moturu , Anna Goldenberg , Babak Taati

In this paper, we introduce $\text{EVL}_{\text{Gen}}$, a streamlined framework designed for the pre-training of visually conditioned language generation models with high computational demands, utilizing frozen pre-trained large language…

Computer Vision and Pattern Recognition · Computer Science 2024-02-22 Yiren Jian , Tingkai Liu , Yunzhe Tao , Chunhui Zhang , Soroush Vosoughi , Hongxia Yang

Contemporary Human Computer Interaction (HCI) research relies primarily on neural network models for machine vision and speech understanding of a system user. Such models require extensively annotated training datasets for optimal…

Human-Computer Interaction · Computer Science 2023-11-14 Muhammad Ali Farooq , Dan Bigioi , Rishabh Jain , Wang Yao , Mariam Yiwere , Peter Corcoran

Children with rare genetic diseases often exhibit distinctive facial phenotypes, yet developing computer vision systems for early diagnosis remains challenging due to extreme data scarcity, privacy constraints, and limited data sharing in…

Computer Vision and Pattern Recognition · Computer Science 2026-05-22 Ganlin Feng , Yuxi Long , Erin Lou , Lianghong Chen , Zihao Jing , Pingzhao Hu , Wei Xu

Generative models have become a powerful tool for synthesizing training data in computer vision tasks. Current approaches solely focus on aligning generated images with the target dataset distribution. As a result, they capture only the…

Computer Vision and Pattern Recognition · Computer Science 2026-01-08 Zerun Wang , Jiafeng Mao , Xueting Wang , Toshihiko Yamasaki

In the field of emotion recognition, the development of high-performance models remains a challenge due to the scarcity of high-quality, diverse emotional datasets. Emotional expressions are inherently subjective, shaped by individual…

Computation and Language · Computer Science 2025-09-16 Keito Inoshita , Rushia Harada

While much research has been done in text-to-image synthesis, little work has been done to explore the usage of linguistic structure of the input text. Such information is even more important for story visualization since its inputs have an…

Computation and Language · Computer Science 2021-10-22 Adyasha Maharana , Mohit Bansal

Deep learning is now the gold standard in computer vision-based quality inspection systems. In order to detect defects, supervised learning is often utilized, but necessitates a large amount of annotated images, which can be costly:…

Computer Vision and Pattern Recognition · Computer Science 2021-07-23 Pierre Gutierrez , Maria Luschkova , Antoine Cordier , Mustafa Shukor , Mona Schappert , Tim Dahmen

We introduce EscherNet, a multi-view conditioned diffusion model for view synthesis. EscherNet learns implicit and generative 3D representations coupled with a specialised camera positional encoding, allowing precise and continuous relative…

Computer Vision and Pattern Recognition · Computer Science 2024-03-20 Xin Kong , Shikun Liu , Xiaoyang Lyu , Marwan Taher , Xiaojuan Qi , Andrew J. Davison

The generation of high-fidelity synthetic data is a cornerstone of modern machine learning, yet Large Language Models (LLMs) frequently suffer from hallucinations, logical inconsistencies, and mode collapse when tasked with structured…

Computation and Language · Computer Science 2026-04-14 Zehua Cheng , Wei Dai , Jiahao Sun , Thomas Lukasiewicz