English
Related papers

Related papers: Grounding Synthetic Data Generation With Vision an…

200 papers

Visual grounding tasks aim to localize image regions based on natural language references. In this work, we explore whether generative VLMs predominantly trained on image-text data could be leveraged to scale up the text annotation of…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Shijie Wang , Dahun Kim , Ali Taalimi , Chen Sun , Weicheng Kuo

The creation of high-quality human-labeled image-caption datasets presents a significant bottleneck in the development of Visual-Language Models (VLMs). In this work, we investigate an approach that leverages the strengths of Large Language…

Computer Vision and Pattern Recognition · Computer Science 2024-06-10 Sahand Sharifzadeh , Christos Kaplanis , Shreya Pathak , Dharshan Kumaran , Anastasija Ilic , Jovana Mitrovic , Charles Blundell , Andrea Banino

In this paper we investigate the feasibility of using synthetic data to augment face datasets. In particular, we propose a novel generative adversarial network (GAN) that can disentangle identity-related attributes from non-identity-related…

Computer Vision and Pattern Recognition · Computer Science 2018-11-02 Daniel Sáez Trigueros , Li Meng , Margaret Hartnett

Deep learning approaches require enough training samples to perform well, but it is a challenge to collect enough real training data and label them manually. In this letter, we propose the use of realistic synthetic data with a wide…

Computer Vision and Pattern Recognition · Computer Science 2020-06-11 Weixing Liu , Jun Liu , Bin Luo

Generative vision-language models (VLMs) exhibit strong high-level image understanding but lack spatially dense alignment between vision and language modalities, as our findings indicate. Orthogonal to advancements in generative VLMs,…

Computer Vision and Pattern Recognition · Computer Science 2025-09-16 Tim Lebailly , Vijay Veerabadran , Satwik Kottur , Karl Ridgeway , Michael Louis Iuzzolino

Recent advances in reasoning language models and reinforcement learning with verifiable rewards have significantly enhanced multi-step reasoning capabilities. This progress motivates the extension of reasoning paradigms to remote sensing…

Computer Vision and Pattern Recognition · Computer Science 2026-03-23 Shuchang Lyu , Haiquan Wen , Guangliang Cheng , Meng Li , Zheng Zhou , You Zhou , Dingding Yao , Zhenwei Shi

Visual grouping -- operationalized through tasks such as instance segmentation, visual grounding, and object detection -- enables applications ranging from robotic perception to photo editing. These fundamental problems in computer vision…

Computer Vision and Pattern Recognition · Computer Science 2026-01-28 Weikai Huang , Jieyu Zhang , Taoyang Jia , Chenhao Zheng , Ziqi Gao , Jae Sung Park , Winson Han , Ranjay Krishna

Recent advances in generative deep learning have enabled the creation of high-quality synthetic images in text-to-image generation. Prior work shows that fine-tuning a pretrained diffusion model on ImageNet and generating synthetic training…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Zhuoran Yu , Chenchen Zhu , Sean Culatana , Raghuraman Krishnamoorthi , Fanyi Xiao , Yong Jae Lee

The generative AI technology offers an increasing variety of tools for generating entirely synthetic images that are increasingly indistinguishable from real ones. Unlike methods that alter portions of an image, the creation of completely…

Computer Vision and Pattern Recognition · Computer Science 2024-04-30 Manos Schinas , Symeon Papadopoulos

Deep Learning has seen an unprecedented increase in vision applications since the publication of large-scale object recognition datasets and introduction of scalable compute hardware. State-of-the-art methods for most vision tasks for…

Computer Vision and Pattern Recognition · Computer Science 2020-04-30 Nikita Jaipuria , Xianling Zhang , Rohan Bhasin , Mayar Arafa , Punarjay Chakravarty , Shubham Shrivastava , Sagar Manglani , Vidya N. Murali

Realistic synthetic image data rendered from 3D models can be used to augment image sets and train image classification semantic segmentation models. In this work, we explore how high quality physically-based rendering and domain…

Computer Vision and Pattern Recognition · Computer Science 2022-12-14 Jason W. Anderson , Marcin Ziolkowski , Ken Kennedy , Amy W. Apon

Image generation abilities of text-to-image diffusion models have significantly advanced, yielding highly photo-realistic images from descriptive text and increasing the viability of leveraging synthetic images to train computer vision…

Computer Vision and Pattern Recognition · Computer Science 2025-02-10 Jiahui Chen , Amy Zhang , Adriana Romero-Soriano

Synthetic data augmentation helps language models learn new knowledge in data-constrained domains. However, naively scaling existing synthetic data methods by training on more synthetic tokens or using stronger generators yields diminishing…

Machine Learning · Computer Science 2026-03-31 Seungju Han , Konwoo Kim , Chanwoo Park , Benjamin Newman , Suhas Kotha , Jaehun Jung , James Zou , Yejin Choi

Recently, synthetic data generation and realistic rendering has advanced tasks like target tracking and human pose estimation. Simulations for most robotics applications are obtained in (semi)static environments, with specific sensors and…

Computer Vision and Pattern Recognition · Computer Science 2023-05-29 Elia Bonetto , Chenghao Xu , Aamir Ahmad

Generative Adversarial Networks (GANs) have been used widely to generate large volumes of synthetic data. This data is being utilized for augmenting with real examples in order to train deep Convolutional Neural Networks (CNNs). Studies…

Computer Vision and Pattern Recognition · Computer Science 2020-06-18 Binod Bhattarai , Seungryul Baek , Rumeysa Bodur , Tae-Kyun Kim

Language Models (LMs) continue to advance, improving response quality and coherence. Given Internet-scale training datasets, LMs have likely encountered much of what users may ask them to generate in some form during their training. A…

Artificial Intelligence · Computer Science 2026-01-27 Michael Majurski , Cynthia Matuszek

Large Vision and Language Models (LVLMs) have shown strong performance across various vision-language tasks in natural image domains. However, their application to remote sensing (RS) remains underexplored due to significant domain…

Computer Vision and Pattern Recognition · Computer Science 2025-06-30 Sungjune Park , Yeongyun Kim , Se Yeon Kim , Yong Man Ro

Remote sensing image (RSI) interpretation typically faces challenges due to the scarcity of labeled data, which limits the performance of RSI interpretation tasks. To tackle this challenge, we propose EarthSynth, a diffusion-based…

Computer Vision and Pattern Recognition · Computer Science 2025-08-08 Jiancheng Pan , Shiye Lei , Yuqian Fu , Jiahao Li , Yanxing Liu , Yuze Sun , Xiao He , Long Peng , Xiaomeng Huang , Bo Zhao

Remote Sensing Image Captioning (RSIC) is a cross-modal field bridging vision and language, aimed at automatically generating natural language descriptions of features and scenes in remote sensing imagery. Despite significant advances in…

Computer Vision and Pattern Recognition · Computer Science 2025-03-07 Qing Zhou , Tao Yang , Junyu Gao , Weiping Ni , Junzheng Wu , Qi Wang

Semantic segmentation has witnessed tremendous progress due to the proposal of various advanced network architectures. However, they are extremely hungry for delicate annotations to train, and the acquisition is laborious and unaffordable.…

Computer Vision and Pattern Recognition · Computer Science 2023-10-24 Lihe Yang , Xiaogang Xu , Bingyi Kang , Yinghuan Shi , Hengshuang Zhao