中文
相关论文

相关论文: Grounding Synthetic Data Generation With Vision an…

200 篇论文

Visual grounding tasks aim to localize image regions based on natural language references. In this work, we explore whether generative VLMs predominantly trained on image-text data could be leveraged to scale up the text annotation of…

计算机视觉与模式识别 · 计算机科学 2024-07-23 Shijie Wang , Dahun Kim , Ali Taalimi , Chen Sun , Weicheng Kuo

The creation of high-quality human-labeled image-caption datasets presents a significant bottleneck in the development of Visual-Language Models (VLMs). In this work, we investigate an approach that leverages the strengths of Large Language…

计算机视觉与模式识别 · 计算机科学 2024-06-10 Sahand Sharifzadeh , Christos Kaplanis , Shreya Pathak , Dharshan Kumaran , Anastasija Ilic , Jovana Mitrovic , Charles Blundell , Andrea Banino

In this paper we investigate the feasibility of using synthetic data to augment face datasets. In particular, we propose a novel generative adversarial network (GAN) that can disentangle identity-related attributes from non-identity-related…

计算机视觉与模式识别 · 计算机科学 2018-11-02 Daniel Sáez Trigueros , Li Meng , Margaret Hartnett

Deep learning approaches require enough training samples to perform well, but it is a challenge to collect enough real training data and label them manually. In this letter, we propose the use of realistic synthetic data with a wide…

计算机视觉与模式识别 · 计算机科学 2020-06-11 Weixing Liu , Jun Liu , Bin Luo

Generative vision-language models (VLMs) exhibit strong high-level image understanding but lack spatially dense alignment between vision and language modalities, as our findings indicate. Orthogonal to advancements in generative VLMs,…

计算机视觉与模式识别 · 计算机科学 2025-09-16 Tim Lebailly , Vijay Veerabadran , Satwik Kottur , Karl Ridgeway , Michael Louis Iuzzolino

Recent advances in reasoning language models and reinforcement learning with verifiable rewards have significantly enhanced multi-step reasoning capabilities. This progress motivates the extension of reasoning paradigms to remote sensing…

计算机视觉与模式识别 · 计算机科学 2026-03-23 Shuchang Lyu , Haiquan Wen , Guangliang Cheng , Meng Li , Zheng Zhou , You Zhou , Dingding Yao , Zhenwei Shi

Visual grouping -- operationalized through tasks such as instance segmentation, visual grounding, and object detection -- enables applications ranging from robotic perception to photo editing. These fundamental problems in computer vision…

计算机视觉与模式识别 · 计算机科学 2026-01-28 Weikai Huang , Jieyu Zhang , Taoyang Jia , Chenhao Zheng , Ziqi Gao , Jae Sung Park , Winson Han , Ranjay Krishna

Recent advances in generative deep learning have enabled the creation of high-quality synthetic images in text-to-image generation. Prior work shows that fine-tuning a pretrained diffusion model on ImageNet and generating synthetic training…

计算机视觉与模式识别 · 计算机科学 2025-01-22 Zhuoran Yu , Chenchen Zhu , Sean Culatana , Raghuraman Krishnamoorthi , Fanyi Xiao , Yong Jae Lee

The generative AI technology offers an increasing variety of tools for generating entirely synthetic images that are increasingly indistinguishable from real ones. Unlike methods that alter portions of an image, the creation of completely…

计算机视觉与模式识别 · 计算机科学 2024-04-30 Manos Schinas , Symeon Papadopoulos

Deep Learning has seen an unprecedented increase in vision applications since the publication of large-scale object recognition datasets and introduction of scalable compute hardware. State-of-the-art methods for most vision tasks for…

计算机视觉与模式识别 · 计算机科学 2020-04-30 Nikita Jaipuria , Xianling Zhang , Rohan Bhasin , Mayar Arafa , Punarjay Chakravarty , Shubham Shrivastava , Sagar Manglani , Vidya N. Murali

Realistic synthetic image data rendered from 3D models can be used to augment image sets and train image classification semantic segmentation models. In this work, we explore how high quality physically-based rendering and domain…

计算机视觉与模式识别 · 计算机科学 2022-12-14 Jason W. Anderson , Marcin Ziolkowski , Ken Kennedy , Amy W. Apon

Image generation abilities of text-to-image diffusion models have significantly advanced, yielding highly photo-realistic images from descriptive text and increasing the viability of leveraging synthetic images to train computer vision…

计算机视觉与模式识别 · 计算机科学 2025-02-10 Jiahui Chen , Amy Zhang , Adriana Romero-Soriano

Synthetic data augmentation helps language models learn new knowledge in data-constrained domains. However, naively scaling existing synthetic data methods by training on more synthetic tokens or using stronger generators yields diminishing…

机器学习 · 计算机科学 2026-03-31 Seungju Han , Konwoo Kim , Chanwoo Park , Benjamin Newman , Suhas Kotha , Jaehun Jung , James Zou , Yejin Choi

Recently, synthetic data generation and realistic rendering has advanced tasks like target tracking and human pose estimation. Simulations for most robotics applications are obtained in (semi)static environments, with specific sensors and…

计算机视觉与模式识别 · 计算机科学 2023-05-29 Elia Bonetto , Chenghao Xu , Aamir Ahmad

Generative Adversarial Networks (GANs) have been used widely to generate large volumes of synthetic data. This data is being utilized for augmenting with real examples in order to train deep Convolutional Neural Networks (CNNs). Studies…

计算机视觉与模式识别 · 计算机科学 2020-06-18 Binod Bhattarai , Seungryul Baek , Rumeysa Bodur , Tae-Kyun Kim

Language Models (LMs) continue to advance, improving response quality and coherence. Given Internet-scale training datasets, LMs have likely encountered much of what users may ask them to generate in some form during their training. A…

人工智能 · 计算机科学 2026-01-27 Michael Majurski , Cynthia Matuszek

Large Vision and Language Models (LVLMs) have shown strong performance across various vision-language tasks in natural image domains. However, their application to remote sensing (RS) remains underexplored due to significant domain…

计算机视觉与模式识别 · 计算机科学 2025-06-30 Sungjune Park , Yeongyun Kim , Se Yeon Kim , Yong Man Ro

Remote sensing image (RSI) interpretation typically faces challenges due to the scarcity of labeled data, which limits the performance of RSI interpretation tasks. To tackle this challenge, we propose EarthSynth, a diffusion-based…

计算机视觉与模式识别 · 计算机科学 2025-08-08 Jiancheng Pan , Shiye Lei , Yuqian Fu , Jiahao Li , Yanxing Liu , Yuze Sun , Xiao He , Long Peng , Xiaomeng Huang , Bo Zhao

Remote Sensing Image Captioning (RSIC) is a cross-modal field bridging vision and language, aimed at automatically generating natural language descriptions of features and scenes in remote sensing imagery. Despite significant advances in…

计算机视觉与模式识别 · 计算机科学 2025-03-07 Qing Zhou , Tao Yang , Junyu Gao , Weiping Ni , Junzheng Wu , Qi Wang

Semantic segmentation has witnessed tremendous progress due to the proposal of various advanced network architectures. However, they are extremely hungry for delicate annotations to train, and the acquisition is laborious and unaffordable.…

计算机视觉与模式识别 · 计算机科学 2023-10-24 Lihe Yang , Xiaogang Xu , Bingyi Kang , Yinghuan Shi , Hengshuang Zhao