English
Related papers

Related papers: DermaSynth: Rich Synthetic Image-Text Pairs Using …

200 papers

For many fundamental scene understanding tasks, it is difficult or impossible to obtain per-pixel ground truth labels from real images. We address this challenge by introducing Hypersim, a photorealistic synthetic dataset for holistic…

Computer Vision and Pattern Recognition · Computer Science 2021-08-19 Mike Roberts , Jason Ramapuram , Anurag Ranjan , Atulit Kumar , Miguel Angel Bautista , Nathan Paczan , Russ Webb , Joshua M. Susskind

Recent advancements in Large Multimodal Models (LMMs) have significantly improved multimodal understanding and generation. However, these models still struggle to generate tightly interleaved image-text outputs, primarily due to the limited…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Yukang Feng , Jianwen Sun , Chuanhao Li , Zizhen Li , Jiaxin Ai , Fanrui Zhang , Yifan Chang , Sizhuo Zhou , Shenglin Zhang , Yu Dai , Kaipeng Zhang

Image synthesis approaches, e.g., generative adversarial networks, have been popular as a form of data augmentation in medical image analysis tasks. It is primarily beneficial to overcome the shortage of publicly accessible data and…

Computer Vision and Pattern Recognition · Computer Science 2023-10-05 Shiyi Du , Xiaosong Wang , Yongyi Lu , Yuyin Zhou , Shaoting Zhang , Alan Yuille , Kang Li , Zongwei Zhou

Diffusion models have exhibited substantial success in text-to-image generation. However, they often encounter challenges when dealing with complex and dense prompts involving multiple objects, attribute binding, and long descriptions. In…

Computer Vision and Pattern Recognition · Computer Science 2024-08-28 Mushui Liu , Yuhang Ma , Yang Zhen , Jun Dan , Yunlong Yu , Zeng Zhao , Zhipeng Hu , Bai Liu , Changjie Fan

Text-guided image editing and generation methods have diverse real-world applications. However, text-guided infinite image synthesis faces several challenges. First, there is a lack of text-image paired datasets with high-resolution and…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Soyeong Kwon , Taegyeong Lee , Taehwan Kim

The scarcity of high-quality annotated medical data, particularly in mental health, poses a significant bottleneck for training robust machine learning models. Privacy regulations restrict data sharing, making synthetic data generation a…

In this paper, we present an effective data augmentation framework leveraging the Large Language Model (LLM) and Diffusion Model (DM) to tackle the challenges inherent in data-scarce scenarios. Recently, DMs have opened up the possibility…

Computer Vision and Pattern Recognition · Computer Science 2024-09-26 Kyuheon Jung , Yongdeuk Seo , Seongwoo Cho , Jaeyoung Kim , Hyun-seok Min , Sungchul Choi

Training large vision-language models requires extensive, high-quality image-text pairs. Existing web-scraped datasets, however, are noisy and lack detailed image descriptions. To bridge this gap, we introduce PixelProse, a comprehensive…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Vasu Singla , Kaiyu Yue , Sukriti Paul , Reza Shirkavand , Mayuka Jayawardhana , Alireza Ganjdanesh , Heng Huang , Abhinav Bhatele , Gowthami Somepalli , Tom Goldstein

This study presents a methodology for constructing a clinically verified dataset of dermatoscopic images for medical informatics research. The relevance of the work is driven by the fact that the performance of automated diagnostic support…

Image and Video Processing · Electrical Eng. & Systems 2026-05-26 Kozachok Elena Sergeevna

This research explores the application of large language models (LLMs) to generate synthetic datasets for Product Desirability Toolkit (PDT) testing, a key component in evaluating user sentiment and product experience. Utilizing…

Computation and Language · Computer Science 2025-03-11 John D. Hastings , Sherri Weitl-Harms , Joseph Doty , Zachary J. Myers , Warren Thompson

The ability to detect manipulated visual content is becoming increasingly important in many application fields, given the rapid advances in image synthesis methods. Of particular concern is the possibility of modifying the content of…

Image and Video Processing · Electrical Eng. & Systems 2024-02-02 Giada Zingarini , Davide Cozzolino , Riccardo Corvi , Giovanni Poggi , Luisa Verdoliva

Recently, powerful Large Language Models (LLMs) have become easily accessible to hundreds of millions of users world-wide. However, their strong capabilities and vast world knowledge do not come without associated privacy risks. In this…

Machine Learning · Computer Science 2024-11-05 Hanna Yukhymenko , Robin Staab , Mark Vero , Martin Vechev

Recent accelerations in multi-modal applications have been made possible with the plethora of image and text data available online. However, the scarcity of analogous data in the medical field, specifically in histopathology, has slowed…

The success of modern machine learning, particularly in facial translation networks, is highly dependent on the availability of high-quality, paired, large-scale datasets. However, acquiring sufficient data is often challenging and costly.…

Computer Vision and Pattern Recognition · Computer Science 2025-09-09 Leyang Wang , Joice Lin

Synthetic data generation using large language models (LLMs) demonstrates substantial promise in addressing biomedical data challenges and shows increasing adoption in biomedical research. This study systematically reviews recent advances…

Computation and Language · Computer Science 2026-02-18 Hanshu Rao , Weisi Liu , Haohan Wang , I-Chan Huang , Zhe He , Xiaolei Huang

In the medical domain, the lack of large training data sets and benchmarks is often a limiting factor for training deep neural networks. In contrast to expensive manual labeling, computer simulations can generate large and fully labeled…

Skin lesion datasets provide essential information for understanding various skin conditions and developing effective diagnostic tools. They aid the artificial intelligence-based early detection of skin cancer, facilitate treatment…

Image and Video Processing · Electrical Eng. & Systems 2024-06-12 Abdurrahim Yilmaz , Sirin Pekcan Yasar , Gulsum Gencoglan , Burak Temelkuran

Pre-trained Vision-Language Models (VLMs) utilizing extensive image-text paired data have demonstrated unprecedented image-text association capabilities, achieving remarkable results across various downstream tasks. A critical challenge is…

Computer Vision and Pattern Recognition · Computer Science 2024-09-10 Zilun Zhang , Tiancheng Zhao , Yulong Guo , Jianwei Yin

Despite the rapidly growing demand for multimodal retrieval, progress in this field remains severely constrained by a lack of training data. In this paper, we introduce MegaPairs, a novel data synthesis method that leverages vision language…

Computer Vision and Pattern Recognition · Computer Science 2024-12-20 Junjie Zhou , Zheng Liu , Ze Liu , Shitao Xiao , Yueze Wang , Bo Zhao , Chen Jason Zhang , Defu Lian , Yongping Xiong

Despite the recent success in applying supervised deep learning to medical imaging tasks, the problem of obtaining large and diverse expert-annotated datasets required for the development of high performant models remains particularly…

Computer Vision and Pattern Recognition · Computer Science 2019-11-21 Amirata Ghorbani , Vivek Natarajan , David Coz , Yuan Liu