English
Related papers

Related papers: DermaSynth: Rich Synthetic Image-Text Pairs Using …

200 papers

Large language model (LLM)-based agents are increasingly used to solve complex tasks involving tool use, such as web browsing, code execution, and data analysis. However, current evaluation benchmarks do not adequately assess their ability…

One of the key impediments for developing and assessing robust medical imaging algorithms is limited access to large-scale datasets with suitable annotations. Synthetic data generated with plausible physical and biological constraints may…

Computer Vision and Pattern Recognition · Computer Science 2025-09-19 Christopher Wiedeman , Anastasiia Sarmakeeva , Elena Sizikova , Daniil Filienko , Miguel Lago , Jana G. Delfino , Aldo Badano

Large language models (LLMs) have shown impressive performance on general-purpose tasks, yet adapting them to specific domains remains challenging due to the scarcity of high-quality domain data. Existing data synthesis tools often struggle…

Computation and Language · Computer Science 2025-07-08 Ziyang Miao , Qiyu Sun , Jingyuan Wang , Yuchen Gong , Yaowei Zheng , Shiqi Li , Richong Zhang

We propose DISC-MedLLM, a comprehensive solution that leverages Large Language Models (LLMs) to provide accurate and truthful medical response in end-to-end conversational healthcare services. To construct high-quality Supervised…

Computation and Language · Computer Science 2023-08-29 Zhijie Bao , Wei Chen , Shengze Xiao , Kuang Ren , Jiaao Wu , Cheng Zhong , Jiajie Peng , Xuanjing Huang , Zhongyu Wei

Prior skin image datasets have not addressed patient-level information obtained from multiple skin lesions from the same patient. Though artificial intelligence classification algorithms have achieved expert-level performance in controlled…

While hundreds of artificial intelligence (AI) algorithms are now approved or cleared by the US Food and Drugs Administration (FDA), many studies have shown inconsistent generalization or latent bias, particularly for underrepresented…

Computer Vision and Pattern Recognition · Computer Science 2023-08-25 Luke W. Sagers , James A. Diao , Luke Melas-Kyriazi , Matthew Groh , Pranav Rajpurkar , Adewole S. Adamson , Veronica Rotemberg , Roxana Daneshjou , Arjun K. Manrai

Artificial Intelligence (AI) in skin disease diagnosis has improved significantly, but a major concern is that these models frequently show biased performance across subgroups, especially regarding sensitive attributes such as skin color.…

Computer Vision and Pattern Recognition · Computer Science 2025-04-03 Nusrat Munia , Abdullah-Al-Zubaer Imran

The driving factors behind the development of large language models (LLMs) with impressive learning capabilities are their colossal model sizes and extensive training datasets. Along with the progress in natural language processing, LLMs…

Computation and Language · Computer Science 2023-09-19 Thuat Nguyen , Chien Van Nguyen , Viet Dac Lai , Hieu Man , Nghia Trung Ngo , Franck Dernoncourt , Ryan A. Rossi , Thien Huu Nguyen

Skin diseases impose a substantial burden on global healthcare systems, driven by their high prevalence (affecting up to 70% of the population), complex diagnostic processes, and a critical shortage of dermatologists in resource-limited…

In the medical domain, acquiring large datasets is challenging due to both accessibility issues and stringent privacy regulations. Consequently, data availability and privacy protection are major obstacles to applying machine learning in…

Image and Video Processing · Electrical Eng. & Systems 2025-07-02 Wenwu Tang , Khaled Seyam , Bin Yang

In the realm of dermatological diagnoses, where the analysis of dermatoscopic and microscopic skin lesion images is pivotal for the accurate and early detection of various medical conditions, the costs associated with creating diverse and…

Multimodal (MM) learning is emerging as a promising paradigm in biomedical artificial intelligence (AI) applications, integrating complementary modality, which highlight different aspects of patient health. The scarcity of large…

Artificial Intelligence · Computer Science 2025-12-01 Niccolo Marini , Zhaohui Liang , Sivaramakrishnan Rajaraman , Zhiyun Xue , Sameer Antani

With the widespread application of artificial intelligence (AI), particularly deep learning (DL) and vision large language models (VLLMs), in skin disease diagnosis, the need for interpretability becomes crucial. However, existing…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Yuhao Shen , Liyuan Sun , Yan Xu , Wenbin Liu , Shuping Zhang , Shawn Afvari , Zhongyi Han , Jiaoyan Song , Yongzhi Ji , Tao Lu , Xiaonan He , Xin Gao , Juexiao Zhou

Large language models (LLMs) have become a dominant and important tool for NLP researchers in a wide range of tasks. Today, many researchers use LLMs in synthetic data generation, task evaluation, fine-tuning, distillation, and other…

Computation and Language · Computer Science 2024-05-29 Ajay Patel , Colin Raffel , Chris Callison-Burch

After pre-training on extensive image-text pairs, Contrastive Language-Image Pre-training (CLIP) demonstrates promising performance on a wide variety of benchmarks. However, a substantial volume of multimodal interleaved documents remains…

Computer Vision and Pattern Recognition · Computer Science 2025-08-06 Tiancheng Gu , Kaicheng Yang , Chaoyi Zhang , Yin Xie , Xiang An , Ziyong Feng , Dongnan Liu , Weidong Cai , Jiankang Deng

Medical Vision-Language Pre-training (VLP) learns representations jointly from medical images and paired radiology reports. It typically requires large-scale paired image-text datasets to achieve effective pre-training for both the image…

Computer Vision and Pattern Recognition · Computer Science 2024-05-01 Che Liu , Anand Shah , Wenjia Bai , Rossella Arcucci

Background: Health datasets from clinical sources do not reflect the breadth and diversity of disease in the real world, impacting research, medical education, and artificial intelligence (AI) tool development. Dermatology is a suitable…

AI in dermatology is evolving at a rapid pace but the major limitation to training trustworthy classifiers is the scarcity of data with ground-truth concept level labels, which are meta-labels semantically meaningful to humans. Foundation…

Computer Vision and Pattern Recognition · Computer Science 2024-09-10 Soham Gadgil , Mahtab Bigverdi

In this paper, we present a cosmetic-specific skin image dataset. It consists of skin images from $45$ patches ($5$ skin patches each from $9$ participants) of size $8mm^*8mm$ under three cosmetic products (i.e., foundation, blusher, and…

Computer Vision and Pattern Recognition · Computer Science 2024-01-12 Toby Chong , Alina Chadwick , I-chao Shen , Haoran Xie , Takeo Igarashi

The scarcity of high-quality, labelled retinal imaging data, which presents a significant challenge in the development of machine learning models for ophthalmology, hinders progress in the field. Existing methods for synthesising Colour…

Image and Video Processing · Electrical Eng. & Systems 2025-07-18 Junzhi Ning , Cheng Tang , Kaijing Zhou , Diping Song , Lihao Liu , Ming Hu , Wei Li , Huihui Xu , Yanzhou Su , Tianbin Li , Jiyao Liu , Jin Ye , Sheng Zhang , Yuanfeng Ji , Junjun He