English
Related papers

Related papers: A Multimodal Vision Foundation Model for Clinical …

200 papers

With a large influx of dermoscopy images and a growing shortage of dermatologists, automatic dermoscopic image analysis plays an essential role in skin cancer diagnosis. In this paper, a new deep fully convolutional neural network (FCNN) is…

Computer Vision and Pattern Recognition · Computer Science 2017-03-17 Jin Qi , Miao Le , Chunming Li , Ping Zhou

The emergence of vision-language models has transformed medical AI, enabling unprecedented advances in diagnostic capability and clinical applications. However, progress in dermatology has lagged behind other medical domains due to the lack…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Siyuan Yan , Ming Hu , Yiwen Jiang , Xieji Li , Hao Fei , Philipp Tschandl , Harald Kittler , Zongyuan Ge

Early detection of melanoma, a potentially lethal type of skin cancer with high prevalence worldwide, improves patient prognosis. In retrospective studies, artificial intelligence (AI) has proven to be helpful for enhancing melanoma…

In this paper, the effectiveness and capability of convolutional neural networks have been studied in the classification of 8 skin diseases. Different pre-trained state-of-the-art architectures (DenseNet 201, ResNet 152, Inception v3,…

Computer Vision and Pattern Recognition · Computer Science 2018-10-25 Amirreza Rezvantalab , Habib Safigholi , Somayeh Karimijeshni

Current artificial intelligence models for medical imaging are predominantly single modality and single disease. Attempts to create multimodal and multi-disease models have resulted in inconsistent clinical accuracy. Furthermore, training…

The identification of melanoma involves an integrated analysis of skin lesion images acquired using the clinical and dermoscopy modalities. Dermoscopic images provide a detailed view of the subsurface visual structures that supplement the…

Computer Vision and Pattern Recognition · Computer Science 2022-06-13 Xiaohang Fu , Lei Bi , Ashnil Kumar , Michael Fulham , Jinman Kim

With the continuous advancement of vision language models (VLMs) technology, remarkable research achievements have emerged in the dermatology field, the fourth most prevalent human disease category. However, despite these advancements, VLM…

Multimedia · Computer Science 2025-02-14 Bo Lin , Yingjing Xu , Xuanwen Bao , Zhou Zhao , Zhouyang Wang , Jianwei Yin

Skin lesion is a severe disease in world-wide extent. Early detection of melanoma in dermoscopy images significantly increases the survival rate. However, the accurate recognition of melanoma is extremely challenging due to the following…

Computer Vision and Pattern Recognition · Computer Science 2017-11-23 Yuexiang Li , Linlin Shen

Cancer clinics capture disease data at various scales, from genetic to organ level. Current bioinformatic methods struggle to handle the heterogeneous nature of this data, especially with missing modalities. We propose PARADIGM, a Graph…

Cell Behavior · Quantitative Biology 2024-11-22 Asim Waqas , Aakash Tripathi , Paul Stewart , Mia Naeini , Matthew B. Schabath , Ghulam Rasool

Medical imaging is a cornerstone of therapy and diagnosis in modern medicine. However, the choice of imaging modality for a particular theranostic task typically involves trade-offs between the feasibility of using a particular modality…

Computer Vision and Pattern Recognition · Computer Science 2022-07-22 Mayur Mallya , Ghassan Hamarneh

Skin cancer can be life-threatening if not diagnosed early, a prevalent yet preventable disease. Globally, skin cancer is perceived among the finest prevailing cancers and millions of people are diagnosed each year. For the allotment of…

Image and Video Processing · Electrical Eng. & Systems 2026-02-23 Mohammad Tahmid Noor , B. M. Shahria Alam , Tasmiah Rahman Orpa , Shaila Afroz Anika , Mahjabin Tasnim Samiha , Fahad Ahammed

The rising global prevalence of skin conditions, some of which can escalate to life-threatening stages if not timely diagnosed and treated, presents a significant healthcare challenge. This issue is particularly acute in remote areas where…

Computer Vision and Pattern Recognition · Computer Science 2024-02-19 Mahapara Khurshid , Mayank Vatsa , Richa Singh

Cutaneous malignancies demand early detection for favorable outcomes, yet current diagnostics suffer from inter-observer variability and access disparities. While AI shows promise, existing dermatological systems are limited by homogeneous…

Computer Vision and Pattern Recognition · Computer Science 2025-10-09 Sher Khan , Raz Muhammad , Adil Hussain , Muhammad Sajjad , Muhammad Rashid

Melanoma is a sort of skin cancer that starts in the cells known as melanocytes. It is more dangerous than other types of skin cancer because it can spread to other organs. Melanoma can be fatal if it spreads to other parts of the body.…

Image and Video Processing · Electrical Eng. & Systems 2023-12-05 Md. Fahim Uddin , Nafisa Tafshir , Mohammad Monirujjaman Khan

Melanoma, one of most dangerous types of skin cancer, re-sults in a very high mortality rate. Early detection and resection are two key points for a successful cure. Recent research has used artificial intelligence to classify melanoma and…

Computer Vision and Pattern Recognition · Computer Science 2020-08-31 Cong Tri Pham , Mai Chi Luong , Dung Van Hoang , Antoine Doucet

Prior skin image datasets have not addressed patient-level information obtained from multiple skin lesions from the same patient. Though artificial intelligence classification algorithms have achieved expert-level performance in controlled…

Artificial intelligence (AI) algorithms using deep learning have advanced the classification of skin disease images; however these algorithms have been mostly applied "in silico" and not validated clinically. Most dermatology AI algorithms…

Computer Vision and Pattern Recognition · Computer Science 2021-05-24 Roxana Daneshjou , Carrie Kovarik , Justin M Ko

As the application of deep learning in dermatology continues to grow, the recognition of melanoma has garnered significant attention, demonstrating potential for improving diagnostic accuracy. Despite advancements in image classification…

Computer Vision and Pattern Recognition · Computer Science 2026-05-11 Rujosh Polma , Krishnan Menon Iyer

Retinal diseases spanning a broad spectrum can be effectively identified and diagnosed using complementary signals from multimodal data. However, multimodal diagnosis in ophthalmic practice is typically challenged in terms of data…

Computer Vision and Pattern Recognition · Computer Science 2026-02-04 Lu Zhang , Huizhen Yu , Zuowei Wang , Fu Gui , Yatu Guo , Wei Zhang , Mengyu Jia

We describe a new multiresolution "nested encoder-decoder" convolutional network architecture and use it to annotate morphological patterns in reflectance confocal microscopy (RCM) images of human skin for aiding cancer diagnosis. Skin…

Computer Vision and Pattern Recognition · Computer Science 2018-08-24 Alican Bozkurt , Kivanc Kose , Christi Alessi-Fox , Melissa Gill , Dana H. Brooks , Jennifer G. Dy , Milind Rajadhyaksha