English
Related papers

Related papers: SkinGEN: an Explainable Dermatology Diagnosis-to-G…

200 papers

A shortage of dermatologists causes long wait times for patients who seek dermatologic care. In addition, the diagnostic accuracy of general practitioners has been reported to be lower than the accuracy of artificial intelligence software.…

Image and Video Processing · Electrical Eng. & Systems 2020-05-20 Daniel Sonntag , Fabrizio Nunnari , Hans-Jürgen Profitlich

Lyme disease which is one of the most common infectious vector-borne diseases manifests itself in most cases with erythema migrans (EM) skin lesions. Recent studies show that convolutional neural networks (CNNs) perform well to identify…

Development of artificial intelligence (AI) techniques in medical imaging requires access to large-scale and diverse datasets for training and evaluation. In dermatology, obtaining such datasets remains challenging due to significant…

Computer Vision and Pattern Recognition · Computer Science 2024-08-02 Andrea Kim , Niloufar Saharkhiz , Elena Sizikova , Miguel Lago , Berkman Sahiner , Jana Delfino , Aldo Badano

Vision language models (VLM) have demonstrated remarkable performance across various downstream tasks. However, understanding fine-grained visual-linguistic concepts, such as attributes and inter-object relationships, remains a significant…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Wujian Peng , Sicheng Xie , Zuyao You , Shiyi Lan , Zuxuan Wu

Skin cancer is a common and fast rising malignancy worldwide. Early detection is critical for improving outcomes. Deep learning models trained on dermoscopic and clinical images can support automated and fast triage. However, many studies…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Durjoy Dey , Yuhong Yan , Hassan Hajjdiab

The incidence rate for skin cancer has been steadily increasing throughout the world, leading to it being a serious issue. Diagnosis at an early stage has the potential to drastically reduce the harm caused by the disease, however, the…

Image and Video Processing · Electrical Eng. & Systems 2022-07-27 Soham Bhosale

As Vision-Language Models (VLMs) grow in sophistication, their ability to perform reasoning is coming under increasing supervision. While they excel at many tasks, their grasp of fundamental scientific principles, such as physics, remains…

Machine Learning · Computer Science 2025-09-11 Pranav Pawar , Kavish Shah , Akshat Bhalani , Komal Kasat , Dev Mittal , Hadi Gala , Deepali Patil , Nikita Raichada , Monali Deshmukh

Vision-language models (VLMs) are increasingly adapted through domain-specific fine-tuning, yet it remains unclear whether this improves reasoning beyond superficial visual cues, particularly in high-stakes domains like medicine. We…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Oliver McLaughlin , Daniel Shubin , Carsten Eickhoff , Ritambhara Singh , William Rudman , Michal Golovanevsky

Automatic clinical diagnosis of retinal diseases has emerged as a promising approach to facilitate discovery in areas with limited access to specialists. We propose a novel visual-assisted diagnosis hybrid model based on the support vector…

Computer Vision and Pattern Recognition · Computer Science 2018-07-05 C. -H. Huck Yang , Jia-Hong Huang , Fangyu Liu , Fang-Yi Chiu , Mengya Gao , Weifeng Lyu , I-Hung Lin M. D. , Jesper Tegner

As one kind of skin cancer, melanoma is very dangerous. Dermoscopy based early detection and recarbonization strategy is critical for melanoma therapy. However, well-trained dermatologists dominant the diagnostic accuracy. In order to solve…

Computer Vision and Pattern Recognition · Computer Science 2017-03-03 Hao Chang

Vision-Language Foundation Models (VLFM) have shown a tremendous increase in performance in terms of generating high-resolution, photorealistic natural images. While VLFMs show a rich understanding of semantic content across modalities,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Parham Saremi , Amar Kumar , Mohamed Mohamed , Zahra TehraniNasab , Tal Arbel

Malignant melanoma has one of the most rapidly increasing incidences in the world and has a considerable mortality rate. Early diagnosis is particularly important since melanoma can be cured with prompt excision. Dermoscopy images play an…

Computer Vision and Pattern Recognition · Computer Science 2017-03-20 Lei Bi , Jinman Kim , Euijoon Ahn , Dagan Feng

Modern Vision-Language Models (VLMs) exhibit unprecedented capabilities in cross-modal semantic understanding between visual and textual modalities. Given the intrinsic need for multi-modal integration in clinical applications, VLMs have…

Image and Video Processing · Electrical Eng. & Systems 2025-06-24 Haoneng Lin , Cheng Xu , Jing Qin

Early detection of skin cancers like melanoma is crucial to ensure high chances of survival for patients. Clinical application of Deep Learning (DL)-based Decision Support Systems (DSS) for skin cancer screening has the potential to improve…

Computer Vision and Pattern Recognition · Computer Science 2021-03-10 Adriano Lucieri , Andreas Dengel , Sheraz Ahmed

Pathologists have a rich vocabulary with which they can describe all the nuances of cellular morphology. In their world, there is a natural pairing of images and words. Recent advances demonstrate that machine learning models can now be…

Machine Learning · Computer Science 2022-07-14 Simon M. Thomas , James G. Lefevre , Glenn Baxter , Nicholas A. Hamilton

Accurate dental diagnosis is essential for oral healthcare, yet many individuals lack access to timely professional evaluation. Existing AI-based methods primarily treat diagnosis as a visual pattern recognition task and do not reflect the…

Vision language models (VLMs) are designed to extract relevant visuospatial information from images. Some research suggests that VLMs can exhibit humanlike scene understanding, while other investigations reveal difficulties in their ability…

Computer Vision and Pattern Recognition · Computer Science 2025-04-23 Sangeet Khemlani , Tyler Tran , Nathaniel Gyory , Anthony M. Harrison , Wallace E. Lawson , Ravenna Thielstrom , Hunter Thompson , Taaren Singh , J. Gregory Trafton

Automated skin lesion analysis for simultaneous detection and recognition is still challenging for inter-class homogeneity and intra-class heterogeneity, leading to low generic capability of a Single Convolutional Neural Network (CNN) with…

Dermatological diagnosis represents a complex multimodal challenge that requires integrating visual features with specialized clinical knowledge. While vision-language pretraining (VLP) has advanced medical AI, its effectiveness in…

Computer Vision and Pattern Recognition · Computer Science 2025-05-15 Siyuan Yan , Xieji Li , Ming Hu , Yiwen Jiang , Zhen Yu , Zongyuan Ge

Image classification usually requires connectivity and access to the cloud which is often limited in many parts of the world, including hard to reach rural areas. TinyML aims to solve this problem by hosting AI assistants on constrained…

Machine Learning · Computer Science 2024-08-16 Tess Watt , Christos Chrysoulas , Peter J Barclay