English
Related papers

Related papers: Transformer-based interpretable multi-modal data f…

200 papers

Artificial intelligence (AI) algorithms using deep learning have advanced the classification of skin disease images; however these algorithms have been mostly applied "in silico" and not validated clinically. Most dermatology AI algorithms…

Computer Vision and Pattern Recognition · Computer Science 2021-05-24 Roxana Daneshjou , Carrie Kovarik , Justin M Ko

In practice, many medical datasets have an underlying taxonomy defined over the disease label space. However, existing classification algorithms for medical diagnoses often assume semantically independent labels. In this study, we aim to…

Computer Vision and Pattern Recognition · Computer Science 2022-09-14 Zhen Yu , Toan Nguyen , Yaniv Gal , Lie Ju , Shekhar S. Chandra , Lei Zhang , Paul Bonnington , Victoria Mar , Zhiyong Wang , Zongyuan Ge

Melanoma is a malignant tumor that originates from skin cell lesions. Accurate and efficient segmentation of skin lesions is essential for quantitative analysis but remains a challenge due to blurred lesion boundaries, gradual color…

Image and Video Processing · Electrical Eng. & Systems 2025-07-03 Saqib Qamar , Syed Furqan Qadri , Roobaea Alroobaea , Goram Mufarah M Alshmrani , Richard Jiang

Skin diseases affect millions of people worldwide, across all ethnicities. Increasing diagnosis accessibility requires fair and accurate segmentation and classification of dermatology images. However, the scarcity of annotated medical…

Computer Vision and Pattern Recognition · Computer Science 2023-07-24 Héctor Carrión , Narges Norouzi

Skin cancer can be identified by dermoscopic examination and ocular inspection, but early detection significantly increases survival chances. Artificial intelligence (AI), using annotated skin images and Convolutional Neural Networks…

Computer Vision and Pattern Recognition · Computer Science 2025-12-24 Abdullah Al Shafi , Abdul Muntakim , Pintu Chandra Shill , Rowzatul Zannat , Abdullah Al-Amin

Recently, deep learning (DL) found its way to interventional X-ray skin dose estimation. While its performance was found to be acceptable, even more accurate results could be achieved if more data sets were available for training. One…

Healthcare data now span EHRs, medical imaging, genomics, and wearable sensors, but most diagnostic models still process these modalities in isolation. This limits their ability to capture early, cross-modal disease signatures. This paper…

Machine Learning · Computer Science 2025-12-18 Md Talha Mohsin , Ismail Abdulrashid

Skin cancer, the most common human malignancy, is primarily diagnosed visually by physicians [1]. Classification with an automated method like CNN [2, 3] shows potential for challenging tasks [1]. By now, the deep convolutional neural…

Computer Vision and Pattern Recognition · Computer Science 2017-03-13 Wenhao Zhang , Liangcai Gao , Runtao Liu

We present a method for skin lesion segmentation for the ISIC 2017 Skin Lesion Segmentation Challenge. Our approach is based on a Fully Convolutional Network architecture which is trained end to end, from scratch, on a limited dataset. Our…

Computer Vision and Pattern Recognition · Computer Science 2017-03-16 Dhanesh Ramachandram , Terrance DeVries

Skin cancer is the most common human malignancy(American Cancer Society) which is primarily diagnosed visually, starting with an initial clinical screening and followed potentially by dermoscopic(related to skin) analysis, a biopsy and…

Image and Video Processing · Electrical Eng. & Systems 2022-02-03 Kartikeya Agarwal , Tismeet Singh

Large Language Models(LLMs) excel in general tasks but struggle in specialized domains like healthcare due to limited domain-specific knowledge.Supervised Fine-Tuning(SFT) data construction for domain adaptation often relies on heuristic…

Machine Learning · Computer Science 2025-09-19 Hongxin Ding , Yue Fang , Runchuan Zhu , Xinke Jiang , Jinyang Zhang , Yongxin Xu , Xu Chu , Junfeng Zhao , Yasha Wang

Melanoma is a sort of skin cancer that starts in the cells known as melanocytes. It is more dangerous than other types of skin cancer because it can spread to other organs. Melanoma can be fatal if it spreads to other parts of the body.…

Image and Video Processing · Electrical Eng. & Systems 2023-12-05 Md. Fahim Uddin , Nafisa Tafshir , Mohammad Monirujjaman Khan

Multimodal fusion frameworks for Human Action Recognition (HAR) using depth and inertial sensor data have been proposed over the years. In most of the existing works, fusion is performed at a single level (feature level or decision level),…

Machine Learning · Computer Science 2019-10-28 Zeeshan Ahmad , Naimul Khan

The rapid advancement of deep learning (DL) has transformed healthcare, particularly in cancer detection and diagnosis. DL surpasses traditional machine learning and human accuracy, making it a critical tool for identifying diseases.…

Image and Video Processing · Electrical Eng. & Systems 2025-04-21 Yassine Habchi , Hamza Kheddar , Yassine Himeur , Adel Belouchrani , Erchin Serpedin , Fouad Khelifi , Muhammad E. H. Chowdhury

Deep learning has the potential to automate many clinically useful tasks in medical imaging. However translation of deep learning into clinical practice has been hindered by issues such as lack of the transparency and interpretability in…

Image and Video Processing · Electrical Eng. & Systems 2022-05-04 Charles Lu , Andreanne Lemay , Ken Chang , Katharina Hoebel , Jayashree Kalpathy-Cramer

We introduce SLIMP (Skin Lesion Image-Metadata Pre-training) for learning rich representations of skin lesions through a novel nested contrastive learning approach that captures complex relationships between images and metadata. Melanoma…

Computer Vision and Pattern Recognition · Computer Science 2026-01-23 Dionysis Christopoulos , Sotiris Spanos , Eirini Baltzi , Valsamis Ntouskos , Konstantinos Karantzalos

Algorithmic detection of facial palsy offers the potential to improve current practices, which usually involve labor-intensive and subjective assessments by clinicians. In this paper, we present a multimodal fusion-based deep learning model…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Heng Yim Nicole Oo , Min Hun Lee , Jeong Hoon Lim

Accurate diagnostics of a skin lesion is a critical task in classification dermoscopic images. In this research, we form a new type of image features, called hybrid features, which has stronger discrimination ability than single method…

Image and Video Processing · Electrical Eng. & Systems 2021-12-21 Redha Ali , Hussin K. Ragb

This work summarizes our submission for the Task 3: Disease Classification of ISIC 2018 challenge in Skin Lesion Analysis Towards Melanoma Detection. We use a novel deep neural network (DNN) ensemble architecture introduced by us that can…

Computer Vision and Pattern Recognition · Computer Science 2018-07-25 Manik Goyal , Jagath C. Rajapakse

Skin cancer is one of the most common types of malignancy, affecting a large population and causing a heavy economic burden worldwide. Over the last few years, computer-aided diagnosis has been rapidly developed and make great progress in…

Computer Vision and Pattern Recognition · Computer Science 2022-03-31 Yongwei Wang , Yuheng Wang , Tim K. Lee , Chunyan Miao , Z. Jane Wang