English
Related papers

Related papers: DerMAE: Improving skin lesion classification throu…

200 papers

Dataset distillation enables the training of deep neural networks with comparable performance in significantly reduced time by compressing large datasets into small and representative ones. Although the introduction of generative models has…

Machine Learning · Computer Science 2025-05-27 Mingzhuo Li , Guang Li , Jiafeng Mao , Takahiro Ogawa , Miki Haseyama

We introduce SLIMP (Skin Lesion Image-Metadata Pre-training) for learning rich representations of skin lesions through a novel nested contrastive learning approach that captures complex relationships between images and metadata. Melanoma…

Computer Vision and Pattern Recognition · Computer Science 2026-01-23 Dionysis Christopoulos , Sotiris Spanos , Eirini Baltzi , Valsamis Ntouskos , Konstantinos Karantzalos

One highly promising direction for enabling flexible real-time on-device image editing is utilizing data distillation by leveraging large-scale text-to-image diffusion models to generate paired datasets used for training generative…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Yifan Gong , Zheng Zhan , Qing Jin , Yanyu Li , Yerlan Idelbayev , Xian Liu , Andrey Zharkov , Kfir Aberman , Sergey Tulyakov , Yanzhi Wang , Jian Ren

Pigmented skin lesions represent localized areas of increased melanin and can indicate serious conditions like melanoma, a major contributor to skin cancer mortality. The MedMNIST v2 dataset, inspired by MNIST, was recently introduced to…

Image and Video Processing · Electrical Eng. & Systems 2025-07-18 Nerma Kadric , Amila Akagic , Medina Kapo

Skin cancer is a global health concern, necessitating early and accurate diagnosis for improved patient outcomes. This study introduces a groundbreaking approach to skin cancer classification, employing the Vision Transformer, a…

Image and Video Processing · Electrical Eng. & Systems 2024-01-11 Galib Muhammad Shahriar Himel , Md. Masudul Islam , Kh Abdullah Al-Aff , Shams Ibne Karim , Md. Kabir Uddin Sikder

Convolutional neural networks (CNNs) have achieved great success in skin lesion classification. A balanced dataset is required to train a good model. However, due to the appearance of different skin lesions in practice, severe or even…

Computer Vision and Pattern Recognition · Computer Science 2022-02-14 Keyu Chen , Di Zhuang , J. Morris Chang

Background and objective: Employing deep learning models in critical domains such as medical imaging poses challenges associated with the limited availability of training data. We present a strategy for improving the performance and…

Computer Vision and Pattern Recognition · Computer Science 2024-03-27 Eva Pachetti , Sotirios A. Tsaftaris , Sara Colantonio

Objective: This work addresses two key problems of skin lesion classification. The first problem is the effective use of high-resolution images with pretrained standard architectures for image classification. The second problem is the high…

Computer Vision and Pattern Recognition · Computer Science 2019-05-10 Nils Gessert , Thilo Sentker , Frederic Madesta , Rüdiger Schmitz , Helge Kniep , Ivo Baltruschat , René Werner , Alexander Schlaefer

Deep models are susceptible to learning spurious correlations, even during the post-processing. We take a closer look at the knowledge distillation -- a popular post-processing technique for model compression -- and find that distilling…

Machine Learning · Computer Science 2023-02-23 Jiwoon Lee , Jaeho Lee

Model compression and knowledge distillation have been successfully applied for cross-architecture and cross-domain transfer learning. However, a key requirement is that training examples are in correspondence across the domains. We show…

Computer Vision and Pattern Recognition · Computer Science 2017-08-30 Jong-Chyi Su , Subhransu Maji

Generative modeling and clustering are conventionally distinct tasks in machine learning. Variational Autoencoders (VAEs) have been widely explored for their ability to integrate both, providing a framework for generative clustering.…

Computer Vision and Pattern Recognition · Computer Science 2025-10-15 Jorge da Silva Gonçalves , Laura Manduchi , Moritz Vandenhirtz , Julia E. Vogt

Accurate and robust medical image classification is a challenging task, especially in application domains where available annotated datasets are small and present high imbalance between target classes. Considering that data acquisition is…

Computer Vision and Pattern Recognition · Computer Science 2024-10-02 Neil De La Fuente , Mireia Majó , Irina Luzko , Henry Córdova , Gloria Fernández-Esparrach , Jorge Bernal

We aim to leverage diffusion to address the challenging image matting task. However, the presence of high computational overhead and the inconsistency of noise sampling between the training and inference processes pose significant obstacles…

Computer Vision and Pattern Recognition · Computer Science 2024-12-05 Yihan Hu , Yiheng Lin , Wei Wang , Yao Zhao , Yunchao Wei , Humphrey Shi

Masked Autoencoders (MAE) achieve self-supervised learning of image representations by randomly removing a portion of visual tokens and reconstructing the original image as a pretext task, thereby significantly enhancing pretraining…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Jiaxuan Li , Qing Xu , Xiangjian He , Ziyu Liu , Chang Xing , Zhen Chen , Daokun Zhang , Rong Qu , Chang Wen Chen

Pre-training a large transformer model on a massive amount of unlabeled data and fine-tuning it on labeled datasets for diverse downstream tasks has proven to be a successful strategy, for a variety of vision and natural language processing…

Computer Vision and Pattern Recognition · Computer Science 2023-06-12 Seanie Lee , Minki Kang , Juho Lee , Sung Ju Hwang , Kenji Kawaguchi

Deep learning has played a major role in the interpretation of dermoscopic images for detecting skin defects and abnormalities. However, current deep learning solutions for dermatological lesion analysis are typically limited in providing…

Computer Vision and Pattern Recognition · Computer Science 2021-07-20 Gun-Hee Lee , Han-Bin Ko , Seong-Whan Lee

Existing video tokenizers typically use the traditional Variational Autoencoder (VAE) architecture for video compression and reconstruction. However, to achieve good performance, its training process often relies on complex multi-stage…

Computer Vision and Pattern Recognition · Computer Science 2025-03-28 Nianzu Yang , Pandeng Li , Liming Zhao , Yang Li , Chen-Wei Xie , Yehui Tang , Xudong Lu , Zhihang Liu , Yun Zheng , Yu Liu , Junchi Yan

Skin image datasets often suffer from imbalanced data distribution, exacerbating the difficulty of computer-aided skin disease diagnosis. Some recent works exploit supervised contrastive learning (SCL) for this long-tailed challenge.…

Computer Vision and Pattern Recognition · Computer Science 2023-07-11 Yilan Zhang , Jianqi Chen , Ke Wang , Fengying Xie

Melanoma is one of the ten most common cancers in the US. Early detection is crucial for survival, but often the cancer is diagnosed in the fatal stage. Deep learning has the potential to improve cancer detection rates, but its…

Computer Vision and Pattern Recognition · Computer Science 2019-05-16 Devansh Bisla , Anna Choromanska , Jennifer A. Stein , David Polsky , Russell Berman

With the rapid development of artificial intelligence (AI), especially in the medical field, the need for its explainability has grown. In medical image analysis, a high degree of transparency and model interpretability can help clinicians…

Artificial Intelligence · Computer Science 2025-02-25 Yuchen Jiang , Xinyuan Zhao , Yihang Wu , Ahmad Chaddad