English
Related papers

Related papers: CheXLearner: Text-Guided Fine-Grained Representati…

200 papers

Autoregressive (AR) models have shown great promise in image generation, yet they face a fundamental inefficiency stemming from their core component: a vast, unstructured vocabulary of visual tokens. This conventional approach treats tokens…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Lixuan He , Shikang Zheng , Linfeng Zhang

Recent advancements in medical Large Language Models (LLMs) have showcased their powerful reasoning and diagnostic capabilities. Despite their success, current unified multimodal medical LLMs face limitations in knowledge update costs,…

Computation and Language · Computer Science 2025-06-25 Yucheng Zhou , Lingran Song , Jianbing Shen

Data is one of the essential ingredients to power deep learning research. Small datasets, especially specific to medical institutes, bring challenges to deep learning training stage. This work aims to develop a practical deep multimodal…

Machine Learning · Computer Science 2019-02-26 Faik Aydin , Maggie Zhang , Michelle Ananda-Rajah , Gholamreza Haffari

The DCELANM-Net structure, which this article offers, is a model that ingeniously combines a Dual Channel Efficient Layer Aggregation Network (DCELAN) and a Micro Masked Autoencoder (Micro-MAE). On the one hand, for the DCELAN, the features…

Image and Video Processing · Electrical Eng. & Systems 2023-04-20 Chengzhun Lu , Zhangrun Xia , Krzysztof Przystupa , Orest Kochan , Jun Su

With the development of Deep Neural Networks (DNNs), many efforts have been made to handle medical image segmentation. Traditional methods such as nnUNet train specific segmentation models on the individual datasets. Plenty of recent…

Computer Vision and Pattern Recognition · Computer Science 2024-07-12 Xiaobao Wei , Jiajun Cao , Yizhu Jin , Ming Lu , Guangyu Wang , Shanghang Zhang

Manifold alignment (MA) involves a set of techniques for learning shared representations across domains, yet many traditional MA methods are incapable of performing out-of-sample extension, limiting their real-world applicability. We…

Machine Learning · Computer Science 2025-09-30 Jake S. Rhodes , Adam G. Rustad , Marshall S. Nielsen , Morgan Chase McClellan , Dallan Gardner , Dawson Hedges

Medical report generation is crucial for clinical diagnosis and patient management, summarizing diagnoses and recommendations based on medical imaging. However, existing work often overlook the clinical pipeline involved in report writing,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-24 Xiaofei Huang , Wenting Chen , Jie Liu , Qisheng Lu , Xiaoling Luo , Linlin Shen

Medical image segmentation is challenging due to overlapping anatomies with ambiguous boundaries and a severe imbalance between the foreground and background classes, which particularly affects the delineation of small lesions. Existing…

Computer Vision and Pattern Recognition · Computer Science 2025-06-24 Hao Shao , Qibin Hou

Deep learning techniques have emerged as a promising approach to highly accelerated MRI. However, recent reconstruction challenges have shown several drawbacks in current deep learning approaches, including the loss of fine image details…

Computer Vision and Pattern Recognition · Computer Science 2021-09-24 Ruiyang Zhao , Yuxin Zhang , Burhaneddin Yaman , Matthew P. Lungren , Michael S. Hansen

In recent years, continuous latent space (CLS) and discrete latent space (DLS) deep learning models have been proposed for medical image analysis for improved performance. However, these models encounter distinct challenges. CLS models…

Computer Vision and Pattern Recognition · Computer Science 2023-10-30 Vandan Gorade , Sparsh Mittal , Debesh Jha , Ulas Bagci

Automatic melanoma segmentation is essential for early skin cancer detection, yet challenges arise from the heterogeneity of melanoma, as well as interfering factors like blurred boundaries, low contrast, and imaging artifacts. While…

Image and Video Processing · Electrical Eng. & Systems 2026-03-31 Zhuoyi Fang , Jiajia Liu , Kexuan Shi , Qiang Han

Medical image-language pre-training aims to align medical images with clinically relevant text to improve model performance on various downstream tasks. However, existing models often struggle with the variability and ambiguity inherent in…

Computer Vision and Pattern Recognition · Computer Science 2025-07-30 Shreyank N Gowda , Ruichi Zhang , Xiao Gu , Ying Weng , Lu Yang

This research presents a machine-learning approach for tumor detection in medical images using convolutional neural networks (CNNs). The study focuses on preprocessing techniques to enhance image features relevant to tumor detection,…

Image and Video Processing · Electrical Eng. & Systems 2024-03-01 Ha Anh Vu

Melanoma detection is vital for early diagnosis and effective treatment. While deep learning models on dermoscopic images have shown promise, they require specialized equipment, limiting their use in broader clinical settings. This study…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Volodymyr Sydorskyi , Igor Krashenyi , Oleksii Yakubenko

Malignant melanoma is the deadliest form of skin cancer and, in recent years, is rapidly growing in terms of the incidence worldwide rate. The most effective approach to targeted treatment is early diagnosis. Deep learning algorithms,…

Image and Video Processing · Electrical Eng. & Systems 2020-09-21 Mario Manzo , Simone Pellino

Existing learning models often utilise CT-scan images to predict lung diseases. These models are posed by high uncertainties that affect lung segmentation and visual feature learning. We introduce MARL, a novel Multimodal Attentional…

Computer Vision and Pattern Recognition · Computer Science 2021-05-04 Ali Hamdi , Amr Aboeleneen , Khaled Shaban

Precision medicine in the quantitative management of chronic diseases and oncology would be greatly improved if the Computed Tomography (CT) scan of any patient could be segmented, parsed and analyzed in a precise and detailed way. However,…

Medical artificial intelligence (AI) systems, particularly multimodal vision-language models (VLM), often exhibit intersectional biases where models are systematically less confident in diagnosing marginalised patient subgroups. Such bias…

Computer Vision and Pattern Recognition · Computer Science 2025-12-25 Yupeng Zhang , Adam G. Dunn , Usman Naseem , Jinman Kim

In this paper, an innovative multi-modal deep learning model is proposed to deeply integrate heterogeneous information from medical images and clinical reports. First, for medical images, convolutional neural networks were used to extract…

Machine Learning · Computer Science 2024-05-29 Ziyan Yao , Fei Lin , Sheng Chai , Weijie He , Lu Dai , Xinghui Fei

Medical image segmentation plays a vital role in various clinical applications, enabling accurate delineation and analysis of anatomical structures or pathological regions. Traditional CNNs have achieved remarkable success in this field.…

Image and Video Processing · Electrical Eng. & Systems 2024-04-18 Seyed M. R. Modaresi , Aomar Osmani , Mohammadreza Razzazi , Abdelghani Chibani