English
Related papers

Related papers: UNICORN: A Deep Learning Model for Integrating Mul…

200 papers

Medical foundation models show promise to learn broadly generalizable features from large, diverse datasets. This could be the base for reliable cross-modality generalization and rapid adaptation to new, task-specific goals, with only a few…

Foundational models are trained on extensive datasets to capture the general trends of a domain. However, in medical imaging, the scarcity of data makes pre-training for every domain, modality, or task challenging. Continual learning offers…

Image and Video Processing · Electrical Eng. & Systems 2025-08-20 Mohammad Areeb Qazi , Munachiso S Nwadike , Ibrahim Almakky , Mohammad Yaqub , Numan Saeed

Virtual stain transfer is a promising area of research in Computational Pathology, which has a great potential to alleviate important limitations when applying deeplearningbased solutions such as lack of annotations and sensitivity to a…

Computer Vision and Pattern Recognition · Computer Science 2022-10-19 Jelica Vasiljević , Friedrich Feuerhake , Cédric Wemmert , Thomas Lampert

Automated segmentation of multiple sclerosis (MS) lesions using multicontrast magnetic resonance (MR) images improves efficiency and reproducibility compared to manual delineation, with deep learning (DL) methods achieving state-of-the-art…

Modern medical image registration approaches predict deformations using deep networks. These approaches achieve state-of-the-art (SOTA) registration accuracy and are generally fast. However, deep learning (DL) approaches are, in contrast to…

The integration of diverse clinical modalities such as medical imaging and the tabular data extracted from patients' Electronic Health Records (EHRs) is a crucial aspect of modern healthcare. Integrative analysis of multiple sources can…

Computer Vision and Pattern Recognition · Computer Science 2025-04-22 Daniel Duenias , Brennan Nichyporuk , Tal Arbel , Tammy Riklin Raviv

Fusing multi-modal data can improve the performance of deep learning models. However, missing modalities are common for medical data due to patients' specificity, which is detrimental to the performance of multi-modal models in…

Image and Video Processing · Electrical Eng. & Systems 2023-09-28 Muyu Wang , Shiyu Fan , Yichen Li , Hui Chen

Multimodal deep learning has shown strong potential in medical applications by integrating heterogeneous data sources such as medical images and structured clinical variables. However, most existing approaches implicitly assume complete…

Machine Learning · Computer Science 2026-05-13 Camillo Maria Caruso , Valerio Guarrasi , Paolo Soda

Virtual immunohistochemistry (IHC) staining from hematoxylin and eosin (H&E) images can accelerate diagnostics by providing preliminary molecular insight directly from routine sections, reducing the need for repeat sectioning when tissue is…

Computer Vision and Pattern Recognition · Computer Science 2026-03-16 Jillur Rahman Saurav , Thuong Le Hoai Pham , Pritam Mukherjee , Paul Yi , Brent A. Orr , Jacob M. Luber

Osteoporosis is a common condition that increases fracture risk, especially in older adults. Early diagnosis is vital for preventing fractures, reducing treatment costs, and preserving mobility. However, healthcare providers face challenges…

Computer Vision and Pattern Recognition · Computer Science 2025-10-21 Mehdi Hosseini Chagahi , Saeed Mohammadi Dashtaki , Niloufar Delfan , Nadia Mohammadi , Farshid Rostami Pouria , Behzad Moshiri , Md. Jalil Piran , Oliver Faust

Classification of medical images plays a vital role in medical image analysis; however, it remains challenging due to the limited availability of labeled data, class imbalances, and the complexity of medical patterns. To overcome these…

Histopathology images; microscopy images of stained tissue biopsies contain fundamental prognostic information that forms the foundation of pathological analysis and diagnostic medicine. However, diagnostics from histopathology images…

Computer Vision and Pattern Recognition · Computer Science 2019-10-30 Aïcha BenTaieb , Ghassan Hamarneh

With the emergence of multimodal electronic health records, the evidence for an outcome may be captured across multiple modalities ranging from clinical to imaging and genomic data. Predicting outcomes effectively requires fusion frameworks…

Colorectal diseases, including inflammatory conditions and neoplasms, require quick, accurate care to be effectively treated. Traditional diagnostic pipelines require extensive preparation and rely on separate, individual evaluations on…

Computer Vision and Pattern Recognition · Computer Science 2025-09-09 Krithik Ramesh , Ritvik Koneru

Medical multi-modal pre-training has revealed promise in computer-aided diagnosis by leveraging large-scale unlabeled datasets. However, existing methods based on masked autoencoders mainly rely on data-level reconstruction tasks, but lack…

Computer Vision and Pattern Recognition · Computer Science 2024-04-10 Yupei Zhang , Li Pan , Qiushi Yang , Tan Li , Zhen Chen

This paper introduces an innovative multi-modal fusion deep learning approach to overcome the drawbacks of traditional single-modal recognition techniques. These drawbacks include incomplete information and limited diagnostic accuracy.…

Computer Vision and Pattern Recognition · Computer Science 2024-06-28 Xiaoyi Liu , Hongjie Qiu , Muqing Li , Zhou Yu , Yutian Yang , Yafeng Yan

Colon cancer also known as Colorectal cancer, is one of the most malignant types of cancer worldwide. Early-stage detection of colon cancer is highly crucial to prevent its deterioration. This research presents a hybrid multi-scale deep…

Computer Vision and Pattern Recognition · Computer Science 2025-09-04 Sadra Saremi , Amirhossein Ahmadkhan Kordbacheh

Chronic wounds such as diabetic foot ulcers and pressure injuries require accurate tissue-level assessment to guide treatment planning and monitor healing progression. While deep learning methods have advanced automated wound analysis, most…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Muhammad Ashad Kabir , Rabin Dulal

Technological advances in medical data collection, such as high-throughput genomic sequencing and digital high-resolution histopathology, have contributed to the rising requirement for multimodal biomedical modelling, specifically for…

Machine Learning · Computer Science 2024-10-29 Konstantin Hemker , Nikola Simidjievski , Mateja Jamnik

In pathology, tissue samples are assessed using multiple staining techniques to enhance contrast in unique histologic features. In this paper, we introduce a multimodal CNN-GNN based graph fusion approach that leverages complementary…

Image and Video Processing · Electrical Eng. & Systems 2022-04-28 Chaitanya Dwivedi , Shima Nofallah , Maryam Pouryahya , Janani Iyer , Kenneth Leidal , Chuhan Chung , Timothy Watkins , Andrew Billin , Robert Myers , John Abel , Ali Behrooz
‹ Prev 1 2 3 10 Next ›