English
Related papers

Related papers: Multimodal Feature Fusion and Knowledge-Driven Lea…

200 papers

Recent works on Multimodal 3D Computer-aided diagnosis have demonstrated that obtaining a competitive automatic diagnosis model when a 3D convolution neural network (CNN) brings more parameters and medical images are scarce remains…

Computer Vision and Pattern Recognition · Computer Science 2022-01-25 Yin Dai , Yifan Gao , Fayu Liu , Jun Fu

This paper introduces an innovative multi-modal fusion deep learning approach to overcome the drawbacks of traditional single-modal recognition techniques. These drawbacks include incomplete information and limited diagnostic accuracy.…

Computer Vision and Pattern Recognition · Computer Science 2024-06-28 Xiaoyi Liu , Hongjie Qiu , Muqing Li , Zhou Yu , Yutian Yang , Yafeng Yan

This study proposes a novel perspective on multimodal deep learning for biomedical signal classification, systematically analyzing how complementary feature domains impact model performance. While fusing multiple domains often presumes…

Machine Learning · Computer Science 2025-08-05 Timothy Oladunni , Alex Wong

Osteoporosis is a common condition that increases fracture risk, especially in older adults. Early diagnosis is vital for preventing fractures, reducing treatment costs, and preserving mobility. However, healthcare providers face challenges…

Computer Vision and Pattern Recognition · Computer Science 2025-10-21 Mehdi Hosseini Chagahi , Saeed Mohammadi Dashtaki , Niloufar Delfan , Nadia Mohammadi , Farshid Rostami Pouria , Behzad Moshiri , Md. Jalil Piran , Oliver Faust

In this paper, we introduce the semantic knowledge of medical images from their diagnostic reports to provide an inspirational network training and an interpretable prediction mechanism with our proposed novel multimodal neural network,…

Computer Vision and Pattern Recognition · Computer Science 2017-08-11 Zizhao Zhang , Pingjun Chen , Manish Sapkota , Lin Yang

ChronoMID builds on the success of cross-modal convolutional neural networks (X-CNNs), making the novel application of the technique to medical imaging data. Specifically, this paper presents and compares alternative approaches - timestamps…

Image and Video Processing · Electrical Eng. & Systems 2020-07-01 Alexander G. Rakowski , Petar Veličković , Enrico Dall'Ara , Pietro Liò

Alzheimers Disease (AD) is a progressive neurodegenerative disorder that poses significant challenges in its early diagnosis, often leading to delayed treatment and poorer outcomes for patients. Traditional diagnostic methods, typically…

Machine Learning · Computer Science 2025-08-06 Tatwadarshi P Nagarhalli , Sanket Patil , Vishal Pande , Uday Aswalekar , Prafulla Patil

Machine learning (ML) for diagnosis of thyroid nodules on ultrasound is an active area of research. However, ML tools require large, well-labelled datasets, the curation of which is time-consuming and labor-intensive. The purpose of our…

Image and Video Processing · Electrical Eng. & Systems 2023-05-05 Jikai Zhang , Maciej M. Mazurowski , Brian C. Allen , Benjamin Wildman-Torbiner

Cancer has relational information residing at varying scales, modalities, and resolutions of the acquired data, such as radiology, pathology, genomics, proteomics, and clinical records. Integrating diverse data types can improve the…

Machine Learning · Computer Science 2024-07-29 Asim Waqas , Aakash Tripathi , Ravi P. Ramachandran , Paul Stewart , Ghulam Rasool

This paper provides a critical review of the literature on deep learning applications in breast tumor diagnosis using ultrasound and mammography images. It also summarizes recent advances in computer-aided diagnosis (CAD) systems, which…

Image and Video Processing · Electrical Eng. & Systems 2020-10-05 Yuliana Jiménez-Gaona , María José Rodríguez-Álvarez , Vasudevan Lakshminarayanan

Quantum machine learning has emerged as a promising approach for medical image analysis, particularly in settings where compact models and expressive feature representations are desired. This paper presents a hybrid classical--quantum…

Computer Vision and Pattern Recognition · Computer Science 2026-05-01 Shabnam Sodagari , Tommy Long

Accurate skin disease classification is a critical yet challenging task due to high inter-class similarity, intra-class variability, and complex lesion textures. While deep learning-based computer-aided diagnosis (CAD) systems have shown…

Computer Vision and Pattern Recognition · Computer Science 2025-08-07 Enam Ahmed Taufik , Abdullah Khondoker , Antara Firoz Parsa , Seraj Al Mahmud Mostafa

Phyllodes tumors (PTs) are rare fibroepithelial breast lesions that are difficult to classify preoperatively due to their radiological similarity to benign fibroadenomas. This often leads to unnecessary surgical excisions. To address this,…

Computer Vision and Pattern Recognition · Computer Science 2025-09-26 Farhan Fuad Abir , Abigail Elliott Daly , Kyle Anderman , Tolga Ozmen , Laura J. Brattain

Medical imaging is a cornerstone of therapy and diagnosis in modern medicine. However, the choice of imaging modality for a particular theranostic task typically involves trade-offs between the feasibility of using a particular modality…

Computer Vision and Pattern Recognition · Computer Science 2022-07-22 Mayur Mallya , Ghassan Hamarneh

Neuro-developmental disorders are manifested as dysfunctions in cognition, communication, behaviour and adaptability, and deep learning-based computer-aided diagnosis (CAD) can alleviate the increasingly strained healthcare resources on…

Machine Learning · Computer Science 2026-04-17 Xin Wen , Shijie Guo , Wenbo Ning , Rui Cao , Jie Xiang , Xiaobo Liu , Jintai Chen

Humans make accurate decisions by interpreting complex data from multiple sources. Medical diagnostics, in particular, often hinge on human interpretation of multi-modal information. In order for artificial intelligence to make progress in…

Computer Vision and Pattern Recognition · Computer Science 2018-11-20 Faisal Mahmood , Ziyun Yang , Thomas Ashley , Nicholas J. Durr

The integration of diverse clinical modalities such as medical imaging and the tabular data extracted from patients' Electronic Health Records (EHRs) is a crucial aspect of modern healthcare. Integrative analysis of multiple sources can…

Computer Vision and Pattern Recognition · Computer Science 2025-04-22 Daniel Duenias , Brennan Nichyporuk , Tal Arbel , Tammy Riklin Raviv

This paper presents a deep learning approach for the classification of Engineering (CAD) models using Convolutional Neural Networks (CNNs). Owing to the availability of large annotated datasets and also enough computational power in the…

Computer Vision and Pattern Recognition · Computer Science 2021-07-15 Bharadwaj Manda , Pranjal Bhaskare , Ramanathan Muthuganapathy

Accurate detection of ultrasound nodules is essential for the early diagnosis and treatment of thyroid and breast cancers. However, this task remains challenging due to irregular nodule shapes, indistinct boundaries, substantial scale…

Computer Vision and Pattern Recognition · Computer Science 2026-01-06 Jingjing Wang , Zhuo Xiao , Xinning Yao , Bo Liu , Lijuan Niu , Xiangzhi Bai , Fugen Zhou

In this paper, we propose a Computer Assisted Diagnosis (CAD) system based on a deep Convolutional Neural Network (CNN) model, to build an end-to-end learning process that classifies breast mass lesions. We investigate the impact that has…

Computer Vision and Pattern Recognition · Computer Science 2017-11-30 Hiba Chougrad , Hamid Zouaki , Omar Alheyane