English
Related papers

Related papers: Improved Multimodal Fusion for Small Datasets with…

200 papers

Histopathology remains the gold standard for cancer diagnosis and prognosis. With the advent of transcriptome profiling, multi-modal learning combining transcriptomics with histology offers more comprehensive information. However, existing…

Image and Video Processing · Electrical Eng. & Systems 2026-03-03 Yupei Zhang , Xiaofei Wang , Anran Liu , Lequan Yu , Chao Li

Multimodal remote sensing data, including spectral and lidar or photogrammetry, is crucial for achieving satisfactory land-use / land-cover classification results in urban scenes. So far, most studies have been conducted in a 2D context.…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Aldino Rizaldy , Richard Gloaguen , Fabian Ewald Fassnacht , Pedram Ghamisi

Early cancer detection remains one of the most critical challenges in modern healthcare, where delayed diagnosis significantly reduces survival outcomes. Recent advancements in artificial intelligence, particularly deep learning, have…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Emmanuella Avwerosuoghene Oghenekaro

Multimodal medical image fusion helps in combining contrasting features from two or more input imaging modalities to represent fused information in a single image. One of the pivotal clinical applications of medical image fusion is the…

Image and Video Processing · Electrical Eng. & Systems 2019-09-20 Nishant Kumar , Nico Hoffmann , Martin Oelschlägel , Edmund Koch , Matthias Kirsch , Stefan Gumhold

As machine learning and artificial intelligence are more frequently being leveraged to tackle problems in the health sector, there has been increased interest in utilizing them in clinical decision-support. This has historically been the…

Machine Learning · Computer Science 2022-04-12 Adrienne Kline , Hanyin Wang , Yikuan Li , Saya Dennis , Meghan Hutch , Zhenxing Xu , Fei Wang , Feixiong Cheng , Yuan Luo

Cone-beam computed tomography (CBCT) is an important tool facilitating computer aided interventions, despite often suffering from artifacts that pose challenges for accurate interpretation. While the degraded image quality can affect…

Image and Video Processing · Electrical Eng. & Systems 2024-07-02 Maximilian E. Tschuchnig , Philipp Steininger , Michael Gadermayr

This study evaluates a multimodal machine learning framework for predicting treatment outcomes in intracranial aneurysms (IAs). Combining angiographic parametric imaging (API), patient biomarkers, and disease morphology, the framework aims…

Accurate breast lesion risk estimation can significantly reduce unnecessary biopsies and help doctors decide optimal treatment plans. Most existing computer-aided systems rely solely on mammogram features to classify breast lesions. While…

Image and Video Processing · Electrical Eng. & Systems 2021-08-24 Hung Q. Vo , Pengyu Yuan , Tiancheng He , Stephen T. C. Wong , Hien V. Nguyen

Multimodal MR-US registration is critical for prostate cancer diagnosis. However, this task remains challenging due to significant modality discrepancies. Existing methods often fail to align critical boundaries while being overly sensitive…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Xudong Ma , Nantheera Anantrasirichai , Stefanos Bolomytis , Alin Achim

Molecular subtyping of breast cancer is crucial for personalized treatment and prognosis. Traditional classification approaches rely on either histopathological images or gene expression profiling, limiting their predictive power. In this…

Computer Vision and Pattern Recognition · Computer Science 2025-03-05 Amin Honarmandi Shandiz

Multi-modal medical image fusion is traditionally optimized for human visual perception, aiming to maximize generic contrast and structural fidelity. However, when these visually pleasing fused images are deployed in automated clinical…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Yuchen Guo , Junli Gong , Hongmin Cai , Yiu-ming Cheung , Weifeng Su

Cancer is a highly heterogeneous condition that can occur almost anywhere in the human body. 18F-fluorodeoxyglucose is an imaging modality commonly used to detect cancer due to its high sensitivity and clear visualisation of the pattern of…

Image and Video Processing · Electrical Eng. & Systems 2023-04-17 Ashay Patel , Petru-Danial Tudiosu , Walter H. L. Pinaya , Gary Cook , Vicky Goh , Sebastien Ourselin , M. Jorge Cardoso

This paper discusses the benefits of incorporating multimodal data for improving latent emotion recognition accuracy, focusing on micro-expression (ME) and physiological signals (PS). The proposed approach presents a novel multimodal…

Computer Vision and Pattern Recognition · Computer Science 2023-08-24 Liangfei Zhang , Yifei Qian , Ognjen Arandjelovic , Anthony Zhu

In multi-view medical diagnosis, deep learning-based models often fuse information from different imaging perspectives to improve diagnostic performance. However, existing approaches are prone to overfitting and rely heavily on…

Computer Vision and Pattern Recognition · Computer Science 2024-10-22 Jingyu Guo , Christos Matsoukas , Fredrik Strand , Kevin Smith

Technological advances in medical data collection, such as high-throughput genomic sequencing and digital high-resolution histopathology, have contributed to the rising requirement for multimodal biomedical modelling, specifically for…

Machine Learning · Computer Science 2024-10-29 Konstantin Hemker , Nikola Simidjievski , Mateja Jamnik

Personalized treatment of patients based on tissue-specific cancer subtypes has strongly increased the efficacy of the chosen therapies. Even though the amount of data measured for cancer patients has increased over the last years, most…

Machine Learning · Statistics 2017-09-18 Nora K. Speicher , Nico Pfeifer

The use of machine learning (ML) for cancer staging through medical image analysis has gained substantial interest across medical disciplines. When accompanied by the innovative federated learning (FL) framework, ML techniques can further…

Machine Learning · Computer Science 2024-10-10 Kasra Borazjani , Naji Khosravan , Leslie Ying , Seyyedali Hosseinalipour

Image analysis using more than one modality (i.e. multi-modal) has been increasingly applied in the field of biomedical imaging. One of the challenges in performing the multimodal analysis is that there exist multiple schemes for fusing the…

Computer Vision and Pattern Recognition · Computer Science 2018-06-19 Zhe Guo , Xiang Li , Heng Huang , Ning Guo , Quanzheng Li

The diagnosis of prostate cancer faces a problem with overdiagnosis that leads to damaging side effects due to unnecessary treatment. Research has shown that the use of multi-parametric magnetic resonance images to conduct biopsies can…

Image and Video Processing · Electrical Eng. & Systems 2021-06-04 Pedro C. Neto

This paper addresses the density based multi-sensor cooperative fusion using random finite set (RFS) type multi-object densities (MODs). Existing fusion methods use scalar weights to characterize the relative information confidence among…

Information Theory · Computer Science 2021-07-21 Wei Yi , Lei Chai