English
Related papers

Related papers: Cross-Modal Self-Attention Distillation for Prosta…

200 papers

In the field of multimodal segmentation, the correlation between different modalities can be considered for improving the segmentation results. In this paper, we propose a multi-modality segmentation network with a correlation constraint.…

Image and Video Processing · Electrical Eng. & Systems 2021-02-08 Tongxue Zhou , Stéphane Canu , Pierre Vera , Su Ruan

Deep neural networks have introduced significant advancements in the field of machine learning-based analysis of digital pathology images including prostate tissue images. With the help of transfer learning, classification and segmentation…

Current deep learning approaches for prostate cancer lesion segmentation achieve limited performance, with Dice scores of 0.32 or lower in large patient cohorts. To address this limitation, we investigate synthetic correlated diffusion…

Computer Vision and Pattern Recognition · Computer Science 2025-11-12 Jarett Dewbury , Chi-en Amy Tai , Alexander Wong

Automatic segmentation of multi-sequence (multi-modal) cardiac MR (CMR) images plays a significant role in diagnosis and management for a variety of cardiac diseases. However, the performance of relevant algorithms is significantly affected…

Image and Video Processing · Electrical Eng. & Systems 2020-09-08 Haochuan Jiang , Chengjia Wang , Agisilaos Chartsias , Sotirios A. Tsaftaris

The detailed images produced by Magnetic Resonance Imaging (MRI) provide life-critical information for the diagnosis and treatment of prostate cancer. To provide standardized acquisition, interpretation and usage of the complex MRI images,…

Image and Video Processing · Electrical Eng. & Systems 2023-09-25 Arnab Das , Suhita Ghosh , Sebastian Stober

Brain tumor segmentation based on multi-modal magnetic resonance imaging (MRI) plays a pivotal role in assisting brain cancer diagnosis, treatment, and postoperative evaluations. Despite the achieved inspiring performance by existing…

Image and Video Processing · Electrical Eng. & Systems 2022-11-16 Haoran Li , Cheng Li , Weijian Huang , Xiawu Zheng , Yan Xi , Shanshan Wang

The successful adaptation of foundation models to multi-modal medical imaging is a critical yet unresolved challenge. Existing models often struggle to effectively fuse information from multiple sources and adapt to the heterogeneous nature…

Computer Vision and Pattern Recognition · Computer Science 2026-01-23 Shadi Alijani , Fereshteh Aghaee Meibodi , Homayoun Najjaran

Immunohistochemical (IHC) biomarker prediction benefits from multi-modal data fusion analysis. However, the simultaneous acquisition of multi-modal data, such as genomic and pathological information, is often challenging due to cost or…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Qibin Zhang , Xinyu Hao , Qiao Chen , Rui Xu , Fengyu Cong , Cheng Lu , Hongming Xu

Medical image registration and segmentation are two of the most frequent tasks in medical image analysis. As these tasks are complementary and correlated, it would be beneficial to apply them simultaneously in a joint manner. In this paper,…

Image and Video Processing · Electrical Eng. & Systems 2021-05-06 Mohamed S. Elmahdy , Laurens Beljaards , Sahar Yousefi , Hessam Sokooti , Fons Verbeek , U. A. van der Heide , Marius Staring

In multi-modal learning, some modalities are more influential than others, and their absence can have a significant impact on classification/segmentation accuracy. Addressing this challenge, we propose a novel approach called Meta-learned…

Computer Vision and Pattern Recognition · Computer Science 2025-08-27 Hu Wang , Salma Hassan , Yuyuan Liu , Congbo Ma , Yuanhong Chen , Qing Li , Jiahui Geng , Bingjie Wang , Yu Tian , Yutong Xie , Jodie Avery , Louise Hull , Ian Reid , Mohammad Yaqub , Gustavo Carneiro

Multi-modal data comprising imaging (MRI, fMRI, PET, etc.) and non-imaging (clinical test, demographics, etc.) data can be collected together and used for disease prediction. Such diverse data gives complementary information about the…

Machine Learning · Computer Science 2018-12-27 Anees Kazi , S. Arvind krishna , Shayan Shekarforoush , Karsten Kortuem , Shadi Albarqouni , Nassir Navab

Due to the constraints of the imaging device and high cost in operation time, computer tomography (CT) scans are usually acquired with low intra-slice resolution. Improving the intra-slice resolution is beneficial to the disease diagnosis…

Image and Video Processing · Electrical Eng. & Systems 2022-07-13 Chaowei Fang , Liang Wang , Dingwen Zhang , Jun Xu , Yixuan Yuan , Junwei Han

Deep learning algorithms have become the golden standard for segmentation of medical imaging data. In most works, the variability and heterogeneity of real clinical data is acknowledged to still be a problem. One way to automatically…

Image and Video Processing · Electrical Eng. & Systems 2022-02-25 Arkadiy Dushatskiy , Gerry Lowe , Peter A. N. Bosman , Tanja Alderliesten

Despite the widespread use of deep learning methods for semantic segmentation of images that are acquired from a single source, clinicians often use multi-domain data for a detailed analysis. For instance, CT and MRI have advantages over…

Image and Video Processing · Electrical Eng. & Systems 2020-06-09 Bora Baydar , Savas Ozkan , A. Emre Kavur , N. Sinem Gezer , M. Alper Selver , Gozde Bozdagi Akar

Knowledge distillation (KD) has proven highly effective for compressing large models and enhancing the performance of smaller ones. However, its effectiveness diminishes in cross-modal scenarios, such as vision-to-language distillation,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Junhong Liu , Yuan Zhang , Tao Huang , Wenchao Xu , Renyu Yang

Depth estimation and scene segmentation are two important tasks in intelligent transportation systems. A joint modeling of these two tasks will reduce the requirement for both the storage and training efforts. This work explores how the…

Machine Learning · Computer Science 2025-05-16 Tiancong Cheng , Ying Zhang , Yuxuan Liang , Roger Zimmermann , Zhiwen Yu , Bin Guo

Automatic lymph node (LN) segmentation and detection for cancer staging are critical. In clinical practice, computed tomography (CT) and positron emission tomography (PET) imaging detect abnormal LNs. Despite its low contrast and variety in…

Image and Video Processing · Electrical Eng. & Systems 2022-12-23 Al-Akhir Nayan , Boonserm Kijsirikul , Yuji Iwahori

Knowledge distillation is an attractive approach for learning compact deep neural networks, which learns a lightweight student model by distilling knowledge from a complex teacher model. Attention-based knowledge distillation is a specific…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Cuong Pham , Van-Anh Nguyen , Trung Le , Dinh Phung , Gustavo Carneiro , Thanh-Toan Do

Micro-expressions are subtle facial movements that occur spontaneously when people try to conceal real emotions. Micro-expression recognition is crucial in many fields, including criminal analysis and psychotherapy. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-03 Guanghao Zhu , Lin Liu , Yuhao Hu , Haixin Sun , Fang Liu , Xiaohui Du , Ruqian Hao , Juanxiu Liu , Yong Liu , Hao Deng , Jing Zhang

Accurate segmentation of the prostate gland in multiparametric MRI (mpMRI) is a fundamental step for a wide range of clinical and research applications, including image registration, volume estimation, and radiomic analysis. However, manual…

Computer Vision and Pattern Recognition · Computer Science 2026-04-03 Pablo Rodriguez-Belenguer , Gloria Ribas , Javier Aquerreta Escribano , Rafael Moreno-Calatayud , Leonor Cerda-Alberich , Luis Marti-Bonmati