English
Related papers

Related papers: ModDrop++: A Dynamic Filter Network with Intra-sub…

200 papers

Modality selection is an important step when designing multimodal systems, especially in the case of cross-domain activity recognition as certain modalities are more robust to domain shift than others. However, selecting only the modalities…

Computer Vision and Pattern Recognition · Computer Science 2023-11-28 Zdravko Marinov , Alina Roitberg , David Schneider , Rainer Stiefelhagen

Cross-modal medical image translation is an essential task for synthesizing missing modality data for clinical diagnosis. However, current learning-based techniques have limitations in capturing cross-modal and global features, restricting…

Computer Vision and Pattern Recognition · Computer Science 2023-10-05 Xuhang Chen , Chi-Man Pun , Shuqiang Wang

Prediction tasks in digital pathology are challenging due to the massive size of whole-slide images (WSIs) and the weak nature of training signals. Advances in computing, data availability, and self-supervised learning (SSL) have paved the…

Image and Video Processing · Electrical Eng. & Systems 2026-02-02 Vishwesh Ramanathan , Tony Xu , Pushpak Pati , Faruk Ahmed , Maged Goubran , Anne L. Martel

This technical report presents a comparative analysis of existing deep learning (DL) based approaches for brain tumor segmentation with missing MRI modalities. Approaches evaluated include the Adversarial Co-training Network (ACN) and a…

Computer Vision and Pattern Recognition · Computer Science 2022-08-09 Benteng Ma , Yushi Wang , Shen Wang

Gliomas are one of the most prevalent types of primary brain tumours, accounting for more than 30\% of all cases and they develop from the glial stem or progenitor cells. In theory, the majority of brain tumours could well be identified…

Computer Vision and Pattern Recognition · Computer Science 2022-04-07 Reza Azad , Nika Khosravi , Dorit Merhof

The integration of artificial intelligence (AI) into medical imaging has advanced clinical diagnostics but poses challenges in managing model drift and ensuring long-term reliability. To address these challenges, we develop MMC+, an…

Image and Video Processing · Electrical Eng. & Systems 2024-10-21 Jameson Merkow , Felix J. Dorfner , Xiyu Yang , Alexander Ersoy , Giridhar Dasegowda , Mannudeep Kalra , Matthew P. Lungren , Christopher P. Bridge , Ivan Tarapov

Self-supervised cross-modal super-resolution (SR) can overcome the difficulty of acquiring paired training data, but is challenging because only low-resolution (LR) source and high-resolution (HR) guide images from different modalities are…

Computer Vision and Pattern Recognition · Computer Science 2022-07-20 Xiaoyu Dong , Naoto Yokoya , Longguang Wang , Tatsumi Uezato

A common problem with segmentation of medical images using neural networks is the difficulty to obtain a significant number of pixel-level annotated data for training. To address this issue, we proposed a semi-supervised segmentation…

Computer Vision and Pattern Recognition · Computer Science 2023-02-23 Ange Lou , Kareem Tawfik , Xing Yao , Ziteng Liu , Jack Noble

Magnetic resonance imaging (MRI) is a widely used neuroimaging technique that can provide images of different contrasts (i.e., modalities). Fusing this multi-modal data has proven particularly effective for boosting model performance in…

Computer Vision and Pattern Recognition · Computer Science 2020-02-13 Tao Zhou , Huazhu Fu , Geng Chen , Jianbing Shen , Ling Shao

Despite significant progress in pixel-level medical image analysis, existing medical image segmentation models rarely explore medical segmentation and diagnosis tasks jointly. However, it is crucial for patients that models can provide…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Lingran Song , Yucheng Zhou , Jianbing Shen

The Coronavirus Disease 2019 (COVID-19) pandemic has increased the public health burden and brought profound disaster to humans. For the particularity of the COVID-19 medical images with blurred boundaries, low contrast and different…

Image and Video Processing · Electrical Eng. & Systems 2023-07-21 Xiaoyu Pan , Huazheng Zhu , Jinglong Du , Guangtao Hu , Baoru Han , Yuanyuan Jia

Multiple Sclerosis (MS) is a chronic progressive neurological disease characterized by the development of lesions in the white matter of the brain. T2-fluid-attenuated inversion recovery (FLAIR) brain magnetic resonance imaging (MRI)…

Image and Video Processing · Electrical Eng. & Systems 2022-09-12 Jueqi Wang , Derek Berger , Erin Mazerolle , Othman Soufan , Jacob Levman

In clinical practice, multi-modal magnetic resonance imaging (MRI) with different contrasts is usually acquired in a single study to assess different properties of the same region of interest in the human body. The whole acquisition process…

Image and Video Processing · Electrical Eng. & Systems 2022-04-05 Kai Xuan , Lei Xiang , Xiaoqian Huang , Lichi Zhang , Shu Liao , Dinggang Shen , Qian Wang

Segmentation of moving objects in dynamic scenes is a key process in scene understanding for navigation tasks. Classical cameras suffer from motion blur in such scenarios rendering them effete. On the contrary, event cameras, because of…

Computer Vision and Pattern Recognition · Computer Science 2020-11-10 Chethan M. Parameshwara , Nitin J. Sanket , Chahat Deep Singh , Cornelia Fermüller , Yiannis Aloimonos

Brain tumor segmentation remains a significant challenge, particularly in the context of multi-modal magnetic resonance imaging (MRI) where missing modality images are common in clinical settings, leading to reduced segmentation accuracy.…

Image and Video Processing · Electrical Eng. & Systems 2024-06-14 Zhongao Sun , Jiameng Li , Yuhan Wang , Jiarong Cheng , Qing Zhou , Chun Li

New lesion segmentation is essential to estimate the disease progression and therapeutic effects during multiple sclerosis (MS) clinical treatments. However, the expensive data acquisition and expert annotation restrict the feasibility of…

Image and Video Processing · Electrical Eng. & Systems 2023-09-18 Yicheng Wu , Zhonghua Wu , Hengcan Shi , Bjoern Picker , Winston Chong , Jianfei Cai

Automated prostate segmentation in MRI is highly demanded for computer-assisted diagnosis. Recently, a variety of deep learning methods have achieved remarkable progress in this task, usually relying on large amounts of training data. Due…

Image and Video Processing · Electrical Eng. & Systems 2020-02-20 Quande Liu , Qi Dou , Lequan Yu , Pheng Ann Heng

Multi-modal embeddings form the foundation for vision-language models, such as CLIP embeddings, the most widely used text-image embeddings. However, these embeddings are vulnerable to subtle misalignment of cross-modal features, resulting…

Computer Vision and Pattern Recognition · Computer Science 2024-10-29 Yilin Ye , Shishi Xiao , Xingchen Zeng , Wei Zeng

Diabetic retinopathy (DR) is a leading cause of preventable blindness worldwide, demanding accurate automated diagnostic systems. While general-domain vision-language models like Contrastive Language-Image Pre-Training (CLIP) perform well…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Argha Kamal Samanta , Harshika Goyal , Vasudha Joshi , Tushar Mungle , Pabitra Mitra

Using multimodal Magnetic Resonance Imaging (MRI) is necessary for accurate brain tumor segmentation. The main problem is that not all types of MRIs are always available in clinical exams. Based on the fact that there is a strong…

Image and Video Processing · Electrical Eng. & Systems 2021-11-11 Tongxue Zhou , Stéphane Canu , Pierre Vera , Su Ruan