English
Related papers

Related papers: No Modality Left Behind: Adapting to Missing Modal…

200 papers

Brain tumors, particularly glioblastoma, continue to challenge medical diagnostics and treatments globally. This paper explores the application of deep learning to multi-modality magnetic resonance imaging (MRI) data for enhanced brain…

Image and Video Processing · Electrical Eng. & Systems 2023-08-15 Chiranjeewee Prasad Koirala , Sovesh Mohapatra , Advait Gosai , Gottfried Schlaug

Knowledge distillation (KD) is a key technique for compressing large-scale language models (LLMs), yet prevailing logit-based methods typically employ static strategies that are misaligned with the dynamic learning process of student…

Computation and Language · Computer Science 2025-10-14 Xurong Xie , Zhucun Xue , Jiafu Wu , Jian Li , Yabiao Wang , Xiaobin Hu , Yong Liu , Jiangning Zhang

Multimodal learning that integrates genomics and histopathology has shown strong potential in cancer diagnosis, yet its clinical translation is hindered by the limited availability of paired histology-genomics data. Knowledge distillation…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Yongxin Guo , Hao Lu , Onur C. Koyun , Zhengjie Zhu , Muhammet Fatih Demir , Metin Nafi Gurcan

Brain Tumor Segmentation (BraTS) plays a critical role in clinical diagnosis, treatment planning, and monitoring the progression of brain tumors. However, due to the variability in tumor appearance, size, and intensity across different MRI…

Image and Video Processing · Electrical Eng. & Systems 2024-09-19 Hongjun Zhu , Jiaohang Huang , Kuo Chen , Xuehui Ying , Ying Qian

Multimodal learning leverages complementary information derived from different modalities, thereby enhancing performance in medical image segmentation. However, prevailing multimodal learning methods heavily rely on extensive well-annotated…

Computer Vision and Pattern Recognition · Computer Science 2024-09-05 Xiaogen Zhou , Yiyou Sun , Min Deng , Winnie Chiu Wing Chu , Qi Dou

The recent Segment Anything Model (SAM) demonstrates strong instance segmentation performance across various downstream tasks. However, SAM is trained solely on RGB data, limiting its direct applicability to RGB-thermal (RGB-T) semantic…

Computer Vision and Pattern Recognition · Computer Science 2025-05-06 Dong Xing , Xianxun Zhu , Wei Zhou , Qika Lin , Hang Yang , Yuqing Wang

Accurate segmentation of brain tumors from 3D multimodal MRI is vital for diagnosis and treatment planning across diverse brain tumors. This paper addresses the challenges posed by the BraTS 2023, presenting a unified transfer learning…

Image and Video Processing · Electrical Eng. & Systems 2024-12-12 Ramy A. Zeineldin , Franziska Mathis-Ullrich

The application of Deep Learning (DL) for medical diagnosis is often hampered by two problems. First, the amount of training data may be scarce, as it is limited by the number of patients who have acquired the condition to be diagnosed.…

Computer Vision and Pattern Recognition · Computer Science 2020-07-17 Diyuan Lu , Nenad Polomac , Iskra Gacheva , Elke Hattingen , Jochen Triesch

The ability to dynamically extend a model to new data and classes is critical for multiple organ and tumor segmentation. However, due to privacy regulations, accessing previous data and annotations can be problematic in the medical domain.…

Image and Video Processing · Electrical Eng. & Systems 2023-07-24 Yixiao Zhang , Xinyi Li , Huimiao Chen , Alan Yuille , Yaoyao Liu , Zongwei Zhou

A brain tumor, whether benign or malignant, can potentially be life threatening and requires painstaking efforts in order to identify the type, origin and location, let alone cure one. Manual segmentation by medical specialists can be…

Image and Video Processing · Electrical Eng. & Systems 2023-05-02 Ayan Gupta , Mayank Dixit , Vipul Kumar Mishra , Attulya Singh , Atul Dayal

Multimodal 3D MRI brain tumor segmentation is a pivotal step in radiotherapy target delineation, surgical planning and post-treatment assessment. Existing methods often assume artifact-free MRI images. However, inevitable patient motion…

Image and Video Processing · Electrical Eng. & Systems 2026-05-18 Yuchun Wang , Xiaosong Li , Gefei Liang , Yang Liu

In multimodal learning, dominant modalities often overshadow others, limiting generalization. We propose Modality-Aware Sharpness-Aware Minimization (M-SAM), a model-agnostic framework that applies to many modalities and supports early and…

Computer Vision and Pattern Recognition · Computer Science 2025-10-30 Hossein R. Nowdeh , Jie Ji , Xiaolong Ma , Fatemeh Afghah

Integrating cross-department multi-modal data (e.g., radiological, pathological, genomic, and clinical data) is ubiquitous in brain cancer diagnosis and survival prediction. To date, such an integration is typically conducted by human…

Machine Learning · Computer Science 2022-07-20 Can Cui , Han Liu , Quan Liu , Ruining Deng , Zuhayr Asad , Yaohong WangShilin Zhao , Haichun Yang , Bennett A. Landman , Yuankai Huo

With the widespread adoption of millimeter-wave (mmWave) massive multi-input-multi-output (MIMO) in vehicular networks, accurate beam prediction and alignment have become critical for high-speed data transmission and reliable access. While…

Information Theory · Computer Science 2026-03-27 Chenyiming Wen , Binpu Shi , Min Li , Ming-Min Zhao , Min-Jian Zhao , Jiangzhou Wang

This paper proposes a 3D attention-based U-Net architecture for multi-region segmentation of brain tumors using a single stacked multi-modal volume created by combining three non-native MRI volumes. The attention mechanism added to the…

Image and Video Processing · Electrical Eng. & Systems 2023-05-11 Maryann M. Gitonga

Mild cognitive impairment (MCI) conversion prediction, i.e., identifying MCI patients of high risks converting to Alzheimer's disease (AD), is essential for preventing or slowing the progression of AD. Although previous studies have shown…

Image and Video Processing · Electrical Eng. & Systems 2021-09-27 Hao Guan , Chaoyue Wang , Dacheng Tao

The missing modality issue is critical but non-trivial to be solved by multi-modal models. Current methods aiming to handle the missing modality problem in multi-modal tasks, either deal with missing modalities only during evaluation or…

Computer Vision and Pattern Recognition · Computer Science 2024-06-14 Hu Wang , Yuanhong Chen , Congbo Ma , Jodie Avery , Louise Hull , Gustavo Carneiro

Multi-modality is widely used in medical imaging, because it can provide multiinformation about a target (tumor, organ or tissue). Segmentation using multimodality consists of fusing multi-information to improve the segmentation. Recently,…

Image and Video Processing · Electrical Eng. & Systems 2020-07-17 Tongxue Zhou , Su Ruan , Stéphane Canu

Multimodal biomedical Vision-Language Models (VLMs) exhibit immense potential in the field of Continual Learning (CL). However, they confront a core dilemma: how to preserve fine-grained intra-modality features while bridging the…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Zizhi Chen , Yizhen Gao , Minghao Han , Yizhou Liu , Zhaoyu Chen , Dingkang Yang , Lihua Zhang

The significance of mental health classification is paramount in contemporary society, where digital platforms serve as crucial sources for monitoring individuals' well-being. However, existing social media mental health datasets primarily…

Computation and Language · Computer Science 2024-11-08 Rina Carines Cabral , Siwen Luo , Josiah Poon , Soyeon Caren Han