English
Related papers

Related papers: M3AE: Multimodal Representation Learning for Brain…

200 papers

Multimodal Magnetic Resonance (MR) Imaging plays a crucial role in disease diagnosis due to its ability to provide complementary information by analyzing a relationship between multimodal images on the same subject. Acquiring all MR…

Image and Video Processing · Electrical Eng. & Systems 2024-02-02 Jihoon Cho , Xiaofeng Liu , Fangxu Xing , Jinsong Ouyang , Georges El Fakhri , Jinah Park , Jonghye Woo

Magnetic Resonance Imaging (MRI) is the most commonly used non-intrusive technique for medical image acquisition. Brain tumor segmentation is the process of algorithmically identifying tumors in brain MRI scans. While many approaches have…

Image and Video Processing · Electrical Eng. & Systems 2022-11-04 Jason Walsh , Alice Othmani , Mayank Jain , Soumyabrata Dev

Magnetic Resonance Imaging (MRI) is an important diagnostic tool for precise detection of various pathologies. Magnetic Resonance (MR) is more preferred than Computed Tomography (CT) due to the high resolution in MR images which help in…

Computer Vision and Pattern Recognition · Computer Science 2017-11-01 Pranay Manocha , Snehal Bhasme , Tanvi Gupta , BK Panigrahi , Tapan K. Gandhi

Multimodal semantic segmentation is a pivotal component of computer vision and typically surpasses unimodal methods by utilizing rich information set from various sources.Current models frequently adopt modality-specific frameworks that…

Computer Vision and Pattern Recognition · Computer Science 2024-05-27 Bingyu Li , Da Zhang , Zhiyuan Zhao , Junyu Gao , Xuelong Li

Segmentation of tumors in brain MRI images is a challenging task, where most recent methods demand large volumes of data with pixel-level annotations, which are generally costly to obtain. In contrast, image-level annotations, where only…

Image and Video Processing · Electrical Eng. & Systems 2019-11-07 Sergey Pavlov , Alexey Artemov , Maksim Sharaev , Alexander Bernstein , Evgeny Burnaev

Robust and generalizable segmentation of brain tumors on multi-parametric magnetic resonance imaging (MRI) remains difficult because tumor types differ widely. The BraTS 2025 Lighthouse Challenge benchmarks segmentation methods on diverse…

Spinal cord tumors significantly contribute to neurological morbidity and mortality. Precise morphometric quantification, encompassing the size, location, and type of such tumors, holds promise for optimizing treatment planning strategies.…

Image and Video Processing · Electrical Eng. & Systems 2024-12-10 Hongkang Song , Zihui Zhang , Yanpeng Zhou , Jie Hu , Zishuo Wang , Hou Him Chan , Chon Lok Lei , Chen Xu , Yu Xin , Bo Yang

A key challenge in learning from multimodal biological data is missing modalities, where data from one or more modalities are absent for some patients. Existing approaches either exclude patients with missing modalities, impute missing…

Machine Learning · Computer Science 2026-05-19 Sina Tabakhi , Chen , Chen , Haiping Lu

Magnetic Resonance Imaging (MRI) plays an important role in diagnosing the parotid tumor, where accurate segmentation of tumors is highly desired for determining appropriate treatment plans and avoiding unnecessary surgery. However, the…

Image and Video Processing · Electrical Eng. & Systems 2022-10-05 Yifan Gao , Yin Dai , Fayu Liu , Weibing Chen , Lifu Shi

The segmentation of diseases is a popular topic explored by researchers in the field of machine learning. Brain tumors are extremely dangerous and require the utmost precision to segment for a successful surgery. Patients with tumors…

Image and Video Processing · Electrical Eng. & Systems 2022-04-05 Sanskriti Singh

Magnetic Resonance (MR) images of different modalities can provide complementary information for clinical diagnosis, but whole modalities are often costly to access. Most existing methods only focus on synthesizing missing images between…

Computer Vision and Pattern Recognition · Computer Science 2020-05-05 Bingyu Xin , Yifan Hu , Yefeng Zheng , Hongen Liao

Automatic segmentation is essential for the brain tumor diagnosis, disease prognosis, and follow-up therapy of patients with gliomas. Still, accurate detection of gliomas and their sub-regions in multimodal MRI is very challenging due to…

Image and Video Processing · Electrical Eng. & Systems 2022-12-20 Ramy A. Zeineldin , Mohamed E. Karar , Oliver Burgert , Franziska Mathis-Ullrich

Masked Autoencoders (MAEs) have been shown to be effective in pre-training Vision Transformers (ViTs) for natural and medical image analysis problems. By reconstructing missing pixel/voxel information in visible patches, a ViT encoder can…

Computer Vision and Pattern Recognition · Computer Science 2025-11-20 Pengfei Gu , Huimin Li , Yejia Zhang , Chaoli Wang , Danny Z. Chen

Automation of brain tumors in 3D magnetic resonance images (MRIs) is key to assess the diagnostic and treatment of the disease. In recent years, convolutional neural networks (CNNs) have shown improved results in the task. However, high…

Image and Video Processing · Electrical Eng. & Systems 2020-09-28 Laura Mora Ballestar , Veronica Vilaplana

Purpose: In this paper, we investigate a framework for interactive brain tumor segmentation which, at its core, treats the problem of interactive brain tumor segmentation as a machine learning problem. Methods: This method has an advantage…

Computer Vision and Pattern Recognition · Computer Science 2016-05-20 Mohammad Havaei , Hugo Larochelle , Philippe Poulin , Pierre-Marc Jodoin

Automatic segmentation of brain tumors in intra-operative ultrasound (iUS) images could facilitate localization of tumor tissue during resection surgery. The lack of large annotated datasets limits the current models performances. In this…

Image and Video Processing · Electrical Eng. & Systems 2025-08-18 Mathilde Faanes , Ragnhild Holden Helland , Ole Solheim , Sébastien Muller , Ingerid Reinertsen

Multi-modal Magnetic Resonance Imaging (MRI) is imperative for accurate brain tumor segmentation, offering indispensable complementary information. Nonetheless, the absence of modalities poses significant challenges in achieving precise…

Image and Video Processing · Electrical Eng. & Systems 2024-08-27 Zheyu Zhang , Xinzhao Liu , Zheng Chen , Yueyi Zhang , Huanjing Yue , Yunwei Ou , Xiaoyan Sun

We propose a unified deep meta-learning framework for accelerated magnetic resonance imaging (MRI) that jointly addresses multi-coil reconstruction and cross-modality synthesis. Motivated by the limitations of conventional methods in…

Optimization and Control · Mathematics 2026-03-10 Merham Fouladvand , Peuroly Batra

Expert interpretation of anatomical images of the human brain is the central part of neuro-radiology. Several machine learning-based techniques have been proposed to assist in the analysis process. However, the ML models typically need to…

This research presents an enhanced approach for precise segmentation of brain tumor masses in magnetic resonance imaging (MRI) using an advanced 3D-UNet model combined with a Context Transformer (CoT). By architectural expansion CoT, the…

Computer Vision and Pattern Recognition · Computer Science 2024-07-12 Thien-Qua T. Nguyen , Hieu-Nghia Nguyen , Thanh-Hieu Bui , Thien B. Nguyen-Tat , Vuong M. Ngo