English
Related papers

Related papers: Brain3D: Brain Report Automation via Inflated Visi…

200 papers

Recent progress in vision-language modeling for 3D medical imaging has been fueled by large-scale computed tomography (CT) corpora with paired free-text reports, stronger architectures, and powerful pretrained models. This has enabled…

Computer Vision and Pattern Recognition · Computer Science 2025-10-24 Ibrahim Ethem Hamamci , Sezgin Er , Suprosanna Shit , Hadrien Reynaud , Dong Yang , Pengfei Guo , Marc Edgar , Daguang Xu , Bernhard Kainz , Bjoern Menze

Recent medical vision-language models (VLMs) have shown promise in 2D medical image interpretation. However extending them to 3D medical imaging has been challenging due to computational complexities and data scarcity. Although a few recent…

Image and Video Processing · Electrical Eng. & Systems 2024-12-19 Changsun Lee , Sangjoon Park , Cheong-Il Shin , Woo Hee Choi , Hyun Jeong Park , Jeong Eun Lee , Jong Chul Ye

Understanding 3D medical image volumes is a critical task in the medical domain. However, existing 3D convolution and transformer-based methods have limited semantic understanding of an image volume and also need a large set of volumes for…

Computer Vision and Pattern Recognition · Computer Science 2024-03-11 Qiuhui Chen , Huping Ye , Yi Hong

Multi-site structural MRI is increasingly used in neuroimaging studies to diversify subject cohorts. However, combining MR images acquired from various sites/centers may introduce site-related non-biological variations. Retrospective image…

Image and Video Processing · Electrical Eng. & Systems 2024-08-20 Mengqi Wu , Minhui Yu , Shuaiming Jing , Pew-Thian Yap , Zhengwu Zhang , Mingxia Liu

Recent advances in multimodal large language models (LLMs) have enabled unified reasoning across images, audio, and video, but extending such capability to brain imaging remains largely unexplored. Bridging this gap is essential to link…

Computation and Language · Computer Science 2026-05-15 Yuxiang Wei , Yanteng Zhang , Xi Xiao , Chengxuan Qian , Tianyang Wang , Vince D. Calhoun

Designing generative models for 3D structural brain MRI that synthesize morphologically-plausible and attribute-specific (e.g., age, sex, disease state) samples is an active area of research. Existing approaches based on frameworks like…

Image and Video Processing · Electrical Eng. & Systems 2025-08-04 Alan Q. Wang , Fangrui Huang , Bailey Trang , Wei Peng , Mohammad Abbasi , Kilian Pohl , Mert Sabuncu , Ehsan Adeli

Decoding visual information from electroencephalography (EEG) has recently achieved promising results, primarily focusing on reconstructing two-dimensional (2D) images from brain activity. However, the reconstruction of three-dimensional…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Emanuele Balloni , Emanuele Frontoni , Chiara Matti , Marina Paolanti , Roberto Pierdicca , Emiliano Santarnecchi

Automatic radiology report generation is a promising application of multimodal deep learning, aiming to reduce reporting workload and improve consistency. However, current state-of-the-art (SOTA) systems - such as Multimodal AI for…

Decoding visual-semantic information from brain signals, such as functional MRI (fMRI), across different subjects poses significant challenges, including low signal-to-noise ratio, limited data availability, and cross-subject variability.…

Computer Vision and Pattern Recognition · Computer Science 2024-09-27 Ruizhe Zheng , Lichao Sun

Brain tumor diagnosis is largely dependent on Magnetic Resonance Imaging (MRI) evaluation, which requires radiologists to synthesize thousands of images across multiple 3D sequences and longitudinal studies. This process requires advanced…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Shiv Ghosh , Junayd Lateef , Chih-Hua Liu , Yannan Yu , Andreas M. Rauschecker , Madhumita Sushil

Understanding brain disorders is crucial for accurate clinical diagnosis and treatment. Recent advances in Multimodal Large Language Models (MLLMs) offer a promising approach to interpreting medical images with the support of text…

Image and Video Processing · Electrical Eng. & Systems 2025-06-03 Jing Zhang , Xiaowei Yu , Yanjun Lyu , Lu Zhang , Tong Chen , Chao Cao , Yan Zhuang , Minheng Chen , Tianming Liu , Dajiang Zhu

Multimodal brain tumor segmentation challenge (BraTS) brings together researchers to improve automated methods for 3D MRI brain tumor segmentation. Tumor segmentation is one of the fundamental vision tasks necessary for diagnosis and…

Image and Video Processing · Electrical Eng. & Systems 2020-01-08 Andriy Myronenko , Ali Hatamizadeh

In modern medical diagnostics, magnetic resonance imaging (MRI) is an important technique that provides detailed insights into anatomical structures. In this paper, we present a comprehensive methodology focusing on streamlining the…

Image and Video Processing · Electrical Eng. & Systems 2024-04-25 Siddharth Jha , Zichen Gui , Benjamin Delbos , Richard Moreau , Arnaud Leleve , Irene Cheng

Pathology reports serve as the definitive record for breast cancer staging, yet their unstructured format impedes large-scale data curation. While Large Language Models (LLMs) offer semantic reasoning, their deployment is often limited by…

Machine Learning · Computer Science 2026-04-16 Jiahao Shao , Anam Nawaz Khan , Christopher Brett , Tom Berg , Xueping Li , Bing Yao

3D medical image analysis is of great importance in disease diagnosis and treatment. Recently, multimodal large language models (MLLMs) have exhibited robust perceptual capacity, strong cross-modal alignment, and promising generalizability.…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Yang Yu , Dunyuan Xu , Yaoqian Li , Xiaomeng Li , Jinpeng Li , Pheng-Ann Heng

Clinically acquired brain MRIs and radiology reports are valuable but underutilized resources due to the challenges of manual analysis and data heterogeneity. We developed fine-tuned language models (LMs) to classify brain MRI reports as…

Text to image latent diffusion models have recently advanced medical image synthesis, but applications to 3D CT generation remain limited. Existing approaches rely on simplified prompts, neglecting the rich semantic detail in full radiology…

Computer Vision and Pattern Recognition · Computer Science 2025-09-19 Sina Amirrajab , Zohaib Salahuddin , Sheng Kuang , Henry C. Woodruff , Philippe Lambin

Medical image analysis is essential to clinical diagnosis and treatment, which is increasingly supported by multi-modal large language models (MLLMs). However, previous research has primarily focused on 2D medical images, leaving 3D images…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Fan Bai , Yuxin Du , Tiejun Huang , Max Q. -H. Meng , Bo Zhao

The integration of artificial intelligence in healthcare has opened new horizons for improving medical diagnostics and patient care. However, challenges persist in developing systems capable of generating accurate and contextually relevant…

Computer Vision and Pattern Recognition · Computer Science 2026-02-16 Marco Salmè , Rosa Sicilia , Paolo Soda , Valerio Guarrasi

Structural magnetic resonance imaging (MRI) has been widely utilized for analysis and diagnosis of brain diseases. Automatic segmentation of brain tumors is a challenging task for computer-aided diagnosis due to low-tissue contrast in the…

Image and Video Processing · Electrical Eng. & Systems 2020-11-22 Mohammad Hamghalam , Baiying Lei , Tianfu Wang