中文
相关论文

相关论文: Brain3D: Brain Report Automation via Inflated Visi…

200 篇论文

Recent progress in vision-language modeling for 3D medical imaging has been fueled by large-scale computed tomography (CT) corpora with paired free-text reports, stronger architectures, and powerful pretrained models. This has enabled…

计算机视觉与模式识别 · 计算机科学 2025-10-24 Ibrahim Ethem Hamamci , Sezgin Er , Suprosanna Shit , Hadrien Reynaud , Dong Yang , Pengfei Guo , Marc Edgar , Daguang Xu , Bernhard Kainz , Bjoern Menze

Recent medical vision-language models (VLMs) have shown promise in 2D medical image interpretation. However extending them to 3D medical imaging has been challenging due to computational complexities and data scarcity. Although a few recent…

图像与视频处理 · 电气工程与系统科学 2024-12-19 Changsun Lee , Sangjoon Park , Cheong-Il Shin , Woo Hee Choi , Hyun Jeong Park , Jeong Eun Lee , Jong Chul Ye

Understanding 3D medical image volumes is a critical task in the medical domain. However, existing 3D convolution and transformer-based methods have limited semantic understanding of an image volume and also need a large set of volumes for…

计算机视觉与模式识别 · 计算机科学 2024-03-11 Qiuhui Chen , Huping Ye , Yi Hong

Multi-site structural MRI is increasingly used in neuroimaging studies to diversify subject cohorts. However, combining MR images acquired from various sites/centers may introduce site-related non-biological variations. Retrospective image…

图像与视频处理 · 电气工程与系统科学 2024-08-20 Mengqi Wu , Minhui Yu , Shuaiming Jing , Pew-Thian Yap , Zhengwu Zhang , Mingxia Liu

Recent advances in multimodal large language models (LLMs) have enabled unified reasoning across images, audio, and video, but extending such capability to brain imaging remains largely unexplored. Bridging this gap is essential to link…

计算与语言 · 计算机科学 2026-05-15 Yuxiang Wei , Yanteng Zhang , Xi Xiao , Chengxuan Qian , Tianyang Wang , Vince D. Calhoun

Designing generative models for 3D structural brain MRI that synthesize morphologically-plausible and attribute-specific (e.g., age, sex, disease state) samples is an active area of research. Existing approaches based on frameworks like…

图像与视频处理 · 电气工程与系统科学 2025-08-04 Alan Q. Wang , Fangrui Huang , Bailey Trang , Wei Peng , Mohammad Abbasi , Kilian Pohl , Mert Sabuncu , Ehsan Adeli

Decoding visual information from electroencephalography (EEG) has recently achieved promising results, primarily focusing on reconstructing two-dimensional (2D) images from brain activity. However, the reconstruction of three-dimensional…

计算机视觉与模式识别 · 计算机科学 2026-04-10 Emanuele Balloni , Emanuele Frontoni , Chiara Matti , Marina Paolanti , Roberto Pierdicca , Emiliano Santarnecchi

Automatic radiology report generation is a promising application of multimodal deep learning, aiming to reduce reporting workload and improve consistency. However, current state-of-the-art (SOTA) systems - such as Multimodal AI for…

Decoding visual-semantic information from brain signals, such as functional MRI (fMRI), across different subjects poses significant challenges, including low signal-to-noise ratio, limited data availability, and cross-subject variability.…

计算机视觉与模式识别 · 计算机科学 2024-09-27 Ruizhe Zheng , Lichao Sun

Brain tumor diagnosis is largely dependent on Magnetic Resonance Imaging (MRI) evaluation, which requires radiologists to synthesize thousands of images across multiple 3D sequences and longitudinal studies. This process requires advanced…

计算机视觉与模式识别 · 计算机科学 2026-05-21 Shiv Ghosh , Junayd Lateef , Chih-Hua Liu , Yannan Yu , Andreas M. Rauschecker , Madhumita Sushil

Understanding brain disorders is crucial for accurate clinical diagnosis and treatment. Recent advances in Multimodal Large Language Models (MLLMs) offer a promising approach to interpreting medical images with the support of text…

图像与视频处理 · 电气工程与系统科学 2025-06-03 Jing Zhang , Xiaowei Yu , Yanjun Lyu , Lu Zhang , Tong Chen , Chao Cao , Yan Zhuang , Minheng Chen , Tianming Liu , Dajiang Zhu

Multimodal brain tumor segmentation challenge (BraTS) brings together researchers to improve automated methods for 3D MRI brain tumor segmentation. Tumor segmentation is one of the fundamental vision tasks necessary for diagnosis and…

图像与视频处理 · 电气工程与系统科学 2020-01-08 Andriy Myronenko , Ali Hatamizadeh

In modern medical diagnostics, magnetic resonance imaging (MRI) is an important technique that provides detailed insights into anatomical structures. In this paper, we present a comprehensive methodology focusing on streamlining the…

图像与视频处理 · 电气工程与系统科学 2024-04-25 Siddharth Jha , Zichen Gui , Benjamin Delbos , Richard Moreau , Arnaud Leleve , Irene Cheng

Pathology reports serve as the definitive record for breast cancer staging, yet their unstructured format impedes large-scale data curation. While Large Language Models (LLMs) offer semantic reasoning, their deployment is often limited by…

机器学习 · 计算机科学 2026-04-16 Jiahao Shao , Anam Nawaz Khan , Christopher Brett , Tom Berg , Xueping Li , Bing Yao

3D medical image analysis is of great importance in disease diagnosis and treatment. Recently, multimodal large language models (MLLMs) have exhibited robust perceptual capacity, strong cross-modal alignment, and promising generalizability.…

计算机视觉与模式识别 · 计算机科学 2026-04-14 Yang Yu , Dunyuan Xu , Yaoqian Li , Xiaomeng Li , Jinpeng Li , Pheng-Ann Heng

Clinically acquired brain MRIs and radiology reports are valuable but underutilized resources due to the challenges of manual analysis and data heterogeneity. We developed fine-tuned language models (LMs) to classify brain MRI reports as…

Text to image latent diffusion models have recently advanced medical image synthesis, but applications to 3D CT generation remain limited. Existing approaches rely on simplified prompts, neglecting the rich semantic detail in full radiology…

计算机视觉与模式识别 · 计算机科学 2025-09-19 Sina Amirrajab , Zohaib Salahuddin , Sheng Kuang , Henry C. Woodruff , Philippe Lambin

Medical image analysis is essential to clinical diagnosis and treatment, which is increasingly supported by multi-modal large language models (MLLMs). However, previous research has primarily focused on 2D medical images, leaving 3D images…

计算机视觉与模式识别 · 计算机科学 2024-04-02 Fan Bai , Yuxin Du , Tiejun Huang , Max Q. -H. Meng , Bo Zhao

The integration of artificial intelligence in healthcare has opened new horizons for improving medical diagnostics and patient care. However, challenges persist in developing systems capable of generating accurate and contextually relevant…

计算机视觉与模式识别 · 计算机科学 2026-02-16 Marco Salmè , Rosa Sicilia , Paolo Soda , Valerio Guarrasi

Structural magnetic resonance imaging (MRI) has been widely utilized for analysis and diagnosis of brain diseases. Automatic segmentation of brain tumors is a challenging task for computer-aided diagnosis due to low-tissue contrast in the…

图像与视频处理 · 电气工程与系统科学 2020-11-22 Mohammad Hamghalam , Baiying Lei , Tianfu Wang