中文
相关论文

相关论文: Towards Personalized Multi-Modal MRI Synthesis acr…

200 篇论文

We propose a multimodal latent diffusion model that jointly synthesizes volumetric magnetic resonance imaging (MRI) and tabular clinical data within a shared latent space via cross-attention. This approach enables coherent joint…

图像与视频处理 · 电气工程与系统科学 2026-05-11 Daniel Mensing , Jan Kapar , Jochen G. Hirsch , Matthias Günther , Horst Hahn , Marvin N. Wright

Multimodal Magnetic Resonance Imaging (MRI) provides essential complementary information for analyzing brain tumor subregions. While methods using four common MRI modalities for automatic segmentation have shown success, they often face…

图像与视频处理 · 电气工程与系统科学 2024-11-14 Runze Cheng , Zhongao Sun , Ye Zhang , Chun Li

Magnetic resonance imaging (MRI) is indispensable for diagnosing and planning treatment in various medical conditions due to its ability to produce multi-series images that reveal different tissue characteristics. However, integrating these…

图像与视频处理 · 电气工程与系统科学 2024-12-11 Churan Wang , Fei Gao , Lijun Yan , Siwen Wang , Yizhou Yu , Yizhou Wang

Fusing multi-modal data can improve the performance of deep learning models. However, missing modalities are common for medical data due to patients' specificity, which is detrimental to the performance of multi-modal models in…

图像与视频处理 · 电气工程与系统科学 2023-09-28 Muyu Wang , Shiyu Fan , Yichen Li , Hui Chen

We present a foundation model for brain MRI that can work with different combinations of imaging sequences. The model uses one encoder with learnable modality embeddings, conditional layer normalization, and a masked autoencoding objective…

计算机视觉与模式识别 · 计算机科学 2025-11-06 Minh Sao Khue Luu , Bair N. Tuchinov

The primary challenges in visible-infrared person re-identification arise from the differences between visible (vis) and infrared (ir) images, including inter-modal and intra-modal variations. These challenges are further complicated by…

计算机视觉与模式识别 · 计算机科学 2024-09-10 Jiarui Li , Zhen Qiu , Yilin Yang , Yuqi Li , Zeyu Dong , Chuanguang Yang

Multi-modal brain magnetic resonance imaging (MRI) plays a crucial role in clinical diagnostics by providing complementary information across different imaging modalities. However, a common challenge in clinical practice is missing MRI…

图像与视频处理 · 电气工程与系统科学 2025-06-04 Haowen Pang , Weiyan Guo , Chuyang Ye

Cross-modal medical image synthesis research focuses on reconstructing missing imaging modalities from available ones to support clinical diagnosis. Driven by clinical necessities for flexible modality reconstruction, we explore K to N…

计算机视觉与模式识别 · 计算机科学 2025-10-06 Feng Yuan , Yifan Gao , Yuehua Ye , Haoyue Li , Xin Gao

We propose a unified deep meta-learning framework for accelerated magnetic resonance imaging (MRI) that jointly addresses multi-coil reconstruction and cross-modality synthesis. Motivated by the limitations of conventional methods in…

最优化与控制 · 数学 2026-03-10 Merham Fouladvand , Peuroly Batra

MRI entails a great amount of cost, time and effort for the generation of all the modalities that are recommended for efficient diagnosis and treatment planning. Recent advancements in deep learning research show that generative models have…

图像与视频处理 · 电气工程与系统科学 2022-02-22 Jaya Chandra Raju , Kompella Subha Gayatri , Keerthi Ram , Rajeswaran Rangasami , Rajoo Ramachandran , Mohansankar Sivaprakasam

Recent advancements in Large Multimodal Models (LMMs) have attracted interest in their generalization capability with only a few samples in the prompt. This progress is particularly relevant to the medical domain, where the quality and…

计算与语言 · 计算机科学 2024-05-06 Seonhee Cho , Choonghan Kim , Jiho Lee , Chetan Chilkunda , Sujin Choi , Joo Heung Yoon

Multimodal data modeling has emerged as a powerful approach in clinical research, enabling the integration of diverse data types such as imaging, genomics, wearable sensors, and electronic health records. Despite its potential to improve…

Deep generative models have emerged as a transformative tool in medical imaging, offering substantial potential for synthetic data generation. However, recent empirical studies highlight a critical vulnerability: these models can memorize…

计算机视觉与模式识别 · 计算机科学 2025-12-30 Antonio Scardace , Lemuel Puglisi , Francesco Guarnera , Sebastiano Battiato , Daniele Ravì

Neuroimaging consortia can enhance reliability and generalizability of findings by pooling data across studies to achieve larger sample sizes. To adjust for site and MRI protocol effects, imaging datasets are often harmonized based on…

Missing or corrupted modalities are common in physiological signal-based medical applications owing to hardware constraints or motion artifacts. However, most existing methods assume the availability of all modalities, resulting in…

机器学习 · 计算机科学 2025-10-14 Cheol-Hui Lee , Hwa-Yeon Lee , Min-Kyung Jung , Dong-Joo Kim

Magnetic resonance imaging (MRI) is a widely used radiological modality renowned for its radiation-free, comprehensive insights into the human body, facilitating medical diagnoses. However, the drawback of prolonged scan times hinders its…

Multi-modal brain MRI provides essential complementary information for clinical diagnosis. However, acquiring all modalities in practice is often constrained by time and cost. To address this, various methods have been proposed to generate…

图像与视频处理 · 电气工程与系统科学 2026-05-07 Hanyeol Yang , Sunggyu Kim , Mi Kyung Kim , Yongseon Yoo , Yu-Mi Kim , Min-Ho Shin , Insung Chung , Sang Baek Koh , Hyeon Chang Kim , Jong-Min Lee

Multimodal sequential recommendation (MSR) leverages diverse item modalities to improve recommendation accuracy, while achieving effective and adaptive fusion remains challenging. Existing MSR models often overlook synergistic information…

信息检索 · 计算机科学 2026-01-19 Xinyi Zhang , Yutong Li , Peijie Sun , Letian Sha , Zhongxuan Han

Multimodal MRI provides complementary and clinically relevant information to probe tissue condition and to characterize various diseases. However, it is often difficult to acquire sufficiently many modalities from the same subject due to…

图像与视频处理 · 电气工程与系统科学 2021-06-08 Xiaofeng Liu , Fangxu Xing , Georges El Fakhri , Jonghye Woo

Federated learning (FL) has become a promising paradigm for collaborative medical image analysis, yet existing frameworks remain tightly coupled to task-specific backbones and are fragile under heterogeneous imaging modalities. Such…

计算机视觉与模式识别 · 计算机科学 2026-03-24 Meilin Liu , Jiaying Wang , Jing Shan