English
Related papers

Related papers: Self-supervised 3D Patient Modeling with Multi-mod…

200 papers

The successful adaptation of foundation models to multi-modal medical imaging is a critical yet unresolved challenge. Existing models often struggle to effectively fuse information from multiple sources and adapt to the heterogeneous nature…

Computer Vision and Pattern Recognition · Computer Science 2026-01-23 Shadi Alijani , Fereshteh Aghaee Meibodi , Homayoun Najjaran

The generation of medical images presents significant challenges due to their high-resolution and three-dimensional nature. Existing methods often yield suboptimal performance in generating high-quality 3D medical images, and there is…

Image and Video Processing · Electrical Eng. & Systems 2025-12-02 Haoshen Wang , Zhentao Liu , Kaicong Sun , Xiaodong Wang , Dinggang Shen , Zhiming Cui

Multimodal data modeling has emerged as a powerful approach in clinical research, enabling the integration of diverse data types such as imaging, genomics, wearable sensors, and electronic health records. Despite its potential to improve…

Existing efforts to boost multimodal fusion of 3D anomaly detection (3D-AD) primarily concentrate on devising more effective multimodal fusion strategies. However, little attention was devoted to analyzing the role of multimodal fusion…

Computer Vision and Pattern Recognition · Computer Science 2024-12-24 Kaifang Long , Guoyang Xie , Lianbo Ma , Jiaqi Liu , Zhichao Lu

Fusing multi-modal data can improve the performance of deep learning models. However, missing modalities are common for medical data due to patients' specificity, which is detrimental to the performance of multi-modal models in…

Image and Video Processing · Electrical Eng. & Systems 2023-09-28 Muyu Wang , Shiyu Fan , Yichen Li , Hui Chen

Three-dimensional (3D) medical images, such as Computed Tomography (CT) and Magnetic Resonance Imaging (MRI), are essential for clinical applications. However, the need for diverse and comprehensive representations is particularly…

Computer Vision and Pattern Recognition · Computer Science 2025-05-26 Siwen Wang , Churan Wang , Fei Gao , Lixian Su , Fandong Zhang , Yizhou Wang , Yizhou Yu

Cancer prognosis and survival outcome predictions are crucial for therapeutic response estimation and for stratifying patients into various treatment groups. Medical domains concerned with cancer prognosis are abundant with multiple…

Image and Video Processing · Electrical Eng. & Systems 2024-02-29 Ruining Deng , Nazim Shaikh , Gareth Shannon , Yao Nie

The latest advances in computer-assisted precision medicine are making it feasible to move from population-wide models that are useful to discover aggregate patterns that hold for group-based analysis to patient-specific models that can…

Computer Vision and Pattern Recognition · Computer Science 2021-07-28 Da Ma , Vincent Chow , Karteek Popuri , Mirza Faisal Beg

Multi-modal medical image fusion is essential for the precise clinical diagnosis and surgical navigation since it can merge the complementary information in multi-modalities into a single image. The quality of the fused image depends on the…

Computer Vision and Pattern Recognition · Computer Science 2023-10-25 Xianming Gu , Lihui Wang , Zeyu Deng , Ying Cao , Xingyu Huang , Yue-min Zhu

Multi-frame human pose estimation in complicated situations is challenging. Although state-of-the-art human joints detectors have demonstrated remarkable results for static images, their performances come short when we apply these models to…

Computer Vision and Pattern Recognition · Computer Science 2021-03-22 Zhenguang Liu , Haoming Chen , Runyang Feng , Shuang Wu , Shouling Ji , Bailin Yang , Xun Wang

For the current 3D human pose estimation task, a group of methods mainly learn the rules of 2D-3D projection from spatial and temporal correlation. However, earlier methods model the global features of the entire body joint in the time…

Computer Vision and Pattern Recognition · Computer Science 2022-11-01 Xinwei Yu , Xiaohua Zhang

Accurate and computationally efficient 3D medical image segmentation remains a critical challenge in clinical workflows. Transformer-based architectures often demonstrate superior global contextual modeling but at the expense of excessive…

Image and Video Processing · Electrical Eng. & Systems 2026-02-19 Kavyansh Tyagi , Vishwas Rathi , Puneet Goyal

The rapid development of diagnostic technologies in healthcare is leading to higher requirements for physicians to handle and integrate the heterogeneous, yet complementary data that are produced during routine practice. For instance, the…

Machine Learning · Computer Science 2023-01-30 Can Cui , Haichun Yang , Yaohong Wang , Shilin Zhao , Zuhayr Asad , Lori A. Coburn , Keith T. Wilson , Bennett A. Landman , Yuankai Huo

3D object detection serves as the core basis of the perception tasks in autonomous driving. Recent years have seen the rapid progress of multi-modal fusion strategies for more robust and accurate 3D object detection. However, current…

Computer Vision and Pattern Recognition · Computer Science 2023-10-12 Bingqi Shen , Shuwei Dai , Yuyin Chen , Rong Xiong , Yue Wang , Yanmei Jiao

Multi-sensor fusion is essential for autonomous vehicle localization, as it is capable of integrating data from various sources for enhanced accuracy and reliability. The accuracy of the integrated location and orientation depends on the…

Robotics · Computer Science 2025-03-10 Changhong Lin , Jiarong Lin , Zhiqiang Sui , XiaoZhi Qu , Rui Wang , Kehua Sheng , Bo Zhang

Building accurate and robust artificial intelligence systems for medical image assessment requires not only the research and design of advanced deep learning models but also the creation of large and curated sets of annotated training…

Computer Vision and Pattern Recognition · Computer Science 2022-01-05 Florin C. Ghesu , Bogdan Georgescu , Awais Mansoor , Youngjin Yoo , Dominik Neumann , Pragneshkumar Patel , R. S. Vishwanath , James M. Balter , Yue Cao , Sasa Grbic , Dorin Comaniciu

Clinical decision-making relies on the integration of information across various data modalities, such as clinical time-series, medical images and textual reports. Compared to other domains, real-world medical data is heterogeneous in…

Image and Video Processing · Electrical Eng. & Systems 2025-08-14 Baraa Al Jorf , Farah Shamout

Semi-supervised learning addresses the issue of limited annotations in medical images effectively, but its performance is often inadequate for complex backgrounds and challenging tasks. Multi-modal fusion methods can significantly improve…

Computer Vision and Pattern Recognition · Computer Science 2025-06-23 Dongdong Meng , Sheng Li , Hao Wu , Guoping Wang , Xueqing Yan

BACKGROUND AND OBJECTIVE: The research done in the field of Augmented Reality (AR) for patient positioning in radiation therapy is scarce. We propose an efficient and cost-effective algorithm for tracking the scene and the patient to…

Computer Vision and Pattern Recognition · Computer Science 2021-08-02 Hamid Sarmadi , Rafael Muñoz-Salinas , M. Álvaro Berbís , Antonio Luna , R. Medina-Carnicer

Automatic breast lesion detection and classification is an important task in computer-aided diagnosis, in which breast ultrasound (BUS) imaging is a common and frequently used screening tool. Recently, a number of deep learning-based…

Image and Video Processing · Electrical Eng. & Systems 2022-10-13 Zong Fan , Ping Gong , Shanshan Tang , Christine U. Lee , Xiaohui Zhang , Pengfei Song , Shigao Chen , Hua Li