English
Related papers

Related papers: TotalFM: An Organ-Separated Framework for 3D-CT Vi…

200 papers

Magnetic Resonance Imaging is a critical imaging modality in clinical diagnosis and research, yet its complexity and heterogeneity hinder scalable, generalizable machine learning. Although foundation models have revolutionized language and…

Precise 3D environmental mapping is pivotal in robotics. Existing methods often rely on predefined concepts during training or are time-intensive when generating semantic maps. This paper presents Open-Fusion, a groundbreaking approach for…

Computer Vision and Pattern Recognition · Computer Science 2023-10-09 Kashu Yamazaki , Taisei Hanyu , Khoa Vo , Thang Pham , Minh Tran , Gianfranco Doretto , Anh Nguyen , Ngan Le

Foundation models refer to artificial intelligence (AI) models that are trained on massive amounts of data and demonstrate broad generalizability across various tasks with high accuracy. These models offer versatile, one-for-many or…

Image and Video Processing · Electrical Eng. & Systems 2024-11-06 Rina Bao , Erfan Darzi , Sheng He , Chuan-Heng Hsiao , Mohammad Arafat Hussain , Jingpeng Li , Atle Bjornerud , Ellen Grant , Yangming Ou

Frontier artificial intelligence (AI) models, such as OpenAI's GPT-5 and Meta's DINOv3, have advanced rapidly through training on internet-scale public data, yet such systems lack access to private clinical data. Neuroimaging, in…

Precision medicine in the quantitative management of chronic diseases and oncology would be greatly improved if the Computed Tomography (CT) scan of any patient could be segmented, parsed and analyzed in a precise and detailed way. However,…

Language promptable X-ray image segmentation would enable greater flexibility for human-in-the-loop workflows in diagnostic and interventional precision medicine. Prior efforts have contributed task-specific models capable of solving…

Computer Vision and Pattern Recognition · Computer Science 2025-06-26 Benjamin D. Killeen , Liam J. Wang , Blanca Inigo , Han Zhang , Mehran Armand , Russell H. Taylor , Greg Osgood , Mathias Unberath

Tongue segmentation serves as the primary step in automated TCM tongue diagnosis, which plays a significant role in the diagnostic results. Currently, numerous deep learning based methods have achieved promising results. However, when…

Computer Vision and Pattern Recognition · Computer Science 2023-12-07 Shan Cao , Qunsheng Ruan , Linjian Ma

Open-vocabulary 3D scene understanding presents a significant challenge in the field. Recent works have sought to transfer knowledge embedded in vision-language models from 2D to 3D domains. However, these approaches often require prior…

Computer Vision and Pattern Recognition · Computer Science 2024-09-06 Hanchen Tai , Qingdong He , Jiangning Zhang , Yijie Qian , Zhenyu Zhang , Xiaobin Hu , Xiangtai Li , Yabiao Wang , Yong Liu

Foundation models have exhibited remarkable success in various applications, such as disease diagnosis and text report generation. To date, a foundation model for endoscopic video analysis is still lacking. In this paper, we propose…

Computer Vision and Pattern Recognition · Computer Science 2024-01-10 Zhao Wang , Chang Liu , Shaoting Zhang , Qi Dou

Radiology plays an integral role in modern medicine, yet rising imaging volumes have far outpaced workforce growth. Foundation models offer a path toward assisting with the full spectrum of radiology tasks, but existing medical models…

Vision-language models (VLMs) pre-trained at large scale have shown unprecedented transferability capabilities and are being progressively integrated into medical image analysis. Although its discriminative potential has been widely…

Computer Vision and Pattern Recognition · Computer Science 2025-06-09 Julio Silva-Rodríguez , Leo Fillioux , Paul-Henry Cournède , Maria Vakalopoulou , Stergios Christodoulidis , Ismail Ben Ayed , Jose Dolz

Ultrasound imaging is widely used in clinical diagnosis due to its non-invasive nature and real-time capabilities. However, traditional ultrasound diagnostics relies heavily on physician expertise and is often hampered by suboptimal image…

Image and Video Processing · Electrical Eng. & Systems 2025-12-18 Yuncheng Jiang , Chun-Mei Feng , Jinke Ren , Jun Wei , Zixun Zhang , Yiwen Hu , Yunbi Liu , Rui Sun , Xuemei Tang , Juan Du , Xiang Wan , Yong Xu , Bo Du , Xin Gao , Guangyu Wang , Shaohua Zhou , Shuguang Cui , Zhen Li

Deep learning has enabled great strides in abdominal multi-organ segmentation, even surpassing junior oncologists on common cases or organs. However, robustness on corner cases and complex organs remains a challenging open problem for…

Image and Video Processing · Electrical Eng. & Systems 2024-06-21 Xiangde Luo , Zihan Li , Shaoting Zhang , Wenjun Liao , Guotai Wang

The goal of automatic report generation is to generate a clinically accurate and coherent phrase from a single given X-ray image, which could alleviate the workload of traditional radiology reporting. However, in a real-world scenario,…

Computer Vision and Pattern Recognition · Computer Science 2023-11-13 Tiancheng Gu , Dongnan Liu , Zhiyuan Li , Weidong Cai

Abdominal organ and tumour segmentation has many important clinical applications, such as organ quantification, surgical planning, and disease diagnosis. However, manual assessment is inherently subjective with considerable inter- and…

Image and Video Processing · Electrical Eng. & Systems 2023-11-17 Wentao Liu , Tong Tian , Weijin Xu , Lemeng Wang , Haoyuan Li , Huihua Yang

Automated radiology report generation is key for reducing radiologist workload and improving diagnostic consistency, yet generating accurate reports for 3D medical imaging remains challenging. Existing vision-language models face two…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Pengcheng Shi , Minghui Zhang , Kehan Song , Jiaqi Liu , Yun Gu , Xinglin Zhang

Supervised deep learning models for automated CTG analysis are typically constrained by narrowly curated labelled datasets and limited patient cohorts, leaving substantial volumes of physiologically informative clinical recordings untapped.…

Machine Learning · Computer Science 2026-05-06 Sheng Wong , Ravi Shankar , Beth Albert , Hao Fei , Lin Li , Imane Ben M'Barek , Manu Vatish , Gabriel Davis Jones

Transformer-based foundation models (FMs) have recently demonstrated remarkable performance in medical image segmentation. However, scaling these models is challenging due to the limited size of medical image datasets within isolated…

Image and Video Processing · Electrical Eng. & Systems 2025-03-20 Yumin Zhang , Yan Gao , Haoran Duan , Hanqing Guo , Tejal Shah , Rajiv Ranjan , Bo Wei

Foundation models (FMs) are transforming computational pathology by offering new ways to analyze histopathology images. However, FMs typically require weeks of training on large databases, making their creation a resource-intensive process.…

Image and Video Processing · Electrical Eng. & Systems 2026-01-27 Till Nicke , Daniela Schacherer , Jan Raphael Schäfer , Natalia Artysh , Antje Prasse , André Homeyer , Andrea Schenk , Henning Höfener , Johannes Lotz

Purpose: To develop and evaluate a deep learning model for multi-organ segmentation of MRI scans. Materials and Methods: The model was trained on 1,200 manually annotated 3D axial MRI scans from the UK Biobank, 221 in-house MRI scans, and…