English
Related papers

Related papers: TotalFM: An Organ-Separated Framework for 3D-CT Vi…

200 papers

This paper aims to build a model that can Segment Anything in 3D medical images, driven by medical terminologies as Text prompts, termed as SAT. Our main contributions are three-fold: (i) We construct the first multimodal knowledge tree on…

Image and Video Processing · Electrical Eng. & Systems 2025-07-21 Ziheng Zhao , Yao Zhang , Chaoyi Wu , Xiaoman Zhang , Xiao Zhou , Ya Zhang , Yanfeng Wang , Weidi Xie

Recent advances in multimodal large language models (LLMs) have enabled unified reasoning across images, audio, and video, but extending such capability to brain imaging remains largely unexplored. Bridging this gap is essential to link…

Computation and Language · Computer Science 2026-05-15 Yuxiang Wei , Yanteng Zhang , Xi Xiao , Chengxuan Qian , Tianyang Wang , Vince D. Calhoun

Foundation models are experiencing a surge in popularity. The Segment Anything model (SAM) asserts an ability to segment a wide spectrum of objects but required supervised training at unprecedented scale. We compared SAM's performance…

Image and Video Processing · Electrical Eng. & Systems 2025-03-11 Danielle Ferreira , Rima Arnaout

Although large-scale visual foundation models (VFMs) achieve remarkable performance in semantic understanding, they still underperform in instance-aware dense prediction tasks. They exhibit different biases in representation: for instance,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Yachan Guo , JoseLuis Gomez Zurita , Danna Xue , Yi Xiao , AntonioManuel Lopez Pena

Universal medical image segmentation models have emerged as a promising paradigm due to their strong generalizability across diverse tasks, showing great potential for a wide range of clinical applications. This potential has been partly…

Computer Vision and Pattern Recognition · Computer Science 2025-08-18 Yanwu Yang , Guinan Su , Jiesi Hu , Francesco Sammarco , Jonas Geiping , Thomas Wolfers

In the paper, we present an approach for learning a single model that universally segments 33 anatomical structures, including vertebrae, pelvic bones, and abdominal organs. Our model building has to address the following challenges.…

Image and Video Processing · Electrical Eng. & Systems 2022-03-07 Pengbo Liu , Yang Deng , Ce Wang , Yuan Hui , Qian Li , Jun Li , Shiwei Luo , Mengke Sun , Quan Quan , Shuxin Yang , You Hao , Honghu Xiao , Chunpeng Zhao , Xinbao Wu , S. Kevin Zhou

With the development of large language models, many remarkable linguistic systems like ChatGPT have thrived and achieved astonishing success on many tasks, showing the incredible power of foundation models. In the spirit of unleashing the…

Computer Vision and Pattern Recognition · Computer Science 2024-01-30 Dingyuan Zhang , Dingkang Liang , Hongcheng Yang , Zhikang Zou , Xiaoqing Ye , Zhe Liu , Xiang Bai

Oral and maxillofacial radiology plays a vital role in dental healthcare, but radiographic image interpretation is limited by a shortage of trained professionals. While AI approaches have shown promise, existing dental AI systems are…

Computer Vision and Pattern Recognition · Computer Science 2025-10-17 Xinrui Huang , Fan Xiao , Dongming He , Anqi Gao , Dandan Li , Xiaofan Zhang , Shaoting Zhang , Xudong Wang

In CT angiography, the accurate segmentation of abdominal aortic aneurysms (AAAs) is difficult due to large anatomical variability, low-contrast vessel boundaries, and the close proximity of organs whose intensities resemble vascular…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Osamah Sufyan , Martin Brückmann , Ralph Wickenhöfer , Babette Dellen , Uwe Jaekel

Cardiac Magnetic Resonance (CMR) imaging serves as the gold-standard for evaluating cardiac morphology and function. Typically, a multi-view CMR stack, covering short-axis (SA) and 2/3/4-chamber long-axis (LA) views, is acquired for a…

Image and Video Processing · Electrical Eng. & Systems 2025-07-03 Yundi Zhang , Chen Chen , Suprosanna Shit , Sophie Starck , Daniel Rueckert , Jiazhen Pan

Precise spatial modeling in the operating room (OR) is foundational to many clinical tasks, supporting intraoperative awareness, hazard avoidance, and surgical decision-making. While existing approaches leverage large-scale multimodal…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Peiqi He , Zhenhao Zhang , Yixiang Zhang , Xiongjun Zhao , Shaoliang Peng

The emergence of Large Language Models (LLMs) presents unprecedented opportunities to revolutionize medical contrastive vision-language pre-training. In this paper, we show how LLMs can facilitate large-scale supervised pre-training,…

Computer Vision and Pattern Recognition · Computer Science 2025-09-17 Yingtai Li , Haoran Lai , Xiaoqian Zhou , Shuai Ming , Wenxin Ma , Wei Wei , Shaohua Kevin Zhou

Foundation models have demonstrated remarkable potential in medical domain. However, their application to complex cardiovascular diagnostics remains underexplored. In this paper, we present Cardiac-CLIP, a multi-modal foundation model…

Federated learning and its application to medical image segmentation have recently become a popular research topic. This training paradigm suffers from statistical heterogeneity between participating institutions' local datasets, incurring…

Image and Video Processing · Electrical Eng. & Systems 2023-10-19 Matthis Manthe , Stefan Duffner , Carole Lartizien

Open-vocabulary semantic segmentation (OVSS) underpins many vision and robotics tasks that require generalizable semantic understanding. Existing approaches either rely on limited segmentation training data, which hinders generalization, or…

Computer Vision and Pattern Recognition · Computer Science 2026-04-13 Omar Alama , Darshil Jariwala , Avigyan Bhattacharya , Seungchan Kim , Wenshan Wang , Sebastian Scherer

Prompt-driven vision foundation models, such as the Segment Anything Model, have recently demonstrated remarkable adaptability in computer vision. However, their direct application to medical imaging remains challenging due to heterogeneous…

Image and Video Processing · Electrical Eng. & Systems 2025-11-14 Himashi Peiris , Sizhe Wang , Gary Egan , Mehrtash Harandi , Meng Law , Zhaolin Chen

Recent advances in 3D medical vision-language models have enabled joint reasoning over volumetric images and text, showing strong performance in medical visual question-answering (VQA) and report generation. Despite this progress, it…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Mashrafi Monon , Umaima Rahman , Asif Hanif , Numan Saeed , Mohammad Yaqub

Foundation models (FMs) have shown great promise in medical image analysis by improving generalization across diverse downstream tasks. In ophthalmology, several FMs have recently emerged, but there is still no clear answer to fundamental…

Recent advances in 3D fully convolutional networks (FCN) have made it feasible to produce dense voxel-wise predictions of full volumetric images. In this work, we show that a multi-class 3D FCN trained on manually labeled CT scans of seven…

Computer Vision and Pattern Recognition · Computer Science 2017-04-24 Holger R. Roth , Hirohisa Oda , Yuichiro Hayashi , Masahiro Oda , Natsuki Shimizu , Michitaka Fujiwara , Kazunari Misawa , Kensaku Mori

The rapid development of Vision Foundation Models (VFMs), particularly Vision Transformers (ViT) and Segment Anything Model (SAM), has sparked significant advances in the field of medical image analysis. These models have demonstrated…

Image and Video Processing · Electrical Eng. & Systems 2025-02-24 Pengchen Liang , Bin Pu , Haishan Huang , Yiwei Li , Hualiang Wang , Weibo Ma , Qing Chang