English
Related papers

Related papers: CLIP-Driven Universal Model for Organ Segmentation…

200 papers

We present a deep learning segmentation model that can automatically and robustly segment all major anatomical structures in body CT images. In this retrospective study, 1204 CT examinations (from the years 2012, 2016, and 2020) were used…

Many recent medical segmentation systems rely on powerful deep learning models to solve highly specific tasks. To maximize performance, it is standard practice to evaluate numerous pipelines with varying model topologies, optimization…

Machine Learning · Computer Science 2019-11-06 Mathias Perslev , Erik Bjørnager Dam , Akshay Pai , Christian Igel

CLIP models pretrained on natural images with billion-scale image-text pairs have demonstrated impressive capabilities in zero-shot classification, cross-modal retrieval, and open-ended visual answering. However, transferring this success…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Shansong Wang , Zhecheng Jin , Mingzhe Hu , Mojtaba Safari , Feng Zhao , Chih-Wei Chang , Richard LJ Qiu , Justin Roper , David S. Yu , Xiaofeng Yang

Extending CLIP models to semantic segmentation remains challenging due to the misalignment between their image-level pre-training objectives and the pixel-level visual understanding required for dense prediction. While prior efforts have…

Computer Vision and Pattern Recognition · Computer Science 2025-10-29 Jinxin Zhou , Jiachen Jiang , Zhihui Zhu

Medical image segmentation typically adopts a point-wise convolutional segmentation head to predict dense labels, where each output channel is heuristically tied to a specific class. This rigid design limits both feature sharing and…

Computer Vision and Pattern Recognition · Computer Science 2025-11-20 Bin Xie , Gady Agam

Data cleaning consumes about 80% of the time spent on data analysis for clinical research projects. This is a much bigger problem in the era of big data and machine learning in the field of medicine where large volumes of data are being…

Medical Physics · Physics 2018-01-03 Timothy Rozario , Troy Long , Mingli Chen , Weiguo Lu , Steve Jiang

In this paper, we propose an automatic brain tumor segmentation approach (e.g., PixelNet) using a pixel-level convolutional neural network (CNN). The model extracts feature from multiple convolutional layers and concatenate them to form a…

Image and Video Processing · Electrical Eng. & Systems 2022-04-26 Mobarakol Islam , Hongliang Ren

3D medical vision-language (VL) pretraining has shown potential in radiology by leveraging large-scale multimodal datasets with CT-report pairs. However, existing methods primarily rely on a global VL alignment directly adapted from 2D…

Computer Vision and Pattern Recognition · Computer Science 2025-12-03 Jingyang Lin , Yingda Xia , Jianpeng Zhang , Ke Yan , Kai Cao , Le Lu , Jiebo Luo , Ling Zhang

The study of decoding visual neural information faces challenges in generalizing single-subject decoding models to multiple subjects, due to individual differences. Moreover, the limited availability of data from a single subject has a…

Computer Vision and Pattern Recognition · Computer Science 2024-02-15 Qiongyi Zhou , Changde Du , Shengpei Wang , Huiguang He

The integration of deep learning in medical imaging has shown great promise for enhancing diagnostic, therapeutic, and research outcomes. However, applying universal models across multiple modalities remains challenging due to the inherent…

Image and Video Processing · Electrical Eng. & Systems 2024-12-30 Yixin Chen , Lin Gao , Yajuan Gao , Rui Wang , Jingge Lian , Xiangxi Meng , Yanhua Duan , Leiying Chai , Hongbin Han , Zhaoping Cheng , Zhaoheng Xie

Recently, developing unified medical image segmentation models gains increasing attention, especially with the advent of the Segment Anything Model (SAM). SAM has shown promising binary segmentation performance in natural domains, however,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-18 Shuangping Huang , Hao Liang , Qingfeng Wang , Chulong Zhong , Zijian Zhou , Miaojing Shi

The scarcity of annotated data has sparked significant interest in unsupervised pre-training methods that leverage medical reports as auxiliary signals for medical visual representation learning. However, existing research overlooks the…

Computer Vision and Pattern Recognition · Computer Science 2024-02-06 Zhe Li , Laurence T. Yang , Bocheng Ren , Xin Nie , Zhangyang Gao , Cheng Tan , Stan Z. Li

Semantic segmentation of medical images aims to associate a pixel with a label in a medical image without human initialization. The success of semantic segmentation algorithms is contingent on the availability of high-quality imaging data…

Pathological structures in medical images are typically deviations from the expected anatomy of a patient. While clinicians consider this interplay between anatomy and pathology, recent deep learning algorithms specialize in recognizing…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Alexander Jaus , Constantin Seibold , Simon Reiß , Lukas Heine , Anton Schily , Moon Kim , Fin Hendrik Bahnsen , Ken Herrmann , Rainer Stiefelhagen , Jens Kleesiek

Colorectal cancer (CRC) remains one of the leading causes of cancer-related morbidity and mortality worldwide, with gastrointestinal (GI) polyps serving as critical precursors according to the World Health Organization (WHO). Early and…

Computer Vision and Pattern Recognition · Computer Science 2026-01-15 Akwasi Asare , Thanh-Huy Nguyen , Ulas Bagci

Accurate detection and segmentation of diffuse large B-cell lymphoma (DLBCL) from PET images has important implications for estimation of total metabolic tumor volume, radiomics analysis, surgical intervention and radiotherapy. Manual…

Image and Video Processing · Electrical Eng. & Systems 2024-03-13 Shadab Ahamed , Natalia Dubljevic , Ingrid Bloise , Claire Gowdy , Patrick Martineau , Don Wilson , Carlos F. Uribe , Arman Rahmim , Fereshteh Yousefirizi

Mueller matrix imaging provides rich, physically meaningful contrast for biomedical tissue analysis, but supervised learning is hindered by scarce dense annotations and strong domain shifts across specimens and acquisition settings. We…

Computer Vision and Pattern Recognition · Computer Science 2026-05-25 Adam Tlemsani , Yingdian Li , Maxime Giot , Naim Slim , Christopher J. Peters , Abhijeet Ghosh , Daniel S. Elson

This paper aims to build a model that can Segment Anything in 3D medical images, driven by medical terminologies as Text prompts, termed as SAT. Our main contributions are three-fold: (i) We construct the first multimodal knowledge tree on…

Image and Video Processing · Electrical Eng. & Systems 2025-07-21 Ziheng Zhao , Yao Zhang , Chaoyi Wu , Xiaoman Zhang , Xiao Zhou , Ya Zhang , Yanfeng Wang , Weidi Xie

Vision-language models and their adaptations to image segmentation tasks present enormous potential for producing highly accurate and interpretable results. However, implementations based on CLIP and BiomedCLIP are still lagging behind more…

Image and Video Processing · Electrical Eng. & Systems 2025-09-08 Julia Dietlmeier , Oluwabukola Grace Adegboro , Vayangi Ganepola , Claudia Mazo , Noel E. O'Connor

This study integrates PET metabolic information with CT anatomical structures to establish a 3D multimodal segmentation dataset for lymphoma based on whole-body FDG PET/CT examinations, which bridges the gap of the lack of standardised…

Image and Video Processing · Electrical Eng. & Systems 2025-12-08 Jiajun Ding , Beiyao Zhu , Xiaosheng Liu , Lishen Zhang , Zhao Liu