English
Related papers

Related papers: Zero-Shot Gaze-based Volumetric Medical Image Segm…

200 papers

Interactive segmentation model leverages prompts from users to produce robust segmentation. This advancement is facilitated by prompt engineering, where interactive prompts serve as strong priors during test-time. However, this is an…

Computer Vision and Pattern Recognition · Computer Science 2023-11-15 Hao Li , Han Liu , Dewei Hu , Jiacheng Wang , Ipek Oguz

Recently, developing unified medical image segmentation models gains increasing attention, especially with the advent of the Segment Anything Model (SAM). SAM has shown promising binary segmentation performance in natural domains, however,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-18 Shuangping Huang , Hao Liang , Qingfeng Wang , Chulong Zhong , Zijian Zhou , Miaojing Shi

Segmenting objects with complex shapes, such as wires, bicycles, or structural grids, remains a significant challenge for current segmentation models, including the Segment Anything Model (SAM) and its high-quality variant SAM-HQ. These…

Computer Vision and Pattern Recognition · Computer Science 2025-06-09 Luka Vetoshkin , Dmitry Yudin

Learning to segmentation without large-scale samples is an inherent capability of human. Recently, Segment Anything Model (SAM) performs the significant zero-shot image segmentation, attracting considerable attention from the computer…

Image and Video Processing · Electrical Eng. & Systems 2023-12-22 Chuanfei Hu , Tianyi Xia , Shenghong Ju , Xinde Li

The Segment Anything Model (SAM) and CLIP are remarkable vision foundation models (VFMs). SAM, a prompt driven segmentation model, excels in segmentation tasks across diverse domains, while CLIP is renowned for its zero shot recognition…

Computer Vision and Pattern Recognition · Computer Science 2024-05-01 Sidra Aleem , Fangyijie Wang , Mayug Maniparambil , Eric Arazo , Julia Dietlmeier , Guenole Silvestre , Kathleen Curran , Noel E. O'Connor , Suzanne Little

Automatic segmentation of anatomical structures is critical in medical image analysis, aiding diagnostics and treatment planning. Skin segmentation plays a key role in registering and visualising multimodal imaging data. 3D skin…

Image and Video Processing · Electrical Eng. & Systems 2025-06-16 Martina Paccini , Giuseppe Patanè

Segment Anything Model 2 (SAM2) demonstrated impressive zero-shot capabilities on natural images but faces challenges in biomedical segmentation due to significant domain shifts and prompt dependency. To address these limitations, we…

Computer Vision and Pattern Recognition · Computer Science 2026-05-08 Hinako Mitsuoka , Kazuhiro Hotta

A volumetric attention(VA) module for 3D medical image segmentation and detection is proposed. VA attention is inspired by recent advances in video processing, enables 2.5D networks to leverage context information along the z direction, and…

Image and Video Processing · Electrical Eng. & Systems 2020-04-07 Xudong Wang , Shizhong Han , Yunqiang Chen , Dashan Gao , Nuno Vasconcelos

Objectives: To evaluate the zero-shot performance of Segment Anything Model 2 (SAM 2) in 3D segmentation of abdominal organs in CT scans, and to investigate the effects of prompt settings on segmentation results. Materials and Methods: In…

Image and Video Processing · Electrical Eng. & Systems 2025-05-13 Yosuke Yamagishi , Shouhei Hanaoka , Tomohiro Kikuchi , Takahiro Nakao , Yuta Nakamura , Yukihiro Nomura , Soichiro Miki , Takeharu Yoshikawa , Osamu Abe

Medical image segmentation is vital for clinical diagnosis and quantitative analysis, yet remains challenging due to the heterogeneity of imaging modalities and the high cost of pixel-level annotations. Although general interactive…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Yujie Lu , Jingwen Li , Sibo Ju , Yanzhou Su , he yao , Yisong Liu , Min Zhu , Junlong Cheng

Existing promptable segmentation methods in the medical imaging field primarily consider either textual or visual prompts to segment relevant objects, yet they often fall short when addressing anomalies in medical images, like tumors, which…

Computer Vision and Pattern Recognition · Computer Science 2024-11-01 Zhongzhen Huang , Yankai Jiang , Rongzhao Zhang , Shaoting Zhang , Xiaofan Zhang

Conventional 3D instance segmentation methods rely on labor-intensive 3D annotations for supervised training, which limits their scalability and generalization to novel objects. Recent approaches leverage multi-view 2D masks from the…

Computer Vision and Pattern Recognition · Computer Science 2026-04-13 Yibo Zhao , Yigong Zhang , Jin Xie

Polyp segmentation, a critical concern in medical imaging, has prompted numerous proposed methods aimed at enhancing the quality of segmented masks. While current state-of-the-art techniques produce impressive results, the size and…

Computer Vision and Pattern Recognition · Computer Science 2024-06-24 Quoc-Huy Trinh , Hai-Dang Nguyen , Bao-Tram Nguyen Ngoc , Debesh Jha , Ulas Bagci , Minh-Triet Tran

The recent Segment Anything Model 2 (SAM2) has demonstrated exceptional capabilities in interactive object segmentation for both images and videos. However, as a foundational model on interactive segmentation, SAM2 performs segmentation…

Computer Vision and Pattern Recognition · Computer Science 2025-05-05 Qiushi Yang , Yuan Yao , Miaomiao Cui , Liefeng Bo

Polyp segmentation plays a crucial role in the early detection and diagnosis of colorectal cancer. However, obtaining accurate segmentations often requires labor-intensive annotations and specialized models. Recently, Meta AI Research…

Image and Video Processing · Electrical Eng. & Systems 2024-09-10 Mobina Mansoori , Sajjad Shahabodini , Jamshid Abouei , Konstantinos N. Plataniotis , Arash Mohammadi

Weakly supervised semantic segmentation (WSSS) in medical imaging struggles with effectively using sparse annotations. One promising direction for WSSS leverages gaze annotations, captured via eye trackers that record regions of interest…

Computer Vision and Pattern Recognition · Computer Science 2025-05-29 Zhisong Wang , Yiwen Ye , Ziyang Chen , Yong Xia

The Segment Anything Model (SAM) is the first foundation model for general image segmentation. It has achieved impressive results on various natural image segmentation tasks. However, medical image segmentation (MIS) is more challenging…

Image and Video Processing · Electrical Eng. & Systems 2024-01-18 Yuhao Huang , Xin Yang , Lian Liu , Han Zhou , Ao Chang , Xinrui Zhou , Rusi Chen , Junxuan Yu , Jiongquan Chen , Chaoyu Chen , Sijing Liu , Haozhe Chi , Xindi Hu , Kejuan Yue , Lei Li , Vicente Grau , Deng-Ping Fan , Fajin Dong , Dong Ni

Medical image segmentation has been traditionally approached by training or fine-tuning the entire model to cater to any new modality or dataset. However, this approach often requires tuning a large number of parameters during training.…

Computer Vision and Pattern Recognition · Computer Science 2024-08-14 Jay N. Paranjape , Shameema Sikder , S. Swaroop Vedula , Vishal M. Patel

Automated pavement monitoring using computer vision can analyze pavement conditions more efficiently and accurately than manual methods. Accurate segmentation is essential for quantifying the severity and extent of pavement defects and…

Computer Vision and Pattern Recognition · Computer Science 2024-09-12 Neema Jakisa Owor , Yaw Adu-Gyamfi , Armstrong Aboah , Mark Amo-Boateng

Rather than regressing gaze direction directly from images, we show that adding a 3D shape model can: i) improve gaze estimation accuracy, ii) perform well with lower resolution inputs and iii) provide a richer understanding of the…

Computer Vision and Pattern Recognition · Computer Science 2023-01-31 Hao Sun , Nick Pears