English
Related papers

Related papers: BLO-Inst: Bi-Level Optimization Based Alignment of…

200 papers

The Segment Anything Model (SAM) is a powerful foundation model that has revolutionised image segmentation. To apply SAM to surgical instrument segmentation, a common approach is to locate precise points or boxes of instruments and then use…

Computer Vision and Pattern Recognition · Computer Science 2023-12-22 Wenxi Yue , Jing Zhang , Kun Hu , Yong Xia , Jiebo Luo , Zhiyong Wang

The Segment Anything Model (SAM) marks a notable milestone in segmentation models, highlighted by its robust zero-shot capabilities and ability to handle diverse prompts. SAM follows a pipeline that separates interactive segmentation into…

Computer Vision and Pattern Recognition · Computer Science 2024-05-30 You Huang , Zongyu Lan , Liujuan Cao , Xianming Lin , Shengchuan Zhang , Guannan Jiang , Rongrong Ji

Recently, promptable segmentation models, such as the Segment Anything Model (SAM), have demonstrated robust zero-shot generalization capabilities on static images. These promptable models exhibit denoising abilities for imprecise prompt…

Computer Vision and Pattern Recognition · Computer Science 2024-03-08 Tao Zhou , Wenhan Luo , Qi Ye , Zhiguo Shi , Jiming Chen

Recently, foundation models trained on massive datasets to adapt to a wide range of tasks have attracted considerable attention and are actively being explored within the computer vision community. Among these, the Segment Anything Model…

Computer Vision and Pattern Recognition · Computer Science 2024-10-14 Hyung-Il Kim , Kimin Yun , Jun-Seok Yun , Yuseok Bae

Localizing object parts precisely is essential for tasks such as object recognition and robotic manipulation. Recent part segmentation methods require extensive training data and labor-intensive annotations. Segment-Anything Model (SAM) has…

Computer Vision and Pattern Recognition · Computer Science 2025-01-14 S. B. van Rooij , G. J. Burghouts

Cryo-electron microscopy (cryo-EM) remains pivotal in structural biology, yet the task of protein particle picking, integral for 3D protein structure construction, is laden with manual inefficiencies. While recent AI tools such as Topaz and…

Computer Vision and Pattern Recognition · Computer Science 2023-11-29 Fei He , Zhiyuan Yang , Mingyue Gao , Biplab Poudel , Newgin Sam Ebin Sam Dhas , Rajan Gyawali , Ashwin Dhakal , Jianlin Cheng , Dong Xu

The ability to segment objects based on open-ended language prompts remains a critical challenge, requiring models to ground textual semantics into precise spatial masks while handling diverse and unseen categories. We present OpenWorldSAM,…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Shiting Xiao , Rishabh Kabra , Yuhang Li , Donghyun Lee , Joao Carreira , Priyadarshini Panda

Highly coherent sensing matrices arise in discretization of continuum imaging problems such as radar and medical imaging when the grid spacing is below the Rayleigh threshold. Algorithms based on techniques of band exclusion (BE) and local…

Information Theory · Computer Science 2011-06-28 A. Fannjiang , W. Liao

Semi-supervised learning (SSL) has achieved notable progress in medical image segmentation. To achieve effective SSL, a model needs to be able to efficiently learn from limited labeled data and effectively exploiting knowledge from abundant…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Juzheng Miao , Cheng Chen , Keli Zhang , Jie Chuai , Quanzheng Li , Pheng-Ann Heng

Foundation models such as the recently introduced Segment Anything Model (SAM) have achieved remarkable results in image segmentation tasks. However, these models typically require user interaction through handcrafted prompts such as…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Mélanie Gaillochet , Christian Desrosiers , Hervé Lombaert

Modern referring image segmentation pipelines couple a vision-language model (VLM) for grounding with a promptable segmenter such as the Segment Anything Model (SAM) for mask generation. Prior training-free instances of this recipe…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Pouya Sadeghi , Shawn He , Pedro Pablo Guerrero Vela , C. Thomas , Alex Wong , Sirisha Rambhatla

The recent Segment Anything Model (SAM) 2 has demonstrated remarkable foundational competence in semantic segmentation, with its memory mechanism and mask decoder further addressing challenges in video tracking and object occlusion, thereby…

Computer Vision and Pattern Recognition · Computer Science 2024-08-09 Jieming Yu , An Wang , Wenzhen Dong , Mengya Xu , Mobarakol Islam , Jie Wang , Long Bai , Hongliang Ren

Radiographic images are a cornerstone of medical diagnostics in orthopaedics, with anatomical landmark detection serving as a crucial intermediate step for information extraction. General-purpose foundational segmentation models, such as…

Image and Video Processing · Electrical Eng. & Systems 2026-02-23 Ekaterina Stansfield , Jennifer A. Mitterer , Abdulrahman Altahhan

Promptable foundation models such as the Segment Anything Model (SAM) produce high-quality masks but remain semantically blind, relying on external prompts to specify categories. Existing vision-language approaches address this limitation…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Shayan Jalilian , Abdul Bais

The Segment Anything Model (SAM) and similar models build a family of promptable foundation models (FMs) for image and video segmentation. The object of interest is identified using prompts, such as bounding boxes or points. With these FMs…

Computer Vision and Pattern Recognition · Computer Science 2024-11-14 Caroline Magg , Hoel Kervadec , Clara I. Sánchez

Training-free Camouflaged Object Segmentation (COS) seeks to segment camouflaged objects without task-specific training, by automatically generating visual prompts to guide the Segment Anything Model (SAM). However, existing pipelines…

Computer Vision and Pattern Recognition · Computer Science 2025-11-13 Chao Yin , Jide Li , Hang Yao , Xiaoqiang Li

Recent advancements in large foundation models have shown promising potential in the medical industry due to their flexible prompting capability. One such model, the Segment Anything Model (SAM), a prompt-driven segmentation model, has…

Computer Vision and Pattern Recognition · Computer Science 2023-08-16 Qi Wu , Yuyao Zhang , Marawan Elbatel

The Segment Anything Model (SAM) is a powerful foundation model that introduced revolutionary advancements in natural image segmentation. However, its performance remains sub-optimal when delineating the intricate structure of biomedical…

Image and Video Processing · Electrical Eng. & Systems 2023-10-05 Xiangru Li , Yifei Zhang , Liang Zhao

Extracting small objects from remote sensing imagery plays a vital role in various applications, including urban planning, environmental monitoring, and disaster management. While current research primarily focuses on small object…

Computer Vision and Pattern Recognition · Computer Science 2025-09-04 Chenhao Wang , Yingrui Ji , Yu Meng , Yunjian Zhang , Yao Zhu

Medical image segmentation is vital for clinical diagnosis, yet current deep learning methods often demand extensive expert effort, i.e., either through annotating large training datasets or providing prompts at inference time for each new…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Xingjian Li , Qifeng Wu , Adithya S. Ubaradka , Yiran Ding , Colleen Que , Runmin Jiang , Jianhua Xing , Tianyang Wang , Min Xu