English
Related papers

Related papers: FusionSAM: Visual Multi-Modal Learning with Segmen…

200 papers

Multimodal semantic communication has gained widespread attention due to its ability to enhance downstream task performance. A key challenge in such systems is the effective fusion of features from different modalities, which requires the…

Image and Video Processing · Electrical Eng. & Systems 2025-09-03 Haoshuo Zhang , Yufei Bo , Hongwei Zhang , Meixia Tao

Medical image segmentation models built on Segment Anything Model (SAM) achieve strong performance on clean benchmarks, yet their reliability often degrades under realistic image corruptions such as noise, blur, motion artifacts, and…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Jieru Li , Matthew Chen , Micky C. Nnamdi , J. Ben Tamo , Benoit L. Marteau , May D. Wang

The ability to segment objects based on open-ended language prompts remains a critical challenge, requiring models to ground textual semantics into precise spatial masks while handling diverse and unseen categories. We present OpenWorldSAM,…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Shiting Xiao , Rishabh Kabra , Yuhang Li , Donghyun Lee , Joao Carreira , Priyadarshini Panda

Segment anything model (SAM) addresses two practical yet challenging segmentation tasks: \textbf{segment anything (SegAny)}, which utilizes a certain point to predict the mask for a single object of interest, and \textbf{segment everything…

Computer Vision and Pattern Recognition · Computer Science 2023-12-18 Chaoning Zhang , Dongshen Han , Sheng Zheng , Jinwoo Choi , Tae-Ho Kim , Choong Seon Hong

The Segmentation Anything Model (SAM) requires labor-intensive data labeling. We present Unsupervised SAM (UnSAM) for promptable and automatic whole-image segmentation that does not require human annotations. UnSAM utilizes a…

Computer Vision and Pattern Recognition · Computer Science 2024-07-01 XuDong Wang , Jingfeng Yang , Trevor Darrell

LiDAR has become a standard sensor for autonomous driving applications as they provide highly precise 3D point clouds. LiDAR is also robust for low-light scenarios at night-time or due to shadows where the performance of cameras is…

Computer Vision and Pattern Recognition · Computer Science 2019-07-18 Khaled El Madawy , Hazem Rashed , Ahmad El Sallab , Omar Nasr , Hanan Kamel , Senthil Yogamani

Segmentation is a fundamental task in computer vision, with prompt-driven methods gaining prominence due to their flexibility. The Segment Anything Model (SAM) excels at point-prompted segmentation, while text-based models, often leveraging…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Suzhe Xu , Jialin Peng , Chengyuan Zhang

Recent segmentation methods, which adopt large-scale data training and transformer architecture, aim to create one foundation model that can perform multiple tasks. However, most of these methods rely on heavy encoder and decoder…

Computer Vision and Pattern Recognition · Computer Science 2025-03-03 Shilin Xu , Haobo Yuan , Qingyu Shi , Lu Qi , Jingbo Wang , Yibo Yang , Yining Li , Kai Chen , Yunhai Tong , Bernard Ghanem , Xiangtai Li , Ming-Hsuan Yang

Foundation models have taken over natural language processing and image generation domains due to the flexibility of prompting. With the recent introduction of the Segment Anything Model (SAM), this prompt-driven paradigm has entered image…

Image and Video Processing · Electrical Eng. & Systems 2023-04-13 Saikat Roy , Tassilo Wald , Gregor Koehler , Maximilian R. Rokuss , Nico Disch , Julius Holzschuh , David Zimmerer , Klaus H. Maier-Hein

The advent of foundation models signals a new era in artificial intelligence. The Segment Anything Model (SAM) is the first foundation model for image segmentation. In this study, we evaluate SAM's ability to segment features from eye…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Virmarie Maquiling , Sean Anthony Byrne , Diederick C. Niehorster , Marcus Nyström , Enkelejda Kasneci

Wound image segmentation is a critical component for the clinical diagnosis and in-time treatment of wounds. Recently, deep learning has become the mainstream methodology for wound image segmentation. However, the pre-processing of the…

Image and Video Processing · Electrical Eng. & Systems 2022-07-13 Honghui Liu , Changjian Wang , Kele Xu , Fangzhao Li , Ming Feng , Yuxing Peng , Hongjun He

The Segment Anything Model (SAM) is a promptable segmentation model recently introduced by Meta AI that has demonstrated its prowess across various fields beyond just image segmentation. SAM can accurately segment images across diverse…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Junzhang Chen , Xiangzhi Bai

In medical image segmentation, heterogeneous privacy policies across institutions often make joint training on pooled datasets infeasible, motivating continual image segmentation-learning from data streams without catastrophic forgetting.…

Computer Vision and Pattern Recognition · Computer Science 2025-11-24 Jiayi Wang , Wei Dai , Haoyu Wang , Sihan Yang , Haixia Bi , Jian Sun

Accurate tumor segmentation and classification in breast ultrasound (BUS) imaging remain challenging due to low contrast, speckle noise, and diverse lesion morphology. This study presents a multi-task deep learning framework that jointly…

Computer Vision and Pattern Recognition · Computer Science 2026-01-12 Samuel E. Johnny , Bernes L. Atabonfack , Israel Alagbe , Assane Gueye

Driven by large-data pre-training, Segment Anything Model (SAM) has been demonstrated as a powerful and promptable framework, revolutionizing the segmentation models. Despite the generality, customizing SAM for specific visual concepts…

Computer Vision and Pattern Recognition · Computer Science 2023-10-05 Renrui Zhang , Zhengkai Jiang , Ziyu Guo , Shilin Yan , Junting Pan , Xianzheng Ma , Hao Dong , Peng Gao , Hongsheng Li

Panoptic segmentation, which combines instance and semantic segmentation, has gained a lot of attention in autonomous vehicles, due to its comprehensive representation of the scene. This task can be applied for cameras and LiDAR sensors,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 Fardin Ayar , Ehsan Javanmardi , Manabu Tsukada , Mahdi Javanmardi , Mohammad Rahmati

As large-scale foundation models trained on billions of image--mask pairs covering a vast diversity of scenes, objects, and contexts, SAM and its upgraded version, SAM~2, have significantly influenced multiple fields within computer vision.…

Computer Vision and Pattern Recognition · Computer Science 2025-08-27 Xiaoqi Zhao , Youwei Pang , Shijie Chang , Yuan Zhao , Lihe Zhang , Chenyang Yu , Hanqi Liu , Jiaming Zuo , Jinsong Ouyang , Weisi Lin , Georges El Fakhri , Huchuan Lu , Xiaofeng Liu

The limited availability of labeled data has driven advancements in semi-supervised learning for medical image segmentation. Modern large-scale models tailored for general segmentation, such as the Segment Anything Model (SAM), have…

Computer Vision and Pattern Recognition · Computer Science 2024-12-19 Kaiwen Huang , Tao Zhou , Huazhu Fu , Yizhe Zhang , Yi Zhou , Chen Gong , Dong Liang

Automated segmentation of ultrasound images can assist medical experts with diagnostic and therapeutic procedures. Although using the common modality of ultrasound, one typically needs separate datasets in order to segment, for example,…

Image and Video Processing · Electrical Eng. & Systems 2023-08-15 Dongik Shin , Beomsuk Kim , Seungjun Baek

Leveraging multimodal large models for image segmentation has become a prominent research direction. However, existing approaches typically rely heavily on manually annotated datasets that include explicit reasoning processes, which are…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Jiaqi Huang , Zunnan Xu , Jun Zhou , Ting Liu , Yicheng Xiao , Mingwen Ou , Bowen Ji , Xiu Li , Kehong Yuan