中文
相关论文

相关论文: Semantic-SAM: Segment and Recognize Anything at An…

200 篇论文

Recently segment anything model (SAM) has shown powerful segmentation capability and has drawn great attention in computer vision fields. Massive following works have developed various applications based on the pre-trained SAM and achieved…

计算机视觉与模式识别 · 计算机科学 2025-01-09 Han Shu , Wenshuo Li , Yehui Tang , Yiman Zhang , Yihao Chen , Houqiang Li , Yunhe Wang , Xinghao Chen

The Segment Anything Model (SAM) has drawn significant attention from researchers who work on medical image segmentation because of its generalizability. However, researchers have found that SAM may have limited performance on medical…

计算机视觉与模式识别 · 计算机科学 2024-03-28 Yihao Liu , Jiaming Zhang , Andres Diaz-Pinto , Haowei Li , Alejandro Martin-Gomez , Amir Kheradmand , Mehran Armand

We introduce SAM4MLLM, an innovative approach which integrates the Segment Anything Model (SAM) with Multi-Modal Large Language Models (MLLMs) for pixel-aware tasks. Our method enables MLLMs to learn pixel-level location information without…

人工智能 · 计算机科学 2024-12-17 Yi-Chia Chen , Wei-Hua Li , Cheng Sun , Yu-Chiang Frank Wang , Chu-Song Chen

In computer vision, object detection is an important task that finds its application in many scenarios. However, obtaining extensive labels can be challenging, especially in crowded scenes. Recently, the Segment Anything Model (SAM) has…

计算机视觉与模式识别 · 计算机科学 2024-07-22 Zhi Cai , Yingjie Gao , Yaoyan Zheng , Nan Zhou , Di Huang

Deep learning models trained with large amounts of data have become a recent and effective approach to predictive problem solving -- these have become known as "foundation models" as they can be used as fundamental tools for other…

图像与视频处理 · 电气工程与系统科学 2024-05-17 José Guilherme de Almeida , Nuno M. Rodrigues , Sara Silva , Nickolas Papanikolaou

The development of 2D foundation models for image segmentation has been significantly advanced by the Segment Anything Model (SAM). However, achieving similar success in 3D models remains a challenge due to issues such as non-unified data…

计算机视觉与模式识别 · 计算机科学 2024-12-04 Yuchen Zhou , Jiayuan Gu , Tung Yen Chiang , Fanbo Xiang , Hao Su

Image segmentation is a critical task in microscopy, essential for accurately analyzing and interpreting complex visual data. This task can be performed using custom models trained on domain-specific datasets, transfer learning from…

计算机视觉与模式识别 · 计算机科学 2025-09-10 Kamyar Barakati , Utkarsh Pratiush , Sheryl L. Sanchez , Aditya Raghavan , Delia J. Milliron , Mahshid Ahmadi , Philip D. Rack , Sergei V. Kalinin

Object extraction and segmentation from remote sensing (RS) images is a critical yet challenging task in urban environment monitoring. Urban morphology is inherently complex, with irregular objects of diverse shapes and varying scales.…

计算机视觉与模式识别 · 计算机科学 2025-02-24 Chenyu Li , Danfeng Hong , Bing Zhang , Yuxuan Li , Gustau Camps-Valls , Xiao Xiang Zhu , Jocelyn Chanussot

Segment Anything Model (SAM) is an advanced foundational model for image segmentation, which is gradually being applied to remote sensing images (RSIs). Due to the domain gap between RSIs and natural images, traditional methods typically…

计算机视觉与模式识别 · 计算机科学 2025-01-14 Nanqing Liu , Xun Xu , Yongyi Su , Haojie Zhang , Heng-Chao Li

Semantic segmentation has been widely investigated in the community, in which the state of the art techniques are based on supervised models. Those models have reported unprecedented performance at the cost of requiring a large set of high…

计算机视觉与模式识别 · 计算机科学 2022-01-11 Rihuan Ke , Angelica Aviles-Rivero , Saurabh Pandey , Saikumar Reddy , Carola-Bibiane Schönlieb

The Segment Anything Model (SAM), a foundation model for general image segmentation, has demonstrated impressive zero-shot performance across numerous natural image segmentation tasks. However, SAM's performance significantly declines when…

计算机视觉与模式识别 · 计算机科学 2023-09-19 Cheng Chen , Juzheng Miao , Dufan Wu , Zhiling Yan , Sekeun Kim , Jiang Hu , Aoxiao Zhong , Zhengliang Liu , Lichao Sun , Xiang Li , Tianming Liu , Pheng-Ann Heng , Quanzheng Li

The Segment Anything Model (SAM) has garnered significant attention for its versatile segmentation abilities and intuitive prompt-based interface. However, its application in medical imaging presents challenges, requiring either substantial…

计算机视觉与模式识别 · 计算机科学 2024-03-28 Zhiheng Cheng , Qingyue Wei , Hongru Zhu , Yan Wang , Liangqiong Qu , Wei Shao , Yuyin Zhou

The recent Segment Anything Model (SAM) demonstrates strong instance segmentation performance across various downstream tasks. However, SAM is trained solely on RGB data, limiting its direct applicability to RGB-thermal (RGB-T) semantic…

计算机视觉与模式识别 · 计算机科学 2025-05-06 Dong Xing , Xianxun Zhu , Wei Zhou , Qika Lin , Hang Yang , Yuqing Wang

The Segment Anything Model (SAM) represents a state-of-the-art research advancement in natural image segmentation, achieving impressive results with input prompts such as points and bounding boxes. However, our evaluation and recent…

计算机视觉与模式识别 · 计算机科学 2023-08-31 Junlong Cheng , Jin Ye , Zhongying Deng , Jianpin Chen , Tianbin Li , Haoyu Wang , Yanzhou Su , Ziyan Huang , Jilong Chen , Lei Jiang , Hui Sun , Junjun He , Shaoting Zhang , Min Zhu , Yu Qiao

In digital pathology, precise nuclei segmentation is pivotal yet challenged by the diversity of tissue types, staining protocols, and imaging conditions. Recently, the segment anything model (SAM) revealed overwhelming performance in…

图像与视频处理 · 电气工程与系统科学 2024-02-27 Zhen Chen , Qing Xu , Xinyu Liu , Yixuan Yuan

The Segment Anything Model (SAM) marks a significant advancement in segmentation models, offering robust zero-shot abilities and dynamic prompting. However, existing medical SAMs are not suitable for the multi-scale nature of whole-slide…

计算机视觉与模式识别 · 计算机科学 2024-03-19 Hong Liu , Haosen Yang , Paul J. van Diest , Josien P. W. Pluim , Mitko Veta

The Segment Anything Model (SAM) has recently gained popularity in the field of image segmentation due to its impressive capabilities in various segmentation tasks and its prompt-based interface. However, recent studies and individual…

计算机视觉与模式识别 · 计算机科学 2024-01-01 Junde Wu , Wei Ji , Yuanpei Liu , Huazhu Fu , Min Xu , Yanwu Xu , Yueming Jin

In this work, we propose SAM3D, a novel framework that is able to predict masks in 3D point clouds by leveraging the Segment-Anything Model (SAM) in RGB images without further training or finetuning. For a point cloud of a 3D scene with…

计算机视觉与模式识别 · 计算机科学 2023-06-07 Yunhan Yang , Xiaoyang Wu , Tong He , Hengshuang Zhao , Xihui Liu

Segmentation quality assessment (SQA) plays a critical role in the deployment of a medical image based AI system. Users need to be informed/alerted whenever an AI system generates unreliable/incorrect predictions. With the introduction of…

图像与视频处理 · 电气工程与系统科学 2023-12-18 Yizhe Zhang , Shuo Wang , Tao Zhou , Qi Dou , Danny Z. Chen

The Segment Anything Model (SAM) is a powerful foundation model that introduced revolutionary advancements in natural image segmentation. However, its performance remains sub-optimal when delineating the intricate structure of biomedical…

图像与视频处理 · 电气工程与系统科学 2023-10-05 Xiangru Li , Yifei Zhang , Liang Zhao