中文
相关论文

相关论文: Customize Segment Anything Model for Multi-Modal S…

200 篇论文

The current variants of the Segment Anything Model (SAM), which include the original SAM and Medical SAM, still lack the capability to produce sufficiently accurate segmentation for medical images. In medical imaging contexts, it is not…

计算机视觉与模式识别 · 计算机科学 2024-06-04 Tianyu Huang , Tao Zhou , Weidi Xie , Shuo Wang , Qi Dou , Yizhe Zhang

The interactive segmentation task consists in the creation of object segmentation masks based on user interactions. The most common way to guide a model towards producing a correct segmentation consists in clicks on the object and…

计算机视觉与模式识别 · 计算机科学 2024-04-15 Robin Schön , Julian Lorenz , Katja Ludwig , Rainer Lienhart

Optical Flow Estimation aims to find the 2D dense motion field between two frames. Due to the limitation of model structures and training datasets, existing methods often rely too much on local clues and ignore the integrity of objects,…

计算机视觉与模式识别 · 计算机科学 2023-12-22 Shili Zhou , Ruian He , Weimin Tan , Bo Yan

Emerging of visual language models, such as the segment anything model (SAM), have made great breakthroughs in the field of universal semantic segmentation and significantly aid the improvements of medical image segmentation, in particular…

人工智能 · 计算机科学 2024-10-30 Meng Wang , Yarong Feng , Yongwei Tang , Tian Zhang , Yuxin Liang , Chao Lv

The objective of this paper is motion segmentation -- discovering and segmenting the moving objects in a video. This is a much studied area with numerous careful, and sometimes complex, approaches and training schemes including:…

计算机视觉与模式识别 · 计算机科学 2024-11-25 Junyu Xie , Charig Yang , Weidi Xie , Andrew Zisserman

The recently introduced Segment Anything Model (SAM) combines a clever architecture and large quantities of training data to obtain remarkable image segmentation capabilities. However, it fails to reproduce such results for…

计算机视觉与模式识别 · 计算机科学 2023-06-13 Tal Shaharabany , Aviad Dahan , Raja Giryes , Lior Wolf

The Segment Anything Model (SAM) is the first foundation model for general image segmentation. It has achieved impressive results on various natural image segmentation tasks. However, medical image segmentation (MIS) is more challenging…

Curating annotations for medical image segmentation is a labor-intensive and time-consuming task that requires domain expertise, resulting in "narrowly" focused deep learning (DL) models with limited translational utility. Recently,…

计算机视觉与模式识别 · 计算机科学 2024-03-25 Pranav Kulkarni , Adway Kanhere , Dharmam Savani , Andrew Chan , Devina Chatterjee , Paul H. Yi , Vishwa S. Parekh

The success of large language models has inspired the computer vision community to explore image segmentation foundation model that is able to zero/few-shot generalize through prompt engineering. Segment-Anything(SAM), among others, is the…

计算机视觉与模式识别 · 计算机科学 2024-04-11 Haojie Zhang , Yongyi Su , Xun Xu , Kui Jia

Mixture-of-Experts (MoE) has emerged as a powerful framework for multi-task learning (MTL). However, existing MoE-MTL methods often rely on single-task pretrained backbones and suffer from redundant adaptation and inefficient knowledge…

计算机视觉与模式识别 · 计算机科学 2025-10-02 Minghao Yang , Ren Togo , Guang Li , Takahiro Ogawa , Miki Haseyama

In this paper, we introduce Semantic-SAM, a universal image segmentation model to enable segment and recognize anything at any desired granularity. Our model offers two key advantages: semantic-awareness and granularity-abundance. To…

计算机视觉与模式识别 · 计算机科学 2023-07-11 Feng Li , Hao Zhang , Peize Sun , Xueyan Zou , Shilong Liu , Jianwei Yang , Chunyuan Li , Lei Zhang , Jianfeng Gao

The Segment Anything Model (SAM) is a promptable segmentation model recently introduced by Meta AI that has demonstrated its prowess across various fields beyond just image segmentation. SAM can accurately segment images across diverse…

计算机视觉与模式识别 · 计算机科学 2023-04-18 Junzhang Chen , Xiangzhi Bai

Recently, foundation models trained on massive datasets to adapt to a wide range of tasks have attracted considerable attention and are actively being explored within the computer vision community. Among these, the Segment Anything Model…

计算机视觉与模式识别 · 计算机科学 2024-10-14 Hyung-Il Kim , Kimin Yun , Jun-Seok Yun , Yuseok Bae

Semi-supervised learning has attracted much attention due to its less dependence on acquiring abundant annotations from experts compared to fully supervised methods, which is especially important for medical image segmentation which…

计算机视觉与模式识别 · 计算机科学 2024-10-24 Yichi Zhang , Jin Yang , Yuchen Liu , Yuan Cheng , Yuan Qi

Semantic Segmentation combines two sub-tasks: the identification of pixel-level image masks and the application of semantic labels to those masks. Recently, so-called Foundation Models have been introduced; general models trained on very…

计算机视觉与模式识别 · 计算机科学 2023-10-03 David Balaban , Justin Medich , Pranay Gosar , Justin Hart

The Segment Anything Model (SAM) exhibits a capability to segment a wide array of objects in natural images, serving as a versatile perceptual tool for various downstream image segmentation tasks. In contrast, medical image segmentation…

计算机视觉与模式识别 · 计算机科学 2023-08-29 Yizhe Zhang , Tao Zhou , Shuo Wang , Ye Wu , Pengfei Gu , Danny Z. Chen

Collective intelligence from multiple medical experts consistently surpasses individual expertise in clinical diagnosis, particularly for ambiguous medical image segmentation tasks involving unclear tissue boundaries or pathological…

图像与视频处理 · 电气工程与系统科学 2025-11-18 Mingzhou Jiang , Jiaying Zhou , Junde Wu , Tianyang Wang , Yueming Jin , Min Xu

Segment Anything Model (SAM) has emerged as a transformative approach in image segmentation, acclaimed for its robust zero-shot segmentation capabilities and flexible prompting system. Nonetheless, its performance is challenged by images…

计算机视觉与模式识别 · 计算机科学 2024-06-17 Wei-Ting Chen , Yu-Jiet Vong , Sy-Yen Kuo , Sizhuo Ma , Jian Wang

Recent segmentation methods, which adopt large-scale data training and transformer architecture, aim to create one foundation model that can perform multiple tasks. However, most of these methods rely on heavy encoder and decoder…

计算机视觉与模式识别 · 计算机科学 2025-03-03 Shilin Xu , Haobo Yuan , Qingyu Shi , Lu Qi , Jingbo Wang , Yibo Yang , Yining Li , Kai Chen , Yunhai Tong , Bernard Ghanem , Xiangtai Li , Ming-Hsuan Yang

The primary challenge in video super-resolution (VSR) is to handle large motions in the input frames, which makes it difficult to accurately aggregate information from multiple frames. Existing works either adopt deformable convolutions or…

计算机视觉与模式识别 · 计算机科学 2023-05-15 Zhihe Lu , Zeyu Xiao , Jiawang Bai , Zhiwei Xiong , Xinchao Wang