English
Related papers

Related papers: Customize Segment Anything Model for Multi-Modal S…

200 papers

The current variants of the Segment Anything Model (SAM), which include the original SAM and Medical SAM, still lack the capability to produce sufficiently accurate segmentation for medical images. In medical imaging contexts, it is not…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Tianyu Huang , Tao Zhou , Weidi Xie , Shuo Wang , Qi Dou , Yizhe Zhang

The interactive segmentation task consists in the creation of object segmentation masks based on user interactions. The most common way to guide a model towards producing a correct segmentation consists in clicks on the object and…

Computer Vision and Pattern Recognition · Computer Science 2024-04-15 Robin Schön , Julian Lorenz , Katja Ludwig , Rainer Lienhart

Optical Flow Estimation aims to find the 2D dense motion field between two frames. Due to the limitation of model structures and training datasets, existing methods often rely too much on local clues and ignore the integrity of objects,…

Computer Vision and Pattern Recognition · Computer Science 2023-12-22 Shili Zhou , Ruian He , Weimin Tan , Bo Yan

Emerging of visual language models, such as the segment anything model (SAM), have made great breakthroughs in the field of universal semantic segmentation and significantly aid the improvements of medical image segmentation, in particular…

Artificial Intelligence · Computer Science 2024-10-30 Meng Wang , Yarong Feng , Yongwei Tang , Tian Zhang , Yuxin Liang , Chao Lv

The objective of this paper is motion segmentation -- discovering and segmenting the moving objects in a video. This is a much studied area with numerous careful, and sometimes complex, approaches and training schemes including:…

Computer Vision and Pattern Recognition · Computer Science 2024-11-25 Junyu Xie , Charig Yang , Weidi Xie , Andrew Zisserman

The recently introduced Segment Anything Model (SAM) combines a clever architecture and large quantities of training data to obtain remarkable image segmentation capabilities. However, it fails to reproduce such results for…

Computer Vision and Pattern Recognition · Computer Science 2023-06-13 Tal Shaharabany , Aviad Dahan , Raja Giryes , Lior Wolf

The Segment Anything Model (SAM) is the first foundation model for general image segmentation. It has achieved impressive results on various natural image segmentation tasks. However, medical image segmentation (MIS) is more challenging…

Image and Video Processing · Electrical Eng. & Systems 2024-01-18 Yuhao Huang , Xin Yang , Lian Liu , Han Zhou , Ao Chang , Xinrui Zhou , Rusi Chen , Junxuan Yu , Jiongquan Chen , Chaoyu Chen , Sijing Liu , Haozhe Chi , Xindi Hu , Kejuan Yue , Lei Li , Vicente Grau , Deng-Ping Fan , Fajin Dong , Dong Ni

Curating annotations for medical image segmentation is a labor-intensive and time-consuming task that requires domain expertise, resulting in "narrowly" focused deep learning (DL) models with limited translational utility. Recently,…

Computer Vision and Pattern Recognition · Computer Science 2024-03-25 Pranav Kulkarni , Adway Kanhere , Dharmam Savani , Andrew Chan , Devina Chatterjee , Paul H. Yi , Vishwa S. Parekh

The success of large language models has inspired the computer vision community to explore image segmentation foundation model that is able to zero/few-shot generalize through prompt engineering. Segment-Anything(SAM), among others, is the…

Computer Vision and Pattern Recognition · Computer Science 2024-04-11 Haojie Zhang , Yongyi Su , Xun Xu , Kui Jia

Mixture-of-Experts (MoE) has emerged as a powerful framework for multi-task learning (MTL). However, existing MoE-MTL methods often rely on single-task pretrained backbones and suffer from redundant adaptation and inefficient knowledge…

Computer Vision and Pattern Recognition · Computer Science 2025-10-02 Minghao Yang , Ren Togo , Guang Li , Takahiro Ogawa , Miki Haseyama

In this paper, we introduce Semantic-SAM, a universal image segmentation model to enable segment and recognize anything at any desired granularity. Our model offers two key advantages: semantic-awareness and granularity-abundance. To…

Computer Vision and Pattern Recognition · Computer Science 2023-07-11 Feng Li , Hao Zhang , Peize Sun , Xueyan Zou , Shilong Liu , Jianwei Yang , Chunyuan Li , Lei Zhang , Jianfeng Gao

The Segment Anything Model (SAM) is a promptable segmentation model recently introduced by Meta AI that has demonstrated its prowess across various fields beyond just image segmentation. SAM can accurately segment images across diverse…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Junzhang Chen , Xiangzhi Bai

Recently, foundation models trained on massive datasets to adapt to a wide range of tasks have attracted considerable attention and are actively being explored within the computer vision community. Among these, the Segment Anything Model…

Computer Vision and Pattern Recognition · Computer Science 2024-10-14 Hyung-Il Kim , Kimin Yun , Jun-Seok Yun , Yuseok Bae

Semi-supervised learning has attracted much attention due to its less dependence on acquiring abundant annotations from experts compared to fully supervised methods, which is especially important for medical image segmentation which…

Computer Vision and Pattern Recognition · Computer Science 2024-10-24 Yichi Zhang , Jin Yang , Yuchen Liu , Yuan Cheng , Yuan Qi

Semantic Segmentation combines two sub-tasks: the identification of pixel-level image masks and the application of semantic labels to those masks. Recently, so-called Foundation Models have been introduced; general models trained on very…

Computer Vision and Pattern Recognition · Computer Science 2023-10-03 David Balaban , Justin Medich , Pranay Gosar , Justin Hart

The Segment Anything Model (SAM) exhibits a capability to segment a wide array of objects in natural images, serving as a versatile perceptual tool for various downstream image segmentation tasks. In contrast, medical image segmentation…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Yizhe Zhang , Tao Zhou , Shuo Wang , Ye Wu , Pengfei Gu , Danny Z. Chen

Collective intelligence from multiple medical experts consistently surpasses individual expertise in clinical diagnosis, particularly for ambiguous medical image segmentation tasks involving unclear tissue boundaries or pathological…

Image and Video Processing · Electrical Eng. & Systems 2025-11-18 Mingzhou Jiang , Jiaying Zhou , Junde Wu , Tianyang Wang , Yueming Jin , Min Xu

Segment Anything Model (SAM) has emerged as a transformative approach in image segmentation, acclaimed for its robust zero-shot segmentation capabilities and flexible prompting system. Nonetheless, its performance is challenged by images…

Computer Vision and Pattern Recognition · Computer Science 2024-06-17 Wei-Ting Chen , Yu-Jiet Vong , Sy-Yen Kuo , Sizhuo Ma , Jian Wang

Recent segmentation methods, which adopt large-scale data training and transformer architecture, aim to create one foundation model that can perform multiple tasks. However, most of these methods rely on heavy encoder and decoder…

Computer Vision and Pattern Recognition · Computer Science 2025-03-03 Shilin Xu , Haobo Yuan , Qingyu Shi , Lu Qi , Jingbo Wang , Yibo Yang , Yining Li , Kai Chen , Yunhai Tong , Bernard Ghanem , Xiangtai Li , Ming-Hsuan Yang

The primary challenge in video super-resolution (VSR) is to handle large motions in the input frames, which makes it difficult to accurately aggregate information from multiple frames. Existing works either adopt deformable convolutions or…

Computer Vision and Pattern Recognition · Computer Science 2023-05-15 Zhihe Lu , Zeyu Xiao , Jiawang Bai , Zhiwei Xiong , Xinchao Wang
‹ Prev 1 3 4 5 6 7 10 Next ›