English
Related papers

Related papers: Generalized SAM: Efficient Fine-Tuning of SAM for …

200 papers

Segment Anything Model (SAM) demonstrates powerful zero-shot capabilities; however, its accuracy and robustness significantly decrease when applied to medical image segmentation. Existing methods address this issue through modality fusion,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-27 Yiheng Zhong , Zihong Luo , Chengzhi Liu , Feilong Tang , Zelin Peng , Ming Hu , Yingzhen Hu , Jionglong Su , Zongyuan Ge , Imran Razzak

The Segment Anything Model (SAM) has set a new standard in interactive image segmentation, offering robust performance across various tasks. However, its significant computational requirements limit its deployment in real-time or…

Image and Video Processing · Electrical Eng. & Systems 2025-01-29 Kunal Dasharath Patil , Gowthamaan Palani , Ganapathy Krishnamurthi

Due to the flexibility of prompting, foundation models have become the dominant force in the domains of natural language processing and image generation. With the recent introduction of the Segment Anything Model (SAM), the prompt-driven…

Image and Video Processing · Electrical Eng. & Systems 2023-08-14 Yichi Zhang , Rushi Jiao

Image-based crack detection algorithms are increasingly in demand in infrastructure monitoring, as early detection of cracks is of paramount importance for timely maintenance planning. While deep learning has significantly advanced crack…

Computer Vision and Pattern Recognition · Computer Science 2025-04-22 Ghodsiyeh Rostami , Po-Han Chen , Mahdi S. Hosseini

Image segmentation is a crucial task in computer vision, with wide-ranging applications in industry. The Segment Anything Model (SAM) has recently attracted intensive attention; however, its application in industrial inspection,…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Zheming Zuo , Joseph Smith , Jonathan Stonehouse , Boguslaw Obara

Recently segment anything model (SAM) has shown powerful segmentation capability and has drawn great attention in computer vision fields. Massive following works have developed various applications based on the pre-trained SAM and achieved…

Computer Vision and Pattern Recognition · Computer Science 2025-01-09 Han Shu , Wenshuo Li , Yehui Tang , Yiman Zhang , Yihao Chen , Houqiang Li , Yunhe Wang , Xinghao Chen

Recently, Segment Anything Model (SAM) has become a research hotspot in the fields of multimedia and computer vision, which exhibits powerful yet versatile capabilities on various (un) conditional image segmentation tasks. Although SAM can…

Computer Vision and Pattern Recognition · Computer Science 2024-08-30 Xiaorui Huang , Gen Luo , Chaoyang Zhu , Bo Tong , Yiyi Zhou , Xiaoshuai Sun , Rongrong Ji

The reliance on large labeled datasets presents a significant challenge in medical image segmentation. Few-shot learning offers a potential solution, but existing methods often still require substantial training data. This paper proposes a…

Image and Video Processing · Electrical Eng. & Systems 2025-03-10 Haiyue Zu , Jun Ge , Heting Xiao , Jile Xie , Zhangzhe Zhou , Yifan Meng , Jiayi Ni , Junjie Niu , Linlin Zhang , Li Ni , Huilin Yang

With the development of Deep Neural Networks (DNNs), many efforts have been made to handle medical image segmentation. Traditional methods such as nnUNet train specific segmentation models on the individual datasets. Plenty of recent…

Computer Vision and Pattern Recognition · Computer Science 2024-07-12 Xiaobao Wei , Jiajun Cao , Yizhu Jin , Ming Lu , Guangyu Wang , Shanghang Zhang

Advances in machine learning, especially the introduction of transformer architectures and vision transformers, have led to the development of highly capable computer vision foundation models. The segment anything model (known colloquially…

Computer Vision and Pattern Recognition · Computer Science 2025-05-29 Kenneth Ball , Erin Taylor , Nirav Patel , Andrew Bartels , Gary Koplik , James Polly , Jay Hineman

We present ENSAM (Equivariant, Normalized, Segment Anything Model), a lightweight and promptable model for universal 3D medical image segmentation. ENSAM combines a SegResNet-based encoder with a prompt encoder and mask decoder in a…

Computer Vision and Pattern Recognition · Computer Science 2025-09-22 Elias Stenhede , Agnar Martin Bjørnstad , Arian Ranjbar

In today's heavily overparameterized models, the value of the training loss provides few guarantees on model generalization ability. Indeed, optimizing only the training loss value, as is commonly done, can easily lead to suboptimal model…

Machine Learning · Computer Science 2021-04-30 Pierre Foret , Ariel Kleiner , Hossein Mobahi , Behnam Neyshabur

Radiological images such as computed tomography (CT) and X-rays render anatomy with intrinsic structures. Being able to reliably locate the same anatomical structure across varying images is a fundamental task in medical image analysis. In…

Computer Vision and Pattern Recognition · Computer Science 2023-10-24 Ke Yan , Jinzheng Cai , Dakai Jin , Shun Miao , Dazhou Guo , Adam P. Harrison , Youbao Tang , Jing Xiao , Jingjing Lu , Le Lu

Sharpness-aware Minimization (SAM) has been proposed recently to improve model generalization ability. However, SAM calculates the gradient twice in each optimization step, thereby doubling the computation costs compared to stochastic…

Computer Vision and Pattern Recognition · Computer Science 2024-03-15 Jiaxin Deng , Junbiao Pang , Baochang Zhang , Tian Wang

We propose a method to efficiently equip the Segment Anything Model (SAM) with the ability to generate regional captions. SAM presents strong generalizability to segment anything while is short for semantic understanding. By introducing a…

Computer Vision and Pattern Recognition · Computer Science 2024-03-27 Xiaoke Huang , Jianfeng Wang , Yansong Tang , Zheng Zhang , Han Hu , Jiwen Lu , Lijuan Wang , Zicheng Liu

Image segmentation is a crucial vision task that groups pixels within an image into semantically meaningful segments, which is pivotal in obtaining a fine-grained understanding of real-world scenes. However, an increasing privacy concern…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Ye Sun , Hao Zhang , Tiehua Zhang , Xingjun Ma , Yu-Gang Jiang

We have witnessed remarkable progress in foundation models in vision tasks. Currently, several recent works have utilized the segmenting anything model (SAM) to boost the segmentation performance in medical images, where most of them focus…

Computer Vision and Pattern Recognition · Computer Science 2025-03-07 Haoran Wang , Lian Huai , Wenbin Li , Lei Qi , Xingqun Jiang , Yinghuan Shi

Sharpness-Aware Minimization (SAM) has emerged as a promising approach for effectively reducing the generalization error. However, SAM incurs twice the computational cost compared to base optimizer (e.g., SGD). We propose Asymptotic…

Computer Vision and Pattern Recognition · Computer Science 2025-03-31 Jiaxin Deng , Junbiao Pang , Baochang Zhang

Fundamental models, trained on large-scale datasets and adapted to new data using innovative learning methods, have revolutionized various fields. In materials science, microstructure image segmentation plays a pivotal role in understanding…

Materials Science · Physics 2024-07-09 Xudong Ma , Yuqi Zhang , Chenchong Wang , Wei Xu

Although the current different types of SAM adaptation methods have achieved promising performance for various downstream tasks, such as prompt-based ones and adapter-based ones, most of them belong to the one-step adaptation paradigm. In…

Computer Vision and Pattern Recognition · Computer Science 2024-12-18 Jinglong Yang , Yichen Wu , Jun Cen , Wenjian Huang , Hong Wang , Jianguo Zhang