English
Related papers

Related papers: Task-Aware Low-Rank Adaptation of Segment Anything…

200 papers

Few-shot learning allows machines to classify novel classes using only a few labeled samples. Recently, few-shot segmentation aiming at semantic segmentation on low sample data has also seen great interest. In this paper, we propose a…

Computer Vision and Pattern Recognition · Computer Science 2022-02-17 Jun Seo , Young-Hyun Park , Sung Whan Yoon , Jaekyun Moon

While large visual models (LVM) demonstrated significant potential in image understanding, due to the application of large-scale pre-training, the Segment Anything Model (SAM) has also achieved great success in the field of image…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 Jiaqi Yang , Yaning Zhang , Jingxi Hu , Xiangjian He , Linlin Shen , Guoping Qiu

While the Segment Anything Model (SAM) excels in semantic segmentation for general-purpose images, its performance significantly deteriorates when applied to medical images, primarily attributable to insufficient representation of medical…

Computer Vision and Pattern Recognition · Computer Science 2023-11-07 Yiming Zhang , Tianang Leng , Kun Han , Xiaohui Xie

Segment Anything Model (SAM) has emerged as a powerful tool for numerous vision applications. A key component that drives the impressive performance for zero-shot transfer and high versatility is a super large Transformer model trained on…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 Yunyang Xiong , Bala Varadarajan , Lemeng Wu , Xiaoyu Xiang , Fanyi Xiao , Chenchen Zhu , Xiaoliang Dai , Dilin Wang , Fei Sun , Forrest Iandola , Raghuraman Krishnamoorthi , Vikas Chandra

There has been a significant increase in the deployment of neural network models, presenting substantial challenges in model adaptation and fine-tuning. Efficient adaptation is crucial in maintaining model performance across diverse tasks…

Machine Learning · Computer Science 2025-04-02 Maolin Wang , Xiangyu Zhao

In the realm of artificial intelligence, the emergence of foundation models, backed by high computing capabilities and extensive data, has been revolutionary. Segment Anything Model (SAM), built on the Vision Transformer (ViT) model with…

Computer Vision and Pattern Recognition · Computer Science 2024-01-05 Xinyang Pu , Hecheng Jia , Linghao Zheng , Feng Wang , Feng Xu

Segment Anything Model (SAM) has gained significant recognition in the field of semantic segmentation due to its versatile capabilities and impressive performance. Despite its success, SAM faces two primary limitations: (1) it relies…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Yuchen Li , Li Zhang , Youwei Liang , Pengtao Xie

In medical image segmentation, heterogeneous privacy policies across institutions often make joint training on pooled datasets infeasible, motivating continual image segmentation-learning from data streams without catastrophic forgetting.…

Computer Vision and Pattern Recognition · Computer Science 2025-11-24 Jiayi Wang , Wei Dai , Haoyu Wang , Sihan Yang , Haixia Bi , Jian Sun

Medical image segmentation is a key task in the imaging workflow, influencing many image-based decisions. Traditional, fully-supervised segmentation models rely on large amounts of labeled training data, typically obtained through manual…

Image and Video Processing · Electrical Eng. & Systems 2025-11-04 Tyler Ward , Meredith K. Owen , O'Kira Coleman , Brian Noehren , Abdullah-Al-Zubaer Imran

Foundation models, such as OpenAI's GPT-3 and GPT-4, Meta's LLaMA, and Google's PaLM2, have revolutionized the field of artificial intelligence. A notable paradigm shift has been the advent of the Segment Anything Model (SAM), which has…

Computer Vision and Pattern Recognition · Computer Science 2023-08-11 Ruikai Cui , Siyuan He , Shi Qiu

Recently segment anything model (SAM) has shown powerful segmentation capability and has drawn great attention in computer vision fields. Massive following works have developed various applications based on the pre-trained SAM and achieved…

Computer Vision and Pattern Recognition · Computer Science 2025-01-09 Han Shu , Wenshuo Li , Yehui Tang , Yiman Zhang , Yihao Chen , Houqiang Li , Yunhe Wang , Xinghao Chen

The combination of Mixture-of-Experts (MoE) and Low-Rank Adaptation (LoRA) has shown significant potential for enhancing the multi-task learning capabilities of Large Language Models. However, existing methods face two primary challenges:…

Computation and Language · Computer Science 2026-04-22 Boyan Shi , Wei Chen , Shuyuan Zhao , Junfeng Shen , Shengnan Guo , Shaojiang Wang , Huaiyu Wan

The Segment Anything Model (SAM), a foundational model designed for promptable segmentation tasks, demonstrates exceptional generalization capabilities, making it highly promising for natural scene image segmentation. However, SAM's lack of…

Computer Vision and Pattern Recognition · Computer Science 2024-08-19 Linghao Zheng , Xinyang Pu , Feng Xu

Low-Rank Adaptation (LoRA) has become a widely adopted parameter-efficient fine-tuning method for large language models, with its effectiveness largely influenced by the allocation of ranks and scaling factors, as well as initialization.…

Computation and Language · Computer Science 2026-04-21 Weicheng Lin , Yi Zhang , Jiawei Dang , Liang-Jie Zhang

Foundational vision models, such as the Segment Anything Model (SAM), have achieved significant breakthroughs through extensive pre-training on large-scale visual datasets. Despite their general success, these models may fall short in…

Computer Vision and Pattern Recognition · Computer Science 2024-08-13 Ke Zhou , Zhongwei Qiu , Dongmei Fu

Segment Anything (SAM) has recently pushed the boundaries of segmentation by demonstrating zero-shot generalization and flexible prompting after training on over one billion masks. Despite this, its mask prediction accuracy often falls…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Zezhong Fan , Xiaohan Li , Topojoy Biswas , Kaushiki Nag , Kannan Achan

In this paper, we introduce Symmetric Low-Rank Adapters, an optimized variant of LoRA with even fewer weights. This method utilizes Low-Rank Symmetric Weight Matrices to learn downstream tasks more efficiently. Traditional LoRA accumulates…

Machine Learning · Computer Science 2025-04-17 Tales Panoutsos , Rodrygo L. T. Santos , Flavio Figueiredo

Automated feature detection in historical maps can significantly accelerate the reconstruction of the geospatial past. However, this process is often constrained by the time-consuming task of manually digitizing sufficient high-quality…

Computer Vision and Pattern Recognition · Computer Science 2024-11-12 Xue Xia , Daiwei Zhang , Wenxuan Song , Wei Huang , Lorenz Hurni

Fine-tuning large pre-trained vision foundation models in a parameter-efficient manner is critical for downstream vision tasks, considering the practical constraints of computational and storage costs. Low-rank adaptation (LoRA) is a…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Houqiang Zhong , Shaocheng Shen , Ke Cai , Zhenglong Wu , Jiangchao Yao , Yuan Cheng , Xuefei Li , Xiaoyun Zhang , Li Song , Qiang Hu

The application of large-scale models in medical image segmentation demands substantial quantities of meticulously annotated data curated by experts along with high computational resources, both of which are challenges in resource-poor…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Navyansh Mahla , Annie D'souza , Shubh Gupta , Bhavik Kanekar , Kshitij Sharad Jadhav