English
Related papers

Related papers: Segment Any RGB-Thermal Model with Language-aided …

200 papers

Segment Anything Model (SAM) has gained significant recognition in the field of semantic segmentation due to its versatile capabilities and impressive performance. Despite its success, SAM faces two primary limitations: (1) it relies…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Yuchen Li , Li Zhang , Youwei Liang , Pengtao Xie

In the realm of artificial intelligence, the emergence of foundation models, backed by high computing capabilities and extensive data, has been revolutionary. Segment Anything Model (SAM), built on the Vision Transformer (ViT) model with…

Computer Vision and Pattern Recognition · Computer Science 2024-01-05 Xinyang Pu , Hecheng Jia , Linghao Zheng , Feng Wang , Feng Xu

High-fidelity wildfire monitoring using Unmanned Aerial Vehicles (UAVs) typically requires multimodal sensing - especially RGB and thermal imagery - which increases hardware cost and power consumption. This paper introduces SAM-TIFF, a…

Image and Video Processing · Electrical Eng. & Systems 2025-05-06 Michael Marinaccio , Fatemeh Afghah

This paper introduces a new Segment Anything Model (SAM) that leverages reverse parameter configuration and test-time training to enhance its performance on Camouflaged Object Detection (COD), named SAM-TTT. While most existing SAM-based…

Computer Vision and Pattern Recognition · Computer Science 2025-09-16 Zhenni Yu , Li Zhao , Guobao Xiao , Xiaoqin Zhang

The recent Segment Anything Model (SAM) has emerged as a new paradigmatic vision foundation model, showcasing potent zero-shot generalization and flexible prompting. Despite SAM finding applications and adaptations in various domains, its…

Computer Vision and Pattern Recognition · Computer Science 2025-02-14 Xumeng Han , Longhui Wei , Xuehui Yu , Zhiyang Dou , Xin He , Kuiran Wang , Yingfei Sun , Zhenjun Han , Qi Tian

We propose a method to efficiently equip the Segment Anything Model (SAM) with the ability to generate regional captions. SAM presents strong generalizability to segment anything while is short for semantic understanding. By introducing a…

Computer Vision and Pattern Recognition · Computer Science 2024-03-27 Xiaoke Huang , Jianfeng Wang , Yansong Tang , Zheng Zhang , Han Hu , Jiwen Lu , Lijuan Wang , Zicheng Liu

The recently introduced Segment Anything Model (SAM), a Visual Foundation Model (VFM), has demonstrated impressive capabilities in zero-shot segmentation tasks across diverse natural image datasets. Despite its success, SAM encounters…

Computer Vision and Pattern Recognition · Computer Science 2024-08-23 Chunpeng Zhou , Kangjie Ning , Qianqian Shen , Sheng Zhou , Zhi Yu , Haishuai Wang

Parotid gland lesion segmentation is essential for the treatment of parotid gland diseases. However, due to the variable size and complex lesion boundaries, accurate parotid gland lesion segmentation remains challenging. Recently, the…

Computer Vision and Pattern Recognition · Computer Science 2025-08-14 Zhongyuan Wu , Chuan-Xian Ren , Yu Wang , Xiaohua Ban , Jianning Xiao , Xiaohui Duan

In the rapidly evolving field of AI research, foundational models like BERT and GPT have significantly advanced language and vision tasks. The advent of pretrain-prompting models such as ChatGPT and Segmentation Anything Model (SAM) has…

Image and Video Processing · Electrical Eng. & Systems 2024-01-25 Saiyang Na , Yuzhi Guo , Feng Jiang , Hehuan Ma , Junzhou Huang

Powered by massive curated training data, Segment Anything Model (SAM) has demonstrated its impressive generalization capabilities in open-world scenarios with the guidance of prompts. However, the vanilla SAM is class agnostic and heavily…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Duojun Huang , Xinyu Xiong , Jie Ma , Jichang Li , Zequn Jie , Lin Ma , Guanbin Li

Segment Anything Model (SAM) has emerged as a transformative approach in image segmentation, acclaimed for its robust zero-shot segmentation capabilities and flexible prompting system. Nonetheless, its performance is challenged by images…

Computer Vision and Pattern Recognition · Computer Science 2024-06-17 Wei-Ting Chen , Yu-Jiet Vong , Sy-Yen Kuo , Sizhuo Ma , Jian Wang

Multimodal image fusion and semantic segmentation are critical for autonomous driving. Despite advancements, current models often struggle with segmenting densely packed elements due to a lack of comprehensive fusion features for guidance…

Computer Vision and Pattern Recognition · Computer Science 2025-06-25 Daixun Li , Weiying Xie , Mingxiang Cao , Yunke Wang , Yusi Zhang , Leyuan Fang , Yunsong Li , Chang Xu

RGB-Thermal fusion is a potential solution for various weather and light conditions in challenging scenarios. However, plenty of studies focus on designing complex modules to fuse different modalities. With the widespread application of…

Computer Vision and Pattern Recognition · Computer Science 2025-03-07 Fuyang Liu , Shun Lu , Jilin Mei , Yu Hu

Remote sensing solutions for avalanche segmentation and mapping are key to supporting risk forecasting and mitigation in mountain regions. Synthetic Aperture Radar (SAR) imagery from Sentinel-1 can be effectively used for this task, but…

Computer Vision and Pattern Recognition · Computer Science 2026-01-06 Riccardo Gelato , Carlo Sgaravatti , Jakob Grahn , Giacomo Boracchi , Filippo Maria Bianchi

Accurate brain tumor segmentation is essential for preoperative evaluation and personalized treatment. Multi-modal MRI is widely used due to its ability to capture complementary tumor features across different sequences. However, in…

Computer Vision and Pattern Recognition · Computer Science 2025-09-19 Shenghao Zhu , Yifei Chen , Weihong Chen , Shuo Jiang , Guanyu Zhou , Yuanhan Wang , Feiwei Qin , Changmiao Wang , Qiyuan Tian

Segment anything model (SAM) addresses two practical yet challenging segmentation tasks: \textbf{segment anything (SegAny)}, which utilizes a certain point to predict the mask for a single object of interest, and \textbf{segment everything…

Computer Vision and Pattern Recognition · Computer Science 2023-12-18 Chaoning Zhang , Dongshen Han , Sheng Zheng , Jinwoo Choi , Tae-Ho Kim , Choong Seon Hong

Learning policies that can generalize to unseen environments is a fundamental challenge in visual reinforcement learning (RL). While most current methods focus on acquiring robust visual representations through auxiliary supervision,…

Machine Learning · Computer Science 2023-12-29 Ziyu Wang , Yanjie Ze , Yifei Sun , Zhecheng Yuan , Huazhe Xu

This paper presents GoodSAM++, a novel framework utilizing the powerful zero-shot instance segmentation capability of SAM (i.e., teacher) to learn a compact panoramic semantic segmentation model, i.e., student, without requiring any labeled…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Weiming Zhang , Yexin Liu , Xu Zheng , Lin Wang

Accurate image segmentation is crucial in reservoir modelling and material characterization, enhancing oil and gas extraction efficiency through detailed reservoir models. This precision offers insights into rock properties, advancing…

Computer Vision and Pattern Recognition · Computer Science 2023-11-21 Zhaoyang Ma , Xupeng He , Shuyu Sun , Bicheng Yan , Hyung Kwak , Jun Gao

The Segment Anything Model (SAM) is a cornerstone of image segmentation, demonstrating exceptional performance across various applications, particularly in autonomous driving and medical imaging, where precise segmentation is crucial.…

Computer Vision and Pattern Recognition · Computer Science 2025-01-03 Xiaoliang Liu , Furao Shen , Jian Zhao