中文
相关论文

相关论文: Adapting Segment Anything Model to Multi-modal Sal…

200 篇论文

Research has focused on Multi-Modal Semantic Segmentation (MMSS), where pixel-wise predictions are derived from multiple visual modalities captured by diverse sensors. Recently, the large vision model, Segment Anything Model 2 (SAM2), has…

计算机视觉与模式识别 · 计算机科学 2025-03-24 Chenfei Liao , Xu Zheng , Yuanhuiyi Lyu , Haiwei Xue , Yihong Cao , Jiawen Wang , Kailun Yang , Xuming Hu

Most existing lightweight RGB-D salient object detection (SOD) models are based on two-stream structure or single-stream structure. The former one first uses two sub-networks to extract unimodal features from RGB and depth images,…

计算机视觉与模式识别 · 计算机科学 2022-11-23 Nianchang Huang , Qiang Zhang , Jungong Han

LiDAR and camera fusion techniques are promising for achieving 3D object detection in autonomous driving. Most multi-modal 3D object detection frameworks integrate semantic knowledge from 2D images into 3D LiDAR point clouds to enhance…

计算机视觉与模式识别 · 计算机科学 2023-06-21 Shaoqing Xu , Fang Li , Ziying Song , Jin Fang , Sifen Wang , Zhi-Xin Yang

Salient Object Detection (SOD) is a popular and important topic aimed at precise detection and segmentation of the interesting regions in the images. We integrate the linguistic information into the vision-based U-Structure networks…

计算机视觉与模式识别 · 计算机科学 2022-08-10 Yunqing Bao , Hang Dai , Abdulmotaleb Elsaddik

We present an effective method to progressively integrate and refine the cross-modality complementarities for RGB-D salient object detection (SOD). The proposed network mainly solves two challenging issues: 1) how to effectively integrate…

计算机视觉与模式识别 · 计算机科学 2020-07-15 Chongyi Li , Runmin Cong , Yongri Piao , Qianqian Xu , Chen Change Loy

Co-salient object detection (Co-SOD) aims to identify common salient objects across a group of related images. While recent methods have made notable progress, they typically rely on low-level visual patterns and lack semantic priors,…

计算机视觉与模式识别 · 计算机科学 2025-06-18 Jiayi Zhu , Qing Guo , Felix Juefei-Xu , Yihao Huang , Yang Liu , Geguang Pu

Most Camouflaged Object Detection (COD) methods heavily rely on mask annotations, which are time-consuming and labor-intensive to acquire. Existing weakly-supervised COD approaches exhibit significantly inferior performance compared to…

计算机视觉与模式识别 · 计算机科学 2024-08-21 Huafeng Chen , Pengxu Wei , Guangqian Guo , Shan Gao

Image-based salient object detection (SOD) has been extensively explored in the past decades. However, SOD on 360$^\circ$ omnidirectional images is less studied owing to the lack of datasets with pixel-level annotations. Toward this end,…

计算机视觉与模式识别 · 计算机科学 2019-09-12 Jia Li , Jinming Su , Changqun Xia , Yonghong Tian

This paper presents a new deep neural network design for salient object detection by maximizing the integration of local and global image context within, around, and beyond the salient objects. Our key idea is to adaptively propagate and…

计算机视觉与模式识别 · 计算机科学 2020-05-21 Xiaowei Hu , Chi-Wing Fu , Lei Zhu , Tianyu Wang , Pheng-Ann Heng

Learning to reliably perceive and understand the scene is an integral enabler for robots to operate in the real-world. This problem is inherently challenging due to the multitude of object types as well as appearance changes caused by…

计算机视觉与模式识别 · 计算机科学 2021-11-05 Abhinav Valada , Rohit Mohan , Wolfram Burgard

The Segment Anything Model (SAM) excels at generating precise object masks from input prompts but lacks semantic awareness, failing to associate its generated masks with specific object categories. To address this limitation, we propose…

计算机视觉与模式识别 · 计算机科学 2025-09-04 Rohit Kundu , Sudipta Paul , Arindam Dutta , Amit K. Roy-Chowdhury

Recent advancements in biomedical image analysis have been significantly driven by the Segment Anything Model (SAM). This transformative technology, originally developed for general-purpose computer vision, has found rapid application in…

计算机视觉与模式识别 · 计算机科学 2024-01-17 Ho Hin Lee , Yu Gu , Theodore Zhao , Yanbo Xu , Jianwei Yang , Naoto Usuyama , Cliff Wong , Mu Wei , Bennett A. Landman , Yuankai Huo , Alberto Santamaria-Pang , Hoifung Poon

The emergence of large foundation models has propelled significant advances in various domains. The Segment Anything Model (SAM), a leading model for image segmentation, exemplifies these advances, outperforming traditional methods.…

计算机视觉与模式识别 · 计算机科学 2025-07-29 Saurabh Yadav , Avi Gupta , Koteswar Rao Jerripothula

This paper presents the Autonomous Driving Segment Anything Model (AD-SAM), a fine-tuned vision foundation model for semantic segmentation in autonomous driving (AD). AD-SAM extends the Segment Anything Model (SAM) with a dual-encoder and…

计算机视觉与模式识别 · 计算机科学 2025-11-03 Mario Camarena , Het Patel , Fatemeh Nazari , Evangelos Papalexakis , Mohamadhossein Noruzoliaee , Jia Chen

Multi-modality image fusion, particularly infrared and visible, plays a crucial role in integrating diverse modalities to enhance scene understanding. Although early research prioritized visual quality, preserving fine details and adapting…

计算机视觉与模式识别 · 计算机科学 2025-03-26 Guanyao Wu , Haoyu Liu , Hongming Fu , Yichuan Peng , Jinyuan Liu , Xin Fan , Risheng Liu

Fully convolutional networks have shown outstanding performance in the salient object detection (SOD) field. The state-of-the-art (SOTA) methods have a tendency to become deeper and more complex, which easily homogenize their learned deep…

计算机视觉与模式识别 · 计算机科学 2020-08-11 Zhenyu Wu , Shuai Li , Chenglizhao Chen , Aimin Hao , Hong Qin

SAM is a segmentation model recently released by Meta AI Research and has been gaining attention quickly due to its impressive performance in generic object segmentation. However, its ability to generalize to specific scenes such as…

计算机视觉与模式识别 · 计算机科学 2023-04-12 Lv Tang , Haoke Xiao , Bo Li

Local feature detection and description play an important role in many computer vision tasks, which are designed to detect and describe keypoints in "any scene" and "any downstream task". Data-driven local feature learning methods need to…

计算机视觉与模式识别 · 计算机科学 2025-10-16 Jingqian Wu , Rongtao Xu , Zach Wood-Doughty , Changwei Wang , Shibiao Xu , Edmund Y. Lam

Few-shot segmentation has garnered significant attention. Many recent approaches attempt to introduce the Segment Anything Model (SAM) to handle this task. With the strong generalization ability and rich object-specific extraction ability…

计算机视觉与模式识别 · 计算机科学 2025-11-20 Jin Wang , Bingfeng Zhang , Jian Pang , Weifeng Liu , Baodi Liu , Honglong Chen

The Segment Anything Model (SAM) emerges as a powerful vision foundation model to generate high-quality 2D segmentation results. This paper aims to generalize SAM to segment 3D objects. Rather than replicating the data acquisition and…

计算机视觉与模式识别 · 计算机科学 2024-04-17 Jiazhong Cen , Jiemin Fang , Zanwei Zhou , Chen Yang , Lingxi Xie , Xiaopeng Zhang , Wei Shen , Qi Tian