English
Related papers

Related papers: Modality-Agnostic Prompt Learning for Multi-Modal …

200 papers

Although current prompt learning methods have successfully been designed to effectively reuse the large pre-trained models without fine-tuning their large number of parameters, they still have limitations to be addressed, i.e., without…

Machine Learning · Computer Science 2023-12-05 Zongqian Wu , Yujing Liu , Mengmeng Zhan , Jialie Shen , Ping Hu , Xiaofeng Zhu

Salient object detection (SOD) on RGB and depth images has attracted more and more research interests, due to its effectiveness and the fact that depth cues can now be conveniently captured. Existing RGB-D SOD models usually adopt different…

Computer Vision and Pattern Recognition · Computer Science 2022-01-11 Tao Zhou , Deng-Ping Fan , Geng Chen , Yi Zhou , Huazhu Fu

Current multi-modal object re-identification approaches based on large-scale pre-trained backbones (i.e., ViT) have displayed remarkable progress and achieved excellent performance. However, these methods usually adopt the standard full…

Computer Vision and Pattern Recognition · Computer Science 2025-04-16 Minghui Lin , Shu Wang , Xiang Wang , Jianhua Tang , Longbin Fu , Zhengrong Zuo , Nong Sang

Foundational vision models, such as the Segment Anything Model (SAM), have achieved significant breakthroughs through extensive pre-training on large-scale visual datasets. Despite their general success, these models may fall short in…

Computer Vision and Pattern Recognition · Computer Science 2024-08-13 Ke Zhou , Zhongwei Qiu , Dongmei Fu

Single-source Domain Generalized Object Detection (SDGOD), as a cutting-edge research topic in computer vision, aims to enhance model generalization capability in unseen target domains through single-source domain training. Current…

Computer Vision and Pattern Recognition · Computer Science 2025-10-23 Chen Li , Huiying Xu , Changxin Gao , Zeyu Wang , Yun Liu , Xinzhong Zhu

Understanding human instructions and accomplishing Vision-Language Navigation tasks in unknown environments is essential for robots. However, existing modular approaches heavily rely on the quality of training data and often exhibit poor…

Robotics · Computer Science 2025-09-30 Yao Wang , Zhirui Sun , Wenzheng Chi , Baozhi Jia , Wenjun Xu , Jiankun Wang

The burgeoning field of camouflaged object detection (COD) seeks to identify objects that blend into their surroundings. Despite the impressive performance of recent models, we have identified a limitation in their robustness, where…

Computer Vision and Pattern Recognition · Computer Science 2023-04-13 Xue-Jing Luo , Shuo Wang , Zongwei Wu , Christos Sakaridis , Yun Cheng , Deng-Ping Fan , Luc Van Gool

The recent Segment Anything Model (SAM) represents a significant breakthrough in scaling segmentation models, delivering strong performance across various downstream applications in the RGB modality. However, directly applying SAM to…

Computer Vision and Pattern Recognition · Computer Science 2024-12-06 Chenyang Zhu , Bin Xiao , Lin Shi , Shoukun Xu , Xu Zheng

Recent object detection systems rely on two critical steps: (1) a set of object proposals is predicted as efficiently as possible, and (2) this set of candidate proposals is then passed to an object classifier. Such approaches have been…

Computer Vision and Pattern Recognition · Computer Science 2015-09-02 Pedro O. Pinheiro , Ronan Collobert , Piotr Dollar

The recently proposed camouflaged object detection (COD) attempts to segment objects that are visually blended into their surroundings, which is extremely complex and difficult in real-world scenarios. Apart from high intrinsic similarity…

Computer Vision and Pattern Recognition · Computer Science 2023-11-01 Youwei Pang , Xiaoqi Zhao , Tian-Zhu Xiang , Lihe Zhang , Huchuan Lu

Recent advancements in large foundation models have shown promising potential in the medical industry due to their flexible prompting capability. One such model, the Segment Anything Model (SAM), a prompt-driven segmentation model, has…

Computer Vision and Pattern Recognition · Computer Science 2023-08-16 Qi Wu , Yuyao Zhang , Marawan Elbatel

Video camouflaged object segmentation (VCOS), aiming at segmenting camouflaged objects that seamlessly blend into their environment, is a fundamental vision task with various real-world applications. With the release of SAM2, video…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Yuli Zhou , Yawei Li , Yuqian Fu , Luca Benini , Ender Konukoglu , Guolei Sun

Cryo-electron microscopy (cryo-EM) remains pivotal in structural biology, yet the task of protein particle picking, integral for 3D protein structure construction, is laden with manual inefficiencies. While recent AI tools such as Topaz and…

Computer Vision and Pattern Recognition · Computer Science 2023-11-29 Fei He , Zhiyuan Yang , Mingyue Gao , Biplab Poudel , Newgin Sam Ebin Sam Dhas , Rajan Gyawali , Ashwin Dhakal , Jianlin Cheng , Dong Xu

Anomaly detection is vital in various industrial scenarios, including the identification of unusual patterns in production lines and the detection of manufacturing defects for quality control. Existing techniques tend to be specialized in…

Computer Vision and Pattern Recognition · Computer Science 2025-05-21 Xiaohao Xu , Yunkang Cao , Huaxin Zhang , Nong Sang , Xiaonan Huang

Multi-modal visual understanding of images with prompts involves using various visual and textual cues to enhance the semantic understanding of images. This approach combines both vision and language processing to generate more accurate…

Computer Vision and Pattern Recognition · Computer Science 2023-05-17 Yuzhou Peng

Change detection (CD) is a fundamental task in Earth observation. While most change detection methods detect all changes, there is a growing need for specialized methods targeting specific changes relevant to particular applications while…

Image and Video Processing · Electrical Eng. & Systems 2024-08-14 Tahir Ahmad , Sudipan Saha

Existing camouflage object detection (COD) methods typically rely on fully-supervised learning guided by mask annotations. However, obtaining mask annotations is time-consuming and labor-intensive. Compared to fully-supervised methods,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Jingchen Ni , Quan Zhang , Dan Jiang , Keyu Lv , Ke Zhang , Chun Yuan

The Segment Anything Model (SAM) has exhibited outstanding performance in various image segmentation tasks. Despite being trained with over a billion masks, SAM faces challenges in mask prediction quality in numerous scenarios, especially…

Computer Vision and Pattern Recognition · Computer Science 2024-01-25 Zhaozhi Xie , Bochen Guan , Weihao Jiang , Muyang Yi , Yue Ding , Hongtao Lu , Lei Zhang

The goal of this work is to present a systematic solution for RGB-D salient object detection, which addresses the following three aspects with a unified framework: modal-specific representation learning, complementary cue selection and…

Computer Vision and Pattern Recognition · Computer Science 2019-09-23 Hao Chen , Youfu Li

Foundation models such as the recently introduced Segment Anything Model (SAM) have achieved remarkable results in image segmentation tasks. However, these models typically require user interaction through handcrafted prompts such as…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Mélanie Gaillochet , Christian Desrosiers , Hervé Lombaert