English
Related papers

Related papers: Learning Cross-Modal Affinity for Referring Video …

200 papers

Over the past few years, state-of-the-art image segmentation algorithms are based on deep convolutional neural networks. To render a deep network with the ability to understand a concept, humans need to collect a large amount of pixel-level…

Computer Vision and Pattern Recognition · Computer Science 2020-03-25 Weide Liu , Chi Zhang , Guosheng Lin , Fayao Liu

Video Moment Retrieval (VMR) aims at retrieving the most relevant events from an untrimmed video with natural language queries. Existing VMR methods suffer from two defects: (1) massive expensive temporal annotations are required to obtain…

Computer Vision and Pattern Recognition · Computer Science 2023-05-24 Xun Jiang , Zailei Zhou , Xing Xu , Yang Yang , Guoqing Wang , Heng Tao Shen

Few-shot Video Object Detection (FSVOD) addresses the challenge of detecting novel objects in videos with limited labeled examples, overcoming the constraints of traditional detection methods that require extensive training data. This task…

Computer Vision and Pattern Recognition · Computer Science 2025-11-19 Yogesh Kumar , Anand Mishra

Few-shot semantic segmentation models aim to segment images after learning from only a few annotated examples. A key challenge for them is how to avoid overfitting because limited training data is available. While prior works usually…

Computer Vision and Pattern Recognition · Computer Science 2021-10-14 Yinan Zhao , Brian Price , Scott Cohen , Danna Gurari

While large visual models (LVM) demonstrated significant potential in image understanding, due to the application of large-scale pre-training, the Segment Anything Model (SAM) has also achieved great success in the field of image…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 Jiaqi Yang , Yaning Zhang , Jingxi Hu , Xiangjian He , Linlin Shen , Guoping Qiu

Pre-trained vision language models have shown remarkable performance on visual recognition tasks, but they typically assume the availability of complete multimodal inputs during both training and inference. In real-world scenarios, however,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Shu Zhao , Nilesh Ahuja , Tan Yu , Tianyi Shen , Vijaykrishnan Narayanan

Few-Shot Segmentation(FSS) aims to efficient segmentation of new objects with few labeled samples. However, its performance significantly degrades when domain discrepancies exist between training and deployment. Cross-Domain Few-Shot…

Computer Vision and Pattern Recognition · Computer Science 2025-08-08 Jianming Liu , Wenlong Qiu , Haitao Wei

Video object segmentation (VOS) -- predicting pixel-level regions for objects within each frame of a video -- is particularly challenging in agricultural scenarios, where videos of crops include hundreds of small, dense, and occluded…

Computer Vision and Pattern Recognition · Computer Science 2025-04-17 Keyhan Najafian , Farhad Maleki , Lingling Jin , Ian Stavness

We aim to improve the performance of Multiple Object Tracking and Segmentation (MOTS) by refinement. However, it remains challenging for refining MOTS results, which could be attributed to that appearance features are not adapted to target…

Computer Vision and Pattern Recognition · Computer Science 2021-01-14 Fan Yang , Xin Chang , Chenyu Dang , Ziqiang Zheng , Sakriani Sakti , Satoshi Nakamura , Yang Wu

Referring Image Segmentation (RIS) - the problem of identifying objects in images through natural language sentences - is a challenging task currently mostly solved through supervised learning. However, while collecting referred annotation…

Computer Vision and Pattern Recognition · Computer Science 2024-08-21 Francisco Eiras , Kemal Oksuz , Adel Bibi , Philip H. S. Torr , Puneet K. Dokania

Referring image segmentation (RIS) requires accurate segmentation of target regions in images according to language descriptions, which is a cross-modal task integrating vision and language. Existing RIS methods typically employ large-scale…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Chen Yang

This paper studies the problem of semi-supervised video object segmentation(VOS). Multiple works have shown that memory-based approaches can be effective for video object segmentation. They are mostly based on pixel-level matching, both…

Computer Vision and Pattern Recognition · Computer Science 2021-04-12 Li Hu , Peng Zhang , Bang Zhang , Pan Pan , Yinghui Xu , Rong Jin

Cross-Domain Few-Shot Segmentation aims to segment categories in data-scarce domains conditioned on a few exemplars. Typical methods first establish few-shot capability in a large-scale source domain and then adapt it to target domains.…

Computer Vision and Pattern Recognition · Computer Science 2026-02-06 Jiahao Nie , Guanqiao Fu , Wenbin An , Yap-Peng Tan , Alex C. Kot , Shijian Lu

Few-shot video action recognition is an effective approach to recognizing new categories with only a few labeled examples, thereby reducing the challenges associated with collecting and annotating large-scale video datasets. Existing…

Computer Vision and Pattern Recognition · Computer Science 2023-09-18 Sarinda Samarasinghe , Mamshad Nayeem Rizve , Navid Kardan , Mubarak Shah

Few-shot semantic segmentation (FSS) is a crucial challenge in computer vision, driving extensive research into a diverse range of methods, from advanced meta-learning techniques to simple transfer learning baselines. With the emergence of…

Computer Vision and Pattern Recognition · Computer Science 2025-06-04 Reda Bensaid , Vincent Gripon , François Leduc-Primeau , Lukas Mauch , Ghouthi Boukli Hacene , Fabien Cardinaux

Referring Audio-Visual Segmentation (Ref-AVS) aims to segment specific objects in videos based on natural language expressions involving audio, vision, and text information. This task poses significant challenges in cross-modal reasoning…

Computer Vision and Pattern Recognition · Computer Science 2025-09-24 Dian Jin , Yanghao Zhou , Jinxing Zhou , Jiaqi Ma , Ruohao Guo , Dan Guo

Audio-visual segmentation (AVS) is an emerging task that aims to accurately segment sounding objects based on audio-visual cues. The success of AVS learning systems depends on the effectiveness of cross-modal interaction. Such a requirement…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Yuanhong Chen , Chong Wang , Yuyuan Liu , Hu Wang , Gustavo Carneiro

Cross-modal feature extraction and integration have led to steady performance improvements in few-shot learning tasks due to generating richer features. However, existing multi-modal object detection (MM-OD) methods degrade when facing…

Computer Vision and Pattern Recognition · Computer Science 2025-02-25 Zeyu Shangguan , Daniel Seita , Mohammad Rostami

Few-shot learning aims to recognize novel concepts by leveraging prior knowledge learned from a few samples. However, for visually intensive tasks such as few-shot semantic segmentation, pixel-level annotations are time-consuming and…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Jiaqi Ma , Guo-Sen Xie , Fang Zhao , Zechao Li

Recent state-of-the-art semi-supervised Video Object Segmentation (VOS) methods have shown significant improvements in target object segmentation accuracy when information from preceding frames is used in segmenting the current frame. In…

Computer Vision and Pattern Recognition · Computer Science 2024-02-15 Amir Nazemi , Mohammad Javad Shafiee , Zahra Gharaee , Paul Fieguth