English
Related papers

Related papers: Improving Audio-Visual Video Parsing with Pseudo V…

200 papers

Visual Grounding (VG) is a crucial topic in the field of vision and language, which involves locating a specific region described by expressions within an image. To reduce the reliance on manually labeled data, unsupervised visual grounding…

Computer Vision and Pattern Recognition · Computer Science 2024-11-20 Linhui Xiao , Xiaoshan Yang , Fang Peng , Ming Yan , Yaowei Wang , Changsheng Xu

Surgical scene segmentation is fundamentally crucial for prompting cognitive assistance in robotic surgery. However, pixel-wise annotating surgical video in a frame-by-frame manner is expensive and time consuming. To greatly reduce the…

Computer Vision and Pattern Recognition · Computer Science 2022-07-21 Yang Yu , Zixu Zhao , Yueming Jin , Guangyong Chen , Qi Dou , Pheng-Ann Heng

Pseudo-label learning methods have been widely applied in weakly-supervised temporal action localization. Existing works directly utilize weakly-supervised base model to generate instance-level pseudo-labels for training the…

Computer Vision and Pattern Recognition · Computer Science 2025-05-01 Quan Zhang , Yuxin Qi , Xi Tang , Rui Yuan , Xi Lin , Ke Zhang , Chun Yuan

Fine-tuning vision-language models (VLMs) with abundant unlabeled data recently has attracted increasing attention. Existing methods that resort to the pseudolabeling strategy would suffer from heavily incorrect hard pseudolabels when VLMs…

Machine Learning · Computer Science 2024-06-18 Jiahan Zhang , Qi Wei , Feng Liu , Lei Feng

With a focus on abnormal events contained within untrimmed videos, there is increasing interest among researchers in video anomaly detection. Among different video anomaly detection scenarios, weakly-supervised video anomaly detection poses…

Computer Vision and Pattern Recognition · Computer Science 2023-09-29 Yidan Fan , Yongxin Yu , Wenhuan Lu , Yahong Han

Recent advances in semi-supervised learning (SSL) demonstrate that a combination of consistency regularization and pseudo-labeling can effectively improve image classification accuracy in the low-data regime. Compared to classification,…

Computer Vision and Pattern Recognition · Computer Science 2021-03-31 Yuliang Zou , Zizhao Zhang , Han Zhang , Chun-Liang Li , Xiao Bian , Jia-Bin Huang , Tomas Pfister

Annotating time boundaries of sound events is labor-intensive, limiting the scalability of strongly supervised learning in audio detection. To reduce annotation costs, weakly-supervised learning with only clip-level labels has been widely…

Sound · Computer Science 2025-10-30 Keisuke Imoto

Semi-supervised object detection methods are widely used in autonomous driving systems, where only a fraction of objects are labeled. To propagate information from the labeled objects to the unlabeled ones, pseudo-labels for unlabeled…

Computer Vision and Pattern Recognition · Computer Science 2022-04-19 Shu Hu , Chun-Hao Liu , Jayanta Dutta , Ming-Ching Chang , Siwei Lyu , Naveen Ramakrishnan

The weakly-supervised audio-visual video parsing (AVVP) aims to predict all modality-specific events and locate their temporal boundaries. Despite significant progress, due to the limitations of the weakly-supervised and the deficiencies of…

Computer Vision and Pattern Recognition · Computer Science 2025-08-13 Langyu Wang , Bingke Zhu , Yingying Chen , Yiyuan Zhang , Ming Tang , Jinqiao Wang

Weakly-supervised temporal action localization aims to locate action regions and identify action categories in untrimmed videos simultaneously by taking only video-level labels as the supervision. Pseudo label generation is a promising…

Computer Vision and Pattern Recognition · Computer Science 2023-12-27 Wulian Yun , Mengshi Qi , Chuanming Wang , Huadong Ma

Multimodal fusion breaks through the boundaries between diverse modalities and has already achieved notable performances. However, in many specialized fields, it is struggling to obtain sufficient alignment data for training, which…

Machine Learning · Computer Science 2024-09-24 Zijia Song , Zelin Zang , Yelin Wang , Guozheng Yang , Kaicheng yu , Wanyu Chen , Miaoyu Wang , Stan Z. Li

In this paper, we introduce a unique variant of the denoising Auto-Encoder and combine it with the perceptual loss to classify images in an unsupervised manner. The proposed method, called Pseudo Labelling, consists of first applying a…

Computer Vision and Pattern Recognition · Computer Science 2021-06-01 Aymene Mohammed Bouayed , Karim Atif , Rachid Deriche , Abdelhakim Saim

Being able to segment unseen classes not observed during training is an important technical challenge in deep learning, because of its potential to reduce the expensive annotation required for semantic segmentation. Prior zero-label…

Computer Vision and Pattern Recognition · Computer Science 2021-04-26 Giuseppe Pastore , Fabio Cermelli , Yongqin Xian , Massimiliano Mancini , Zeynep Akata , Barbara Caputo

Recent advances in semi-supervised object detection (SSOD) are largely driven by consistency-based pseudo-labeling methods for image classification tasks, producing pseudo labels as supervisory signals. However, when using pseudo labels,…

Computer Vision and Pattern Recognition · Computer Science 2022-01-03 Hengduo Li , Zuxuan Wu , Abhinav Shrivastava , Larry S. Davis

Pseudo labeling (PL) is a wide-applied strategy to enlarge the labeled dataset by self-annotating the potential samples during the training process. Several works have shown that it can improve the graph learning model performance in…

Machine Learning · Computer Science 2023-10-04 Botao Wang , Jia Li , Yang Liu , Jiashun Cheng , Yu Rong , Wenjia Wang , Fugee Tsung

Human-centric visual analysis plays a pivotal role in diverse applications, including surveillance, healthcare, and human-computer interaction. With the emergence of large-scale unlabeled human image datasets, there is an increasing need…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Mingshuang Luo , Ruibing Hou , Bo Chao , Hong Chang , Zimo Liu , Yaowei Wang , Shiguang Shan

Weakly supervised temporal action localization aims to localize temporal boundaries of actions and simultaneously identify their categories with only video-level category labels. Many existing methods seek to generate pseudo labels for…

Computer Vision and Pattern Recognition · Computer Science 2022-03-15 Linjiang Huang , Liang Wang , Hongsheng Li

Given the difficulty of manually annotating motion in video, the current best motion estimation methods are trained with synthetic data, and therefore struggle somewhat due to a train/test gap. Self-supervised methods hold the promise of…

Computer Vision and Pattern Recognition · Computer Science 2024-02-20 Xinglong Sun , Adam W. Harley , Leonidas J. Guibas

The canonical approach to video action recognition dictates a neural model to do a classic and standard 1-of-N majority vote task. They are trained to predict a fixed set of predefined categories, limiting their transferable ability on new…

Computer Vision and Pattern Recognition · Computer Science 2021-09-20 Mengmeng Wang , Jiazheng Xing , Yong Liu

Large-scale vision-language models like CLIP have demonstrated impressive open-vocabulary capabilities for image-level tasks, excelling in recognizing what objects are present. However, they struggle with pixel-level recognition tasks like…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Heeseong Shin , Chaehyun Kim , Sunghwan Hong , Seokju Cho , Anurag Arnab , Paul Hongsuck Seo , Seungryong Kim