English
Related papers

Related papers: Context Consistency Learning via Sentence Removal …

200 papers

Recent semi-supervised object detection (SSOD) has achieved remarkable progress by leveraging unlabeled data for training. Mainstream SSOD methods rely on Consistency Regularization methods and Exponential Moving Average (EMA), which form a…

Computer Vision and Pattern Recognition · Computer Science 2024-05-24 Liyu Chen , Huaao Tang , Yi Wen , Hanting Chen , Wei Li , Junchao Liu , Jie Hu

Semi-supervised semantic segmentation learns a model for classifying pixels into specific classes using a few labeled samples and numerous unlabeled images. The recent leading approach is consistency regularization by selftraining with…

Computer Vision and Pattern Recognition · Computer Science 2023-03-22 Jingi Ju , Hyeoncheol Noh , Yooseung Wang , Minseok Seo , Dong-Geol Choi

Pseudo-labeling (PL) has been shown to be effective in semi-supervised automatic speech recognition (ASR), where a base model is self-trained with pseudo-labels generated from unlabeled data. While PL can be further improved by iteratively…

Audio and Speech Processing · Electrical Eng. & Systems 2021-06-17 Yosuke Higuchi , Niko Moritz , Jonathan Le Roux , Takaaki Hori

This work tackles Weakly Supervised Anomaly detection, in which a predictor is allowed to learn not only from normal examples but also from a few labeled anomalies made available during training. In particular, we deal with the localization…

Computer Vision and Pattern Recognition · Computer Science 2022-08-11 Aniello Panariello , Angelo Porrello , Simone Calderara , Rita Cucchiara

Sequential sensor data is generated in a wide variety of practical applications. A fundamental challenge involves learning effective classifiers for such sequential data. While deep learning has led to impressive performance gains in recent…

Machine Learning · Computer Science 2020-10-07 Nauman Ahad , Mark A. Davenport

We present a self-supervised learning (SSL) method suitable for semi-global tasks such as object detection and semantic segmentation. We enforce local consistency between self-learned features, representing corresponding image locations of…

Computer Vision and Pattern Recognition · Computer Science 2022-12-09 Ashraful Islam , Ben Lundell , Harpreet Sawhney , Sudipta Sinha , Peter Morales , Richard J. Radke

The recently proposed Mean Teacher method, which exploits large-scale unlabeled data in a self-ensembling manner, has achieved state-of-the-art results in several semi-supervised learning benchmarks. Spurred by current achievements, this…

Machine Learning · Computer Science 2022-02-25 Rui Tao , Long Yan , Kazushige Ouchi , Xiangdong Wang

Addressing the challenge of domain shift between datasets is vital in maintaining model performance. In the context of cross-domain object detection, the teacher-student framework, a widely-used semi-supervised model, has shown significant…

Computer Vision and Pattern Recognition · Computer Science 2024-09-19 Runou Yang , Tian Tian , Jinwen Tian

We address the challenging problem of Long-Tailed Semi-Supervised Learning (LTSSL) where labeled data exhibit imbalanced class distribution and unlabeled data follow an unknown distribution. Unlike in balanced SSL, the generated…

Computer Vision and Pattern Recognition · Computer Science 2024-04-04 Chengcheng Ma , Ismail Elezi , Jiankang Deng , Weiming Dong , Changsheng Xu

Fine-tuning pre-trained language models (PLMs) has demonstrated its effectiveness on various downstream NLP tasks recently. However, in many low-resource scenarios, the conventional fine-tuning strategies cannot sufficiently capture the…

Computation and Language · Computer Science 2021-11-15 Yusheng Su , Xu Han , Yankai Lin , Zhengyan Zhang , Zhiyuan Liu , Peng Li , Jie Zhou , Maosong Sun

Learning sentence embeddings in an unsupervised manner is fundamental in natural language processing. Recent common practice is to couple pre-trained language models with unsupervised contrastive learning, whose success relies on augmenting…

Computation and Language · Computer Science 2022-10-20 Qiyu Wu , Chongyang Tao , Tao Shen , Can Xu , Xiubo Geng , Daxin Jiang

This paper focuses on webly supervised learning (WSL), where datasets are built by crawling samples from the Internet and directly using search queries as web labels. Although WSL benefits from fast and low-cost data collection, noises in…

Computer Vision and Pattern Recognition · Computer Science 2020-08-28 Jingkang Yang , Litong Feng , Weirong Chen , Xiaopeng Yan , Huabin Zheng , Ping Luo , Wayne Zhang

Semi-supervised learning (SSL) is a popular setting aiming to effectively utilize unlabelled data to improve model performance in downstream natural language processing (NLP) tasks. Currently, there are two popular approaches to make use of…

Computation and Language · Computer Science 2023-05-23 Zhengxiang Shi , Francesco Tonolini , Nikolaos Aletras , Emine Yilmaz , Gabriella Kazai , Yunlong Jiao

Video representation learning has been successful in video-text pre-training for zero-shot transfer, where each sentence is trained to be close to the paired video clips in a common feature space. For long videos, given a paragraph of…

Computer Vision and Pattern Recognition · Computer Science 2023-03-31 Yuncong Yang , Jiawei Ma , Shiyuan Huang , Long Chen , Xudong Lin , Guangxing Han , Shih-Fu Chang

In-Context Learning (ICL) allows Large Language Models (LLMs) to adapt to new tasks with just a few examples, but their predictions often suffer from systematic biases, leading to unstable performance in classification. While calibration…

Machine Learning · Statistics 2026-03-05 Korel Gundem , Juncheng Dong , Dennis Zhang , Vahid Tarokh , Zhengling Qi

Semi-supervised action recognition aims to improve spatio-temporal reasoning ability with a few labeled data in conjunction with a large amount of unlabeled data. Albeit recent advancements, existing powerful methods are still prone to…

Computer Vision and Pattern Recognition · Computer Science 2024-04-26 Yu Wang , Sanping Zhou , Kun Xia , Le Wang

In recent years, great progress has been made to incorporate unlabeled data to overcome the inefficiently supervised problem via semi-supervised learning (SSL). Most state-of-the-art models are based on the idea of pursuing consistent model…

Machine Learning · Computer Science 2022-09-27 Yangbangyan Jiang , Xiaodan Li , Yuefeng Chen , Yuan He , Qianqian Xu , Zhiyong Yang , Xiaochun Cao , Qingming Huang

We develop a set of methods to improve on the results of self-supervised learning using context. We start with a baseline of patch based arrangement context learning and go from there. Our methods address some overt problems such as…

Computer Vision and Pattern Recognition · Computer Science 2021-07-06 T. Nathan Mundhenk , Daniel Ho , Barry Y. Chen

Automated brain lesion segmentation provides valuable information for the analysis and intervention of patients. In particular, methods based on convolutional neural networks (CNNs) have achieved state-of-the-art segmentation performance.…

Computer Vision and Pattern Recognition · Computer Science 2019-03-05 Wenhui Cui , Yanlin Liu , Yuxing Li , Menghao Guo , Yiming Li , Xiuli Li , Tianle Wang , Xiangzhu Zeng , Chuyang Ye

Self-supervised learning (SSL) methods targeting scene images have seen a rapid growth recently, and they mostly rely on either a dedicated dense matching mechanism or a costly unsupervised object discovery module. This paper shows that…

Computer Vision and Pattern Recognition · Computer Science 2023-10-02 Ke Zhu , Minghao Fu , Jianxin Wu