中文
相关论文

相关论文: Switching Temporary Teachers for Semi-Supervised S…

200 篇论文

Semi-supervised learning has emerged as an appealing strategy to train deep models with limited supervision. Most prior literature under this learning paradigm resorts to dual-based architectures, typically composed of a teacher-student…

计算机视觉与模式识别 · 计算机科学 2022-03-08 Martin Van Waerebeke , Gregory Lodygensky , Jose Dolz

Training deep neural networks requires massive amounts of training data, but for many tasks only limited labeled data is available. This makes weak supervision attractive, using weak or noisy signals like the output of heuristic methods or…

机器学习 · 计算机科学 2017-12-08 Mostafa Dehghani , Aliaksei Severyn , Sascha Rothe , Jaap Kamps

Exponential Moving Average (EMA) is a widely used weight averaging (WA) regularization to learn flat optima for better generalizations without extra cost in deep neural network (DNN) optimization. Despite achieving better flatness, existing…

机器学习 · 计算机科学 2024-10-08 Siyuan Li , Zicheng Liu , Juanxi Tian , Ge Wang , Zedong Wang , Weiyang Jin , Di Wu , Cheng Tan , Tao Lin , Yang Liu , Baigui Sun , Stan Z. Li

In order to train robust deep learning models, large amounts of labelled data is required. However, in the absence of such large repositories of labelled data, unlabeled data can be exploited for the same. Semi-Supervised learning aims to…

机器学习 · 计算机科学 2021-07-20 Soumyadeep Ghosh , Sanjay Kumar , Janu Verma , Awanish Kumar

Self-training achieves enormous success in various semi-supervised and weakly-supervised learning tasks. The method can be interpreted as a teacher-student framework, where the teacher generates pseudo-labels, and the student makes…

计算与语言 · 计算机科学 2022-05-04 Simiao Zuo , Yue Yu , Chen Liang , Haoming Jiang , Siawpeng Er , Chao Zhang , Tuo Zhao , Hongyuan Zha

Electroencephalography (EEG) is an objective tool for emotion recognition and shows promising performance. However, the label scarcity problem is a main challenge in this field, which limits the wide application of EEG-based emotion…

信号处理 · 电气工程与系统科学 2024-09-02 Rushuang Zhou , Weishan Ye , Zhiguo Zhang , Yanyang Luo , Li Zhang , Linling Li , Gan Huang , Yining Dong , Yuan-Ting Zhang , Zhen Liang

In this paper, we study teacher-student learning from the perspective of data initialization and propose a novel algorithm called Active Teacher(Source code are available at: \url{https://github.com/HunterJ-Lin/ActiveTeacher}) for…

计算机视觉与模式识别 · 计算机科学 2023-03-16 Peng Mi , Jianghang Lin , Yiyi Zhou , Yunhang Shen , Gen Luo , Xiaoshuai Sun , Liujuan Cao , Rongrong Fu , Qiang Xu , Rongrong Ji

We present Polite Teacher, a simple yet effective method for the task of semi-supervised instance segmentation. The proposed architecture relies on the Teacher-Student mutual learning framework. To filter out noisy pseudo-labels, we use…

计算机视觉与模式识别 · 计算机科学 2022-11-09 Dominik Filipiak , Andrzej Zapała , Piotr Tempczyk , Anna Fensel , Marek Cygan

Semi-supervised learning approaches train on small sets of labeled data along with large sets of unlabeled data. Self-training is a semi-supervised teacher-student approach that often suffers from the problem of "confirmation bias" that…

机器学习 · 计算机科学 2023-01-19 Aswathnarayan Radhakrishnan , Jim Davis , Zachary Rabin , Benjamin Lewis , Matthew Scherreik , Roman Ilin

I present the Lower Biased Teacher model, an enhancement of the Unbiased Teacher model, specifically tailored for semi-supervised object detection tasks. The primary innovation of this model is the integration of a localization loss into…

计算机视觉与模式识别 · 计算机科学 2024-10-07 Shuang Wang

The training of deep learning models generally requires a large amount of annotated data for effective convergence and generalisation. However, obtaining high-quality annotations is a laboursome and expensive process due to the need of…

计算机视觉与模式识别 · 计算机科学 2021-11-05 Fengbei Liu , Yu Tian , Filipe R. Cordeiro , Vasileios Belagiannis , Ian Reid , Gustavo Carneiro

We study the effects of counterfactual teacher-to-classroom assignments on average student achievement in elementary and middle schools in the US. We use the Measures of Effective Teaching (MET) experiment to semiparametrically identify the…

计量经济学 · 经济学 2020-09-02 Bryan S. Graham , Geert Ridder , Petra Thiemann , Gema Zamarro

Continual learning-the ability to learn many tasks in sequence-is critical for artificial learning systems. Yet standard training methods for deep networks often suffer from catastrophic forgetting, where learning new tasks erases knowledge…

机器学习 · 统计学 2021-07-12 Sebastian Lee , Sebastian Goldt , Andrew Saxe

We address the task of domain adaptation in object detection, where there is a domain gap between a domain with annotations (source) and a domain of interest without annotations (target). As an effective semi-supervised learning method, the…

计算机视觉与模式识别 · 计算机科学 2022-05-13 Yu-Jhe Li , Xiaoliang Dai , Chih-Yao Ma , Yen-Cheng Liu , Kan Chen , Bichen Wu , Zijian He , Kris Kitani , Peter Vajda

To better tackle the named entity recognition (NER) problem on languages with little/no labeled data, cross-lingual NER must effectively leverage knowledge learned from source languages with rich labeled data. Previous works on…

计算与语言 · 计算机科学 2020-07-16 Qianhui Wu , Zijia Lin , Börje F. Karlsson , Jian-Guang Lou , Biqing Huang

In this paper, we present a new dynamic collaborative network for semi-supervised 3D vessel segmentation, termed DiCo. Conventional mean teacher (MT) methods typically employ a static approach, where the roles of the teacher and student…

计算机视觉与模式识别 · 计算机科学 2026-01-13 Jiao Xu , Xin Chen , Lihe Zhang

Entity alignment is to find identical entities in different knowledge graphs. Although embedding-based entity alignment has recently achieved remarkable progress, training data insufficiency remains a critical challenge. Conventional…

人工智能 · 计算机科学 2022-03-15 Kexuan Xin , Zequn Sun , Wen Hua , Bing Liu , Wei Hu , Jianfeng Qu , Xiaofang Zhou

Masked Image Modeling (MIM)-based models, such as SdAE, CAE, GreenMIM, and MixAE, have explored different strategies to enhance the performance of Masked Autoencoders (MAE) by modifying prediction, loss functions, or incorporating…

计算机视觉与模式识别 · 计算机科学 2024-06-26 Srinivasa Rao Nandam , Sara Atito , Zhenhua Feng , Josef Kittler , Muhammad Awais

Recently, One-stage Weakly Supervised Semantic Segmentation (WSSS) with image-level labels has gained increasing interest due to simplification over its cumbersome multi-stage counterpart. Limited by the inherent ambiguity of Class…

计算机视觉与模式识别 · 计算机科学 2024-03-19 Yuanchen Wu , Xichen Ye , Kequan Yang , Jide Li , Xiaoqiang Li

Ensemble modeling has been widely used to solve complex problems as it helps to improve overall performance and generalization. In this paper, we propose a novel TemporalAugmenter approach based on ensemble modeling for augmenting the…

机器学习 · 计算机科学 2024-01-17 Nelly Elsayed , Constantinos L. Zekios , Navid Asadizanjani , Zag ElSayed