English
Related papers

Related papers: Utilizing the Mean Teacher with Supcontrast Loss f…

200 papers

Recently proposed techniques for semi-supervised learning such as Temporal Ensembling and Mean Teacher have achieved state-of-the-art results in many important classification benchmarks. In this work, we expand the Mean Teacher approach to…

Computer Vision and Pattern Recognition · Computer Science 2018-10-02 Christian S. Perone , Julien Cohen-Adad

Contrastive learning has achieved remarkable success in learning effective representations, with supervised contrastive learning often outperforming self-supervised approaches. However, in real-world scenarios, data annotations are often…

Machine Learning · Computer Science 2025-05-29 Zi-Hao Zhou , Jun-Jie Wang , Tong Wei , Min-Ling Zhang

Self-supervised contrastive representation learning has proved incredibly successful in the vision and natural language domains, enabling state-of-the-art performance with orders of magnitude less labeled data. However, such methods are…

Machine Learning · Computer Science 2022-03-17 Dara Bahri , Heinrich Jiang , Yi Tay , Donald Metzler

Deep learning has achieved great success in recent years with the aid of advanced neural network structures and large-scale human-annotated datasets. However, it is often costly and difficult to accurately and efficiently annotate…

Computer Vision and Pattern Recognition · Computer Science 2023-03-23 Chen Feng , Ioannis Patras

As the integration density and design intricacy of semiconductor wafers increase, the magnitude and complexity of defects in them are also on the rise. Since the manual inspection of wafer defects is costly, an automated artificial…

Computer Vision and Pattern Recognition · Computer Science 2022-07-05 Subhrajit Nag , Dhruv Makwana , Sai Chandra Teja R , Sparsh Mittal , C Krishna Mohan

The training of deep learning models generally requires a large amount of annotated data for effective convergence and generalisation. However, obtaining high-quality annotations is a laboursome and expensive process due to the need of…

Computer Vision and Pattern Recognition · Computer Science 2021-11-05 Fengbei Liu , Yu Tian , Filipe R. Cordeiro , Vasileios Belagiannis , Ian Reid , Gustavo Carneiro

Semi-supervised learning has emerged as a widely adopted technique in the field of medical image segmentation. The existing works either focuses on the construction of consistency constraints or the generation of pseudo labels to provide…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Ning Gao , Sanping Zhou , Le Wang , Nanning Zheng

Manufacturing wafers is an intricate task involving thousands of steps. Defect Pattern Recognition (DPR) of wafer maps is crucial for determining the root cause of production defects, which may further provide insight for yield improvement…

Machine Learning · Computer Science 2023-10-19 Nitish Shukla , Anurima Dey , Srivatsan K

Self-training methods have proven to be effective in exploiting abundant unlabeled data in semi-supervised learning, particularly when labeled data is scarce. While many of these approaches rely on a cross-entropy loss function (CE), recent…

Machine Learning · Computer Science 2024-09-12 Aurelien Gauffre , Julien Horvat , Massih-Reza Amini

Semi-supervised learning methods have shown promising results in solving many practical problems when only a few labels are available. The existing methods assume that the class distributions of labeled and unlabeled data are equal;…

Machine Learning · Computer Science 2024-08-06 Min Gu Kwak , Hyungu Kahng , Seoung Bum Kim

Semi-supervised object detection has made significant progress with the development of mean teacher driven self-training. Despite the promising results, the label mismatch problem is not yet fully explored in the previous works, leading to…

Computer Vision and Pattern Recognition · Computer Science 2022-06-15 Binbin Chen , Weijie Chen , Shicai Yang , Yunyi Xuan , Jie Song , Di Xie , Shiliang Pu , Mingli Song , Yueting Zhuang

Deploying machine learning models in resource-constrained environments, such as edge devices or rapid prototyping scenarios, increasingly demands distillation of large datasets into significantly smaller yet informative synthetic datasets.…

Computer Vision and Pattern Recognition · Computer Science 2025-05-23 Wenmin Li , Shunsuke Sakai , Tatsuhito Hasegawa

In fine-grained road scene understanding, semantic segmentation plays a crucial role in enabling vehicles to perceive and comprehend their surroundings. By assigning a specific class label to each pixel in an image, it allows for precise…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Yuting Hong , Yongkang Wu , Hui Xiao , Huazheng Hao , Xiaojie Qiu , Baochen Yao , Chengbin Peng

Semi- and weakly-supervised learning have recently attracted considerable attention in the object detection literature since they can alleviate the cost of annotation needed to successfully train deep learning models. State-of-art…

Computer Vision and Pattern Recognition · Computer Science 2022-06-20 Akhil Meethal , Marco Pedersoli , Zhongwen Zhu , Francisco Perdigon Romero , Eric Granger

Contrastive learning is a major studied topic in metric learning. However, sampling effective contrastive pairs remains a challenge due to factors such as limited batch size, imbalanced data distribution, and the risk of overfitting. In…

Computer Vision and Pattern Recognition · Computer Science 2023-08-02 Bolun Cai , Pengfei Xiong , Shangxuan Tian

Recent advancements in industrial anomaly detection (AD) have demonstrated that incorporating a small number of anomalous samples during training can significantly enhance accuracy. However, this improvement often comes at the cost of…

Computer Vision and Pattern Recognition · Computer Science 2025-01-16 Hanxi Li , Jingqi Wu , Deyin Liu , Lin Wu , Hao Chen , Mingwen Wang , Chunhua Shen

This study reveals a cutting-edge re-balanced contrastive learning strategy aimed at strengthening face anti-spoofing capabilities within facial recognition systems, with a focus on countering the challenges posed by printed photos, and…

Computer Vision and Pattern Recognition · Computer Science 2024-05-30 Chuanbiao Song , Yan Hong , Jun Lan , Huijia Zhu , Weiqiang Wang , Jianfu Zhang

The automotive mmWave radar plays a key role in advanced driver assistance systems (ADAS) and autonomous driving. Deep learning-based instance segmentation enables real-time object identification from the radar detection points. In the…

Computer Vision and Pattern Recognition · Computer Science 2023-02-07 Weiyi Xiong , Jianan Liu , Yuxuan Xia , Tao Huang , Bing Zhu , Wei Xiang

Pseudo-label based self training approaches are a popular method for source-free unsupervised domain adaptation. However, their efficacy depends on the quality of the labels generated by the source trained model. These labels may be…

Computer Vision and Pattern Recognition · Computer Science 2021-10-01 Deepti Hegde , Vishwanath Sindagi , Velat Kilic , A. Brinton Cooper , Mark Foster , Vishal Patel

We show that bringing intermediate layers' representations of two augmented versions of an image closer together in self-supervised learning helps to improve the momentum contrastive (MoCo) method. To this end, in addition to the…

Computer Vision and Pattern Recognition · Computer Science 2021-10-29 Aakash Kaku , Sahana Upadhya , Narges Razavian