中文
相关论文

相关论文: Revisiting Consistency Regularization for Semi-Sup…

200 篇论文

Semi-supervised learning (SSL) aims to improve performance by exploiting unlabeled data when labels are scarce. Conventional SSL studies typically assume close environments where important factors (e.g., label, feature, distribution)…

机器学习 · 计算机科学 2024-12-25 Lan-Zhe Guo , Lin-Han Jia , Jie-Jing Shao , Yu-Feng Li

Partial label learning (PLL) learns from training examples each associated with multiple candidate labels, among which only one is valid. In recent years, benefiting from the strong capability of dealing with ambiguous supervision and the…

人工智能 · 计算机科学 2024-02-28 Qian-Wei Wang , Bowen Zhao , Mingyan Zhu , Tianxiang Li , Zimo Liu , Shu-Tao Xia

Consistency regularization describes a class of approaches that have yielded state-of-the-art results for semi-supervised classification. While semi-supervised semantic segmentation proved to be more challenging, a number of successful…

计算机视觉与模式识别 · 计算机科学 2021-10-12 Geoff French , Michal Mackiewicz

Self-supervised learning (SSL) is a popular paradigm for representation learning. Recent multiview methods can be classified as sample-contrastive, dimension-contrastive, or asymmetric network-based, with each family having its own approach…

机器学习 · 计算机科学 2024-08-06 Oscar Skean , Aayush Dhakal , Nathan Jacobs , Luis Gonzalo Sanchez Giraldo

Few-shot learning (FSL) commonly requires a model to identify images (queries) that belong to classes unseen during training, based on a few labelled samples of the new classes (support set) as reference. So far, plenty of algorithms…

计算机视觉与模式识别 · 计算机科学 2024-12-20 Yunwei Bai , Ying Kiat Tan , Shiming Chen , Yao Shu , Tsuhan Chen

Semi-Supervised Learning (SSL) is a framework that utilizes both labeled and unlabeled data to enhance model performance. Conventional SSL methods operate under the assumption that labeled and unlabeled data share the same label space.…

计算机视觉与模式识别 · 计算机科学 2023-11-16 Noam Fluss , Guy Hacohen , Daphna Weinshall

Sound event detection (SED), as a core module of acoustic environmental analysis, suffers from the problem of data deficiency. The integration of semi-supervised learning (SSL) largely mitigates such problem while bringing no extra…

音频与语音处理 · 电气工程与系统科学 2024-01-01 Nian Shao , Erfan Loweimi , Xiaofei Li

Recent advances in contrastive learning have enlightened diverse applications across various semi-supervised fields. Jointly training supervised learning and unsupervised learning with a shared feature encoder becomes a common scheme.…

机器学习 · 计算机科学 2022-06-03 Cheng Tan , Zhangyang Gao , Lirong Wu , Siyuan Li , Stan Z. Li

The development of semi-supervised learning (SSL) has in recent years largely focused on the development of new consistency regularization or entropy minimization approaches, often resulting in models with complex training strategies to…

机器学习 · 计算机科学 2025-07-01 Durgesh Singh , Ahcene Boubekki , Robert Jenssen , Michael C. Kampffmeyer

Consistency regularization (CR), which enforces agreement between model predictions on augmented views, has found recent benefits in automatic speech recognition [1]. In this paper, we propose the use of consistency regularization for audio…

声音 · 计算机科学 2025-09-15 Shanmuka Sadhu , Weiran Wang

Semi-supervised learning (SSL) provides an effective means of leveraging unlabeled data to improve a model's performance. In this paper, we demonstrate the power of a simple combination of two common SSL methods: consistency regularization…

We propose two generic methods for improving semi-supervised learning (SSL). The first integrates weight perturbation (WP) into existing "consistency regularization" (CR) based methods. We implement WP by leveraging variational Bayesian…

机器学习 · 计算机科学 2021-03-22 Kien Do , Truyen Tran , Svetha Venkatesh

Semi-supervised learning (SSL) seeks to enhance task performance by training on both labeled and unlabeled data. Mainstream SSL image classification methods mostly optimize a loss that additively combines a supervised classification…

计算机视觉与模式识别 · 计算机科学 2024-03-19 Zhe Huang , Xiaowei Yu , Dajiang Zhu , Michael C. Hughes

Self-Supervised Learning (SSL) methods harness the concept of semantic invariance by utilizing data augmentation strategies to produce similar representations for different deformations of the same input. Essentially, the model captures the…

计算机视觉与模式识别 · 计算机科学 2024-03-05 Huijie Guo , Ying Ba , Jie Hu , Lingyu Si , Wenwen Qiang , Lei Shi

The core issue in semi-supervised learning (SSL) lies in how to effectively leverage unlabeled data, whereas most existing methods tend to put a great emphasis on the utilization of high-confidence samples yet seldom fully explore the usage…

计算机视觉与模式识别 · 计算机科学 2022-12-22 Yue Duan , Zhen Zhao , Lei Qi , Lei Wang , Luping Zhou , Yinghuan Shi , Yang Gao

Consistency regularization and pseudo-labeling have significantly advanced semi-supervised learning (SSL). Prior works have effectively employed Mixup for consistency regularization in SSL. However, our findings indicate that applying Mixup…

机器学习 · 计算机科学 2025-04-18 Haorong Han , Jidong Yuan , Chixuan Wei , Zhongyang Yu

Data augmentation has been proven to be an effective technique for developing machine learning models that are robust to known classes of distributional shifts (e.g., rotations of images), and alignment regularization is a technique often…

机器学习 · 计算机科学 2022-06-07 Haohan Wang , Zeyi Huang , Xindi Wu , Eric P. Xing

Self-supervised learning (SSL) typically learns representations invariant to semantic-preserving augmentations. While effective for recognition, enforcing strong invariance can suppress transformation-dependent structure that is useful for…

计算机视觉与模式识别 · 计算机科学 2026-03-10 Joohyung Lee , Changhun Kim , Hyunsu Kim , Kwanhyung Lee , Juho Lee

Fine-tuning Large Language Models (LLMs) on specific datasets is a common practice to improve performance on target tasks. However, this performance gain often leads to overfitting, where the model becomes too specialized in either the task…

计算与语言 · 计算机科学 2024-09-10 Sonam Gupta , Yatin Nandwani , Asaf Yehudai , Mayank Mishra , Gaurav Pandey , Dinesh Raghu , Sachindra Joshi

High-throughput interpretation of robotically gathered seafloor visual imagery can increase the efficiency of marine monitoring and exploration. Although recent research has suggested that location metadata can enhance self-supervised…

计算机视觉与模式识别 · 计算机科学 2025-09-09 Cailei Liang , Adrian Bodenmann , Emma J Curtis , Samuel Simmons , Kazunori Nagano , Stan Brown , Adam Riese , Blair Thornton