中文
相关论文

相关论文: Multi-Task Self-Supervised Learning for Disfluency…

200 篇论文

Annotated data is an essential ingredient in natural language processing for training and evaluating machine learning models. It is therefore very desirable for the annotations to be of high quality. Recent work, however, has shown that…

计算与语言 · 计算机科学 2022-09-27 Jan-Christoph Klie , Bonnie Webber , Iryna Gurevych

State-of-the-art methods for counting people in crowded scenes rely on deep networks to estimate crowd density. While effective, these data-driven approaches rely on large amount of data annotation to achieve good performance, which stops…

计算机视觉与模式识别 · 计算机科学 2021-03-31 Weizhe Liu , Nikita Durasov , Pascal Fua

Training deep neural networks (DNNs) with limited supervision has been a popular research topic as it can significantly alleviate the annotation burden. Self-training has been successfully applied in semi-supervised learning tasks, but one…

机器学习 · 计算机科学 2023-02-17 Ran Xu , Yue Yu , Hejie Cui , Xuan Kan , Yanqiao Zhu , Joyce Ho , Chao Zhang , Carl Yang

Deep neural networks are typically trained under a supervised learning framework where a model learns a single task using labeled data. Instead of relying solely on labeled data, practitioners can harness unlabeled or related data to…

机器学习 · 计算机科学 2020-07-03 Huanru Henry Mao

Semi-supervised text classification (SSTC) has gained increasing attention due to its ability to leverage unlabeled data. However, existing approaches based on pseudo-labeling suffer from the issues of pseudo-label bias and error…

计算与语言 · 计算机科学 2023-10-24 Henry Peng Zou , Cornelia Caragea

In order to train robust deep learning models, large amounts of labelled data is required. However, in the absence of such large repositories of labelled data, unlabeled data can be exploited for the same. Semi-Supervised learning aims to…

机器学习 · 计算机科学 2021-07-20 Soumyadeep Ghosh , Sanjay Kumar , Janu Verma , Awanish Kumar

Supervised machine learning based state-of-the-art computer vision techniques are in general data hungry and pose the challenges of not having adequate computing resources and of high costs involved in human labeling efforts. Training data…

计算机视觉与模式识别 · 计算机科学 2018-05-30 Vishal Kaushal , Anurag Sahoo , Khoshrav Doctor , Narasimha Raju , Suyash Shetty , Pankaj Singh , Rishabh Iyer , Ganesh Ramakrishnan

Computational social science (CSS) practitioners often rely on human-labeled data to fine-tune supervised text classifiers. We assess the potential for researchers to augment or replace human-generated training data with surrogate training…

计算与语言 · 计算机科学 2024-06-26 Nicholas Pangakis , Samuel Wolken

Data labeling in supervised learning is considered an expensive and infeasible tool in some conditions. The self-supervised learning method is proposed to tackle the learning effectiveness with fewer labeled data, however, there is a lack…

机器学习 · 计算机科学 2021-08-18 Hilal AlQuabeh , Ameera Bawazeer , Abdulateef Alhashmi

In real-world scenarios we often need to perform multiple tasks simultaneously. Multi-Task Learning (MTL) is an adequate method to do so, but usually requires datasets labeled for all tasks. We propose a method that can leverage datasets…

计算机视觉与模式识别 · 计算机科学 2023-06-16 Federica Spinola , Philipp Benz , Minhyeong Yu , Tae-hoon Kim

Annotating abusive language is expensive, logistically complex and creates a risk of psychological harm. However, most machine learning research has prioritized maximizing effectiveness (i.e., F1 or accuracy score) rather than data…

计算与语言 · 计算机科学 2022-09-22 Hannah Rose Kirk , Bertie Vidgen , Scott A. Hale

A critical bottleneck in supervised machine learning is the need for large amounts of labeled data which is expensive and time consuming to obtain. However, it has been shown that a small amount of labeled data, while insufficient to…

In this paper, we study bidirectional LSTM network for the task of text classification using both supervised and semi-supervised approaches. Several prior works have suggested that either complex pretraining schemes using unsupervised…

计算与语言 · 计算机科学 2020-09-10 Devendra Singh Sachan , Manzil Zaheer , Ruslan Salakhutdinov

This paper investigates a range of empirical risk functions and regularization methods suitable for self-training methods in semi-supervised learning. These approaches draw inspiration from various divergence measures, such as…

Auto-annotation by ensemble of models is an efficient method of learning on unlabeled data. Wrong or inaccurate annotations generated by the ensemble may lead to performance degradation of the trained model. To deal with this problem we…

计算机视觉与模式识别 · 计算机科学 2024-03-14 Dror Simon , Miriam Farber , Roman Goldenberg

Unsupervised learning has been an attractive method for easily deriving meaningful data representations from vast amounts of unlabeled data. These representations, or embeddings, often yield superior results in many tasks, whether used…

计算与语言 · 计算机科学 2018-11-02 Shao-Yen Tseng , Brian Baucom , Panayiotis Georgiou

The current success of deep neural networks (DNNs) in an increasingly broad range of tasks involving artificial intelligence strongly depends on the quality and quantity of labeled training data. In general, the scarcity of labeled data,…

计算与语言 · 计算机科学 2018-11-21 Shun Kiyono , Jun Suzuki , Kentaro Inui

Selecting an effective training signal for machine learning tasks is difficult: expert annotations are expensive, and crowd-sourced annotations may not be reliable. Recent work has demonstrated that learning from a distribution over labels…

计算与语言 · 计算机科学 2025-04-23 Dustin Wright , Isabelle Augenstein

As the adoption of deep learning techniques in industrial applications grows with increasing speed and scale, successful deployment of deep learning models often hinges on the availability, volume, and quality of annotated data. In this…

计算机视觉与模式识别 · 计算机科学 2021-11-23 Haoping Bai , Meng Cao , Ping Huang , Jiulong Shan

Recent progress in singing voice separation has primarily focused on supervised deep learning methods. However, the scarcity of ground-truth data with clean musical sources has been a problem for long. Given a limited set of labeled data,…

音频与语音处理 · 电气工程与系统科学 2021-02-17 Zhepei Wang , Ritwik Giri , Umut Isik , Jean-Marc Valin , Arvindh Krishnaswamy