English
Related papers

Related papers: A Weakly Supervised Data Labeling Framework for Ma…

200 papers

Large language models (LLMs) are now rapidly advancing and surpassing human abilities on many natural language tasks. However, aligning these super-human LLMs with human knowledge remains challenging because the supervision signals from…

Computation and Language · Computer Science 2024-06-28 Yue Guo , Yi Yang

Solving text classification in a weakly supervised manner is important for real-world applications where human annotations are scarce. In this paper, we propose to query a masked language model with cloze style prompts to obtain supervision…

Computation and Language · Computer Science 2022-05-16 Ziqian Zeng , Weimin Ni , Tianqing Fang , Xiang Li , Xinran Zhao , Yangqiu Song

We present a simple yet efficient approach capable of training deep neural networks on large-scale weakly-supervised web images, which are crawled raw from the Internet by using text queries, without any human annotation. We develop a…

Computer Vision and Pattern Recognition · Computer Science 2018-10-19 Sheng Guo , Weilin Huang , Haozhi Zhang , Chenfan Zhuang , Dengke Dong , Matthew R. Scott , Dinglong Huang

Supervisory signals are a critical resource for training learning to rank models. In many real-world search and retrieval scenarios, these signals may not be readily available or could be costly to obtain for some queries. The examples…

Information Retrieval · Computer Science 2024-10-10 Xuyang Wu , Ajit Puthenputhussery , Hongwei Shang , Changsung Kang , Yi Fang

Contrastive learning has achieved remarkable success in learning effective representations, with supervised contrastive learning often outperforming self-supervised approaches. However, in real-world scenarios, data annotations are often…

Machine Learning · Computer Science 2025-05-29 Zi-Hao Zhou , Jun-Jie Wang , Tong Wei , Min-Ling Zhang

A crucial issue of current text generation models is that they often uncontrollably generate factually inconsistent text with respective of their inputs. Limited by the lack of annotated data, existing works in evaluating factual…

Computation and Language · Computer Science 2023-05-30 Wenhao Wu , Wei Li , Xinyan Xiao , Jiachen Liu , Sujian Li , Yajuan Lv

Supervised object detection and semantic segmentation require object or even pixel level annotations. When there exist image level labels only, it is challenging for weakly supervised algorithms to achieve accurate predictions. The accuracy…

Computer Vision and Pattern Recognition · Computer Science 2018-03-06 Weifeng Ge , Sibei Yang , Yizhou Yu

Establishing dense correspondences across semantically similar images remains a challenging task due to the significant intra-class variations and background clutters. Traditionally, a supervised learning was used for training the models,…

Computer Vision and Pattern Recognition · Computer Science 2022-04-06 Jiwon Kim , Kwangrok Ryoo , Junyoung Seo , Gyuseong Lee , Daehwan Kim , Hansang Cho , Seungryong Kim

The availability of labelled data is one of the main limitations in machine learning. We can alleviate this using weak supervision: a framework that uses expert-defined rules $\boldsymbol{\lambda}$ to estimate probabilistic labels…

Machine Learning · Computer Science 2021-05-03 Samantha Biegel , Rafah El-Khatib , Luiz Otavio Vilas Boas Oliveira , Max Baak , Nanne Aben

This paper presents a semi-supervised learning framework that is new in being designed for automatic modulation classification (AMC). By carefully utilizing unlabeled signal data with a self-supervised contrastive-learning pre-training…

Machine Learning · Computer Science 2022-03-31 Dongxin Liu , Peng Wang , Tianshi Wang , Tarek Abdelzaher

Converting written texts into their spoken forms is an essential problem in any text-to-speech (TTS) systems. However, building an effective text normalization solution for a real-world TTS system face two main challenges: (1) the semantic…

Computation and Language · Computer Science 2022-09-08 Huu-Tien Dang , Thi-Hai-Yen Vuong , Xuan-Hieu Phan

In this paper, we propose a method for training neural networks when we have a large set of data with weak labels and a small amount of data with true labels. In our proposed model, we train two neural networks: a target network, the…

Machine Learning · Statistics 2017-12-01 Mostafa Dehghani , Aliaksei Severyn , Sascha Rothe , Jaap Kamps

We present a new flavor of Variational Autoencoder (VAE) that interpolates seamlessly between unsupervised, semi-supervised and fully supervised learning domains. We show that unlabeled datapoints not only boost unsupervised tasks, but also…

Machine Learning · Computer Science 2019-11-15 Felix Berkhahn , Richard Keys , Wajih Ouertani , Nikhil Shetty , Dominik Geißler

The challenging field of scene text detection requires complex data annotation, which is time-consuming and expensive. Techniques, such as weak supervision, can reduce the amount of data needed. In this paper we propose a weak supervision…

Computer Vision and Pattern Recognition · Computer Science 2022-01-14 Emanuel Metzenthin , Christian Bartz , Christoph Meinel

The success of Vision Language Models (VLMs) on various vision-language tasks heavily relies on pre-training with large scale web-crawled datasets. However, the noisy and incomplete nature of web data makes dataset scale crucial for…

Computer Vision and Pattern Recognition · Computer Science 2024-09-25 Yiyi Tao , Zhuoyue Wang , Hang Zhang , Lun Wang

We introduce Integrated Weak Learning, a principled framework that integrates weak supervision into the training process of machine learning models. Our approach jointly trains the end-model and a label model that aggregates multiple…

Machine Learning · Computer Science 2022-06-22 Peter Hayes , Mingtian Zhang , Raza Habib , Jordan Burgess , Emine Yilmaz , David Barber

Many ways of annotating a dataset for machine learning classification tasks that go beyond the usual class labels exist in practice. These are of interest as they can simplify or facilitate the collection of annotations, while not greatly…

The expense of acquiring labels in large-scale statistical machine learning makes partially and weakly-labeled data attractive, though it is not always apparent how to leverage such data for model fitting or validation. We present a…

Machine Learning · Statistics 2022-02-10 Maxime Cauchois , Suyash Gupta , Alnur Ali , John Duchi

Existing weakly or semi-supervised semantic segmentation methods utilize image or box-level supervision to generate pseudo-labels for weakly labeled images. However, due to the lack of strong supervision, the generated pseudo-labels are…

Computer Vision and Pattern Recognition · Computer Science 2021-10-22 Md Amirul Islam , Matthew Kowal , Sen Jia , Konstantinos G. Derpanis , Neil D. B. Bruce

We propose a sequence labeling framework with a secondary training objective, learning to predict surrounding words for every word in the dataset. This language modeling objective incentivises the system to learn general-purpose patterns of…

Computation and Language · Computer Science 2017-04-25 Marek Rei