English
Related papers

Related papers: Generalized Weak Supervision for Neural Informatio…

200 papers

Weakly-supervised text classification has received much attention in recent years for it can alleviate the heavy burden of annotating massive data. Among them, keyword-driven methods are the mainstream where user-provided keywords are…

Computation and Language · Computer Science 2021-10-07 Lu Zhang , Jiandong Ding , Yi Xu , Yingyao Liu , Shuigeng Zhou

Conventional video summarization approaches based on reinforcement learning have the problem that the reward can only be received after the whole summary is generated. Such kind of reward is sparse and it makes reinforcement learning hard…

Computer Vision and Pattern Recognition · Computer Science 2020-03-03 Yiyan Chen , Li Tao , Xueting Wang , Toshihiko Yamasaki

The classic teacher-student model in machine learning posits that a strong teacher supervises a weak student to improve the student's capabilities. We instead consider the inverted situation, where a weak teacher supervises a strong student…

Machine Learning · Computer Science 2025-02-03 David X. Wu , Anant Sahai

The amount of manually labeled data is limited in medical applications, so semi-supervised learning and automatic labeling strategies can be an asset for training deep neural networks. However, the quality of the automatically generated…

Machine Learning · Computer Science 2022-03-04 Wenhui Cui , Haleh Akrami , Anand A. Joshi , Richard M. Leahy

In this paper, we propose a \textit{weak supervision} framework for neural ranking tasks based on the data programming paradigm \citep{Ratner2016}, which enables us to leverage multiple weak supervision signals from different sources.…

Information Retrieval · Computer Science 2019-06-05 Peng Xu , Xiaofei Ma , Ramesh Nallapati , Bing Xiang

In the presence of noisy or incorrect labels, neural networks have the undesirable tendency to memorize information about the noise. Standard regularization techniques such as dropout, weight decay or data augmentation sometimes help, but…

Machine Learning · Computer Science 2020-11-23 Hrayr Harutyunyan , Kyle Reing , Greg Ver Steeg , Aram Galstyan

Solving math word problems (MWPs) is an important and challenging problem in natural language processing. Existing approaches to solve MWPs require full supervision in the form of intermediate equations. However, labeling every MWP with its…

Computation and Language · Computer Science 2023-06-16 Oishik Chatterjee , Isha Pandey , Aashish Waikar , Vishwajeet Kumar , Ganesh Ramakrishnan

In scientific reasoning tasks, the veracity of the reasoning process is as critical as the final outcome. While Process Reward Models (PRMs) offer a solution to the coarse-grained supervision problems inherent in Outcome Reward Models…

Computation and Language · Computer Science 2026-03-10 Chi-Min Chan , Ehsan Hajiramezanali , Xiner Li , Edward De Brouwer , Carl Edwards , Wei Xue , Sirui Han , Yike Guo , Gabriele Scalia

Programmatic Weak Supervision (PWS) enables supervised model training without direct access to ground truth labels, utilizing weak labels from heuristics, crowdsourcing, or pre-trained models. However, the absence of ground truth…

Machine Learning · Statistics 2024-11-01 Felipe Maia Polo , Subha Maity , Mikhail Yurochkin , Moulinath Banerjee , Yuekai Sun

Multi-label learning is a challenging computer vision task that requires assigning multiple categories to each image. However, fully annotating large-scale datasets is often impractical due to high costs and effort, motivating the study of…

Computer Vision and Pattern Recognition · Computer Science 2025-08-29 Luong Tran , Thieu Vo , Anh Nguyen , Sang Dinh , Van Nguyen

State-of-the-art deep neural networks require large-scale labeled training data that is often expensive to obtain or not available for many tasks. Weak supervision in the form of domain-specific rules has been shown to be useful in such…

Computation and Language · Computer Science 2021-04-13 Giannis Karamanolakis , Subhabrata Mukherjee , Guoqing Zheng , Ahmed Hassan Awadallah

We study Label Smoothing (LS), a widely used regularization technique, in the context of neural learning to rank (L2R) models. LS combines the ground-truth labels with a uniform distribution, encouraging the model to be less confident in…

Information Retrieval · Computer Science 2020-12-17 Gustavo Penha , Claudia Hauff

Weak supervision (WS) is a popular approach for label-efficient learning, leveraging diverse sources of noisy but inexpensive weak labels to automatically annotate training data. Despite its wide usage, WS and its practical value are…

Machine Learning · Computer Science 2025-01-31 Tianyi Zhang , Linrong Cai , Jeffrey Li , Nicholas Roberts , Neel Guha , Jinoh Lee , Frederic Sala

Label noise and class imbalance are two major issues coexisting in real-world datasets. To alleviate the two issues, state-of-the-art methods reweight each instance by leveraging a small amount of clean and unbiased data. Yet, these methods…

Computer Vision and Pattern Recognition · Computer Science 2021-11-02 Can Chen , Shuhao Zheng , Xi Chen , Erqun Dong , Xue Liu , Hao Liu , Dejing Dou

Training convolutional networks for semantic segmentation with strong (per-pixel) and weak (per-bounding-box) supervision requires a large amount of weakly labeled data. We propose two methods for selecting the most relevant data with weak…

Computer Vision and Pattern Recognition · Computer Science 2019-07-17 Panagiotis Meletis , Rob Romijnders , Gijs Dubbelman

Weakly-supervised learning has become a popular technology in recent years. In this paper, we propose a novel medical image classification algorithm, called Weakly-Supervised Generative Adversarial Networks (WSGAN), which only uses a small…

Computer Vision and Pattern Recognition · Computer Science 2021-12-01 Jiawei Mao , Xuesong Yin , Yuanqi Chang , Qi Huang

Weak supervision searches have in principle the advantages of both being able to train on experimental data and being able to learn distinctive signal properties. However, the practical applicability of such searches is limited by the fact…

High Energy Physics - Phenomenology · Physics 2024-03-05 Hugues Beauchesne , Zong-En Chen , Cheng-Wei Chiang

Recently, graph-based semi-supervised learning and pseudo-labeling have gained attention due to their effectiveness in reducing the need for extensive data annotations. Pseudo-labeling uses predictions from unlabeled data to improve model…

Computer Vision and Pattern Recognition · Computer Science 2025-10-30 Jingjun Bi , Fadi Dornaika

We solve a weakly supervised regression problem. Under "weakly" we understand that for some training points the labels are known, for some unknown, and for others uncertain due to the presence of random noise or other reasons such as lack…

Machine Learning · Computer Science 2021-04-15 Vladimir Berikov , Alexander Litvinenko

Weak Supervision (WS) techniques allow users to efficiently create large training datasets by programmatically labeling data with heuristic sources of supervision. While the success of WS relies heavily on the provided labeling heuristics,…

Machine Learning · Computer Science 2022-10-25 Cheng-Yu Hsieh , Jieyu Zhang , Alexander Ratner