English
Related papers

Related papers: Structured Exploration and Exploitation of Label F…

200 papers

To reduce the human annotation efforts, the programmatic weak supervision (PWS) paradigm abstracts weak supervision sources as labeling functions (LFs) and involves a label model to aggregate the output of multiple LFs to produce training…

Machine Learning · Computer Science 2023-03-09 Renzhi Wu , Shen-En Chen , Jieyu Zhang , Xu Chu

Large Language Models (LLMs) have demonstrated their efficacy across a broad spectrum of tasks in healthcare applications. However, often LLMs need to be fine-tuned on task-specific expert annotated data to achieve optimal performance,…

Machine Learning · Computer Science 2024-08-06 Bhawesh Kumar , Jonathan Amar , Eric Yang , Nan Li , Yugang Jia

Neural natural language generation (NLG) and understanding (NLU) models are data-hungry and require massive amounts of annotated data to be competitive. Recent frameworks address this bottleneck with generative models that synthesize weak…

Computation and Language · Computer Science 2021-02-09 Ernie Chang , Vera Demberg , Alex Marin

Instruction fine-tuning stands as a crucial advancement in leveraging large language models (LLMs) for enhanced task performance. However, the annotation of instruction datasets has traditionally been expensive and laborious, often relying…

Computation and Language · Computer Science 2024-08-05 He Zhu , Junyou Su , Tianle Lun , Yicheng Tao , Wenjia Zhang , Zipei Fan , Guanhua Chen

Network log data analysis plays a critical role in detecting security threats and operational anomalies. Traditional log analysis methods for anomaly detection and root cause analysis rely heavily on expert knowledge or fully supervised…

Networking and Internet Architecture · Computer Science 2025-09-09 Xuanhao Luo , Shivesh Madan Nath Jha , Akruti Sinha , Zhizhen Li , Yuchen Liu

Large-scale datasets are essential to modern day deep learning. Advocates argue that understanding these methods requires dataset transparency (e.g. "dataset curation, motivation, composition, collection process, etc..."). However, almost…

Computer Vision and Pattern Recognition · Computer Science 2023-06-27 Nadine Chang , Francesco Ferroni , Michael J. Tarr , Martial Hebert , Deva Ramanan

Although large language models (LLMs) have advanced the state-of-the-art in NLP significantly, deploying them for downstream applications is still challenging due to cost, responsiveness, control, or concerns around privacy and security. As…

Computation and Language · Computer Science 2023-11-01 Dong-Ho Lee , Jay Pujara , Mohit Sewak , Ryen W. White , Sujay Kumar Jauhar

Large Language Models (LLMs) have demonstrated remarkable capabilities across diverse domains, but developing high-performing models for specialized applications often requires substantial human annotation -- a process that is…

Computation and Language · Computer Science 2025-07-30 Abhinav Arabelly , Jagrut Nemade , Robert D Nowak , Jifan Zhang

Learning from noisy labels is an important and long-standing problem in machine learning for real applications. One of the main research lines focuses on learning a label corrector to purify potential noisy labels. However, these methods…

Machine Learning · Computer Science 2023-12-05 Jian Chen , Ruiyi Zhang , Tong Yu , Rohan Sharma , Zhiqiang Xu , Tong Sun , Changyou Chen

Existing feature engineering methods based on large language models (LLMs) have not yet been applied to multi-label learning tasks. They lack the ability to model complex label dependencies and are not specifically adapted to the…

Machine Learning · Computer Science 2025-12-18 Wanfu Gao , Zebin He , Jun Gao

Real-world text classification tasks often require many labeled training examples that are expensive to obtain. Recent advancements in machine teaching, specifically the data programming paradigm, facilitate the creation of training data…

Machine Learning · Computer Science 2020-02-05 Neil Mallinar , Abhishek Shah , Tin Kam Ho , Rajendra Ugrani , Ayush Gupta

Data annotation and synthesis generally refers to the labeling or generating of raw data with relevant information, which could be used for improving the efficacy of machine learning models. The process, however, is labor-intensive and…

Computation and Language · Computer Science 2024-12-04 Zhen Tan , Dawei Li , Song Wang , Alimohammad Beigi , Bohan Jiang , Amrita Bhattacharjee , Mansooreh Karami , Jundong Li , Lu Cheng , Huan Liu

Supervised learning usually requires a large amount of labelled data. However, attaining ground-truth labels is costly for many tasks. Alternatively, weakly supervised methods learn with cheap weak signals that only approximately label some…

Machine Learning · Computer Science 2024-11-26 You Lu , Wenzhuo Song , Chidubem Arachie , Bert Huang

The labels used to train machine learning (ML) models are of paramount importance. Typically for ML classification tasks, datasets contain hard labels, yet learning using soft labels has been shown to yield benefits for model…

Machine Learning · Computer Science 2022-08-31 Katherine M. Collins , Umang Bhatt , Adrian Weller

The labor-intensive annotation process of semantic segmentation datasets is often prone to errors, since humans struggle to label every pixel correctly. We study algorithms to automatically detect such annotation errors, in particular…

Machine Learning · Computer Science 2023-07-12 Vedang Lad , Jonas Mueller

Most previous methods for text data augmentation are limited to simple tasks and weak baselines. We explore data augmentation on hard tasks (i.e., few-shot natural language understanding) and strong baselines (i.e., pretrained models with…

Computation and Language · Computer Science 2022-03-16 Jing Zhou , Yanan Zheng , Jie Tang , Jian Li , Zhilin Yang

The recent success of Large Language Models (LLMs) has gained significant attention in both academia and industry. Substantial efforts have been made to enhance the zero- and few-shot generalization capabilities of open-source LLMs through…

Computation and Language · Computer Science 2023-10-03 Zongxi Li , Xianming Li , Yuzhang Liu , Haoran Xie , Jing Li , Fu-lee Wang , Qing Li , Xiaoqin Zhong

Active learning aims to reduce annotation cost by selectively querying informative samples for supervision under a limited labeling budget. In this work, we investigate how vision-language models (VLMs) can be leveraged to further reduce…

Computer Vision and Pattern Recognition · Computer Science 2026-05-04 Phuong Ngoc Nguyen , Kaito Shiku , Ryoma Bise , Seiichi Uchida , Shinnosuke Matsuo

Objective: Electronic health record (EHR) phenotyping often relies on noisy proxy labels, which undermine the reliability of downstream risk prediction. Active learning can reduce annotation costs, but most rely on fixed heuristics and do…

Machine Learning · Computer Science 2025-11-25 Yang Yang , Kathryn I. Pollak , Bibhas Chakraborty , Molei Liu , Doudou Zhou , Chuan Hong

Acquiring labelled training data remains a costly task in real world machine learning projects to meet quantity and quality requirements. Recently Large Language Models (LLMs), notably GPT-4, have shown great promises in labelling data with…

Computation and Language · Computer Science 2025-01-22 Thomas Walshe , Sae Young Moon , Chunyang Xiao , Yawwani Gunawardana , Fran Silavong