English
Related papers

Related papers: Active Learning for Natural Language Generation

200 papers

Network Traffic Classification (NTC) has become an important feature in various network management operations, e.g., Quality of Service (QoS) provisioning and security services. Machine Learning (ML) algorithms as a popular approach for NTC…

Networking and Internet Architecture · Computer Science 2024-10-28 Amin Shahraki , Mahmoud Abbasi , Amir Taherkordi , Anca Delia Jurcut

During recent years, active learning has evolved into a popular paradigm for utilizing user's feedback to improve accuracy of learning algorithms. Active learning works by selecting the most informative sample among unlabeled data and…

Machine Learning · Computer Science 2016-11-17 Alireza Ghasemi , Hamid R. Rabiee , Mohsen Fadaee , Mohammad T. Manzuri , Mohammad H. Rohban

This paper explores the integration of active machine learning (ML) for 6G networks, an area that remains under-explored yet holds potential. Unlike passive ML systems, active ML can be made to interact with the network environment. It…

Networking and Internet Architecture · Computer Science 2024-06-07 Omar Alhussein , Ning Zhang , Sami Muhaidat , Weihua Zhuang

This paper offers a comprehensive review of the research on Natural Language Generation (NLG) over the past two decades, especially in relation to data-to-text generation and text-to-text generation deep learning methods, as well as new…

Computation and Language · Computer Science 2022-08-03 Chenhe Dong , Yinghui Li , Haifan Gong , Miaoxin Chen , Junxin Li , Ying Shen , Min Yang

Active learning is usually applied to acquire labels of informative data points in supervised learning, to maximize accuracy in a sample-efficient way. However, maximizing the accuracy is not the end goal when the results are used for…

Machine Learning · Statistics 2021-10-22 Louis Filstroff , Iiris Sundin , Petrus Mikkola , Aleksei Tiulpin , Juuso Kylmäoja , Samuel Kaski

While many active learning papers assume that the learner can simply ask for a label and receive it, real annotation often presents a mismatch between the form of a label (say, one among many classes), and the form of an annotation…

Machine Learning · Computer Science 2019-07-10 Peiyun Hu , Zachary C. Lipton , Anima Anandkumar , Deva Ramanan

Natural language generation (NLG) is the key technology to achieve generative artificial intelligence (AI). With the breakthroughs in large language models (LLMs), NLG has been widely used in various medical applications, demonstrating the…

Computation and Language · Computer Science 2025-05-08 Mengxian Lyu , Xiaohan Li , Ziyi Chen , Jinqian Pan , Cheng Peng , Sankalp Talankar , Yonghui Wu

In supervised learning, acquiring labeled training data for a predictive model can be very costly, but acquiring a large amount of unlabeled data is often quite easy. Active learning is a method of obtaining predictive models with high…

Machine Learning · Computer Science 2020-12-17 Hideitsu Hino

Generative large language models (LLMs) can be a powerful tool for augmenting text annotation procedures, but their performance varies across annotation tasks due to prompt quality, text data idiosyncrasies, and conceptual difficulty.…

Computation and Language · Computer Science 2023-06-02 Nicholas Pangakis , Samuel Wolken , Neil Fasching

State-of-the-art supervised NLP models achieve high accuracy but are also susceptible to failures on inputs from low-data regimes, such as domains that are not represented in training data. As an approximation to collecting ground-truth…

Computation and Language · Computer Science 2023-06-29 Parikshit Bansal , Amit Sharma

The rise of Large Language Models (LLMs) has boosted the use of Few-Shot Learning (FSL) methods in natural language processing, achieving acceptable performance even when working with limited training data. The goal of FSL is to effectively…

The remarkable advancements in large language models (LLMs) have significantly enhanced the performance in few-shot learning settings. By using only a small number of labeled examples, referred to as demonstrations, LLMs can effectively…

Computation and Language · Computer Science 2023-11-23 Katerina Margatina , Timo Schick , Nikolaos Aletras , Jane Dwivedi-Yu

Recently, Deep Neural Networks (DNNs) have made remarkable progress for text classification, which, however, still require a large number of labeled data. To train high-performing models with the minimal annotation cost, active learning is…

Computation and Language · Computer Science 2021-08-25 Qiang Liu , Yanqiao Zhu , Zhaocheng Liu , Yufeng Zhang , Shu Wu

Active learning (AL) aims to improve model performance within a fixed labeling budget by choosing the most informative data points to label. Existing AL focuses on the single-domain setting, where all data come from the same domain (e.g.,…

Machine Learning · Computer Science 2024-02-12 Guang-Yuan Hao , Hengguan Huang , Haotian Wang , Jie Gao , Hao Wang

Data annotated by humans is a source of knowledge by describing the peculiarities of the problem and therefore fueling the decision process of the trained model. Unfortunately, the annotation process for subjective natural language…

Computation and Language · Computer Science 2023-12-14 Kamil Kanclerz , Julita Bielaniewicz , Marcin Gruza , Jan Kocon , Stanisław Woźniak , Przemysław Kazienko

Active Learning (AL) addresses the crucial challenge of enabling machines to efficiently gather labeled examples through strategic queries. Among the many AL strategies, Uncertainty Sampling (US) stands out as one of the most widely…

Machine Learning · Computer Science 2025-06-24 Po-Yi Lu , Yi-Jie Cheng , Chun-Liang Li , Hsuan-Tien Lin

Training robust deep learning (DL) systems for medical image classification or segmentation is challenging due to limited images covering different disease types and severity. We propose an active learning (AL) framework to select most…

Computer Vision and Pattern Recognition · Computer Science 2019-10-23 Dwarikanath Mahapatra , Behzad Bozorgtabar , Jean-Philippe Thiran , Mauricio Reyes

Generative Adversarial Networks (GANs) have known a tremendous success for many continuous generation tasks, especially in the field of image generation. However, for discrete outputs such as language, optimizing GANs remains an open…

Machine Learning · Computer Science 2022-01-31 Sylvain Lamprier , Thomas Scialom , Antoine Chaffin , Vincent Claveau , Ewa Kijak , Jacopo Staiano , Benjamin Piwowarski

Training regimes based on Maximum Likelihood Estimation (MLE) suffer from known limitations, often leading to poorly generated text sequences. At the root of these limitations is the mismatch between training and inference, i.e. the…

Computation and Language · Computer Science 2020-06-09 Thomas Scialom , Paul-Alexis Dray , Sylvain Lamprier , Benjamin Piwowarski , Jacopo Staiano

Entity Alignment (EA) aims to match equivalent entities across different Knowledge Graphs (KGs) and is an essential step of KG fusion. Current mainstream methods -- neural EA models -- rely on training with seed alignment, i.e., a set of…

Computation and Language · Computer Science 2021-10-14 Bing Liu , Harrisen Scells , Guido Zuccon , Wen Hua , Genghong Zhao