English
Related papers

Related papers: LlamBERT: Large-scale low-cost data annotation in …

200 papers

In the era of increasingly sophisticated natural language processing (NLP) systems, large language models (LLMs) have demonstrated remarkable potential for diverse applications, including tasks requiring nuanced textual understanding and…

Computation and Language · Computer Science 2025-05-16 Poli Apollinaire Nemkova , Solomon Ubani , Mark V. Albert

Large Language Models (LLMs) have emerged as powerful support tools across various natural language tasks and a range of application domains. Recent studies focus on exploring their capabilities for data annotation. This paper provides a…

Computation and Language · Computer Science 2025-07-01 Maja Pavlovic , Massimo Poesio

Prevalent supervised learning methods in natural language processing (NLP) are notoriously data-hungry, which demand large amounts of high-quality annotated data. In practice, acquiring such data is a costly endeavor. Recently, the superior…

Computation and Language · Computer Science 2023-11-01 Ruoyu Zhang , Yanzeng Li , Yongliang Ma , Ming Zhou , Lei Zou

In NLP, fine-tuning LLMs is effective for various applications but requires high-quality annotated data. However, manual annotation of data is labor-intensive, time-consuming, and costly. Therefore, LLMs are increasingly used to automate…

Computation and Language · Computer Science 2025-04-22 Muhammad Uzair Ul Haq , Davide Rigoni , Alessandro Sperduti

NLP benchmarks rely on standardized datasets for training and evaluating models and are crucial for advancing the field. Traditionally, expert annotations ensure high-quality labels; however, the cost of expert annotation does not scale…

Computation and Language · Computer Science 2025-09-15 Omer Nahum , Nitay Calderon , Orgad Keller , Idan Szpektor , Roi Reichart

Unstructured text in medical notes and dialogues contains rich information. Recent advancements in Large Language Models (LLMs) have demonstrated superior performance in question answering and summarization tasks on unstructured text data,…

Computation and Language · Computer Science 2024-05-31 Yuhao Chen , Zhimu Wang , Bo Wen , Farhana Zulkernine

The quality of the dataset is crucial for ensuring optimal performance and reliability of downstream task models. However, datasets often contain noisy data inadvertently included during the construction process. Numerous attempts have been…

Computation and Language · Computer Science 2024-09-25 Juhwan Choi , Jungmin Yun , Kyohoon Jin , YoungBin Kim

The exponential growth of online textual content across diverse domains has necessitated advanced methods for automated text classification. Large Language Models (LLMs) based on transformer architectures have shown significant success in…

Computation and Language · Computer Science 2025-09-09 Zhyar Rzgar K Rostam , Gábor Kertész

The unstructured nature of clinical notes within electronic health records often conceals vital patient-related information, making it challenging to access or interpret. To uncover this hidden information, specialized Natural Language…

Annotated data plays a critical role in Natural Language Processing (NLP) in training models and evaluating their performance. Given recent developments in Large Language Models (LLMs), models such as ChatGPT demonstrate zero-shot…

Computation and Language · Computer Science 2024-03-18 Minzhi Li , Taiwei Shi , Caleb Ziems , Min-Yen Kan , Nancy F. Chen , Zhengyuan Liu , Diyi Yang

Data annotation is a time-consuming and labor-intensive process for many NLP tasks. Although there exist various methods to produce pseudo data labels, they are often task-specific and require a decent amount of labeled data to start with.…

Computation and Language · Computer Science 2021-09-01 Shuohang Wang , Yang Liu , Yichong Xu , Chenguang Zhu , Michael Zeng

Transformer models have achieved state-of-the-art results, with Large Language Models (LLMs), an evolution of first-generation transformers (1stTR), being considered the cutting edge in several NLP tasks. However, the literature has yet to…

Computation and Language · Computer Science 2024-08-20 Claudio M. V. de Andrade , Washington Cunha , Davi Reis , Adriana Silvina Pagano , Leonardo Rocha , Marcos André Gonçalves

Large Transformer-based language models such as BERT have led to broad performance improvements on many NLP tasks. Domain-specific variants of these models have demonstrated excellent performance on a variety of specialised tasks. In legal…

Computation and Language · Computer Science 2021-09-16 Benjamin Clavié , Akshita Gheewala , Paul Briton , Marc Alphonsus , Rym Laabiyad , Francesco Piccoli

Machine learning-based classifiers have been used for text classification, such as sentiment analysis, news classification, and toxic comment classification. However, supervised machine learning models often require large amounts of labeled…

Computation and Language · Computer Science 2025-05-06 Yejian Zhang , Shingo Takada

Although large language models (LLMs) have advanced the state-of-the-art in NLP significantly, deploying them for downstream applications is still challenging due to cost, responsiveness, control, or concerns around privacy and security. As…

Computation and Language · Computer Science 2023-11-01 Dong-Ho Lee , Jay Pujara , Mohit Sewak , Ryen W. White , Sujay Kumar Jauhar

Despite the impressive capabilities of large language models (LLMs), their performance on information extraction tasks is still not entirely satisfactory. However, their remarkable rewriting capabilities and extensive world knowledge offer…

Computation and Language · Computer Science 2024-02-23 Junjie Ye , Nuo Xu , Yikun Wang , Jie Zhou , Qi Zhang , Tao Gui , Xuanjing Huang

This paper presents a comprehensive and practical guide for practitioners and end-users working with Large Language Models (LLMs) in their downstream natural language processing (NLP) tasks. We provide discussions and insights into the…

Computation and Language · Computer Science 2023-04-28 Jingfeng Yang , Hongye Jin , Ruixiang Tang , Xiaotian Han , Qizhang Feng , Haoming Jiang , Bing Yin , Xia Hu

Unlocking the potential of Large Language Models (LLMs) in data classification represents a promising frontier in natural language processing. In this work, we evaluate the performance of different LLMs in comparison with state-of-the-art…

Computation and Language · Computer Science 2025-01-16 Arina Kostina , Marios D. Dikaiakos , Dimosthenis Stefanidis , George Pallis

Large Language Models (LLMs) have shown impressive abilities in data annotation, opening the way for new approaches to solve classic NLP problems. In this paper, we show how to use LLMs to create NuNER, a compact language representation…

Computation and Language · Computer Science 2024-02-26 Sergei Bogdanov , Alexandre Constantin , Timothée Bernard , Benoit Crabbé , Etienne Bernard

Although speech emotion recognition (SER) has advanced significantly with deep learning, annotation remains a major hurdle. Human annotation is not only costly but also subject to inconsistencies annotators often have different preferences…

Artificial Intelligence · Computer Science 2025-06-02 Xin Jing , Jiadong Wang , Iosif Tsangko , Andreas Triantafyllopoulos , Björn W. Schuller