English
Related papers

Related papers: Augmenting NER Datasets with LLMs: Towards Automat…

200 papers

Generative large language models (LLMs) can be a powerful tool for augmenting text annotation procedures, but their performance varies across annotation tasks due to prompt quality, text data idiosyncrasies, and conceptual difficulty.…

Computation and Language · Computer Science 2023-06-02 Nicholas Pangakis , Samuel Wolken , Neil Fasching

Large Language Models (LLMs) have revolutionized various sectors, including healthcare where they are employed in diverse applications. Their utility is particularly significant in the context of rare diseases, where data scarcity,…

Computation and Language · Computer Science 2024-08-20 Qiuhao Lu , Rui Li , Andrew Wen , Jinlian Wang , Liwei Wang , Hongfang Liu

Textual data annotation, the process of labeling or tagging text with relevant information, is typically costly, time-consuming, and labor-intensive. While large language models (LLMs) have demonstrated their potential as direct…

Computation and Language · Computer Science 2025-08-12 Yu-Min Tseng , Wei-Lin Chen , Chung-Chi Chen , Hsin-Hsi Chen

This work proposes a novel approach to enhancing annotated bibliography generation through Large Language Model (LLM) ensembles. In particular, multiple LLMs in different roles -- controllable text generation, evaluation, and summarization…

Computation and Language · Computer Science 2024-12-31 Sergio Bermejo

Training and deploying machine learning models relies on a large amount of human-annotated data. As human labeling becomes increasingly expensive and time-consuming, recent research has developed multiple strategies to speed up annotation…

Computation and Language · Computer Science 2025-01-28 Ekaterina Artemova , Akim Tsvigun , Dominik Schlechtweg , Natalia Fedorova , Konstantin Chernyshev , Sergei Tilga , Boris Obmoroshev

Exploring the application of powerful large language models (LLMs) on the named entity recognition (NER) task has drawn much attention recently. This work pushes the performance boundary of zero-shot NER with LLMs by proposing a…

Computation and Language · Computer Science 2024-03-22 Tingyu Xie , Qi Li , Yan Zhang , Zuozhu Liu , Hongwei Wang

Although the annotation paradigm based on Large Language Models (LLMs) has made significant breakthroughs in recent years, its actual deployment still has two core bottlenecks: first, the cost of calling commercial APIs in large-scale…

Computation and Language · Computer Science 2025-06-23 Yao Lu , Zhaiyuan Ji , Jiawei Du , Yu Shanqing , Qi Xuan , Tianyi Zhou

Named entity recognition in real-world applications suffers from the diversity of entity types, the emergence of new entity types, and the lack of high-quality annotations. To address the above problems, this paper proposes an in-context…

Computation and Language · Computer Science 2023-05-29 Jiawei Chen , Yaojie Lu , Hongyu Lin , Jie Lou , Wei Jia , Dai Dai , Hua Wu , Boxi Cao , Xianpei Han , Le Sun

Large language models offer a scalable alternative to human coding for data annotation tasks, enabling the scale-up of research across data-intensive domains. While LLMs are already achieving near-human accuracy on objective annotation…

Computation and Language · Computer Science 2026-01-21 Zhen Xu , Vedant Khatri , Yijun Dai , Xiner Liu , Siyan Li , Xuanming Zhang , Renzhe Yu

Annotating large datasets can be challenging. However, crowd-sourcing is often expensive and can lack quality, especially for non-trivial tasks. We propose a method of using LLMs as few-shot learners for annotating data in a complex natural…

Prevalent supervised learning methods in natural language processing (NLP) are notoriously data-hungry, which demand large amounts of high-quality annotated data. In practice, acquiring such data is a costly endeavor. Recently, the superior…

Computation and Language · Computer Science 2023-11-01 Ruoyu Zhang , Yanzeng Li , Yongliang Ma , Ming Zhou , Lei Zou

The use of Natural Language Processing (NLP) in highstakes AI-based applications has increased significantly in recent years, especially since the emergence of Large Language Models (LLMs). However, despite their strong performance, LLMs…

Named Entity Recognition seeks to extract substrings within a text that name real-world objects and to determine their type (for example, whether they refer to persons or organizations). In this survey, we first present an overview of…

Computation and Language · Computer Science 2024-12-23 Imed Keraghel , Stanislas Morbieu , Mohamed Nadif

In low-resource natural language processing (NLP), the key problems are a lack of target language training data, and a lack of native speakers to create it. Cross-lingual methods have had notable success in addressing these concerns, but in…

Computation and Language · Computer Science 2021-04-27 Tatiana Tsygankova , Francesca Marini , Stephen Mayhew , Dan Roth

Classroom speech and lectures often contain named entities (NEs) such as names of people and special terminology. While automatic speech recognition (ASR) systems have achieved remarkable performance on general speech, the word error rate…

Computation and Language · Computer Science 2026-04-21 Viet Anh Trinh , Xinlu He , Jacob Whitehill

Sentence embedding is essential for many NLP tasks, with contrastive learning methods achieving strong performance using annotated datasets like NLI. Yet, the reliance on manual labels limits scalability. Recent studies leverage large…

Computation and Language · Computer Science 2025-06-05 Liyang He , Chenglong Liu , Rui Li , Zhenya Huang , Shulan Ruan , Jun Zhou , Enhong Chen

In the domain of Natural Language Processing (NLP), Named Entity Recognition (NER) stands out as a pivotal mechanism for extracting structured insights from unstructured text. This manuscript offers an exhaustive exploration into the…

Computation and Language · Computer Science 2023-09-26 Kalyani Pakhale

Despite recent advancements in speech emotion recognition (SER) models, state-of-the-art deep learning (DL) approaches face the challenge of the limited availability of annotated data. Large language models (LLMs) have revolutionised our…

Sound · Computer Science 2024-06-21 Siddique Latif , Muhammad Usama , Mohammad Ibrahim Malik , Björn W. Schuller

Many contemporary data-driven research efforts in the natural sciences, such as chemistry and materials science, require large-scale, high-performance entity recognition from scientific datasets. Large language models (LLMs) have…

Computation and Language · Computer Science 2025-09-10 Zihan Chen , Lei Shi , Weize Wu , Qiji Zhou , Yue Zhang

Deep neural network models have recently achieved state-of-the-art performance gains in a variety of natural language processing (NLP) tasks (Young, Hazarika, Poria, & Cambria, 2017). However, these gains rely on the availability of large…

Computation and Language · Computer Science 2018-11-15 Maximilian Hofer , Andrey Kormilitzin , Paul Goldberg , Alejo Nevado-Holgado