English
Related papers

Related papers: Open-Source LLMs for Text Annotation: A Practical …

200 papers

Recent advancements in the field of Natural Language Processing, particularly the development of large-scale language models that are pretrained on vast amounts of knowledge, are creating novel opportunities within the realm of Knowledge…

Computation and Language · Computer Science 2023-10-06 Anisa Rula , Jennifer D'Souza

Instruction tuning is crucial for enabling Large Language Models (LLMs) to solve real-world tasks. Prior work has shown the effectiveness of instruction-tuning data synthesized solely from LLMs, raising a fundamental question: Do we still…

Textual data annotation, the process of labeling or tagging text with relevant information, is typically costly, time-consuming, and labor-intensive. While large language models (LLMs) have demonstrated their potential as direct…

Computation and Language · Computer Science 2025-08-12 Yu-Min Tseng , Wei-Lin Chen , Chung-Chi Chen , Hsin-Hsi Chen

Language Models (LMs) can perform new tasks by adapting to a few in-context examples. For humans, explanations that connect examples to task principles can improve learning. We therefore investigate whether explanations of few-shot examples…

In the swiftly expanding domain of Natural Language Processing (NLP), the potential of GPT-based models for the financial sector is increasingly evident. However, the integration of these models with financial datasets presents challenges,…

Computation and Language · Computer Science 2023-11-14 Neng Wang , Hongyang Yang , Christina Dan Wang

Recently, Large Language Models (LLM) have demonstrated impressive capability to solve a wide range of tasks. However, despite their success across various tasks, no prior work has investigated their capability in the biomedical domain yet.…

Computation and Language · Computer Science 2024-02-21 Israt Jahan , Md Tahmid Rahman Laskar , Chun Peng , Jimmy Huang

Tumor documentation in Germany is largely done manually, requiring reading patient records and entering data into structured databases. Large language models (LLMs) could potentially enhance this process by improving efficiency and…

Computation and Language · Computer Science 2025-08-08 Stefan Lenz , Arsenij Ustjanzew , Marco Jeray , Meike Ressing , Torsten Panholzer

Large language models (LLMs) holds significant promise in achieving general medication recommendation systems owing to their comprehensive interpretation of clinical notes and flexibility to medication encoding. We evaluated both…

Information Retrieval · Computer Science 2025-08-05 Zihao Zhao , Chenxiao Fan , Junlong Liu , Zheng Wang , Xiangnan He , Chongming Gao , Juan Li , Fuli Feng

Public Narratives (PNs) are key tools for leadership development and civic mobilization, yet their systematic analysis remains challenging due to their subjective interpretation and the high cost of expert annotation. In this work, we…

Computation and Language · Computer Science 2025-11-18 Elinor Poole-Dayan , Daniel T Kessler , Hannah Chiou , Margaret Hughes , Emily S Lin , Marshall Ganz , Deb Roy

The rapid growth of biomedical literature poses challenges for manual knowledge curation and synthesis. Biomedical Natural Language Processing (BioNLP) automates the process. While Large Language Models (LLMs) have shown promise in general…

Large Language Models (LLMs) have remarkable capabilities across NLP tasks. However, their performance in multilingual contexts, especially within the mental health domain, has not been thoroughly explored. In this paper, we evaluate…

Computation and Language · Computer Science 2026-02-03 Nishat Raihan , Sadiya Sayara Chowdhury Puspo , Ana-Maria Bucur , Stevie Chancellor , Marcos Zampieri

Large language models (LLMs) are becoming increasingly better at a wide range of Natural Language Processing tasks (NLP), such as text generation and understanding. Recently, these models have extended their capabilities to coding tasks,…

Machine Learning · Computer Science 2024-10-23 Nishat Raihan , Mohammed Latif Siddiq , Joanna C. S. Santos , Marcos Zampieri

OpenNotes enables patients to access EHR notes, but medical jargon can hinder comprehension. To improve understanding, we evaluated closed- and open-source LLMs for extracting and prioritizing key medical terms using prompting, fine-tuning,…

Computation and Language · Computer Science 2026-05-08 Won Seok Jang , Sharmin Sultana , Zonghai Yao , Hieu Tran , Zhichao Yang , Sunjae Kwon , Hong Yu

This paper explores the use of open generative Large Language Models (LLMs) for annotation tasks in the social sciences. The study highlights the challenges associated with proprietary models, such as limited reproducibility and privacy…

Computation and Language · Computer Science 2024-01-02 Maximilian Weber , Merle Reichardt

With the development of large-scale Language Models (LLM), fine-tuning pre-trained LLM has become a mainstream paradigm for solving downstream tasks of natural language processing. However, training a language model in the legal field…

Computation and Language · Computer Science 2024-06-07 Chun-Hsien Lin , Pu-Jen Cheng

Large Language Models (LLMs) excel in zero-shot and few-shot tasks, but achieving similar performance with encoder-only models like BERT and RoBERTa has been challenging due to their architecture. However, encoders offer advantages such as…

Deploying language models (LMs) in customer-facing speech applications requires conversational fluency and adherence to specific stylistic guidelines. This can be challenging to achieve reliably using complex system prompts due to issues…

Machine Learning · Computer Science 2025-07-08 Ingo Marquardt , Philippe Brule

In recent years, pre-trained large language models (LLMs) have demonstrated remarkable efficiency in achieving an inference-time few-shot learning capability known as in-context learning. However, existing literature has highlighted the…

Computation and Language · Computer Science 2024-02-14 Xinyi Wang , Wanrong Zhu , Michael Saxon , Mark Steyvers , William Yang Wang

While Large Language Models (LLMs) have demonstrated exceptional multitasking abilities, fine-tuning these models on downstream, domain-specific datasets is often necessary to yield superior performance on test sets compared to their…

Computation and Language · Computer Science 2024-03-15 Haoran Yang , Yumeng Zhang , Jiaqi Xu , Hongyuan Lu , Pheng Ann Heng , Wai Lam

Prior work has shown that finetuning large language models (LLMs) using machine-generated instruction-following data enables such models to achieve remarkable zero-shot capabilities on new tasks, and no human-written instructions are…

Computation and Language · Computer Science 2023-04-07 Baolin Peng , Chunyuan Li , Pengcheng He , Michel Galley , Jianfeng Gao