English
Related papers

Related papers: LlamBERT: Large-scale low-cost data annotation in …

200 papers

Executing machine learning inference tasks on resource-constrained edge devices requires careful hardware-software co-design optimizations. Recent examples have shown how transformer-based deep neural network models such as ALBERT can be…

Machine Learning · Computer Science 2023-04-14 Zirui Fu , Aleksandre Avaliani , Marco Donato

Transfer learning from large language models (LLMs) has emerged as a powerful technique to enable knowledge-based fine-tuning for a number of tasks, adaptation of models for different domains and even languages. However, it remains an open…

Computation and Language · Computer Science 2022-11-08 Sovesh Mohapatra , Somesh Mohapatra

Linguistic annotation of transcribed speech is essential for research in language acquisition, language disorders, and sociolinguistics, yet remains labor-intensive and time-consuming. While Large Language Models (LLMs) have shown promise…

Computation and Language · Computer Science 2026-05-19 Qingwen Zhao , Hongao Zhu , Yunqi He , Rui Wang , Aijun Huang , Hai Hu

Event annotation is important for identifying market changes, monitoring breaking news, and understanding sociological trends. Although expert annotators set the gold standards, human coding is expensive and inefficient. Unlike information…

Computation and Language · Computer Science 2026-04-29 Feng Gu , Zongxia Li , Carlos Rafael Colon , Benjamin Evans , Ishani Mondal , Jordan Lee Boyd-Graber

Large Language Models (LLMs) offer numerous applications, the full extent of which is not yet understood. This paper investigates if LLMs can be applied for editing structured and semi-structured documents with minimal effort. Using a…

Machine Learning · Computer Science 2024-09-16 Irene Weber

Annotating speaker attributes from text is inherently ambiguous, particularly in multilingual settings where demographic and social cues are implicit and culturally variable. We propose a human-large language model (LLM) collaborative…

Computation and Language · Computer Science 2026-05-26 Lingyu Gao , Will Monroe , David Smith , Meghan Jemison , Jackie Lee

Although LLMs have attained significant success in high-resource languages, their capacity in low-resource linguistic environments like Kannada and Arabic is not yet fully understood. This work benchmarking the performance of multilingual…

Computation and Language · Computer Science 2025-07-29 Maitha Alshehhi , Ahmed Sharshar , Mohsen Guizani

The rise of large language models (LLMs) has brought a critical need for high-quality human-labeled data, particularly for processes like human feedback and evaluation. A common practice is to label data via consensus annotation over human…

Computation and Language · Computer Science 2025-06-23 Manya Wadhwa , Jifan Chen , Junyi Jessy Li , Greg Durrett

Entity matching (EM) is a critical task in data integration, aiming to identify records across different datasets that refer to the same real-world entities. Traditional methods often rely on manually engineered features and rule-based…

Computation and Language · Computer Science 2024-06-03 Qianyu Huang , Tongfang Zhao

Large language models (LLMs) have revolutionized zero-shot task performance, mitigating the need for task-specific annotations while enhancing task generalizability. Despite its advancements, current methods using trigger phrases such as…

Computation and Language · Computer Science 2024-06-13 Saurabh Srivastava , Chengyue Huang , Weiguo Fan , Ziyu Yao

Building on advancements in Large Language Models (LLMs), we can tackle complex analytical and mathematical reasoning tasks requiring nuanced contextual understanding. A prime example of such complex tasks is modelling resource allocation…

Networking and Internet Architecture · Computer Science 2025-12-02 Tasnim Ahmed , Siana Rizwan , Naveed Ejaz , Salimur Choudhury

With the rapid advancement and strong generalization capabilities of large language models (LLMs), they have been increasingly incorporated into the active learning pipelines as annotators to reduce annotation costs. However, considering…

Machine Learning · Computer Science 2026-01-23 Yuanyuan Qi , Xiaohao Yang , Jueqing Lu , Guoxiang Guo , Joanne Enticott , Gang Liu , Lan Du

This paper assesses the accuracy, reliability and bias of the Large Language Model (LLM) ChatGPT-4 on the text analysis task of classifying the political affiliation of a Twitter poster based on the content of a tweet. The LLM is compared…

Computation and Language · Computer Science 2023-04-14 Petter Törnberg

Native Language Identification (NLI) - the task of identifying the native language (L1) of a person based on their writing in the second language (L2) - has applications in forensics, marketing, and second language acquisition.…

Computation and Language · Computer Science 2025-01-22 Yee Man Ng , Ilia Markov

Language Models (LMs) such as BERT, have been shown to perform well on the task of identifying Named Entities (NE) in text. A BERT LM is typically used as a classifier to classify individual tokens in the input text, or to classify spans of…

Computation and Language · Computer Science 2024-03-04 Edward Whittaker , Ikuo Kitagishi

Large language models (LLMs) have wide applications in the field of natural language processing(NLP), such as GPT-4 and Llama. However, with the exponential growth of model parameter sizes, LLMs bring significant resource overheads. Low-bit…

Computation and Language · Computer Science 2025-02-27 Liangdong Liu , Zhitong Zheng , Cong Wang , Tianhuang Su , Zhenyu Yang

Graph Neural Networks have demonstrated great success in various fields of multimedia. However, the distribution shift between the training and test data challenges the effectiveness of GNNs. To mitigate this challenge, Test-Time Training…

Machine Learning · Computer Science 2024-04-23 Jiaxin Zhang , Yiqi Wang , Xihong Yang , Siwei Wang , Yu Feng , Yu Shi , Ruicaho Ren , En Zhu , Xinwang Liu

The exponential growth of unstructured text data presents a fundamental challenge in modern data management and information retrieval. While Large Language Models (LLMs) have shown remarkable capabilities in natural language processing,…

Artificial Intelligence · Computer Science 2025-05-06 William Brach , Kristián Košťál , Michal Ries

Large Language Models (LLMs), typified by OpenAI's GPT, have marked a significant advancement in artificial intelligence. Trained on vast amounts of text data, LLMs are capable of understanding and generating human-like text across a…

Artificial Intelligence · Computer Science 2024-10-29 Haochen Zhang , Yuyang Dong , Chuan Xiao , Masafumi Oyamada

The construction of high-quality parallel corpora for translation research has increasingly evolved from simple sentence alignment to complex, multi-layered annotation tasks. This methodological shift presents significant challenges for…

Computation and Language · Computer Science 2026-02-12 Baorong Huang , Ali Asiri