English
Related papers

Related papers: Beyond Demographics: Fine-tuning Large Language Mo…

200 papers

Large Language Models (LLMs) are quickly becoming ubiquitous, but the implications for social science research are not yet well understood. This paper asks whether LLMs can help us analyse large-N qualitative data from open-ended…

Computation and Language · Computer Science 2023-10-06 Julian Ashwin , Aditya Chhabra , Vijayendra Rao

Large language models are increasingly used to annotate texts, but their outputs reflect some human perspectives better than others. Existing methods for correcting LLM annotation error assume a single ground truth. However, this assumption…

Computation and Language · Computer Science 2026-03-24 Navya Mehrotra , Adam Visokay , Kristina Gligorić

We present a novel approach for enhancing diversity and control in data annotation tasks by personalizing large language models (LLMs). We investigate the impact of injecting diverse persona descriptions into LLM prompts across two studies,…

Computation and Language · Computer Science 2024-10-16 Leon Fröhling , Gianluca Demartini , Dennis Assenmacher

State of the art large language models (LLMs) have shown impressive performance on a variety of benchmark tasks and are increasingly used as components in larger applications, where LLM-based predictions serve as proxies for human…

Computation and Language · Computer Science 2024-06-14 Michael Franke , Polina Tsvilodub , Fausto Carcassi

Previous work adopts large language models (LLMs) as evaluators to evaluate natural language process (NLP) tasks. However, certain shortcomings, e.g., fairness, scope, and accuracy, persist for current LLM evaluators. To analyze whether…

Computation and Language · Computer Science 2025-01-22 Qintong Li , Leyang Cui , Lingpeng Kong , Wei Bi

Large language models (LLMs) have transformed natural language processing, yet face challenges in specialized tasks such as simulating opinions on environmental policies. This paper introduces a novel fine-tuning approach that integrates…

Computation and Language · Computer Science 2024-12-10 Haocheng Lin

Recent work has explored the use of personal information in the form of persona sentences or self-disclosures to improve modeling of individual characteristics and prediction of annotator labels for subjective tasks. The volume of personal…

Computation and Language · Computer Science 2026-01-27 Kieran Henderson , Kian Omoomi , Vasudha Varadarajan , Allison Lahnala , Charles Welch

The prediction has served as a crucial scientific method in modern social studies. With the recent advancement of Large Language Models (LLMs), efforts have been made to leverage LLMs to predict the human features in social life, such as…

Computers and Society · Computer Science 2024-02-21 Kaiqi Yang , Hang Li , Hongzhi Wen , Tai-Quan Peng , Jiliang Tang , Hui Liu

Crowdsourcing has been the prevalent paradigm for creating natural language understanding datasets in recent years. A common crowdsourcing practice is to recruit a small number of high-quality workers, and have them massively generate…

Computation and Language · Computer Science 2019-08-29 Mor Geva , Yoav Goldberg , Jonathan Berant

Natural Language Processing tasks that aim to infer an author's private states, e.g., emotions and opinions, from their written text, typically rely on datasets annotated by third-party annotators. However, the assumption that third-party…

Computation and Language · Computer Science 2025-04-29 Jiayi Li , Yingfan Zhou , Pranav Narayanan Venkit , Halima Binte Islam , Sneha Arya , Shomir Wilson , Sarah Rajtmajer

Large Language Models (LLMs) have demonstrated considerable advances, and several claims have been made about their exceeding human performance. However, in real-world tasks, domain knowledge is often required. Low-resource learning methods…

Computation and Language · Computer Science 2023-11-17 Yuxuan Lu , Bingsheng Yao , Shao Zhang , Yun Wang , Peng Zhang , Tun Lu , Toby Jia-Jun Li , Dakuo Wang

Generative language models (LMs) are increasingly used for document class-prediction tasks and promise enormous improvements in cost and efficiency. Existing research often examines simple classification tasks, but the capability of LMs to…

Computation and Language · Computer Science 2023-10-31 Rosamond Thalken , Edward H. Stiglitz , David Mimno , Matthew Wilkens

Understanding the sources of variability in annotations is crucial for developing fair NLP systems, especially for tasks like sexism detection where demographic bias is a concern. This study investigates the extent to which annotator…

Computation and Language · Computer Science 2025-07-29 Hadi Mohammadi , Tina Shahedi , Pablo Mosteiro , Massimo Poesio , Ayoub Bagheri , Anastasia Giachanou

Large language models (LLMs) are increasingly used to predict human behavior. We propose a measure for evaluating how much knowledge a pretrained LLM brings to such a prediction: its equivalent sample size, defined as the amount of…

Econometrics · Economics 2026-01-21 Wayne Gao , Sukjin Han , Annie Liang

Hate speech spreads widely online, harming individuals and communities, making automatic detection essential for large-scale moderation, yet detecting it remains difficult. Part of the challenge lies in subjectivity: what one person flags…

Computation and Language · Computer Science 2025-12-11 Paloma Piot , David Otero , Patricia Martín-Rodilla , Javier Parapar

In the rapidly evolving landscape of Natural Language Processing (NLP), the use of Large Language Models (LLMs) for automated text annotation in social media posts has garnered significant interest. Despite the impressive innovations in…

Computation and Language · Computer Science 2024-06-12 Mao Li , Frederick Conrad

Collecting labeled datasets in finance is challenging due to scarcity of domain experts and higher cost of employing them. While Large Language Models (LLMs) have demonstrated remarkable performance in data annotation tasks on general…

Computation and Language · Computer Science 2024-03-28 Toyin Aguda , Suchetha Siddagangappa , Elena Kochkina , Simerjot Kaur , Dongsheng Wang , Charese Smiley , Sameena Shah

Event annotation is important for identifying market changes, monitoring breaking news, and understanding sociological trends. Although expert annotators set the gold standards, human coding is expensive and inefficient. Unlike information…

Computation and Language · Computer Science 2026-04-29 Feng Gu , Zongxia Li , Carlos Rafael Colon , Benjamin Evans , Ishani Mondal , Jordan Lee Boyd-Graber

Machine learning models for text classification are trained to predict a class for a given text. To do this, training and validation samples must be prepared: a set of texts is collected, and each text is assigned a class. These classes are…

Computation and Language · Computer Science 2025-08-26 Aleksandr Tsymbalov , Mikhail Khovrichev

Evaluating the quality of arguments is a crucial aspect of any system leveraging argument mining. However, it is a challenge to obtain reliable and consistent annotations regarding argument quality, as this usually requires domain-specific…

Computation and Language · Computer Science 2024-04-16 Nailia Mirzakhmedova , Marcel Gohsen , Chia Hao Chang , Benno Stein