English
Related papers

Related papers: OpinionGPT: Modelling Explicit Biases in Instructi…

200 papers

Large Language Models (LLMs) have shown remarkable capabilities in a multitude of Natural Language Processing (NLP) tasks. However, these models are still not immune to limitations such as social biases, especially gender bias. This work…

Computation and Language · Computer Science 2024-10-15 Divij Bajaj , Yuanyuan Lei , Jonathan Tong , Ruihong Huang

This work investigates the ability of open Large Language Models (LLMs) to predict citation intent through in-context learning and fine-tuning. Unlike traditional approaches relying on domain-specific pre-trained models like SciBERT, we…

Computation and Language · Computer Science 2025-11-17 Paris Koloveas , Serafeim Chatzopoulos , Thanasis Vergoulis , Christos Tryfonopoulos

This paper investigates supervised fine-tuning of large language models (LLMs) to improve their pedagogical alignment in computing education, addressing concerns that LLMs may hinder learning outcomes. The project utilised a proprietary…

Computation and Language · Computer Science 2024-11-05 Alexandra Vassar , Jake Renzella , Emily Ross , Andrew Taylor

Proprietary Large Language Models (LLMs), such as ChatGPT, have garnered significant attention due to their exceptional capabilities in handling a diverse range of tasks. Recent studies demonstrate that open-sourced smaller foundational…

Computation and Language · Computer Science 2023-10-10 Yue Zhang , Leyang Cui , Deng Cai , Xinting Huang , Tao Fang , Wei Bi

Large Language Models (LLMs) are becoming increasingly persuasive, demonstrating the ability to personalize arguments in conversation with humans by leveraging their personal data. This may have serious impacts on the scale and…

Computation and Language · Computer Science 2025-01-30 Jasper Timm , Chetan Talele , Jacob Haimes

Large Language Models (LLMs) have transformed text generation through inherently probabilistic context-aware mechanisms, mimicking human natural language. In this paper, we systematically investigate the performance of various LLMs when…

Computation and Language · Computer Science 2025-02-28 Javier Coronado-Blázquez

Large Language Models (LLMs) have advanced various Natural Language Processing (NLP) tasks, such as text generation and translation, among others. However, these models often generate texts that can perpetuate biases. Existing approaches to…

Computation and Language · Computer Science 2025-01-07 Shaina Raza , Oluwanifemi Bamgbose , Shardul Ghuge , Fatemeh Tavakol , Deepak John Reji , Syed Raza Bashir

This paper surveys research works in the quickly advancing field of instruction tuning (IT), which can also be referred to as supervised fine-tuning (SFT)\footnote{In this paper, unless specified otherwise, supervised fine-tuning (SFT) and…

Computation and Language · Computer Science 2025-10-07 Shengyu Zhang , Linfeng Dong , Xiaoya Li , Sen Zhang , Xiaofei Sun , Shuhe Wang , Jiwei Li , Runyi Hu , Tianwei Zhang , Fei Wu , Guoyin Wang

Large Language Models (LLMs) possess the potential to exert substantial influence on public perceptions and interactions with information. This raises concerns about the societal impact that could arise if the ideologies within these models…

Computation and Language · Computer Science 2024-06-19 Kai Chen , Zihao He , Jun Yan , Taiwei Shi , Kristina Lerman

Large language models (LLMs) have been recently leveraged as training data generators for various natural language processing (NLP) tasks. While previous research has explored different approaches to training models using generated data,…

Computation and Language · Computer Science 2023-10-19 Yue Yu , Yuchen Zhuang , Jieyu Zhang , Yu Meng , Alexander Ratner , Ranjay Krishna , Jiaming Shen , Chao Zhang

The alignments of reasoning abilities between smaller and larger Language Models are largely conducted via Supervised Fine-Tuning (SFT) using demonstrations generated from robust Large Language Models (LLMs). Although these approaches…

Computation and Language · Computer Science 2025-01-28 Leonardo Ranaldi , Andrè Freitas

Large language models (LLMs) are now widely deployed in user-facing applications, reaching hundreds of millions worldwide. As they become integrated into everyday tasks, growing reliance on their outputs raises significant concerns. In…

Computers and Society · Computer Science 2025-10-16 Robin Staab , Jasper Dekoninck , Maximilian Baader , Martin Vechev

Open-sourced large language models (LLMs) have demonstrated remarkable efficacy in various tasks with instruction tuning. However, these models can sometimes struggle with tasks that require more specialized knowledge such as translation.…

Computation and Language · Computer Science 2024-01-23 Jiali Zeng , Fandong Meng , Yongjing Yin , Jie Zhou

Large Language Models (LLMs) are prone to generating content that exhibits gender biases, raising significant ethical concerns. Alignment, the process of fine-tuning LLMs to better align with desired behaviors, is recognized as an effective…

Computation and Language · Computer Science 2024-12-17 Tao Zhang , Ziqian Zeng , Yuxiang Xiao , Huiping Zhuang , Cen Chen , James Foulds , Shimei Pan

As large language models (LLMs) become increasingly embedded in products used by millions, their outputs may influence individual beliefs and, cumulatively, shape public opinion. If the behavior of LLMs can be intentionally steered toward…

Computation and Language · Computer Science 2025-09-17 Paul Kröger , Emilio Barkett

The rapid advancement of large language models (LLMs) and their growing integration into daily life underscore the importance of evaluating and ensuring their fairness. In this work, we examine fairness within the domain of emotional theory…

Computation and Language · Computer Science 2026-03-03 Maureen Herbert , Katie Sun , Angelica Lim , Yasaman Etesam

Investigating bias in large language models (LLMs) is crucial for developing trustworthy AI. While prompt-based through prompt engineering is common, its effectiveness relies on the assumption that models inherently understand biases. Our…

Computation and Language · Computer Science 2025-03-13 Xinyi Yang , Runzhe Zhan , Derek F. Wong , Shu Yang , Junchao Wu , Lidia S. Chao

Large language models (LLMs) are currently at the forefront of intertwining AI systems with human communication and everyday life. Therefore, it is of great importance to evaluate their emerging abilities. In this study, we show that LLMs,…

Computation and Language · Computer Science 2023-10-10 Thilo Hagendorff , Sarah Fabi

Instruction tuning enhances large language models (LLMs) to follow human instructions across diverse tasks, relying on high-quality datasets to guide behavior. However, these datasets, whether manually curated or synthetically generated,…

Recent work has explored the use of large language models (LLMs) to generate tutoring responses in mathematics, yet it remains unclear how closely their instructional behavior aligns with expert human practice. We analyze a dataset of math…

Computation and Language · Computer Science 2026-05-28 Ramatu Oiza Abdulsalam , Segun Aroyehun