English
Related papers

Related papers: Rethinking LLM Bias Probing Using Lessons from the…

200 papers

As the deployment of large language models (LLMs) expands, there is an increasing demand for personalized LLMs. One method to personalize and guide the outputs of these models is by assigning a persona -- a role that describes the expected…

Computation and Language · Computer Science 2024-09-19 Mahammed Kamruzzaman , Hieu Nguyen , Nazmul Hassan , Gene Louis Kim

Financial institutions increasingly rely on large language models (LLMs) for high-stakes decision-making. However, these models risk perpetuating harmful biases if deployed without careful oversight. This paper investigates racial bias in…

General Economics · Economics 2025-06-24 Thomas R. Cook , Sophia Kazinnik

This paper presents a systematic analysis of biases in open-source Large Language Models (LLMs), across gender, religion, and race. Our study evaluates bias in smaller-scale Llama and Gemma models using the SALT ($\textbf{S}$ocial…

Computation and Language · Computer Science 2025-02-19 Samee Arif , Zohaib Khan , Maaidah Kaleem , Suhaib Rashid , Agha Ali Raza , Awais Athar

Large Language Models (LLMs) have demonstrated remarkable success across various domains. However, despite their promising performance in numerous real-world applications, most of these algorithms lack fairness considerations. Consequently,…

Computation and Language · Computer Science 2024-12-20 Zhibo Chu , Zichong Wang , Wenbin Zhang

The rapid rise of Large Language Models (LLMs) has created new disruptive possibilities for persuasive communication, enabling fully-automated, personalized, and interactive content generation at an unprecedented scale. In this paper, we…

Computation and Language · Computer Science 2026-04-22 Sander Noels , Alexander Rogiers , Maarten Buyl , Tijl De Bie

This systematic literature review comprehensively examines the application of Large Language Models (LLMs) in forecasting and anomaly detection, highlighting the current state of research, inherent challenges, and prospective future…

Machine Learning · Computer Science 2024-02-19 Jing Su , Chufeng Jiang , Xin Jin , Yuxin Qiao , Tingsong Xiao , Hongda Ma , Rong Wei , Zhi Jing , Jiajun Xu , Junhong Lin

Large Language Models (LLMs) have demonstrated their transformative potential across numerous disciplinary studies, reshaping the existing research methodologies and fostering interdisciplinary collaboration. However, a systematic…

Computation and Language · Computer Science 2025-07-14 Lu Xiang , Yang Zhao , Yaping Zhang , Chengqing Zong

LLM-powered multimodal systems are increasingly used to interpret human behavior, yet how researchers apply the models' 'social competence' remains poorly understood. This paper presents a systematic literature review of 176 publications…

Human-Computer Interaction · Computer Science 2025-11-19 Zihan Liu , Parisa Rabbani , Veda Duddu , Kyle Fan , Madison Lee , Yun Huang

As scientific research becomes increasingly complex, innovative tools are needed to manage vast data, facilitate interdisciplinary collaboration, and accelerate discovery. Large language models (LLMs) are now evolving into LLM-based…

Artificial Intelligence · Computer Science 2026-02-03 Shuo Ren , Can Xie , Pu Jian , Zhenjiang Ren , Chunlin Leng , Jiajun Zhang

With the rapid progress of Large Language Models (LLMs), the general public now has easy and affordable access to applications capable of answering most health-related questions in a personalized manner. These LLMs are increasingly proving…

Artificial Intelligence · Computer Science 2025-10-20 Emma Kondrup , Anne Imouza

Large language models (LLMs) distinguish themselves from previous technologies by functioning as collaborative ``thought partners,'' capable of engaging more fluidly in natural language on a range of tasks. As LLMs increasingly influence…

Large Language Models (LLMs) are increasingly used as proxies for human subjects in social science surveys, but their reliability and susceptibility to known human-like response biases, such as central tendency, opinion floating and primacy…

Computation and Language · Computer Science 2025-10-17 Jens Rupprecht , Georg Ahnert , Markus Strohmaier

Survey research has a long-standing history of being a human-powered field, but one that embraces various technologies for the collection, processing, and analysis of various behavioral, political, and social outcomes of interest, among…

Digital Libraries · Computer Science 2025-09-04 Trent D. Buskirk , Florian Keusch , Leah von der Heyde , Adam Eck

Large language models (LLMs) are increasingly used to assign document relevance labels in information retrieval pipelines, especially in domains lacking human-labeled data. However, different models often disagree on borderline cases,…

Information Retrieval · Computer Science 2025-07-04 William A. Ingram , Bipasha Banerjee , Edward A. Fox

Recently, there has been an increase in efforts to understand how large language models (LLMs) propagate and amplify social biases. Several works have utilized templates for fairness evaluation, which allow researchers to quantify social…

Computation and Language · Computer Science 2022-10-11 Preethi Seshadri , Pouya Pezeshkpour , Sameer Singh

The use of language technologies in high-stake settings is increasing in recent years, mostly motivated by the success of Large Language Models (LLMs). However, despite the great performance of LLMs, they are are susceptible to ethical…

Artificial Intelligence · Computer Science 2025-06-16 Alejandro Peña , Julian Fierrez , Aythami Morales , Gonzalo Mancera , Miguel Lopez , Ruben Tolosana

Large language models (LLMs) show strong potential for simulating human social behaviors and interactions, yet lack large-scale, systematically constructed benchmarks for evaluating their alignment with real-world social attitudes. To…

Social and Information Networks · Computer Science 2025-10-14 Jia Wang , Ziyu Zhao , Tingjuntao Ni , Zhongyu Wei

Large Language Models (LLMs) offer the potential to automate hiring by matching job descriptions with candidate resumes, streamlining recruitment processes, and reducing operational costs. However, biases inherent in these models may lead…

Computation and Language · Computer Science 2025-03-26 Hayate Iso , Pouya Pezeshkpour , Nikita Bhutani , Estevam Hruschka

Recent advancements in Artificial Intelligence, particularly in Large Language Models (LLMs), have transformed natural language processing by improving generative capabilities. However, detecting biases embedded within these models remains…

Computation and Language · Computer Science 2025-03-11 Suvendu Mohanty

As large language models (LLMs) grow more capable, they face increasingly diverse and complex tasks, making reliable evaluation challenging. The paradigm of LLMs as judges has emerged as a scalable solution, yet prior work primarily focuses…

Computation and Language · Computer Science 2025-11-03 Weiyuan Li , Xintao Wang , Siyu Yuan , Rui Xu , Jiangjie Chen , Qingqing Dong , Yanghua Xiao , Deqing Yang