English
Related papers

Related papers: Detecting Bias in Large Language Models: Fine-tune…

200 papers

With the advance of Artificial Intelligence (AI), Large Language Models (LLMs) have gained prominence and been applied in diverse contexts. As they evolve into more sophisticated versions, it is essential to assess whether they reproduce…

Computation and Language · Computer Science 2025-08-15 Gustavo Bonil , Simone Hashiguti , Jhessica Silva , João Gondim , Helena Maia , Nádia Silva , Helio Pedrini , Sandra Avila

Large language models (LLMs) have demonstrated remarkable capabilities in simulating human behaviour and social intelligence. However, they risk perpetuating societal biases, especially when demographic information is involved. We introduce…

Computers and Society · Computer Science 2025-06-11 Bryan Chen Zhengyu Tan , Roy Ka-Wei Lee

Large Language Models (LLMs), which bridge the gap between human language understanding and complex problem-solving, achieve state-of-the-art performance on several NLP tasks, particularly in few-shot and zero-shot settings. Despite the…

Cryptography and Security · Computer Science 2025-01-07 Shuai Zhao , Meihuizi Jia , Zhongliang Guo , Leilei Gan , Xiaoyu Xu , Xiaobao Wu , Jie Fu , Yichao Feng , Fengjun Pan , Luu Anh Tuan

With the development of large language models (LLMs), social biases in these LLMs have become a pressing issue. Although there are various benchmarks for social biases across languages, the extent to which Japanese LLMs exhibit social…

Computation and Language · Computer Science 2025-06-16 Hitomi Yanaka , Namgi Han , Ryoma Kumon , Jie Lu , Masashi Takeshita , Ryo Sekizawa , Taisei Kato , Hiromi Arai

Instruction-tuned Large Language Models (LLMs) have recently showcased remarkable ability to generate fitting responses to natural language instructions. However, an open research question concerns the inherent biases of trained models and…

Computation and Language · Computer Science 2023-09-08 Patrick Haller , Ansar Aynetdinov , Alan Akbik

Large Language Models (LLMs) have seen widespread deployment in various real-world applications. Understanding these biases is crucial to comprehend the potential downstream consequences when using LLMs to make decisions, particularly for…

Computation and Language · Computer Science 2024-01-10 Abel Salinas , Parth Vipul Shah , Yuzhong Huang , Robert McCormack , Fred Morstatter

As machine learning methods are deployed in real-world settings such as healthcare, legal systems, and social science, it is crucial to recognize how they shape social biases and stereotypes in these sensitive decision-making processes.…

Computation and Language · Computer Science 2021-06-25 Paul Pu Liang , Chiyu Wu , Louis-Philippe Morency , Ruslan Salakhutdinov

Large Language Models (LLMs) such as Mistral and LLaMA have showcased remarkable performance across various natural language processing (NLP) tasks. Despite their success, these models inherit social biases from the diverse datasets on…

Computation and Language · Computer Science 2024-06-19 Nirmalendu Prakash , Lee Ka Wei Roy

Progress in natural language generation research has been shaped by the ever-growing size of language models. While large language models pre-trained on web data can generate human-sounding text, they also reproduce social biases and…

Computation and Language · Computer Science 2023-06-06 Celine Wald , Lukas Pfahler

Large Language Models (LLMs) demonstrate impressive capabilities across various fields, yet their increasing use raises critical security concerns. This article reviews recent literature addressing key issues in LLM security, with a focus…

Cryptography and Security · Computer Science 2025-11-26 Benji Peng , Keyu Chen , Ming Li , Pohsun Feng , Ziqian Bi , Junyu Liu , Xinyuan Song , Qian Niu

Commercial Large Language Models (LLMs) have recently incorporated memory features to deliver personalised responses. This memory retains details such as user demographics and individual characteristics, allowing LLMs to adjust their…

Computation and Language · Computer Science 2025-05-06 Paloma Piot , Patricia Martín-Rodilla , Javier Parapar

Large language models (LLMs) often exhibit gender bias, posing challenges for their safe deployment. Existing methods to mitigate bias lack a comprehensive understanding of its mechanisms or compromise the model's core capabilities. To…

Computation and Language · Computer Science 2025-01-27 Zeping Yu , Sophia Ananiadou

As Large Language Models (LLMs) become widely used to model and simulate human behavior, understanding their biases becomes critical. We developed an experimental framework using Big Five personality surveys and uncovered a previously…

Artificial Intelligence · Computer Science 2024-11-25 Aadesh Salecha , Molly E. Ireland , Shashanka Subrahmanya , João Sedoc , Lyle H. Ungar , Johannes C. Eichstaedt

With the advent of Large Language Models (LLMs) possessing increasingly impressive capabilities, a number of Large Vision-Language Models (LVLMs) have been proposed to augment LLMs with visual inputs. Such models condition generated text on…

Computer Vision and Pattern Recognition · Computer Science 2025-05-01 Phillip Howard , Kathleen C. Fraser , Anahita Bhiwandiwalla , Svetlana Kiritchenko

Nowadays, billions of people engage in communication and express their opinions on the internet daily. Unfortunately, not all of these expressions are friendly or compliant, making content moderation an indispensable task. A common approach…

Machine Learning · Computer Science 2024-03-08 Huan Ma , Changqing Zhang , Huazhu Fu , Peilin Zhao , Bingzhe Wu

Large language models (LLMs) are widely applied across diverse domains, raising concerns about their limitations and potential risks. In this study, we investigate two types of bias that LLMs may display: stereotype bias and deviation bias.…

Computation and Language · Computer Science 2026-05-20 Daniel Wang , Eli Brignac , Minjia Mao , Xiao Fang

While Large Language Models (LLMs) have become ubiquitous in many fields, understanding and mitigating LLM biases is an ongoing issue. This paper provides a novel method for evaluating the demographic biases of various generative AI models.…

Computation and Language · Computer Science 2025-06-16 Jack H Fagan , Ruhaan Juyaal , Amy Yue-Ming Yu , Siya Pun

Recently, researchers have made considerable improvements in dialogue systems with the progress of large language models (LLMs) such as ChatGPT and GPT-4. These LLM-based chatbots encode the potential biases while retaining disparities that…

Computation and Language · Computer Science 2023-10-18 Hsuan Su , Cheng-Chu Cheng , Hua Farn , Shachi H Kumar , Saurav Sahay , Shang-Tse Chen , Hung-yi Lee

Large Language Models (LLMs) have revolutionized artificial intelligence, demonstrating remarkable computational power and linguistic capabilities. However, these models are inherently prone to various biases stemming from their training…

Computation and Language · Computer Science 2025-02-14 Riccardo Cantini , Giada Cosenza , Alessio Orsino , Domenico Talia

Adapting language models (LMs) to novel domains is often achieved through fine-tuning a pre-trained LM (PLM) on domain-specific data. Fine-tuning introduces new knowledge into an LM, enabling it to comprehend and efficiently perform a…

Computation and Language · Computer Science 2024-03-29 Micheal Abaho , Danushka Bollegala , Gary Leeming , Dan Joyce , Iain E Buchan