English
Related papers

Related papers: Uncovering Biases with Reflective Large Language M…

200 papers

Reinforcement Learning from Human Feedback (RLHF) has become a pivotal paradigm in artificial intelligence to align large models with human preferences. In this paper, we propose a novel statistical framework to simultaneously conduct the…

Machine Learning · Statistics 2026-05-01 Nan Lu , Ethan Lee , Ethan X. Fang , Junwei Lu

Large Language Models (LLMs) have emerged as dominant foundational models in modern NLP. However, the understanding of their prediction processes and internal mechanisms, such as feed-forward networks (FFN) and multi-head self-attention…

Computation and Language · Computer Science 2024-04-16 Xintong Wang , Xiaoyu Li , Xingshan Li , Chris Biemann

Large language models (LLMs) have demonstrated remarkable capabilities in handling complex dialogue tasks without requiring use case-specific fine-tuning. However, analyzing live dialogues in real-time necessitates low-latency processing…

Computation and Language · Computer Science 2025-03-10 Xuanqing Liu , Luyang Kong , Wei Niu , Afshin Khashei , Belinda Zeng , Steve Johnson , Jon Jay , Davor Golac , Matt Pope

The growing integration of Large Language Models (LLMs) into critical societal domains has raised concerns about embedded biases that can perpetuate stereotypes and undermine fairness. Such biases may stem from historical inequalities in…

Computation and Language · Computer Science 2025-10-17 Riccardo Cantini , Alessio Orsino , Massimo Ruggiero , Domenico Talia

Recent advancements in Large Language Models (LLMs) have positioned them as powerful tools for clinical decision-making, with rapidly expanding applications in healthcare. However, concerns about bias remain a significant challenge in the…

Artificial Intelligence · Computer Science 2024-10-23 Kenza Benkirane , Jackie Kay , Maria Perez-Ortiz

Using Large Language Models (LLMs) to simulate user opinions has received growing attention. Yet LLMs, especially trained with reinforcement learning from human feedback (RLHF), are known to exhibit biases toward dominant viewpoints,…

Computation and Language · Computer Science 2025-12-09 Ziyun Yu , Yiru Zhou , Chen Zhao , Hongyi Wen

Large Language Models (LLMs) are foundational to AI advancements, facilitating applications like predictive text generation. Nonetheless, they pose risks by potentially memorizing and disseminating sensitive, biased, or copyrighted…

Artificial Intelligence · Computer Science 2024-03-26 Youyang Qu , Ming Ding , Nan Sun , Kanchana Thilakarathna , Tianqing Zhu , Dusit Niyato

Large Language Models (LLMs) are prone to generating fluent but incorrect content, known as confabulation, which poses increasing risks in multi-turn or agentic applications where outputs may be reused as context. In this work, we…

Computation and Language · Computer Science 2026-03-18 Tianyi Zhou , Johanne Medina , Sanjay Chawla

Large language models (LLMs) are increasingly used in social science simulations. While their performance on reasoning and optimization tasks has been extensively evaluated, less attention has been paid to their ability to simulate human…

Computational Engineering, Finance, and Science · Computer Science 2025-08-25 Yuanjun Feng , Vivek Choudhary , Yash Raj Shrestha

Large language models (LLMs) possess strong semantic understanding, driving significant progress in data mining applications. This is further enhanced by large reasoning models (LRMs), which provide explicit multi-step reasoning traces. On…

Machine Learning · Computer Science 2026-04-07 Aobo Chen , Chenxu Zhao , Chenglin Miao , Mengdi Huai

News Articles provides crucial information about various events happening in the society but they unfortunately come with different kind of biases. These biases can significantly distort public opinion and trust in the media, making it…

Computation and Language · Computer Science 2025-01-07 Bhushan Santosh Shah , Deven Santosh Shah , Vahida Attar

The use of language technologies in high-stake settings is increasing in recent years, mostly motivated by the success of Large Language Models (LLMs). However, despite the great performance of LLMs, they are are susceptible to ethical…

Artificial Intelligence · Computer Science 2025-06-16 Alejandro Peña , Julian Fierrez , Aythami Morales , Gonzalo Mancera , Miguel Lopez , Ruben Tolosana

Language serves as a vehicle for conveying thought, enabling communication among individuals. The ability to distinguish between diverse concepts, identify fairness and injustice, and comprehend a range of legal notions fundamentally relies…

Computation and Language · Computer Science 2023-11-23 Ha-Thanh Nguyen , Wachara Fungwacharakorn , Ken Satoh

Large Language Models (LLMs) often generate inaccurate responses (hallucinations) when faced with questions beyond their knowledge scope. Retrieval-Augmented Generation (RAG) addresses this by leveraging external knowledge, but a critical…

Information Retrieval · Computer Science 2025-09-10 Haoxiang Jin , Ronghan Li , Zixiang Lu , Qiguang Miao

This paper presents research on enhancements to Large Language Models (LLMs) through the addition of diversity in its generated outputs. Our study introduces a configuration of multiple LLMs which demonstrates the diversities capable with a…

Computation and Language · Computer Science 2025-08-05 Purva Prasad Gosavi , Vaishnavi Murlidhar Kulkarni , Alan F. Smeaton

Large language models (LLMs) can pass explicit social bias tests but still harbor implicit biases, similar to humans who endorse egalitarian beliefs yet exhibit subtle biases. Measuring such implicit biases can be a challenge: as LLMs…

Computers and Society · Computer Science 2024-05-24 Xuechunzi Bai , Angelina Wang , Ilia Sucholutsky , Thomas L. Griffiths

The reflection capacity of Large Language Model (LLM) has garnered extensive attention. A post-hoc prompting strategy, e.g., reflexion and self-refine, refines LLM's response based on self-evaluated or external feedback. However, recent…

Computation and Language · Computer Science 2024-06-10 Wenqi Zhang , Yongliang Shen , Linjuan Wu , Qiuying Peng , Jun Wang , Yueting Zhuang , Weiming Lu

Aligning Large Language Models (LLMs) is crucial for enhancing their safety and utility. However, existing methods, primarily based on preference datasets, face challenges such as noisy labels, high annotation costs, and privacy concerns.…

Machine Learning · Computer Science 2025-01-28 Hao Sun , Mihaela van der Schaar

Bias in Large Language Models (LLMs) significantly undermines their reliability and fairness. We focus on a common form of bias: when two reference concepts in the model's concept space, such as sentiment polarities (e.g., "positive" and…

Computation and Language · Computer Science 2025-05-22 Lang Gao , Kaiyang Wan , Wei Liu , Chenxi Wang , Zirui Song , Zixiang Xu , Yanbo Wang , Veselin Stoyanov , Xiuying Chen

The advancement of Large Language Models (LLMs) has significantly impacted various domains, including Web search, healthcare, and software development. However, as these models scale, they become more vulnerable to cybersecurity risks,…

Cryptography and Security · Computer Science 2024-10-01 Qin Liu , Wenjie Mo , Terry Tong , Jiashu Xu , Fei Wang , Chaowei Xiao , Muhao Chen