English
Related papers

Related papers: Large Language Models Are Still Misled by Simple B…

200 papers

Modern language models are trained on large amounts of data. These data inevitably include controversial and stereotypical content, which contains all sorts of biases related to gender, origin, age, etc. As a result, the models express…

Computation and Language · Computer Science 2025-09-03 Aleksandra Sorokovikova , Pavel Chizhov , Iuliia Eremenko , Ivan P. Yamshchikov

The rapid development of Large Language Models (LLMs) demonstrates remarkable multilingual capabilities in natural language processing, attracting global attention in both academia and industry. To mitigate potential discrimination and…

Computation and Language · Computer Science 2025-01-08 Kaiyu Huang , Fengran Mo , Xinyu Zhang , Hongliang Li , You Li , Yuanchi Zhang , Weijian Yi , Yulong Mao , Jinchen Liu , Yuzhuang Xu , Jinan Xu , Jian-Yun Nie , Yang Liu

Large language models (LLMs) inherit biases from their training data and alignment processes, influencing their responses in subtle ways. While many studies have examined these biases, little work has explored their robustness during…

Computation and Language · Computer Science 2024-11-06 Virgile Rennard , Christos Xypolopoulos , Michalis Vazirgiannis

The breakthrough of generative large language models (LLMs) that can solve different tasks through chat interaction has led to a significant increase in the use of general benchmarks to assess the quality or performance of these models…

Computation and Language · Computer Science 2025-04-03 Fabio Barth , Georg Rehm

Large language models (LLMs) are revolutionizing every aspect of society. They are increasingly used in problem-solving tasks to substitute human assessment and reasoning. LLMs are trained on what humans write and are thus exposed to human…

Software Engineering · Computer Science 2025-10-14 Fengfei Sun , Ningke Li , Kailong Wang , Lorenz Goette

Tabular machine learning problems often require time-consuming and labor-intensive feature engineering. Recent efforts have focused on using large language models (LLMs) to capitalize on their potential domain knowledge. At the same time,…

Machine Learning · Computer Science 2025-07-16 Jaris Küken , Lennart Purucker , Frank Hutter

Based on the foundation of Large Language Models (LLMs), Multilingual LLMs (MLLMs) have been developed to address the challenges faced in multilingual natural language processing, hoping to achieve knowledge transfer from high-resource…

Computation and Language · Computer Science 2024-12-10 Yuemei Xu , Ling Hu , Jiayi Zhao , Zihan Qiu , Kexin XU , Yuqi Ye , Hanwen Gu

Large language models~(LLMs) have greatly advanced the frontiers of artificial intelligence, attaining remarkable improvement in model capacity. To assess the model performance, a typical approach is to construct evaluation benchmarks for…

Computation and Language · Computer Science 2023-11-06 Kun Zhou , Yutao Zhu , Zhipeng Chen , Wentong Chen , Wayne Xin Zhao , Xu Chen , Yankai Lin , Ji-Rong Wen , Jiawei Han

This study introduces a hypothesis-testing framework to assess whether large language models (LLMs) possess genuine reasoning abilities or primarily depend on token bias. We go beyond evaluating LLMs on accuracy; rather, we aim to…

Computation and Language · Computer Science 2024-10-07 Bowen Jiang , Yangxinyu Xie , Zhuoqun Hao , Xiaomeng Wang , Tanwi Mallick , Weijie J. Su , Camillo J. Taylor , Dan Roth

The growing deployment of large language models (LLMs) has amplified concerns regarding their inherent biases, raising critical questions about their fairness, safety, and societal impact. However, quantifying LLM bias remains a fundamental…

Computation and Language · Computer Science 2025-05-26 Alireza Arbabi , Florian Kerschbaum

Large language models (LLMs) exhibit probabilistic output characteristics, yet conventional evaluation frameworks rely on deterministic scalar metrics. This study introduces a Bayesian approach for LLM capability assessment that integrates…

Computation and Language · Computer Science 2025-05-01 Xiao Xiao , Yu Su , Sijing Zhang , Zhang Chen , Yadong Chen , Tian Liu

Large language models (LLMs) are becoming increasingly relevant as a potential tool for healthcare, aiding communication between clinicians, researchers, and patients. However, traditional evaluations of LLMs on medical exam questions do…

Computation and Language · Computer Science 2023-09-19 Rojin Ziaei , Samuel Schmidgall

This paper studies the performance of large language models (LLMs), particularly regarding demographic fairness, in solving real-world healthcare tasks. We evaluate state-of-the-art LLMs with three prevalent learning frameworks across six…

Computation and Language · Computer Science 2024-12-10 Yue Zhou , Barbara Di Eugenio , Lu Cheng

Large Language Models have demonstrated remarkable capabilities in natural language processing, yet their decision-making processes often lack transparency. This opaqueness raises significant concerns regarding trust, bias, and model…

Large language models (LLMs) have demonstrated remarkable capabilities across a wide range of tasks in various domains. Despite their impressive performance, they can be unreliable due to factual errors in their generations. Assessing their…

Computation and Language · Computer Science 2024-03-26 Jiahui Geng , Fengyu Cai , Yuxia Wang , Heinz Koeppl , Preslav Nakov , Iryna Gurevych

Recent advancements in Large Language Models (LLMs) have significantly enhanced interactions between users and models. These advancements concurrently underscore the need for rigorous safety evaluations due to the manifestation of social…

Computation and Language · Computer Science 2025-03-26 Dahyun Jung , Seungyoon Lee , Hyeonseok Moon , Chanjun Park , Heuiseok Lim

As large language models (LLMs) are increasingly deployed in real-world applications, ensuring their fair responses across demographics has become crucial. Despite many efforts, an ongoing challenge is hidden bias: LLMs appear fair under…

Computation and Language · Computer Science 2026-02-05 Kahee Lim , Soyeon Kim , Steven Euijong Whang

Large Language Models (LLMs) have emerged as powerful candidates to inform clinical decision-making processes. While these models play an increasingly prominent role in shaping the digital landscape, two growing concerns emerge in…

Computation and Language · Computer Science 2024-04-24 Raphael Poulain , Hamed Fayyaz , Rahmatollah Beheshti

Unlearning methods have the potential to improve the privacy and safety of large language models (LLMs) by removing sensitive or harmful information post hoc. The LLM unlearning research community has increasingly turned toward empirical…

Computation and Language · Computer Science 2025-04-09 Pratiksha Thaker , Shengyuan Hu , Neil Kale , Yash Maurya , Zhiwei Steven Wu , Virginia Smith

The growing integration of Large Language Models (LLMs) into critical societal domains has raised concerns about embedded biases that can perpetuate stereotypes and undermine fairness. Such biases may stem from historical inequalities in…

Computation and Language · Computer Science 2025-10-17 Riccardo Cantini , Alessio Orsino , Massimo Ruggiero , Domenico Talia