English
Related papers

Related papers: Do LLMs Find Human Answers To Fact-Driven Question…

200 papers

Large Language Models (LLMs) have been evaluated using diverse question types, e.g., multiple-choice, true/false, and short/long answers. This study answers an unexplored question about the impact of different question types on LLM accuracy…

Computation and Language · Computer Science 2026-04-29 Seok Hwan Song , Mohna Chakraborty , Qi Li , Wallapak Tavanapong

Using Large Language Models (LLMs) to simulate user opinions has received growing attention. Yet LLMs, especially trained with reinforcement learning from human feedback (RLHF), are known to exhibit biases toward dominant viewpoints,…

Computation and Language · Computer Science 2025-12-09 Ziyun Yu , Yiru Zhou , Chen Zhao , Hongyi Wen

We investigate the role of large language models (LLMs) in supporting mental health by analyzing Reddit posts and comments about mental health conversations with ChatGPT. Our findings reveal that users value ChatGPT as a safe,…

Human-Computer Interaction · Computer Science 2025-10-28 Kyuha Jung , Gyuho Lee , Yuanhui Huang , Yunan Chen

Do large language models (LLMs) display rational reasoning? LLMs have been shown to contain human biases due to the data they have been trained on; whether this is reflected in rational reasoning remains less clear. In this paper, we answer…

Computation and Language · Computer Science 2024-02-16 Olivia Macmillan-Scott , Mirco Musolesi

The rapid evolution of large language models (LLMs) and their capacity to simulate human cognition and behavior has given rise to LLM-based frameworks and tools that are evaluated and applied based on their ability to perform tasks…

Computation and Language · Computer Science 2024-12-03 Jing Yi Wang , Nicholas Sukiennik , Tong Li , Weikang Su , Qianyue Hao , Jingbo Xu , Zihan Huang , Fengli Xu , Yong Li

The increasing sophistication of large language models (LLMs) has sparked growing concerns regarding their potential role in exacerbating ideological polarization through the automated generation of persuasive and biased content. This study…

Computation and Language · Computer Science 2025-06-18 . Pazzaglia , V. Vendetti , L. D. Comencini , F. Deriu , V. Modugno

The cognitive mechanism by which Large Language Models (LLMs) solve mathematical problems remains a widely debated and unresolved issue. Currently, there is little interpretable experimental evidence that connects LLMs' problem-solving with…

Artificial Intelligence · Computer Science 2025-09-23 Wei Xie , Shuoyoucheng Ma , Zhenhua Wang , Enze Wang , Kai Chen , Xiaobing Sun , Baosheng Wang

While large language models (LLMs) have demonstrated impressive capabilities across various natural language processing tasks by acquiring rich factual knowledge from their broad training data, their ability to synthesize and logically…

Computation and Language · Computer Science 2024-07-31 Tianshi Zheng , Jiaxin Bai , Yicheng Wang , Tianqing Fang , Yue Guo , Yauwai Yim , Yangqiu Song

Simulation powered by Large Language Models (LLMs) has become a promising method for exploring complex human social behaviors. However, the application of LLMs in simulations presents significant challenges, particularly regarding their…

Computers and Society · Computer Science 2025-02-26 Qian Wang , Zhenheng Tang , Bingsheng He

Large language models (LLMs) are increasingly used as proxies for human judgment in computational social science, yet their ability to reproduce patterns of susceptibility to misinformation remains unclear. We test whether LLM-simulated…

Social and Information Networks · Computer Science 2026-04-13 Eun Cheol Choi , Lindsay E. Young , Emilio Ferrara

State of the art large language models (LLMs) have shown impressive performance on a variety of benchmark tasks and are increasingly used as components in larger applications, where LLM-based predictions serve as proxies for human…

Computation and Language · Computer Science 2024-06-14 Michael Franke , Polina Tsvilodub , Fausto Carcassi

Large language models (LLMs) have recently shown impressive performance on tasks involving reasoning, leading to a lively debate on whether these models possess reasoning capabilities similar to humans. However, despite these successes, the…

Computation and Language · Computer Science 2024-08-07 Philipp Mondorf , Barbara Plank

Pre-trained Language Models (PLMs) are trained on vast unlabeled data, rich in world knowledge. This fact has sparked the interest of the community in quantifying the amount of factual knowledge present in PLMs, as this explains their…

Computation and Language · Computer Science 2023-12-06 Paul Youssef , Osman Alperen Koraş , Meijie Li , Jörg Schlötterer , Christin Seifert

Large Language Models (LLMs) excel in handling general knowledge tasks, yet they struggle with user-specific personalization, such as understanding individual emotions, writing styles, and preferences. Personalized Large Language Models…

Artificial Intelligence · Computer Science 2025-09-23 Jiahong Liu , Zexuan Qiu , Zhongyang Li , Quanyu Dai , Wenhao Yu , Jieming Zhu , Minda Hu , Menglin Yang , Tat-Seng Chua , Irwin King

Deploying Large Language Models (LLMs) for question answering (QA) over lengthy contexts is a significant challenge. In industrial settings, this process is often hindered by high computational costs and latency, especially when multiple…

Computation and Language · Computer Science 2025-09-29 Xiliang Zhu , Shi Zong , David Rossouw

This study explores the use of Large Language Models (LLMs) to analyze text comments from Reddit users, aiming to achieve two primary objectives: firstly, to pinpoint critical excerpts that support a predefined psychological assessment of…

Computation and Language · Computer Science 2024-02-07 Sergi Blanco-Cuaresma

The capabilities of large language models (LLMs) have raised concerns about their potential to create and propagate convincing narratives. Here, we study their performance in detecting convincing arguments to gain insights into LLMs'…

Computation and Language · Computer Science 2024-10-07 Paula Rescala , Manoel Horta Ribeiro , Tiancheng Hu , Robert West

Policy researchers need scalable ways to surface public views, yet they often rely on interviews, listening sessions, and surveys-analyzed thematically-that are slow, expensive, and limited in scale and diversity. LLMs offer new…

Human-Computer Interaction · Computer Science 2026-04-08 Yuhan Liu , Shuyao Zhou , Jakob Kaiser , Ella Colby , Jennifer Okwara , Maggie Wang , Varun Nagaraj Rao , Andrés Monroy-Hernández

Large Language Models (LLMs) have made significant progress in reasoning, demonstrating their capability to generate human-like responses. This study analyzes the problem-solving capabilities of LLMs in the domain of thermodynamics. A…

Computational Engineering, Finance, and Science · Computer Science 2025-12-18 Rebecca Loubet , Pascal Zittlau , Luisa Vollmer , Marco Hoffmann , Sophie Fellenz , Fabian Jirasek , Heike Leitte , Hans Hasse

Creating human-like large language model (LLM) agents is crucial for faithful social simulation. Having LLMs role-play based on demographic information sometimes improves human likeness but often does not. This study assessed whether LLM…

Computation and Language · Computer Science 2024-10-17 Yun-Shiuan Chuang , Krirk Nirunwiroj , Zach Studdiford , Agam Goyal , Vincent V. Frigo , Sijia Yang , Dhavan Shah , Junjie Hu , Timothy T. Rogers