English
Related papers

Related papers: Predicting Field Experiments with Large Language M…

200 papers

Large Language Models (LLMs) trained on extensive textual corpora have emerged as leading solutions for a broad array of Natural Language Processing (NLP) tasks. Despite their notable performance, these models are prone to certain…

Computation and Language · Computer Science 2023-07-25 Yufei Wang , Wanjun Zhong , Liangyou Li , Fei Mi , Xingshan Zeng , Wenyong Huang , Lifeng Shang , Xin Jiang , Qun Liu

ChatGPT and other state-of-the-art large language models (LLMs) are rapidly transforming multiple fields, offering powerful tools for a wide range of applications. These models, commonly trained on vast datasets, exhibit human-like text…

The use of large language models (LLMs) for qualitative analysis is gaining attention in various fields, including software engineering, where qualitative methods are essential for understanding human and social factors. This study aimed to…

Software Engineering · Computer Science 2025-03-11 Matheus de Morais Leça , Lucas Valença , Reydne Santos , Ronnie de Souza Santos

Can Large Language Models (LLMs) accurately predict election outcomes? While LLMs have demonstrated impressive performance in various domains, including healthcare, legal analysis, and creative tasks, their ability to forecast elections…

Artificial Intelligence · Computer Science 2025-04-07 Chenxiao Yu , Zhaotian Weng , Yuangang Li , Zheng Li , Xiyang Hu , Yue Zhao

Large Language Models (LLMs) have shown powerful performance and development prospects and are widely deployed in the real world. However, LLMs can capture social biases from unprocessed training data and propagate the biases to downstream…

Computation and Language · Computer Science 2024-02-22 Yingji Li , Mengnan Du , Rui Song , Xin Wang , Ying Wang

This paper investigates the effectiveness of large language models (LLMs) in answering questions over datasets. We examine their performance in two scenarios: (a) directly answering questions given a dataset file as input, and (b)…

Computation and Language · Computer Science 2026-05-12 Andreas Xenofontos , Pavlos Fafalios

Machine learning can predict human behavior well when substantial structured data and well-defined outcomes are available, but these models are typically limited to specific outcomes and cannot readily be applied to new domains. We test…

This paper investigates Large Language Models (LLMs) ability to assess the economic soundness and theoretical consistency of empirical findings in spatial econometrics. We created original and deliberately altered "counterfactual" summaries…

Computers and Society · Computer Science 2025-06-10 Giuseppe Arbia , Luca Morandini , Vincenzo Nardelli

In recent years, large language models (LLMs) have attracted attention due to their ability to generate human-like text. As surveys and opinion polls remain key tools for gauging public attitudes, there is increasing interest in assessing…

General Economics · Economics 2025-02-12 Shapeng Jiang , Lijia Wei , Chen Zhang

Although most people support climate action, widespread underestimation of others' support stalls individual and systemic changes. In this preregistered experiment, we test whether large language models (LLMs) can reliably predict these…

Computers and Society · Computer Science 2026-01-29 Nattavudh Powdthavee , Sandra J. Geiger

Behavioral simulation is increasingly used to anticipate responses to interventions. Large language models (LLMs) enable researchers to specify population characteristics and intervention context in natural language, but it remains unclear…

Computers and Society · Computer Science 2026-04-14 Zonghan Li , Feng Ji

Large Language Models (LLMs) are transforming scholarly tasks like search and summarization, but their reliability remains uncertain. Current evaluation metrics for testing LLM reliability are primarily automated approaches that prioritize…

Human-Computer Interaction · Computer Science 2026-02-25 Anna Martin-Boyle , William Humphreys , Martha Brown , Cara Leckey , Harmanpreet Kaur

Large language models (LLMs) have recently been proposed as general-purpose agents for experimental design, with claims that they can perform in-context experimental design. We evaluate this hypothesis using both open- and closed-source…

Machine Learning · Computer Science 2025-09-29 Rushil Gupta , Jason Hartford , Bang Liu

Human models play a crucial role in human-robot interaction (HRI), enabling robots to consider the impact of their actions on people and plan their behavior accordingly. However, crafting good human models is challenging; capturing…

Robotics · Computer Science 2024-10-03 Bowen Zhang , Harold Soh

Large Language Models (LLMs) have achieved remarkable success across a wide array of tasks. Due to the impressive planning and reasoning abilities of LLMs, they have been used as autonomous agents to do many tasks automatically. Recently,…

Computation and Language · Computer Science 2024-04-22 Taicheng Guo , Xiuying Chen , Yaqi Wang , Ruidi Chang , Shichao Pei , Nitesh V. Chawla , Olaf Wiest , Xiangliang Zhang

Large language models (LLMs) are increasingly used for persuasion, such as in political communication and marketing, where they affect how people think, choose, and act. Yet, empirical findings on the effectiveness of LLMs in persuasion…

Human-Computer Interaction · Computer Science 2025-12-02 Lukas Hölbling , Sebastian Maier , Stefan Feuerriegel

Large Language Models (LLMs) have demonstrated their remarkable capabilities in numerous fields. This survey focuses on how LLMs empower users, regardless of their technical background, to use human languages to automatically generate…

Software Engineering · Computer Science 2025-04-03 Nam Huynh , Beiyu Lin

The impressive performance of large language models (LLMs) has led to their consideration as models of human language processing. Instead, we suggest that the success of LLMs arises from the flexibility of the transformer learning…

Computation and Language · Computer Science 2024-11-19 Xiaoliang Luo , Michael Ramscar , Bradley C. Love

Pre-trained large language models (LLMs) have recently emerged as a breakthrough technology in natural language processing and artificial intelligence, with the ability to handle large-scale datasets and exhibit remarkable performance…

Software Engineering · Computer Science 2024-03-05 Junjie Wang , Yuchao Huang , Chunyang Chen , Zhe Liu , Song Wang , Qing Wang

Large language models (LLMs) are transforming research on machine learning while galvanizing public debates. Understanding not only when these models work well and succeed but also why they fail and misbehave is of great societal relevance.…

Computation and Language · Computer Science 2024-10-16 Julian Coda-Forno , Kristin Witte , Akshay K. Jagadish , Marcel Binz , Zeynep Akata , Eric Schulz