English
Related papers

Related papers: Large Language Model Prediction Capabilities: Evid…

200 papers

Large Language Models (LLMs) such as OpenAI's GPT-4 and Meta's LLaMA offer a promising approach for scalable personality assessment from open-ended language. However, inferring personality traits remains challenging, and earlier work often…

Computation and Language · Computer Science 2025-07-22 Jianfeng Zhu , Ruoming Jin , Karin G. Coifman

As Large Language Models (LLMs) are integrated into critical real-world applications, their strategic and logical reasoning abilities are increasingly crucial. This paper evaluates LLMs' reasoning abilities in competitive environments…

Computation and Language · Computer Science 2024-06-11 Jinhao Duan , Renming Zhang , James Diffenderfer , Bhavya Kailkhura , Lichao Sun , Elias Stengel-Eskin , Mohit Bansal , Tianlong Chen , Kaidi Xu

Recently, large language models (LLMs), particularly GPT-4, have demonstrated significant capabilities in various planning and reasoning tasks \cite{cheng2023gpt4,bubeck2023sparks}. Motivated by these advancements, there has been a surge of…

Artificial Intelligence · Computer Science 2023-09-21 Bingzhe Wu

Large language models (LLMs) have demonstrated their potential in social science research by emulating human perceptions and behaviors, a concept referred to as algorithmic fidelity. This study assesses the algorithmic fidelity and bias of…

Artificial Intelligence · Computer Science 2024-08-09 S. Lee , T. Q. Peng , M. H. Goldberg , S. A. Rosenthal , J. E. Kotcher , E. W. Maibach , A. Leiserowitz

Large language models (LLM) such as OpenAI's ChatGPT and GPT-3 offer unique testbeds for exploring the translation challenges of turning literacy into numeracy. Previous publicly-available transformer models from eighteen months prior and…

Computation and Language · Computer Science 2023-02-01 David Noever , Forrest McKee

Advances in deep learning systems have allowed large models to match or surpass human accuracy on a number of skills such as image classification, basic programming, and standardized test taking. As the performance of the most capable…

Machine Learning · Computer Science 2024-06-10 Sarah Pratt , Seth Blumberg , Pietro Kreitlon Carolino , Meredith Ringel Morris

Automated fact-checking, using machine learning to verify claims, has grown vital as misinformation spreads beyond human fact-checking capacity. Large Language Models (LLMs) like GPT-4 are increasingly trusted to write academic papers,…

Computation and Language · Computer Science 2024-02-08 Dorian Quelle , Alexandre Bovet

There is an increasing interest in leveraging Large Language Models (LLMs) for managing structured data and enhancing data science processes. Despite the potential benefits, this integration poses significant questions regarding their…

Artificial Intelligence · Computer Science 2023-11-21 Nathalia Nascimento , Cristina Tavares , Paulo Alencar , Donald Cowan

Structured deliberation has been found to improve the performance of human forecasters. This study investigates whether a similar intervention, i.e. allowing LLMs to review each other's forecasts before updating, can improve accuracy in…

Artificial Intelligence · Computer Science 2025-12-30 Paul Schneider , Amalie Schramm

Adversarial information operations can destabilize societies by undermining fair elections, manipulating public opinions on policies, and promoting scams. Despite their widespread occurrence and potential impacts, our understanding of…

Computation and Language · Computer Science 2024-05-07 Keith Burghardt , Kai Chen , Kristina Lerman

Artificial intelligence is making spectacular progress, and one of the best examples is the development of large language models (LLMs) such as OpenAI's GPT series. In these lectures, written for readers with a background in mathematics or…

Computation and Language · Computer Science 2023-10-09 Michael R. Douglas

Following the widespread adoption of ChatGPT in early 2023, numerous studies reported that large language models (LLMs) can match or even surpass human performance in creative tasks. However, it remains unclear whether LLMs have become more…

Computation and Language · Computer Science 2025-04-18 Jennifer Haase , Paul H. P. Hanel , Sebastian Pokutta

Large language models (LLMs) such as ChatGPT and GPT-4 have recently demonstrated their remarkable abilities of communicating with human users. In this technical report, we take an initiative to investigate their capacities of playing text…

Computation and Language · Computer Science 2025-04-01 Chen Feng Tsai , Xiaochen Zhou , Sierra S. Liu , Jing Li , Mo Yu , Hongyuan Mei

Forecasting future world events is a challenging but valuable task. Forecasts of climate, geopolitical conflict, pandemics and economic indicators help shape policy and decision making. In these domains, the judgment of expert humans…

Machine Learning · Computer Science 2022-10-11 Andy Zou , Tristan Xiao , Ryan Jia , Joe Kwon , Mantas Mazeika , Richard Li , Dawn Song , Jacob Steinhardt , Owain Evans , Dan Hendrycks

While large language models have made strides in natural language processing, their proficiency in complex reasoning tasks requiring formal language comprehension, such as chess, remains less investigated. This paper probes the performance…

Computation and Language · Computer Science 2023-08-30 Mu-Tien Kuo , Chih-Chung Hsueh , Richard Tzong-Han Tsai

Large Language Models (LLMs) have revolutionized the field of Natural Language Processing thanks to their ability to reuse knowledge acquired on massive text corpora on a wide variety of downstream tasks, with minimal (if any) tuning steps.…

Computation and Language · Computer Science 2024-07-12 Flavio Petruzzellis , Alberto Testolin , Alessandro Sperduti

This paper explores the cutting-edge Large Language Model with analytical reasoning on sports. Our analytical reasoning embodies the tasks of letting large language models count how many points each team scores in a quarter in the NBA and…

Computation and Language · Computer Science 2024-03-08 Yebowen Hu , Kaiqiang Song , Sangwoo Cho , Xiaoyang Wang , Hassan Foroosh , Dong Yu , Fei Liu

This paper presents a comprehensive survey of ChatGPT-related (GPT-3.5 and GPT-4) research, state-of-the-art large language models (LLM) from the GPT series, and their prospective applications across diverse domains. Indeed, key innovations…

Large Language Models (LLMs) have recently emerged as powerful tools for natural language generation, with applications spanning from content creation to social simulations. Their ability to mimic human interactions raises both…

Computation and Language · Computer Science 2025-06-30 Daniele Cirulli , Giulio Cimini , Giovanni Palermo

Large language models (LLMs), including OpenAI's GPT-series, have made significant advancements in recent years. Known for their expertise across diverse subject areas and quick adaptability to user-provided prompts, LLMs hold unique…

Human-Computer Interaction · Computer Science 2025-07-09 Michael Vaccaro , Mikayla Friday , Arash Zaghi