English
Related papers

Related papers: Exploring the Sensitivity of LLMs' Decision-Making…

200 papers

Large language models (LLMs) are being widely applied across various fields, but as tasks become more complex, evaluating their responses is increasingly challenging. Compared to human evaluators, the use of LLMs to support performance…

Artificial Intelligence · Computer Science 2025-04-25 Yuran Li , Jama Hussein Mohamud , Chongren Sun , Di Wu , Benoit Boulet

The performance of large language models (LLMs) has recently improved to the point where models can perform well on many language tasks. We show here that--for the first time--the models can also generate valid metalinguistic analyses of…

Computation and Language · Computer Science 2025-07-14 Gašper Beguš , Maksymilian Dąbkowski , Ryan Rhodes

In many real-world applications, large language models (LLMs) operate as independent agents without interaction, thereby limiting coordination. In this setting, we examine how prompt framing influences decisions in a threshold voting task…

Computation and Language · Computer Science 2026-04-08 Zice Wang , Zhenyu Zhang

Current benchmarks for evaluating Large Language Models (LLMs) often do not exhibit enough writing style diversity, with many adhering primarily to standardized conventions. Such benchmarks do not fully capture the rich variety of…

Computation and Language · Computer Science 2025-09-29 Kimberly Le Truong , Riccardo Fogliato , Hoda Heidari , Zhiwei Steven Wu

Large Language Models (LLMs) achieve impressive performance in a wide range of tasks, even if they are often trained with the only objective of chatting fluently with users. Among other skills, LLMs show emergent abilities in mathematical…

Computation and Language · Computer Science 2024-06-12 Flavio Petruzzellis , Alberto Testolin , Alessandro Sperduti

Serendipity-oriented recommender systems aim to counteract over-specialization in user preferences. However, evaluating a user's serendipitous response towards a recommended item can be challenging because of its emotional nature. In this…

Information Retrieval · Computer Science 2024-12-18 Yu Tokutake , Kazushi Okamoto

The output of large language models (LLMs) is unstable, due both to non-determinism of the decoding process as well as to prompt brittleness. While the intrinsic non-determinism of LLM generation may mimic existing uncertainty in human…

Computation and Language · Computer Science 2025-11-10 Jiahui Li , Sean Papay , Roman Klinger

Large Language Models (LLMs) are often misleadingly recognized as having a personality or a set of values. We argue that an LLM can be seen as a superposition of perspectives with different values and personality traits. LLMs exhibit…

Computation and Language · Computer Science 2023-11-08 Grgur Kovač , Masataka Sawayama , Rémy Portelas , Cédric Colas , Peter Ford Dominey , Pierre-Yves Oudeyer

The advent of large language models marks a revolutionary breakthrough in artificial intelligence. With the unprecedented scale of training and model parameters, the capability of large language models has been dramatically improved,…

Information Retrieval · Computer Science 2025-01-16 Jin Chen , Zheng Liu , Xu Huang , Chenwang Wu , Qi Liu , Gangwei Jiang , Yuanhao Pu , Yuxuan Lei , Xiaolong Chen , Xingmei Wang , Defu Lian , Enhong Chen

As Large Language Models (LLMs) are proposed as legal decision assistants, and even first-instance decision-makers, across a range of judicial and administrative contexts, it becomes essential to explore how they answer legal questions, and…

Artificial Intelligence · Computer Science 2026-04-30 Oisin Suttle , David Lillis

Large Language Models (LLMs) are increasingly deployed in autonomous decision-making roles across high-stakes domains. However, since models are trained on human-generated data, they may inherit cognitive biases that systematically distort…

Artificial Intelligence · Computer Science 2025-08-08 Emilio Barkett , Olivia Long , Paul Kröger

Large Language Models (LLMs) have transformed human-computer interaction by enabling natural language-based communication with AI-powered chatbots. These models are designed to be intuitive and user-friendly, allowing users to articulate…

Large Language Models (LLMs) have emerged as dominant foundational models in modern NLP. However, the understanding of their prediction processes and internal mechanisms, such as feed-forward networks (FFN) and multi-head self-attention…

Computation and Language · Computer Science 2024-04-16 Xintong Wang , Xiaoyu Li , Xingshan Li , Chris Biemann

Large language models (LLMs) are evolving fast and are now frequently used as evaluators, in a process typically referred to as LLM-as-a-Judge, which provides quality assessments of model outputs. However, recent research points out…

Computation and Language · Computer Science 2026-01-27 Hugo Silva , Mateus Mendes , Hugo Gonçalo Oliveira

Concerns with the safety and reliability of applying large-language models (LLMs) in unpredictable real-world applications motivate this study, which examines how task phrasing can lead to presumptions in LLMs, making it difficult for them…

Computation and Language · Computer Science 2026-05-04 Kenneth J. K. Ong

Stated preference (SP) surveys are a key method to research how individuals make trade-offs in hypothetical, also futuristic, scenarios. In energy context this includes key decarbonisation enablement contexts, such as low-carbon…

Computation and Language · Computer Science 2025-08-25 Han Wang , Jacek Pawlak , Aruna Sivakumar

Recent advancements in Large Language Models (LLMs) have demonstrated remarkable capabilities in various domains. However, effective decision-making relies heavily on strong reasoning abilities. Reasoning is the foundation for…

Computation and Language · Computer Science 2025-06-30 Dana Alsagheer , Yang Lu , Abdulrahman Kamal , Omar Kamal , Mohammad Kamal , Nada Mansour , Cosmo Yang Wu , Rambiba Karanjai , Sen Li , Weidong Shi

The capabilities of large language models (LLMs) have raised concerns about their potential to create and propagate convincing narratives. Here, we study their performance in detecting convincing arguments to gain insights into LLMs'…

Computation and Language · Computer Science 2024-10-07 Paula Rescala , Manoel Horta Ribeiro , Tiancheng Hu , Robert West

Large Language Models (LLMs) have emerged as powerful tools in various research domains. This article examines their potential through a literature review and firsthand experimentation. While LLMs offer benefits like cost-effectiveness and…

Human-Computer Interaction · Computer Science 2024-04-10 M. Namvarpour , A. Razi

In the present study, we investigate and compare reasoning in large language models (LLM) and humans using a selection of cognitive psychology tools traditionally dedicated to the study of (bounded) rationality. To do so, we presented to…

Computation and Language · Computer Science 2023-09-25 Nicolas Yax , Hernan Anlló , Stefano Palminteri