English
Related papers

Related papers: Open Models, Closed Minds? On Agents Capabilities …

200 papers

As Large Language Models (LLMs) are integrated with human daily applications rapidly, many societal and ethical concerns are raised regarding the behavior of LLMs. One of the ways to comprehend LLMs' behavior is to analyze their…

Computation and Language · Computer Science 2024-02-23 Xiaoyang Song , Yuta Adachi , Jessie Feng , Mouwei Lin , Linhao Yu , Frank Li , Akshat Gupta , Gopala Anumanchipalli , Simerjot Kaur

Large Language Models (LLMs) are increasingly used in everyday life and research. One of the most common use cases is conversational interactions, enabled by the language generation capabilities of LLMs. Just as between two humans, a…

Computation and Language · Computer Science 2024-11-12 Jingyao Zheng , Xian Wang , Simo Hosio , Xiaoxian Xu , Lik-Hang Lee

Large language models (LLMs) are now increasingly utilized for role-playing tasks, especially in impersonating domain-specific experts, primarily through role-playing prompts. When interacting in real-world scenarios, the decision-making…

Computation and Language · Computer Science 2024-03-01 Chenglei Shen , Guofu Xie , Xiao Zhang , Jun Xu

Have Large Language Models (LLMs) developed a personality? The short answer is a resounding "We Don't Know!". In this paper, we show that we do not yet have the right tools to measure personality in language models. Personality is an…

Computation and Language · Computer Science 2023-05-25 Xiaoyang Song , Akshat Gupta , Kiyan Mohebbizadeh , Shujie Hu , Anant Singh

Large Language Models (LLMs) such as OpenAI's GPT-4 and Meta's LLaMA offer a promising approach for scalable personality assessment from open-ended language. However, inferring personality traits remains challenging, and earlier work often…

Computation and Language · Computer Science 2025-07-22 Jianfeng Zhu , Ruoming Jin , Karin G. Coifman

Machine learning can predict human behavior well when substantial structured data and well-defined outcomes are available, but these models are typically limited to specific outcomes and cannot readily be applied to new domains. We test…

In this study, we propose LLM agents as a novel approach in behavioral strategy research, complementing simulations and laboratory experiments to advance our understanding of cognitive processes in decision-making. Specifically, we…

General Economics · Economics 2024-10-10 Daniel Albert , Stephan Billinger

Large Language Models (LLMs) demonstrate a remarkable capacity to adopt different personas and roles; however, it remains unclear whether they can manifest behavior that adheres to a coherent, human-like value structure. In this work, we…

Artificial Intelligence · Computer Science 2026-05-29 Asaf Yehudai , Naama Rozen , Ariel Gera

Large language models (LLMs) are increasingly explored as substitutes for human participants in cognitive tasks, but their ability to simulate human behavioral variability remains unclear. This study examines whether LLMs can approximate…

Computation and Language · Computer Science 2026-02-27 Mengyang Qiu , Zoe Brisebois , Siena Sun

Large Language Models (LLMs) have emerged as formidable instruments capable of comprehending and producing human-like text. This paper explores the potential of LLMs, to shape user perspectives and subsequently influence their decisions on…

Artificial Intelligence · Computer Science 2024-09-04 Ganesh Prasath Ramani , Shirish Karande , Santhosh V , Yash Bhatia

Psychological profiling of large language models (LLMs) using psychometric questionnaires designed for humans has become widespread. However, it remains unclear whether the resulting profiles mirror the models' psychological characteristics…

Computation and Language · Computer Science 2026-04-06 Woojung Song , Dongmin Choi , Yoonah Park , Jongwook Han , Yohan Jo

Recent advancements in Large Language Models (LLMs) have led to their adaptation in various domains as conversational agents. We wonder: can personality tests be applied to these agents to analyze their behavior, similar to humans? We…

Large Language Models have shown exceptional generative abilities in various natural language and generation tasks. However, possible anthropomorphization and leniency towards failure cases have propelled discussions on emergent abilities…

Robotics · Computer Science 2024-01-18 Mudit Verma , Siddhant Bhambri , Subbarao Kambhampati

Large language models (LLMs) are increasingly used to model human social behavior, with recent research exploring their ability to simulate social dynamics. Here, we test whether LLMs mirror human behavior in social dilemmas, where…

Social and Information Networks · Computer Science 2024-11-18 Jin Han , Balaraju Battu , Ivan Romić , Talal Rahwan , Petter Holme

Standardized and quantified evaluation of machine behaviors is a crux of understanding LLMs. In this study, we draw inspiration from psychometric studies by leveraging human personality theory as a tool for studying machine behaviors.…

Computation and Language · Computer Science 2023-10-31 Guangyuan Jiang , Manjie Xu , Song-Chun Zhu , Wenjuan Han , Chi Zhang , Yixin Zhu

Recent developments in large language models (LLMs) have unlocked new opportunities for healthcare, from information synthesis to clinical decision support. These new LLMs are not just capable of modeling language, but can also act as…

Human-Computer Interaction · Computer Science 2023-09-21 Nikita Mehandru , Brenda Y. Miao , Eduardo Rodriguez Almaraz , Madhumita Sushil , Atul J. Butte , Ahmed Alaa

This paper explores the advancements in making large language models (LLMs) more human-like. We focus on techniques that enhance natural language understanding, conversational coherence, and emotional intelligence in AI systems. The study…

Computation and Language · Computer Science 2026-02-03 Ethem Yağız Çalık , Talha Rüzgar Akkuş

Recent advances in Large Language Models (LLMs) have enabled multi-agent systems that simulate real-world interactions with near-human reasoning. While previous studies have extensively examined biases related to protected attributes such…

Artificial Intelligence · Computer Science 2025-06-03 Min Choi , Keonwoo Kim , Sungwon Chae , Sangyeob Baek

Large Language Models (LLMs) have emerged as dominant foundational models in modern NLP. However, the understanding of their prediction processes and internal mechanisms, such as feed-forward networks (FFN) and multi-head self-attention…

Computation and Language · Computer Science 2024-04-16 Xintong Wang , Xiaoyu Li , Xingshan Li , Chris Biemann

Human problem-solving is enriched by a diversity of styles and personality traits, yet the development of Large Language Models (LLMs) has largely prioritized uniform performance benchmarks that favour specific behavioural tendencies such…

Computation and Language · Computer Science 2026-03-09 Xi Wang , Mengdie Zhuang , Jiqun Liu