English
Related papers

Related papers: Behavioral Consistency Validation for LLM Agents: …

200 papers

It is crucial to explore the impact of different teaching methods on student learning in educational research. However, real-person experiments face significant ethical constraints, and we cannot conduct repeated teaching experiments on the…

Multiagent Systems · Computer Science 2026-03-24 Bushi Xiao , Qian Shen

Large language models (LLMs) are increasingly deployed in agentic and multi-turn workflows where they are tasked to perform actions of significant consequence. In order to deploy them reliably and manage risky outcomes in these settings, it…

Machine Learning · Computer Science 2026-02-10 Arka Pal , Teo Kitanovski , Arthur Liang , Akilesh Potti , Micah Goldblum

Large language models (LLMs) have demonstrated remarkable capabilities in natural language tasks, yet their performance in dynamic, real-world financial environments remains underexplored. Existing approaches are limited to historical…

Machine Learning · Computer Science 2025-09-03 Tianmi Ma , Jiawei Du , Wenxin Huang , Wenjie Wang , Liang Xie , Xian Zhong , Joey Tianyi Zhou

The rapid advancement of Large Language Models (LLMs) has led to a surge of financial benchmarks, evolving from static knowledge evaluation toward interactive trading simulations. However, existing frameworks for evaluating real-time…

Trading and Market Microstructure · Quantitative Finance 2026-05-28 Wentao Zhang , Mingxuan Zhao , Jincheng Gao , Jieshun You , Huaiyu Jia , Yilei Zhao , Bo An , Shuo Sun

In this study, we propose LLM agents as a novel approach in behavioral strategy research, complementing simulations and laboratory experiments to advance our understanding of cognitive processes in decision-making. Specifically, we…

General Economics · Economics 2024-10-10 Daniel Albert , Stephan Billinger

Large language models (LLMs) demonstrate strong potential as autonomous agents, with promising capabilities in reasoning, tool use, and sequential decision-making. While prior benchmarks have evaluated LLM agents in various domains, the…

Machine Learning · Computer Science 2026-03-03 Yanxu Chen , Zijun Yao , Yantao Liu , Amy Xin , Jin Ye , Jianing Yu , Lei Hou , Juanzi Li

Large Language Models (LLMs) are increasingly used in decision-making scenarios that involve risk assessment, yet their alignment with human economic rationality remains unclear. In this study, we investigate whether LLMs exhibit risk…

General Economics · Economics 2025-09-16 Jiaxin Liu , Yixuan Tang , Yi Yang , Kar Yan Tam

Large Language Models (LLMs) have been employed in financial decision making, enhancing analytical capabilities for investment strategies. Traditional investment strategies often utilize quantitative models, fundamental analysis, and…

General Finance · Quantitative Finance 2025-07-04 Sedigheh Mahdavi , Jiating , Chen , Pradeep Kumar Joshi , Lina Huertas Guativa , Upmanyu Singh

As AI systems advance in capabilities, measuring their safety and alignment to human values is becoming paramount. A fast-growing field of AI research is devoted to developing such assessments. However, most current advances therein may be…

Computers and Society · Computer Science 2026-03-17 Max Hellrigel-Holderbaum , Edward James Young

The reproduction of realistic dynamics in financial markets is of great significance, as it enhances our understanding of market evolution beyond other physical processes, and facilitates the development and backtesting of investment…

Multiagent Systems · Computer Science 2025-10-14 Tianlang He , Fengming Zhu , Keyan Lu , Chang Xu , Yang Liu , Weiqing Liu , Fangzhen Lin , S. -H. Gary Chan , Jiang Bian

Aligning Large Language Models (LLMs) with investor decision-making processes under herd behavior is a critical challenge in behavioral finance, which grapples with a fundamental limitation: the scarcity of real-user data needed for…

Computation and Language · Computer Science 2025-07-10 Huisheng Wang , Zhuoshi Pan , Hangjing Zhang , Mingxiao Liu , Hanqing Gao , H. Vicky Zhao

Student simulation with Large language models (LLMs) offers a scalable alternative for educational research and teacher training. Yet, its validity depends on whether models maintain stable personas across extended interactions. We test…

Human-Computer Interaction · Computer Science 2026-05-25 Jana Gonnermann-Müller , Jennifer Haase , Nicolas Leins , Thomas Kosch , Sebastian Pokutta

Large Language Models (LLMs) have increasingly been utilized in social simulations, where they are often guided by carefully crafted instructions to stably exhibit human-like behaviors during simulations. Nevertheless, we doubt the…

Artificial Intelligence · Computer Science 2024-10-29 Zengqing Wu , Run Peng , Shuyuan Zheng , Qianying Liu , Xu Han , Brian Inhyuk Kwon , Makoto Onizuka , Shaojie Tang , Chuan Xiao

Large language model (LLM) simulations of human behavior have the potential to revolutionize the social and behavioral sciences, if and only if they faithfully reflect real human behaviors. Current evaluations of simulation fidelity are…

Computation and Language · Computer Science 2026-04-14 Tiancheng Hu , Joachim Baumann , Lorenzo Lupo , Nigel Collier , Dirk Hovy , Paul Röttger

There is ongoing debate about whether large language models (LLMs) can serve as substitutes for human participants in survey and experimental research. While recent work in fields such as marketing and psychology has explored the potential…

Computation and Language · Computer Science 2025-12-30 Steven Wang , Kyle Hunt , Shaojie Tang , Kenneth Joseph

Personality traits have long been studied as predictors of human behavior. Recent advances in Large Language Models (LLMs) suggest similar patterns may emerge in artificial systems, with advanced LLMs displaying consistent behavioral…

Artificial Intelligence · Computer Science 2025-09-08 Pengrui Han , Rafal Kocielnik , Peiyang Song , Ramit Debnath , Dean Mobbs , Anima Anandkumar , R. Michael Alvarez

Financial sentiment analysis is crucial for trading and investment decision-making. This study introduces an adaptive retrieval augmented framework for Large Language Models (LLMs) that aligns with human instructions through Instruction…

Computational Engineering, Finance, and Science · Computer Science 2024-10-22 Zijie Zhao , Roy E. Welsch

As AI agents increasingly act on behalf of human stakeholders in economic settings, understanding their behavior in complex market environments becomes critical. This article examines how Large Language Models coordinate on markets that are…

General Economics · Economics 2026-03-11 Alexander Erlei , Lukas Meub

Value alignment is central to the development of safe and socially compatible artificial intelligence. However, how Large Language Models (LLMs) represent and enact human values in real-world decision contexts remains under-explored. We…

Computation and Language · Computer Science 2026-01-14 Jen-tse Huang , Jiantong Qin , Xueli Qiu , Sharon Levy , Michelle R. Kaufman , Mark Dredze

Significant progress has been made in automated problem-solving using societies of agents powered by large language models (LLMs). In finance, efforts have largely focused on single-agent systems handling specific tasks or multi-agent…

Trading and Market Microstructure · Quantitative Finance 2025-06-04 Yijia Xiao , Edward Sun , Di Luo , Wei Wang