中文
相关论文

相关论文: Behavioral Consistency Validation for LLM Agents: …

200 篇论文

Large language models (LLMs) are increasingly proposed as agents in strategic decision environments, yet their behavior in structured geopolitical simulations remains under-researched. We evaluate six popular state-of-the-art LLMs alongside…

计算与语言 · 计算机科学 2026-03-03 Veronika Solopova , Viktoria Skorik , Maksym Tereshchenko , Alina Haidun , Ostap Vykhopen

Large Language Models (LLMs) are increasingly being used to simulate human-like decision making in agent-based financial market models (ABMs). As models become more powerful and accessible, researchers can now incorporate individual LLM…

机器学习 · 计算机科学 2025-01-29 Alicia Vidler , Toby Walsh

We explore the potential of Large Language Models (LLMs) to replicate human behavior in economic market experiments. Compared to previous studies, we focus on dynamic feedback between LLM agents: the decisions of each LLM impact the market…

综合经济学 · 经济学 2025-05-13 R. Maria del Rio-Chanona , Marco Pangallo , Cars Hommes

When large language models (LLMs) are asked to perform certain tasks, how can we be sure that their learned representations align with reality? We propose a domain-agnostic framework for systematically evaluating distribution shifts in LLMs…

计算与语言 · 计算机科学 2024-10-01 Tanush Chopra , Michael Li , Jacob Haimes

Run the same LLM agent on the same task twice: do you get the same behavior? We find the answer is often no. In a study of 3,000 agent runs across three models (Llama 3.1 70B, GPT-4o, and Claude Sonnet 4.5) on HotpotQA, we observe that…

人工智能 · 计算机科学 2026-02-13 Aman Mehta

As large language models (LLMs) increasingly act as autonomous agents in markets and organizations, their behavior in strategic environments becomes economically consequential. We document that off-the-shelf LLM agents exhibit systematic…

综合经济学 · 经济学 2026-03-16 Wei Lu , Amit Dhanda , Daniel L. Chen , Christian B. Hansen

Trading is a highly competitive task that requires a combination of strategy, knowledge, and psychological fortitude. With the recent success of large language models(LLMs), it is appealing to apply the emerging intelligence of LLM agents…

交易与市场微观结构 · 定量金融 2026-03-03 Han Ding , Yinheng Li , Junhao Wang , Hang Chen , Doudou Guo , Yunbai Zhang

Given the increased use of LLMs in financial systems today, it becomes important to evaluate the safety and robustness of such systems. One failure mode that LLMs frequently display in general domain settings is that of sycophancy. That is,…

人工智能 · 计算机科学 2026-04-30 Zhenyu Zhao , Aparna Balagopalan , Adi Agrawal , Dilshoda Yergasheva , Waseem Alshikh , Daniel M. Bikel

As large language models (LLMs) are increasingly deployed as autonomous agents, understanding how strategic behavior emerges in multi-agent environments has become an important alignment challenge. We take a neutral empirical stance and…

Large Language Models (LLMs) are evolving into autonomous trading agents, yet existing benchmarks often overlook the interplay between architectural reasoning and strategy consistency. We propose Strat-LLM, a framework grounded in…

人工智能 · 计算机科学 2026-05-08 Wenliang Huang , Zengyi Yu

As Large Language Models (LLMs) increasingly operate as autonomous decision-makers in interactive and multi-agent systems and human societies, understanding their strategic behaviour has profound implications for safety, coordination, and…

Can large language model (LLM) agents reproduce the complex social dynamics that characterize human online behavior -- shaped by homophily, reciprocity, and social validation -- and what memory and learning mechanisms enable such dynamics…

人工智能 · 计算机科学 2025-10-23 Philipp J. Schneider , Lin Tian , Marian-Andrei Rizoiu

With the rapid advancement of Large Language Models (LLMs), recent studies have drawn attention to their potential for handling not only simple question-answer tasks but also more complex conversational abilities and performing human-like…

人工智能 · 计算机科学 2025-11-25 Mingyu Jeon , Jaeyoung Suh , Suwan Cho , Dohyeon Kim

Large Language Models (LLMs) are increasingly deployed in socially complex, interaction-driven tasks, yet their ability to mirror human behavior in emotionally and strategically complex contexts remains underexplored. This study assesses…

计算与语言 · 计算机科学 2025-09-23 Deuksin Kwon , Kaleen Shrestha , Bin Han , Elena Hayoung Lee , Gale Lucas

We study behavioral alignment and representation dynamics of large language model (LLM) agents in financial decision environments. Using TradeArena, an auditable trading-agent testbed with risk reports, execution simulation, memory, and…

机器学习 · 计算机科学 2026-05-29 Weicheng Xue

The emergence of Large Language Models (LLMs), has opened exciting possibilities for constructing computational simulations designed to replicate human behavior accurately. Current research suggests that LLM-based agents become increasingly…

计算与语言 · 计算机科学 2024-12-18 Amir Taubenfeld , Yaniv Dover , Roi Reichart , Ariel Goldstein

Most economic theories typically assume that financial market participants are fully rational individuals and use mathematical models to simulate human behavior in financial markets. However, human behavior is often not entirely rational…

计算与语言 · 计算机科学 2024-07-01 Shen Gao , Yuntao Wen , Minghang Zhu , Jianing Wei , Yuhan Cheng , Qunzi Zhang , Shuo Shang

Can AI Agents simulate real-world trading environments to investigate the impact of external factors on stock trading activities (e.g., macroeconomics, policy changes, company fundamentals, and global events)? These factors, which…

交易与市场微观结构 · 定量金融 2024-09-24 Chong Zhang , Xinyi Liu , Zhongmou Zhang , Mingyu Jin , Lingyao Li , Zhenting Wang , Wenyue Hua , Dong Shu , Suiyuan Zhu , Xiaobo Jin , Sujian Li , Mengnan Du , Yongfeng Zhang

When creating policies, plans, or designs for people, it is challenging for designers to foresee all of the ways in which people may reason and behave. Recently, Large Language Models (LLMs) have been shown to be able to simulate human…

人机交互 · 计算机科学 2024-07-03 Karthik Sreedhar , Lydia Chilton

Large Language Models (LLMs) have demonstrated great potential in Conversational Recommender Systems (CRS). However, the application of LLMs to CRS has exposed a notable discrepancy in behavior between LLM-based CRS and human recommenders:…

信息检索 · 计算机科学 2024-10-21 Dayu Yang , Fumian Chen , Hui Fang