English
Related papers

Related papers: Cattle Trade: A Multi-Agent Benchmark for LLM Bluf…

200 papers

Large language models (LLMs) are reshaping automated fact-checking (AFC) by enabling unified, end-to-end verification pipelines rather than isolated components. While large proprietary models achieve strong performance, their closed…

Computation and Language · Computer Science 2026-01-19 Malin Astrid Larsson , Harald Fosen Grunnaleite , Vinay Setty

Powered by large language models (LLMs), AI agents have become capable of many human tasks. Using the most canonical definitions of the Big Five personality, we measure the ability of LLMs to negotiate within a game-theoretical framework,…

Computation and Language · Computer Science 2024-05-10 Sean Noh , Ho-Chun Herbert Chang

Competitive debate is a complex task of computational argumentation. Large Language Models (LLMs) suffer from hallucinations and lack competitiveness in this field. To address these challenges, we introduce Agent for Debate (Agent4Debate),…

Computation and Language · Computer Science 2024-08-21 Yiqun Zhang , Xiaocui Yang , Shi Feng , Daling Wang , Yifei Zhang , Kaisong Song

As AI agents become increasingly capable of tool use and long-horizon tasks, they have begun to be deployed in settings where multiple agents can interact. However, whereas prior work has mostly focused on human-AI interactions, there is an…

Artificial Intelligence · Computer Science 2025-08-27 Olivia Long , Carter Teplica

Large language models (LLMs) have been widely used as agents to complete different tasks, such as personal assistance or event planning. While most of the work has focused on cooperation and collaboration between agents, little work…

Artificial Intelligence · Computer Science 2024-06-10 Qinlin Zhao , Jindong Wang , Yixuan Zhang , Yiqiao Jin , Kaijie Zhu , Hao Chen , Xing Xie

Large language models (LLMs) have shown remarkable performance across diverse reasoning and generation tasks, and are increasingly deployed as agents in dynamic environments such as code generation and recommendation systems. However, many…

Machine Learning · Computer Science 2025-05-27 Hao Kang , Qingru Zhang , Han Cai , Weiyuan Xu , Tushar Krishna , Yilun Du , Tsachy Weissman

Multi-agent systems have evolved into practical LLM-driven collaborators for many applications, gaining robustness from diversity and cross-checking. However, multi-agent RL (MARL) training is resource-intensive and unstable: co-adapting…

Evaluating AI agents in finance faces two key challenges: static benchmarks require costly expert annotation yet miss the dynamic decision-making central to real-world trading, while LLM-based judges introduce uncontrolled variance on…

Artificial Intelligence · Computer Science 2026-03-03 Xiaochuang Yuan , Hui Xu , Silvia Xu , Cui Zou , Jing Xiong

As LLMs increasingly act as autonomous agents in interactive and multi-agent settings, understanding their strategic behavior is critical for safety, coordination, and AI-driven social and economic systems. We investigate how payoff…

Safety evaluation of large language models (LLMs) increasingly relies on LLM-as-a-judge pipelines, but strong judges can still be expensive to use at scale. We study whether structured multi-agent debate can improve judge reliability while…

Artificial Intelligence · Computer Science 2026-03-19 Dachuan Lin , Guobin Shen , Zihao Yang , Tianrong Liu , Dongcheng Zhao , Yi Zeng

Large language models (LLMs) achieve strong performance across benchmarks--from knowledge quizzes and math reasoning to web-agent tasks--but these tests occur in static settings, lacking real dynamics and uncertainty. Consequently, they…

Trading and Market Microstructure · Quantitative Finance 2025-11-06 Haofei Yu , Fenghai Li , Jiaxuan You

It has been established in recent work that Large Language Models (LLMs) can be prompted to "self-play" conversational games that probe certain capabilities (general instruction following, strategic goal orientation, language understanding…

Computation and Language · Computer Science 2024-06-03 Anne Beyer , Kranti Chalamalasetti , Sherzod Hakimov , Brielen Madureira , Philipp Sadler , David Schlangen

In recent years, Large Language Models (LLMs) have demonstrated remarkable capabilities across diverse NLP tasks. Extensive research has explored how to enhance the logical reasoning abilities such as Chain-of-Thought, Chain-of-Thought with…

Computation and Language · Computer Science 2025-12-29 Tongxuan Liu , Xingyu Wang , Weizhe Huang , Wenjiang Xu , Yuting Zeng , Lei Jiang , Hailong Yang , Jing Li

As LLM agents tackle increasingly complex tasks, a critical question is whether they can maintain strategic coherence over long horizons: planning under uncertainty, learning from delayed feedback, and adapting when early mistakes compound.…

Computation and Language · Computer Science 2026-04-02 Muyu He , Adit Jain , Anand Kumar , Vincent Tu , Soumyadeep Bakshi , Sachin Patro , Nazneen Rajani

The financial domain poses substantial challenges for vision-language models (VLMs) due to specialized chart formats and knowledge-intensive reasoning requirements. However, existing financial benchmarks are largely single-turn and rely on…

Computer Vision and Pattern Recognition · Computer Science 2026-02-04 Chenxi Zhang , Ziliang Gan , Liyun Zhu , Youwei Pang , Qing Zhang , Rongjunchen Zhang

We consider the problem of incentivising desirable behaviours in multi-agent systems by way of taxation schemes. Our study employs the concurrent games model: in this model, each agent is primarily motivated to seek the satisfaction of a…

Computer Science and Game Theory · Computer Science 2023-07-12 David Hyland , Julian Gutierrez , Michael Wooldridge

This paper presents PolySwarm, a novel multi-agent large language model (LLM) framework designed for real-time prediction market trading and latency arbitrage on decentralized platforms such as Polymarket. PolySwarm deploys a swarm of 50…

Artificial Intelligence · Computer Science 2026-04-07 Rajat M. Barot , Arjun S. Borkhatariya

In this paper, our objective is to develop a multi-agent financial system that incorporates simulated trading, a technique extensively utilized by financial professionals. While current LLM-based agent models demonstrate competitive…

Artificial Intelligence · Computer Science 2025-10-07 Xiangyu Li , Yawen Zeng , Xiaofen Xing , Jin Xu , Xiangmin Xu

Multi-modal large language models (MLMs) are often assessed on static, individual benchmarks -- which cannot jointly assess MLM capabilities in a single task -- or rely on human or model pairwise comparisons -- which is highly subjective,…

Computation and Language · Computer Science 2025-10-24 Nishant Balepur , Dang Nguyen , Dayeon Ki

Game-theoretic scenarios have become pivotal in evaluating the social intelligence of Large Language Model (LLM)-based social agents. While numerous studies have explored these agents in such settings, there is a lack of a comprehensive…

Computation and Language · Computer Science 2025-07-22 Xiachong Feng , Longxu Dou , Ella Li , Qinghao Wang , Haochuan Wang , Yu Guo , Chang Ma , Lingpeng Kong