English
Related papers

Related papers: UNO Arena for Evaluating Sequential Decision-Makin…

200 papers

Large language models (LLMs) are increasingly embedded in AI-based tutoring systems. Can they faithfully model novice reasoning and metacognitive judgments? Existing evaluations emphasize problem-solving accuracy, overlooking the fragmented…

Computation and Language · Computer Science 2026-05-12 Conrad Borchers , Jill-Jênn Vie , Roger Azevedo

Large language models (LLMs) with billions of parameters exhibit in-context learning abilities, enabling few-shot learning on tasks that the model was not specifically trained for. Traditional models achieve breakthrough performance on…

Artificial Intelligence · Computer Science 2025-11-04 Aske Plaat , Annie Wong , Suzan Verberne , Joost Broekens , Niki van Stein , Thomas Back

Large Language Models (LLMs) have achieved strong performance on static reasoning benchmarks, yet their effectiveness as interactive agents operating in adversarial, time-sensitive environments remains poorly understood. Existing…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Yang Li , Xing Chen , Yutao Liu , Gege Qi , Yanxian BI , Zizhe Wang , Yunjian Zhang , Yao Zhu

This paper introduces a new paradigm for AI game programming, leveraging large language models (LLMs) to extend and operationalize Claude Shannon's taxonomy of game-playing machines. Central to this paradigm is Nemobot, an interactive…

Artificial Intelligence · Computer Science 2026-04-24 Chee Wei Tan , Yuchen Wang , Shangxin Guo

While large language models (LLMs) have shown strong performance in math and logic reasoning, their ability to handle combinatorial optimization (CO) -- searching high-dimensional solution spaces under hard constraints -- remains…

Artificial Intelligence · Computer Science 2026-04-13 Xia Jiang , Jing Chen , Cong Zhang , Jie Gao , Chengpeng Hu , Chenhao Zhang , Yaoxin Wu , Yingqian Zhang

Large Language Models (LLMs) are increasingly deployed in real-world applications that demand complex reasoning. To track progress, robust benchmarks are required to evaluate their capabilities beyond superficial pattern recognition.…

Computation and Language · Computer Science 2025-06-03 Wenye Lin , Jonathan Roberts , Yunhan Yang , Samuel Albanie , Zongqing Lu , Kai Han

This paper presents a comprehensive survey of the current status and opportunities for Large Language Models (LLMs) in strategic reasoning, a sophisticated form of reasoning that necessitates understanding and predicting adversary actions…

Computation and Language · Computer Science 2024-04-02 Yadong Zhang , Shaoguang Mao , Tao Ge , Xun Wang , Adrian de Wynter , Yan Xia , Wenshan Wu , Ting Song , Man Lan , Furu Wei

This paper investigates the strategic decision-making capabilities of three Large Language Models (LLMs): GPT-3.5, GPT-4, and LLaMa-2, within the framework of game theory. Utilizing four canonical two-player games -- Prisoner's Dilemma,…

Computer Science and Game Theory · Computer Science 2023-09-13 Nunzio Lorè , Babak Heydari

Evaluation has traditionally focused on ranking candidates for a specific skill. Modern generalist models, such as Large Language Models (LLMs), decidedly outpace this paradigm. Open-ended evaluation systems, where candidate models are…

Computer Science and Game Theory · Computer Science 2025-05-09 Siqi Liu , Ian Gemp , Luke Marris , Georgios Piliouras , Nicolas Heess , Marc Lanctot

Wargames are simulations of conflicts in which participants' decisions influence future events. While casual wargaming can be used for entertainment or socialization, serious wargaming is used by experts to explore strategic implications of…

Artificial Intelligence · Computer Science 2025-10-24 Glenn Matlin , Parv Mahajan , Isaac Song , Yixiong Hao , Ryan Bard , Stu Topp , Evan Montoya , M. Rehan Parwani , Soham Shetty , Mark Riedl

Large language models (LLMs) increasingly serve as interactive social agents, yet their ability to maintain coherent and authentic persona-level role-playing remains limited, particularly in realistic social scenarios. Existing research…

Artificial Intelligence · Computer Science 2026-05-19 Wenlong Shi , Jianxun Lian , Mingqi Wu , Haiming Qin , Mingyang Zhou , Xing Xie , Naipeng Chao , Hao Liao

This paper investigates the capabilities of large language models (LLMs) in formulating and solving decision-making problems using mathematical programming. We first conduct a systematic review and meta-analysis of recent literature to…

Artificial Intelligence · Computer Science 2025-08-26 Mohammad J. Abdel-Rahman , Yasmeen Alslman , Dania Refai , Amro Saleh , Malik A. Abu Loha , Mohammad Yahya Hamed

The task of long-term action anticipation demands solutions that can effectively model temporal dynamics over extended periods while deeply understanding the inherent semantics of actions. Traditional approaches, which primarily rely on…

Computer Vision and Pattern Recognition · Computer Science 2025-01-03 Binglu Wang , Yao Tian , Shunzhou Wang , Le Yang

This pilot study explores the application of language models (LMs) to model game event sequences, treating them as a customized natural language. We investigate a popular mobile game, transforming raw event data into textual sequences and…

Large Language Models (LLMs) have demonstrated remarkable capabilities in comprehending and analyzing lengthy sequential inputs, owing to their extensive context windows that allow processing millions of tokens in a single forward pass.…

Computation and Language · Computer Science 2024-12-23 Peyman Hosseini , Ignacio Castro , Iacopo Ghinassi , Matthew Purver

The emergence of large language models (LLMs) has substantially influenced natural language processing, demonstrating exceptional results across various tasks. In this study, we employ ``Introspective Tips" to facilitate LLMs in…

Artificial Intelligence · Computer Science 2023-05-22 Liting Chen , Lu Wang , Hang Dong , Yali Du , Jie Yan , Fangkai Yang , Shuang Li , Pu Zhao , Si Qin , Saravan Rajmohan , Qingwei Lin , Dongmei Zhang

A burgeoning area within reinforcement learning (RL) is the design of sequential decision-making agents centered around large language models (LLMs). While autonomous decision-making agents powered by modern LLMs could facilitate numerous…

Machine Learning · Computer Science 2026-02-10 Dilip Arumugam , Thomas L. Griffiths

Large Language Models (LLMs) exhibit robust problem-solving capabilities for diverse tasks. However, most LLM-based agents are designed as specific task solvers with sophisticated prompt engineering, rather than agents capable of learning…

Artificial Intelligence · Computer Science 2024-06-10 Wenqi Zhang , Ke Tang , Hai Wu , Mengna Wang , Yongliang Shen , Guiyang Hou , Zeqi Tan , Peng Li , Yueting Zhuang , Weiming Lu

The rapid evolution of large language models (LLMs) holds promise for reforming the methodology of spatio-temporal data mining. However, current works for evaluating the spatio-temporal understanding capability of LLMs are somewhat limited…

Computation and Language · Computer Science 2024-06-28 Wenbin Li , Di Yao , Ruibo Zhao , Wenjie Chen , Zijie Xu , Chengxue Luo , Chang Gong , Quanliang Jing , Haining Tan , Jingping Bi

Deep Reinforcement Learning (RL) involves the use of Deep Neural Networks (DNNs) to make sequential decisions in order to maximize reward. For many tasks the resulting sequence of actions produced by a Deep RL policy can be long and…

Artificial Intelligence · Computer Science 2022-07-26 Sam Blakeman , Denis Mareschal