English
Related papers

Related papers: GVGAI-LLM: Evaluating Large Language Model Agents …

200 papers

Large Language Models (LLMs) are increasingly deployed in real-world applications that demand complex reasoning. To track progress, robust benchmarks are required to evaluate their capabilities beyond superficial pattern recognition.…

Computation and Language · Computer Science 2025-06-03 Wenye Lin , Jonathan Roberts , Yunhan Yang , Samuel Albanie , Zongqing Lu , Kai Han

The Game Reasoning Arena library provides a framework for evaluating the decision making abilities of large language models (LLMs) through strategic board games implemented in Google OpenSpiel library. The framework enables systematic…

Artificial Intelligence · Computer Science 2025-08-19 Lucia Cipolina-Kun , Marianna Nezhurina , Jenia Jitsev

Code large language models have demonstrated remarkable capabilities in programming tasks, yet current benchmarks primarily focus on single modality rather than visual game development. Most existing code-related benchmarks evaluate syntax…

Software Engineering · Computer Science 2025-09-25 Wei Zhang , Jack Yang , Renshuai Tao , Lingzheng Chai , Shawn Guo , Jiajun Wu , Xiaoming Chen , Ganqu Cui , Ning Ding , Xander Xu , Hu Wei , Bowen Zhou

Recent advancements in Multimodal Large Language Models (MLLMs) have demonstrated impressive capabilities in visual-text processing. However, existing static image-text benchmarks are insufficient for evaluating their dynamic perception and…

Computer Vision and Pattern Recognition · Computer Science 2026-04-27 Xiangxi Zheng , Linjie Li , Zhengyuan Yang , Ping Yu , Alex Jinpeng Wang , Rui Yan , Yuan Yao , Lijuan Wang

With video games now generating the highest revenues in the entertainment industry, optimizing game development workflows has become essential for the sector's sustained growth. Recent advancements in Vision-Language Models (VLMs) offer…

Computer Vision and Pattern Recognition · Computer Science 2025-12-22 Mohammad Reza Taesiri , Abhijay Ghildyal , Saman Zadtootaghaj , Nabajeet Barman , Cor-Paul Bezemer

Vision-Language(-Action) Models (VLMs) are increasingly applied to interactive environments, yet existing benchmarks often overlook the complex physical reasoning required for point-and-click puzzle games. This paper introduces…

Artificial Intelligence · Computer Science 2026-05-19 Maximilian Triebel , Marco Menner , Dominik Helfenstein

Vision-language models (VLMs) have achieved strong results on coding and math benchmarks that are challenging for humans, yet their ability to perform tasks that come naturally to humans--such as perception, spatial navigation, and memory…

Artificial Intelligence · Computer Science 2026-05-18 Alex L. Zhang , Thomas L. Griffiths , Karthik R. Narasimhan , Ofir Press

Video-based large language models (Video-LLMs) have been recently introduced, targeting both fundamental improvements in perception and comprehension, and a diverse range of user inquiries. In pursuit of the ultimate goal of achieving…

Computer Vision and Pattern Recognition · Computer Science 2023-11-29 Munan Ning , Bin Zhu , Yujia Xie , Bin Lin , Jiaxi Cui , Lu Yuan , Dongdong Chen , Li Yuan

Recent work has proposed a methodology for the systematic evaluation of "Situated Language Understanding Agents"-agents that operate in rich linguistic and non-linguistic contexts-through testing them in carefully constructed interactive…

Computation and Language · Computer Science 2023-11-27 Kranti Chalamalasetti , Jana Götze , Sherzod Hakimov , Brielen Madureira , Philipp Sadler , David Schlangen

With their prominent scene understanding and reasoning capabilities, pre-trained visual-language models (VLMs) such as GPT-4V have attracted increasing attention in robotic task planning. Compared with traditional task planning strategies,…

Robotics · Computer Science 2024-05-24 Aoran Mei , Jianhua Wang , Guo-Niu Zhu , Zhongxue Gan

Towards an embodied generalist for real-world interaction, Multimodal Large Language Model (MLLM) agents still suffer from challenging latency, sparse feedback, and irreversible mistakes. Video games offer an ideal testbed with rich visual…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Mingyu Ouyang , Siyuan Hu , Kevin Qinghong Lin , Hwee Tou Ng , Mike Zheng Shou

Large language models (LLMs) hold interesting potential for the design, development, and research of video games. Building on the decades of prior research on generative AI in games, many researchers have sped to investigate the power and…

Human-Computer Interaction · Computer Science 2024-03-06 Penny Sweetser

Large Language Models (LLMs) have significantly advanced natural language processing, demonstrating exceptional reasoning, tool usage, and memory capabilities. As their applications expand into multi-agent environments, there arises a need…

Computation and Language · Computer Science 2024-11-28 Lin Xu , Zhiyuan Hu , Daquan Zhou , Hongyu Ren , Zhen Dong , Kurt Keutzer , See Kiong Ng , Jiashi Feng

An essential element of human mathematical reasoning is our number sense -- an abstract understanding of numbers and their relationships -- which allows us to solve problems involving vast number spaces using limited computational…

Artificial Intelligence · Computer Science 2025-04-02 Roussel Rahman

Large Language Models (LLMs) demonstrate significant potential in multi-agent negotiation tasks, yet evaluation in this domain remains challenging due to a lack of robust and generalizable benchmarks. Abdelnabi et al. (2024) introduce a…

Machine Learning · Computer Science 2026-02-24 Jorge Carrasco Pollo , Ioannis Kapetangeorgis , Joshua Rosenthal , John Hua Yao

Recent advancements in large language models (LLMs) have expanded their capabilities beyond traditional text-based tasks to multimodal domains, integrating visual, auditory, and textual data. While multimodal LLMs have been extensively…

Artificial Intelligence · Computer Science 2024-12-03 Nicholas R. Waytowich , Devin White , MD Sunbeam , Vinicius G. Goecks

Large Vision-Language Models (LVLMs) are capable of handling diverse data types such as imaging, text, and physiological signals, and can be applied in various fields. In the medical field, LVLMs have a high potential to offer substantial…

Game theory has long served as a foundational tool in cybersecurity to test, predict, and design strategic interactions between attackers and defenders. The recent advent of Large Language Models (LLMs) offers new tools and challenges for…

Cryptography and Security · Computer Science 2026-02-19 Daniele Proverbio , Alessio Buscemi , Alessandro Di Stefano , The Anh Han , German Castignani , Pietro Liò

As large language models (LLMs) advance across diverse tasks, the need for comprehensive evaluation beyond single metrics becomes increasingly important. To fully assess LLM intelligence, it is crucial to examine their interactive dynamics…

Computation and Language · Computer Science 2025-09-23 Junhao Chen , Jingbo Sun , Xiang Li , Haidong Xin , Yuhao Xue , Yibin Xu , Hao Zhao

The rapid advancement of large language models has accelerated their application in reasoning, with strategic reasoning drawing increasing attention. To evaluate the strategic reasoning capabilities of LLMs, game theory, with its concise…

Artificial Intelligence · Computer Science 2025-05-28 Haochuan Wang , Xiachong Feng , Lei Li , Yu Guo , Zhanyue Qin , Dianbo Sui , Lingpeng Kong