English
Related papers

Related papers: Alchemy: A benchmark and analysis toolkit for meta…

200 papers

The recent advances in reinforcement learning have led to effective methods able to obtain above human-level performances in very complex environments. However, once solved, these environments become less valuable, and new challenges with…

Machine Learning · Computer Science 2022-10-20 Alessandro Palmas

Reinforcement learning (RL) is a powerful machine learning technique that has been successfully applied to a wide variety of problems. However, it can be unpredictable and produce suboptimal results in complicated learning environments.…

Multiagent Systems · Computer Science 2024-11-19 Brian Mintz , Feng Fu

This paper explores the open research problem of understanding the social behaviors of LLM-based agents. Using Avalon as a testbed, we employ system prompts to guide LLM agents in gameplay. While previous studies have touched on gameplay…

Computation and Language · Computer Science 2024-10-15 Yihuai Lan , Zhiqiang Hu , Lei Wang , Yang Wang , Deheng Ye , Peilin Zhao , Ee-Peng Lim , Hui Xiong , Hao Wang

Game environments offer a unique opportunity for training virtual agents due to their interactive nature, which provides diverse play traces and affect labels. Despite their potential, no reinforcement learning framework incorporates human…

Artificial Intelligence · Computer Science 2024-07-29 Matthew Barthet , Roberto Gallotta , Ahmed Khalifa , Antonios Liapis , Georgios N. Yannakakis

Retrieval-augmented generation (RAG) has emerged as a powerful framework for enhancing large language models (LLMs) with external knowledge, particularly in scientific domains that demand specialized and dynamic information. Despite its…

Computation and Language · Computer Science 2026-02-17 Xianrui Zhong , Bowen Jin , Siru Ouyang , Yanzhen Shen , Qiao Jin , Yin Fang , Zhiyong Lu , Jiawei Han

In this work we proposing adapting the Minecraft builder task into an LLM benchmark suitable for evaluating LLM ability in spatially orientated tasks, and informing builder agent design. Previous works have proposed corpora with varying…

Computation and Language · Computer Science 2024-07-18 Chris Madge , Massimo Poesio

Designing an effective communication mechanism among agents in reinforcement learning has been a challenging task, especially for real-world applications. The number of agents can grow or an environment sometimes needs to interact with a…

Machine Learning · Computer Science 2022-02-01 Wei-Cheng Tseng , Wei Wei , Da-Cheng Juan , Min Sun

Reinforcement Learning (RL) has emerged as a powerful paradigm in Artificial Intelligence (AI), enabling agents to learn optimal behaviors through interactions with their environments. Drawing from the foundations of trial and error, RL…

Artificial Intelligence · Computer Science 2025-02-04 Majid Ghasemi , Amir Hossein Moosavi , Dariush Ebrahimi

Recent progress in Large Language Models (LLMs) has drawn attention to their potential for accelerating drug discovery. However, a central problem remains: translating theoretical ideas into robust implementations in the highly specialized…

Machine Learning · Computer Science 2025-03-06 Sizhe Liu , Yizhou Lu , Siyu Chen , Xiyang Hu , Jieyu Zhao , Yingzhou Lu , Yue Zhao

Multi-LLM collaboration promises accurate, robust, and context-aware solutions, yet existing approaches rely on implicit selection and output assessment without analyzing whether collaborating models truly complement or conflict. We…

Machine Learning · Computer Science 2025-10-07 Huascar Sanchez , Briland Hitaj

Game environments provide rich, controllable settings that stimulate many aspects of real-world complexity. As such, game agents offer a valuable testbed for exploring capabilities relevant to Artificial General Intelligence. Recently, the…

Artificial Intelligence · Computer Science 2025-11-05 Sihao Hu , Tiansheng Huang , Gaowen Liu , Ramana Rao Kompella , Fatih Ilhan , Selim Furkan Tekin , Yichang Xu , Zachary Yahn , Ling Liu

LLM-based agents have shown promise in various cooperative and strategic reasoning tasks, but their effectiveness in competitive multi-agent environments remains underexplored. To address this gap, we introduce PillagerBench, a novel…

Artificial Intelligence · Computer Science 2025-09-09 Olivier Schipper , Yudi Zhang , Yali Du , Mykola Pechenizkiy , Meng Fang

Large Language Models (LLMs) are becoming increasingly powerful and capable of handling complex tasks, e.g., building single agents and multi-agent systems. Compared to single agents, multi-agent systems have higher requirements for the…

Computation and Language · Computer Science 2024-08-29 Wei Wang , Dan Zhang , Tao Feng , Boyan Wang , Jie Tang

Reinforcement learning (RL) has achieved remarkable success in real-world decision-making across diverse domains, including gaming, robotics, online advertising, public health, and natural language processing. Despite these advances, a…

Applications · Statistics 2026-01-23 Asim H. Gazi , Yongyi Guo , Daiqi Gao , Ziping Xu , Kelly W. Zhang , Susan A. Murphy

Predicting chemical reactions, a fundamental challenge in chemistry, involves forecasting the resulting products from a given reaction process. Conventional techniques, notably those employing Graph Neural Networks (GNNs), are often limited…

Machine Learning · Computer Science 2023-10-23 Yaorui Shi , An Zhang , Enzhi Zhang , Zhiyuan Liu , Xiang Wang

In this paper, we explore the potential of Large Language Models (LLMs) Agents in playing the strategic social deduction game, Resistance Avalon. Players in Avalon are challenged not only to make informed decisions based on dynamically…

Artificial Intelligence · Computer Science 2023-11-09 Jonathan Light , Min Cai , Sheng Shen , Ziniu Hu

The advancement and extensive application of large language models (LLMs) have been remarkable, including their use in scientific research assistance. However, these models often generate scientifically incorrect or unsafe responses, and in…

Computation and Language · Computer Science 2024-11-28 Haochen Zhao , Xiangru Tang , Ziran Yang , Xiao Han , Xuanzhi Feng , Yueqing Fan , Senhao Cheng , Di Jin , Yilun Zhao , Arman Cohan , Mark Gerstein

A common challenge in reinforcement learning is how to convert the agent's interactions with an environment into fast and robust learning. For instance, earlier work makes use of domain knowledge to improve existing reinforcement learning…

Machine Learning · Computer Science 2020-04-01 Yannis Flet-Berliac , Philippe Preux

The Arcade Learning Environment (ALE) is an evaluation platform that poses the challenge of building AI agents with general competency across dozens of Atari 2600 games. It supports a variety of different problem settings and it has been…

Machine Learning · Computer Science 2017-12-04 Marlos C. Machado , Marc G. Bellemare , Erik Talvitie , Joel Veness , Matthew Hausknecht , Michael Bowling

Recent progress in the field of reinforcement learning has been accelerated by virtual learning environments such as video games, where novel algorithms and ideas can be quickly tested in a safe and reproducible manner. We introduce the…