English
Related papers

Related papers: Pre-trained Language Models as Prior Knowledge for…

200 papers

Reinforcement Learning (RL) agents often struggle with efficiency and performance in complex environments. We propose a novel framework that uses a Large Language Model (LLM) to dynamically generate a curriculum over available actions,…

Machine Learning · Computer Science 2026-04-03 Amirreza Alasti , Efe Erdal , Yücel Celik , Theresa Eimer

Domain knowledge is crucial for effective performance in autonomous control systems. Typically, human effort is required to encode this knowledge into a control algorithm. In this paper, we present an approach to language grounding which…

Computation and Language · Computer Science 2014-01-22 S. R. K. Branavan , David Silver , Regina Barzilay

Text-based games (TBGs) have emerged as an important collection of NLP tasks, requiring reinforcement learning (RL) agents to combine natural language understanding with reasoning. A key challenge for agents attempting to solve such tasks…

Computation and Language · Computer Science 2024-03-19 Kinjal Basu , Keerthiram Murugesan , Subhajit Chaudhury , Murray Campbell , Kartik Talamadupula , Tim Klinger

Reinforcement learning (RL) is well known for requiring large amounts of data in order for RL agents to learn to perform complex tasks. Recent progress in model-based RL allows agents to be much more data-efficient, as it enables them to…

Machine Learning · Computer Science 2021-08-17 Remo Sasso , Matthia Sabatelli , Marco A. Wiering

TextArena is an open-source collection of competitive text-based games for training and evaluation of agentic behavior in Large Language Models (LLMs). It spans 57+ unique environments (including single-player, two-player, and multi-player…

Computation and Language · Computer Science 2025-05-27 Leon Guertler , Bobby Cheng , Simon Yu , Bo Liu , Leshem Choshen , Cheston Tan

The question of how an effective and efficient communication system can emerge in a population of agents that need to solve a particular task attracts more and more attention from researchers in many fields, including artificial…

Artificial Intelligence · Computer Science 2020-04-21 Jens Nevens , Paul Van Eecke , Katrien Beuls

Large language models (LLMs) are effective at answering questions that are clearly asked. However, when faced with ambiguous queries they can act unpredictably and produce incorrect outputs. This underscores the need for the development of…

Computation and Language · Computer Science 2024-02-22 Yizhe Zhang , Jiarui Lu , Navdeep Jaitly

One major barrier to applications of deep Reinforcement Learning (RL) both inside and outside of games is the lack of explainability. In this paper, we describe a lightweight and effective method to derive explanations for deep RL agents,…

Machine Learning · Computer Science 2021-10-08 Alexander Sieusahai , Matthew Guzdial

Reinforcement learning (RL) is a promising approach for aligning large language models (LLMs) knowledge with sequential decision-making tasks. However, few studies have thoroughly investigated the impact on LLM agents capabilities of…

Large Language Models (LLMs) have gained widespread popularity across diverse domains involving text generation, summarization, and various natural language processing tasks. Despite their inherent limitations, LLM-based designs have shown…

Cryptography and Security · Computer Science 2024-04-17 Maria Rigaki , Ondřej Lukáš , Carlos A. Catania , Sebastian Garcia

This study proposes a method to improve the performance of Werewolf agents by switching between predefined strategies based on the attitudes of other players and the context of conversations. While prior works of Werewolf agents using…

Computation and Language · Computer Science 2025-07-18 Fuya Nakamori , Yin Jou Huang , Fei Cheng

Reasoning in a complex and ambiguous environment is a key goal for Reinforcement Learning (RL) agents. While some sophisticated RL agents can successfully solve difficult tasks, they require a large amount of training data and often…

Machine Learning · Computer Science 2023-02-03 Ishita Dasgupta , Christine Kaeser-Chen , Kenneth Marino , Arun Ahuja , Sheila Babayan , Felix Hill , Rob Fergus

Playing video games requires perception, memory, and planning, exactly the faculties modern large language model (LLM) agents are expected to master. We study the major challenges in using popular video games to evaluate modern LLMs and…

Artificial Intelligence · Computer Science 2025-06-04 Lanxiang Hu , Mingjia Huo , Yuxuan Zhang , Haoyang Yu , Eric P. Xing , Ion Stoica , Tajana Rosing , Haojian Jin , Hao Zhang

Reinforcement Learning (RL) has been witnessed its potential for training a dialogue policy agent towards maximizing the accumulated rewards given from users. However, the reward can be very sparse for it is usually only provided at the end…

Computation and Language · Computer Science 2021-11-03 Hongru Wang , Huimin Wang , Zezhong Wang , Kam-Fai Wong

Researchers and practitioners have recently reframed powerful Large Language Models (LLMs) as agents, enabling them to automate complex tasks largely via the use of specialized functions. To facilitate the development of LLM agents, we…

Artificial Intelligence · Computer Science 2024-08-01 Shaokun Zhang , Jieyu Zhang , Jiale Liu , Linxin Song , Chi Wang , Ranjay Krishna , Qingyun Wu

In recent years, transformer-based language representation models (LRMs) have achieved state-of-the-art results on difficult natural language understanding problems, such as question answering and text summarization. As these models are…

Computation and Language · Computer Science 2022-10-17 Zhisheng Tang , Mayank Kejriwal

Large Language Models (LLMs) as agents often struggle in out-of-distribution (OOD) scenarios. Real-world environments are complex and dynamic, governed by task-specific rules and stochasticity, which makes it difficult for LLMs to ground…

Machine Learning · Computer Science 2025-10-20 Shiqi Chen , Tongyao Zhu , Zian Wang , Jinghan Zhang , Kangrui Wang , Siyang Gao , Teng Xiao , Yee Whye Teh , Junxian He , Manling Li

This paper presents an innovative framework that integrates Large Language Models (LLMs) with an external Thinker module to enhance the reasoning capabilities of LLM-based agents. Unlike augmenting LLMs with prompt engineering, Thinker…

Artificial Intelligence · Computer Science 2024-04-01 Shuang Wu , Liwen Zhu , Tao Yang , Shiwei Xu , Qiang Fu , Yang Wei , Haobo Fu

A key method for creating Artificial Intelligence (AI) agents is Reinforcement Learning (RL). However, constructing a standalone RL policy that maps perception to action directly encounters severe problems, chief among them being its lack…

Deep reinforcement learning agents are notoriously sample inefficient, which considerably limits their application to real-world problems. Recently, many model-based methods have been designed to address this issue, with learning in the…

Machine Learning · Computer Science 2023-03-02 Vincent Micheli , Eloi Alonso , François Fleuret