中文
相关论文

相关论文: Reward Prediction with Factorized World States

200 篇论文

Large Language Models (LLMs) have the potential to automate reward engineering by leveraging their broad domain knowledge across various tasks. However, they often need many iterations of trial-and-error to generate effective reward…

机器学习 · 计算机科学 2024-10-28 Vishnu Sarukkai , Brennan Shacklett , Zander Majercik , Kush Bhatia , Christopher Ré , Kayvon Fatahalian

Value factorization is a popular and promising approach to scaling up multi-agent reinforcement learning in cooperative settings, which balances the learning scalability and the representational capacity of value functions. However, the…

机器学习 · 计算机科学 2021-11-02 Jianhao Wang , Zhizhou Ren , Beining Han , Jianing Ye , Chongjie Zhang

Automated decision-making tools increasingly assess individuals to determine if they qualify for high-stakes opportunities. A recent line of research investigates how strategic agents may respond to such scoring tools to receive favorable…

机器学习 · 计算机科学 2021-10-28 Keegan Harris , Hoda Heidari , Zhiwei Steven Wu

As language models accelerate scientific research by automating hypothesis generation and implementation, a new bottleneck emerges: evaluating and filtering hundreds of AI-generated ideas without exhaustive experimentation. We ask whether…

机器学习 · 计算机科学 2026-05-22 Srujan P Mule , Aniketh Garikaparthi , Manasi Patwardhan

Recent progress in using machine learning models for reasoning tasks has been driven by novel model architectures, large-scale pre-training protocols, and dedicated reasoning datasets for fine-tuning. In this work, to further pursue these…

机器学习 · 计算机科学 2023-09-18 Jack Lanchantin , Sainbayar Sukhbaatar , Gabriel Synnaeve , Yuxuan Sun , Kavya Srinet , Arthur Szlam

Value function factorization via centralized training and decentralized execution is promising for solving cooperative multi-agent reinforcement tasks. One of the approaches in this area, QMIX, has become state-of-the-art and achieved the…

多智能体系统 · 计算机科学 2023-07-27 Hanhan Zhou , Tian Lan , Vaneet Aggarwal

An open problem in artificial intelligence is how to learn and represent knowledge that is sufficient for a general agent that needs to solve multiple tasks in a given world. In this work we propose world value functions (WVFs), which are a…

机器学习 · 计算机科学 2022-05-19 Geraud Nangue Tasse , Steven James , Benjamin Rosman

In reinforcement learning (RL), state representations are key to dealing with large or continuous state spaces. While one of the promises of deep learning algorithms is to automatically construct features well-tuned for the task they try to…

In an unfamiliar setting, a model-based reinforcement learning agent can be limited by the accuracy of its world model. In this work, we present a novel, training-free approach to improving the performance of such agents separately from…

机器学习 · 计算机科学 2024-02-26 Martin Benfeghoul , Umais Zahid , Qinghai Guo , Zafeirios Fountas

The outstanding capabilities of large language models (LLMs) render them a crucial component in various autonomous agent systems. While traditional methods depend on the inherent knowledge of LLMs without fine-tuning, more recent approaches…

人工智能 · 计算机科学 2024-12-10 Zhirui Deng , Zhicheng Dou , Yutao Zhu , Ji-Rong Wen , Ruibin Xiong , Mang Wang , Weipeng Chen

Reinforcement learning (RL) has successfully automated the complex process of mining formulaic alpha factors, for creating interpretable and profitable investment strategies. However, existing methods are hampered by the sparse rewards…

机器学习 · 计算机科学 2025-07-29 Junjie Zhao , Chengxi Zhang , Chenkai Wang , Peng Yang

We introduce a new count-based optimistic exploration algorithm for Reinforcement Learning (RL) that is feasible in environments with high-dimensional state-action spaces. The success of RL algorithms in these domains depends crucially on…

人工智能 · 计算机科学 2017-06-27 Jarryd Martin , Suraj Narayanan Sasikumar , Tom Everitt , Marcus Hutter

While safe reinforcement learning (RL) holds great promise for many practical applications like robotics or autonomous cars, current approaches require specifying constraints in mathematical form. Such specifications demand domain…

计算与语言 · 计算机科学 2021-08-05 Tsung-Yen Yang , Michael Hu , Yinlam Chow , Peter J. Ramadge , Karthik Narasimhan

Reinforcement learning (RL) is a popular approach for robotic path planning in uncertain environments. However, the control policies trained for an RL agent crucially depend on user-defined, state-based reward functions. Poorly designed…

Most model-free reinforcement learning methods leverage state representations (embeddings) for generalization, but either ignore structure in the space of actions or assume the structure is provided a priori. We show how a policy can be…

机器学习 · 计算机科学 2019-05-16 Yash Chandak , Georgios Theocharous , James Kostas , Scott Jordan , Philip S. Thomas

Learning from Demonstrations (LfD) and Reinforcement Learning (RL) have enabled robot agents to accomplish complex tasks. Reward Machines (RMs) enhance RL's capability to train policies over extended time horizons by structuring high-level…

机器人学 · 计算机科学 2024-12-16 Mattijs Baert , Sam Leroux , Pieter Simoens

Learning world models offers a promising avenue for goal-conditioned reinforcement learning with sparse rewards. By allowing agents to plan actions or exploratory goals without direct interaction with the environment, world models enhance…

机器学习 · 计算机科学 2024-11-06 Yuanlin Duan , Wensen Mao , He Zhu

Both animals and artificial agents benefit from state representations that support rapid transfer of learning across tasks and which enable them to efficiently traverse their environments to reach rewarding states. The successor…

机器学习 · 计算机科学 2021-11-09 Ted Moskovitz , Spencer R. Wilson , Maneesh Sahani

Deep reinforcement learning has obtained significant breakthroughs in recent years. Most methods in deep-RL achieve good results via the maximization of the reward signal provided by the environment, typically in the form of discounted…

机器学习 · 计算机科学 2018-09-10 Yubin Deng , Ke Yu , Dahua Lin , Xiaoou Tang , Chen Change Loy

Reinforcement learning (RL) agents are often designed specifically for a particular problem and they generally have uninterpretable working processes. Statistical methods-based agent algorithms can be improved in terms of generalizability…

人工智能 · 计算机科学 2020-07-14 Faruk Kucuksubasi , Elif Surer