中文
相关论文

相关论文: Verifiable and Compositional Reinforcement Learnin…

200 篇论文

To overcome the curses of dimensionality and modeling of Dynamic Programming (DP) methods to solve Markov Decision Process (MDP) problems, Reinforcement Learning (RL) methods are adopted in practice. Contrary to traditional RL algorithms…

机器学习 · 计算机科学 2021-08-24 Arghyadip Roy , Vivek Borkar , Abhay Karandikar , Prasanna Chaporkar

We introduce a biologically plausible RL framework for solving tasks in partially observable Markov decision processes (POMDPs). The proposed algorithm combines three integral parts: (1) A Meta-RL architecture, resembling the mammalian…

机器学习 · 计算机科学 2025-04-17 Julian Lemmel , Radu Grosu

We present a modular approach to \emph{reinforcement learning} (RL) in environments consisting of simpler components evolving in parallel. A monolithic view of such modular environments may be prohibitively large to learn, or may require…

机器学习 · 计算机科学 2023-12-18 Milad Kazemi , Mateo Perez , Fabio Somenzi , Sadegh Soudjani , Ashutosh Trivedi , Alvaro Velasquez

Improving sample efficiency is central to Reinforcement Learning (RL), especially in environments where the rewards are sparse. Some recent approaches have proposed to specify reward functions as manually designed or learned reward…

机器学习 · 计算机科学 2024-01-26 Shuai Han , Mehdi Dastani , Shihan Wang

Model-based reinforcement learning (RL) is considered to be a promising approach to reduce the sample complexity that hinders model-free RL. However, the theoretical understanding of such methods has been rather limited. This paper…

机器学习 · 计算机科学 2021-02-16 Yuping Luo , Huazhe Xu , Yuanzhi Li , Yuandong Tian , Trevor Darrell , Tengyu Ma

Reinforcement Learning (RL) is a widely employed machine learning architecture that has been applied to a variety of control problems. However, applications in safety-critical domains require a systematic and formal approach to specifying…

机器学习 · 计算机科学 2023-06-07 Hosein Hasanbeig , Daniel Kroening , Alessandro Abate

This paper targets the efficient construction of a safety shield for decision making in scenarios that incorporate uncertainty. Markov decision processes (MDPs) are prominent models to capture such planning problems. Reinforcement learning…

人工智能 · 计算机科学 2019-11-26 Nils Jansen , Bettina Könighofer , Sebastian Junges , Alexandru C. Serban , Roderick Bloem

Reinforcement Learning (RL) is an emerging approach to control many dynamical systems for which classical control approaches are not applicable or insufficient. However, the resultant policies may not generalize to variations in the…

机器人学 · 计算机科学 2023-11-13 Abdel Gafoor Haddad , Mohammed B. Mohiuddin , Igor Boiko , Yahya Zweiri

Children can rapidly generalize compositionally-constructed rules to unseen test sets. On the other hand, deep reinforcement learning (RL) agents need to be trained over millions of episodes, and their ability to generalize to unseen…

机器学习 · 计算机科学 2024-05-06 Zijun Lin , Haidi Azaman , M Ganesh Kumar , Cheston Tan

Self-paced reinforcement learning (RL) aims to improve the data efficiency of learning by automatically creating sequences, namely curricula, of probability distributions over contexts. However, existing techniques for self-paced RL fail in…

机器学习 · 计算机科学 2023-05-29 Cevahir Koprulu , Ufuk Topcu

Reinforcement fine-tuning with verifiable rewards (RLVR) has emerged as a powerful paradigm for equipping large vision-language models (LVLMs) with agentic capabilities such as tool use and multi-step reasoning. Despite striking empirical…

机器学习 · 计算机科学 2026-04-23 Carter Adams , Rafael Oliveira , Gabriel Almeida , Sofia Torres

Reinforcement learning (RL) has become a standard paradigm for refining large language models (LLMs) beyond pre-training and instruction tuning. A prominent line of work is RL with verifiable rewards (RLVR), which leverages automatically…

机器学习 · 计算机科学 2025-09-23 Bonan Zhang , Zhongqi Chen , Bowen Song , Qinya Li , Fan Wu , Guihai Chen

This work studies offline Reinforcement Learning (RL) in a class of non-Markovian environments called Regular Decision Processes (RDPs). In RDPs, the unknown dependency of future observations and rewards from the past interactions can be…

机器学习 · 计算机科学 2024-09-05 Ahana Deb , Roberto Cipollone , Anders Jonsson , Alessandro Ronca , Mohammad Sadegh Talebi

We present CompoSuite, an open-source simulated robotic manipulation benchmark for compositional multi-task reinforcement learning (RL). Each CompoSuite task requires a particular robot arm to manipulate one individual object to achieve a…

机器学习 · 计算机科学 2022-07-12 Jorge A. Mendez , Marcel Hussing , Meghna Gummadi , Eric Eaton

Self-organizing networks face challenges from complex parameter interdependencies and conflicting objectives. This study introduces two compositional learning approaches-Compositional Deep Reinforcement Learning (CDRL) and Compositional…

机器学习 · 计算机科学 2025-06-04 Qi Liao , Parijat Bhattacharjee

We propose a novel framework to controller design in environments with a two-level structure: a known high-level graph ("map") in which each vertex is populated by a Markov decision process, called a "room". The framework "separates…

人工智能 · 计算机科学 2025-03-11 Florent Delgrange , Guy Avni , Anna Lukina , Christian Schilling , Ann Nowé , Guillermo A. Pérez

In recent years, reinforcement learning has achieved many remarkable successes due to the growing adoption of deep learning techniques and the rapid growth in computing power. Nevertheless, it is well-known that flat reinforcement learning…

人工智能 · 计算机科学 2024-10-30 Le Pham Tuyen , Ngo Anh Vien , Abu Layek , TaeChoong Chung

Reinforcement learning (RL) methods have been shown to be capable of learning intelligent behavior in rich domains. However, this has largely been done in simulated domains without adequate focus on the process of building the simulator. In…

机器学习 · 计算机科学 2019-10-24 Aditya Modi , Nan Jiang , Ambuj Tewari , Satinder Singh

The linear Markov Decision Process (MDP) framework offers a principled foundation for reinforcement learning (RL) with strong theoretical guarantees and sample efficiency. However, its restrictive assumption-that both transition dynamics…

机器学习 · 统计学 2025-06-03 Sinian Zhang , Kaicheng Zhang , Ziping Xu , Tianxi Cai , Doudou Zhou

Motivated by the prevailing paradigm of using unsupervised learning for efficient exploration in reinforcement learning (RL) problems [tang2017exploration,bellemare2016unifying], we investigate when this paradigm is provably efficient. We…

机器学习 · 计算机科学 2020-12-02 Fei Feng , Ruosong Wang , Wotao Yin , Simon S. Du , Lin F. Yang