中文
相关论文

相关论文: Low-Dimensional State and Action Representation Le…

200 篇论文

A challenge in multi-agent reinforcement learning is to be able to generalize over intractable state-action spaces. Inspired from Tesseract [Mahajan et al., 2021], this position paper investigates generalisation in state-action space over…

机器学习 · 计算机科学 2021-10-28 Pascal Van Der Vaart , Anuj Mahajan , Shimon Whiteson

Existing off-policy reinforcement learning algorithms often rely on an explicit state-action-value function representation, which can be problematic in high-dimensional action spaces due to the curse of dimensionality. This reliance results…

机器学习 · 计算机科学 2025-02-18 Fabian Otto , Philipp Becker , Ngo Anh Vien , Gerhard Neumann

Reinforcement learning (RL) algorithms have proven transformative in a range of domains. To tackle real-world domains, these systems often use neural networks to learn policies directly from pixels or other high-dimensional sensory input.…

机器学习 · 计算机科学 2025-10-02 Nishil Patel , Sebastian Lee , Stefano Sarao Mannelli , Sebastian Goldt , Andrew Saxe

Low-complexity models such as linear function representation play a pivotal role in enabling sample-efficient reinforcement learning (RL). The current paper pertains to a scenario with value-based linear representation, which postulates the…

机器学习 · 计算机科学 2021-10-19 Gen Li , Yuxin Chen , Yuejie Chi , Yuantao Gu , Yuting Wei

Many reinforcement learning (RL) algorithms are too costly to use in practice due to the large sizes $S, A$ of the problem's state and action space. To resolve this issue, we study transfer RL with latent low rank structure. We consider the…

机器学习 · 计算机科学 2024-10-30 Tyler Sam , Yudong Chen , Christina Lee Yu

Deep reinforcement learning algorithms require large amounts of experience to learn an individual task. While in principle meta-reinforcement learning (meta-RL) algorithms enable agents to learn new skills from small amounts of experience,…

机器学习 · 计算机科学 2019-03-21 Kate Rakelly , Aurick Zhou , Deirdre Quillen , Chelsea Finn , Sergey Levine

We consider a Reinforcement Learning setup where an agent interacts with an environment in observation-reward-action cycles without any (esp.\ MDP) assumptions on the environment. State aggregation and more generally feature reinforcement…

人工智能 · 计算机科学 2014-07-15 Marcus Hutter

This work exploits action equivariance for representation learning in reinforcement learning. Equivariance under actions states that transitions in the input space are mirrored by equivalent transitions in latent space, while the map and…

机器学习 · 计算机科学 2020-02-28 Elise van der Pol , Thomas Kipf , Frans A. Oliehoek , Max Welling

Scaling end-to-end reinforcement learning to control real robots from vision presents a series of challenges, in particular in terms of sample efficiency. Against end-to-end learning, state representation learning can help learn a compact,…

Deep reinforcement learning has shown remarkable success in the past few years. Highly complex sequential decision making problems from game playing and robotics have been solved with deep model-free methods. Unfortunately, the sample…

机器学习 · 计算机科学 2021-07-20 Aske Plaat , Walter Kosters , Mike Preuss

A major challenge in reinforcement learning (RL) is the design of agents that are able to generalize across tasks that share common dynamics. A viable solution is meta-reinforcement learning, which identifies common structures among past…

机器学习 · 计算机科学 2019-10-24 Sephora Madjiheurem , Laura Toni

In distributed optimization, the practical problem-solving performance is essentially sensitive to algorithm selection, parameter setting, problem type and data pattern. Thus, it is often laborious to acquire a highly efficient method for a…

最优化与控制 · 数学 2024-01-04 Daokuan Zhu , Tianqi Xu , Jie Lu

The low rank MDP has emerged as an important model for studying representation learning and exploration in reinforcement learning. With a known representation, several model-free exploration strategies exist. In contrast, all algorithms for…

机器学习 · 计算机科学 2022-06-23 Aditya Modi , Jinglin Chen , Akshay Krishnamurthy , Nan Jiang , Alekh Agarwal

Reinforcement learning (RL) algorithms have been around for decades and employed to solve various sequential decision-making problems. These algorithms however have faced great challenges when dealing with high-dimensional environments. The…

机器学习 · 计算机科学 2020-04-01 Thanh Thi Nguyen , Ngoc Duy Nguyen , Saeid Nahavandi

Data-efficient reinforcement learning (RL) in continuous state-action spaces using very high-dimensional observations remains a key challenge in developing fully autonomous systems. We consider a particularly important instance of this…

人工智能 · 计算机科学 2015-10-12 John-Alexander M. Assael , Niklas Wahlström , Thomas B. Schön , Marc Peter Deisenroth

Traditionally, Reinforcement Learning (RL) aims at deciding how to act optimally for an artificial agent. We argue that deciding when to act is equally important. As humans, we drift from default, instinctive or memorized behaviors to…

机器学习 · 计算机科学 2022-03-17 Alexis Jacq , Johan Ferret , Olivier Pietquin , Matthieu Geist

Due to information asymmetry, finding optimal policies for Decentralized Partially Observable Markov Decision Processes (Dec-POMDPs) is hard with the complexity growing doubly exponentially in the horizon length. The challenge increases…

机器学习 · 计算机科学 2021-10-26 Hsu Kao , Vijay Subramanian

A fundamental assumption of reinforcement learning in Markov decision processes (MDPs) is that the relevant decision process is, in fact, Markov. However, when MDPs have rich observations, agents typically learn by way of an abstract state…

机器学习 · 计算机科学 2024-03-18 Cameron Allen , Neev Parikh , Omer Gottesman , George Konidaris

Modeling agent behavior is central to understanding the emergence of complex phenomena in multiagent systems. Prior work in agent modeling has largely been task-specific and driven by hand-engineering domain-specific prior knowledge. We…

多智能体系统 · 计算机科学 2018-08-02 Aditya Grover , Maruan Al-Shedivat , Jayesh K. Gupta , Yura Burda , Harrison Edwards

Methods of deep machine learning enable to to reuse low-level representations efficiently for generating more abstract high-level representations. Originally, deep learning has been applied passively (e.g., for classification purposes).…

机器学习 · 计算机科学 2014-12-22 Mark Wernsdorfer , Ute Schmid