中文
相关论文

相关论文: Using PCA to Efficiently Represent State Spaces

200 篇论文

Principal component analysis (PCA) is a well-known linear dimension-reduction method that has been widely used in data analysis and modeling. It is an unsupervised learning technique that identifies a suitable linear subspace for the input…

机器学习 · 统计学 2021-09-10 Shaojie Xu , Joel Vaughan , Jie Chen , Agus Sudjianto , Vijayan Nair

The policy represented by the deep neural network can overfit the spurious features in observations, which hamper a reinforcement learning agent from learning effective policy. This issue becomes severe in high-dimensional state, where the…

机器学习 · 计算机科学 2023-05-01 Md Masudur Rahman , Yexiang Xue

Dense retrievers powered by pretrained embeddings are widely used for document retrieval but struggle in specialized domains due to the mismatches between the training and target domain distributions. Domain adaptation typically requires…

信息检索 · 计算机科学 2026-01-21 Chunsheng Zuo , Daniel Khashabi

This work leverages adaptive social learning to estimate partially observable global states in multi-agent reinforcement learning (MARL) problems. Unlike existing methods, the proposed approach enables the concurrent operation of social…

多智能体系统 · 计算机科学 2025-08-11 Ainur Zhaikhan , Malek Khammassi , Ali H. Sayed

Recent advances in reinforcement learning have shown its potential to tackle complex real-life tasks. However, as the dimensionality of the task increases, reinforcement learning methods tend to struggle. To overcome this, we explore…

计算与语言 · 计算机科学 2020-02-06 Erez Schwartz , Guy Tennenholtz , Chen Tessler , Shie Mannor

While supervised learning has enabled great progress in many applications, unsupervised learning has not seen such widespread adoption, and remains an important and challenging endeavor for artificial intelligence. In this work, we propose…

机器学习 · 计算机科学 2019-01-23 Aaron van den Oord , Yazhe Li , Oriol Vinyals

In safe reinforcement learning, agent needs to balance between exploration actions and safety constraints. Following this paradigm, domain transfer approaches learn a prior Q-function from the related environments to prevent unsafe actions.…

机器学习 · 计算机科学 2025-04-29 Duc Kien Doan , Bang Giang Le , Viet Cuong Ta

Deep reinforcement learning agents have recently been successful across a variety of discrete and continuous control tasks; however, they can be slow to train and require a large number of interactions with the environment to learn a…

机器学习 · 计算机科学 2018-12-19 Thomas Carr , Maria Chli , George Vogiatzis

This paper discusses a system that accelerates reinforcement learning by using transfer from related tasks. Without such transfer, even if two tasks are very similar at some abstract level, an extensive re-learning effort is required. The…

人工智能 · 计算机科学 2011-06-10 C. Drummond

We study the optimal sample complexity in large-scale Reinforcement Learning (RL) problems with policy space generalization, i.e. the agent has a prior knowledge that the optimal policy lies in a known policy space. Existing results show…

机器学习 · 计算机科学 2020-08-18 Wenlong Mou , Zheng Wen , Xi Chen

Reinforcement learning (RL) algorithms have proven transformative in a range of domains. To tackle real-world domains, these systems often use neural networks to learn policies directly from pixels or other high-dimensional sensory input.…

机器学习 · 计算机科学 2025-10-02 Nishil Patel , Sebastian Lee , Stefano Sarao Mannelli , Sebastian Goldt , Andrew Saxe

Discovering an informative, or agent-centric, state representation that encodes only the relevant information while discarding the irrelevant is a key challenge towards scaling reinforcement learning algorithms and efficiently applying them…

机器学习 · 计算机科学 2024-04-24 Lili Wu , Ben Evans , Riashat Islam , Raihan Seraj , Yonathan Efroni , Alex Lamb

One of the preeminent obstacles to scaling multi-agent reinforcement learning to large numbers of agents is assigning credit to individual agents' actions. In this paper, we address this credit assignment problem with an approach that we…

机器学习 · 计算机科学 2021-12-24 Benjamin Freed , Aditya Kapoor , Ian Abraham , Jeff Schneider , Howie Choset

Bayesian Optimization (BO) is a popular approach to optimizing expensive-to-evaluate black-box functions. Despite the success of BO, its performance may decrease exponentially as the dimensionality increases. A common framework to tackle…

机器学习 · 计算机科学 2024-12-24 Quoc-Anh Hoang Nguyen , The Hung Tran

Reinforcement learning has become a cornerstone technique for developing reasoning models in complex tasks, ranging from mathematical problem-solving to imaginary reasoning. The optimization of these models typically relies on policy…

机器学习 · 计算机科学 2026-02-11 Qingnan Ren , Shiting Huang , Zhen Fang , Zehui Chen , Lin Chen , Lijun Li , Feng Zhao

In many practical applications of RL, it is expensive to observe state transitions from the environment. For example, in the problem of plasma control for nuclear fusion, computing the next state for a given state-action pair requires…

机器学习 · 计算机科学 2022-03-16 Viraj Mehta , Biswajit Paria , Jeff Schneider , Stefano Ermon , Willie Neiswanger

We study the problem of representation learning in goal-conditioned hierarchical reinforcement learning. In such hierarchical structures, a higher-level controller solves tasks by iteratively communicating goals which a lower-level policy…

人工智能 · 计算机科学 2019-01-10 Ofir Nachum , Shixiang Gu , Honglak Lee , Sergey Levine

The current thesis aims to explore the reinforcement learning field and build on existing methods to produce improved ones to tackle the problem of learning in high-dimensional and complex environments. It addresses such goals by…

机器学习 · 计算机科学 2024-03-26 Ayoub Ghriss , Masashi Sugiyama , Alessandro Lazaric

State-of-the-art computer vision algorithms often achieve efficiency by making discrete choices about which hypotheses to explore next. This allows allocation of computational resources to promising candidates, however, such decisions are…

计算机视觉与模式识别 · 计算机科学 2017-04-12 Alexander Krull , Eric Brachmann , Sebastian Nowozin , Frank Michel , Jamie Shotton , Carsten Rother

Representation learning has significantly been developed with the advance of contrastive learning methods. Most of those methods have benefited from various data augmentations that are carefully designated to maintain their identities so…

计算机视觉与模式识别 · 计算机科学 2022-01-24 Xiao Wang , Guo-Jun Qi