中文
相关论文

相关论文: Tensor-Efficient High-Dimensional Q-learning

200 篇论文

Low rank tensor decompositions are a powerful tool for learning generative models, and uniqueness results give them a significant advantage over matrix decomposition methods. However, tensors pose significant algorithmic challenges and…

数据结构与算法 · 计算机科学 2014-01-21 Aditya Bhaskara , Moses Charikar , Ankur Moitra , Aravindan Vijayaraghavan

Model-based offline reinforcement learning (RL) is a compelling approach that addresses the challenge of learning from limited, static data by generating imaginary trajectories using learned models. However, these approaches often struggle…

机器学习 · 计算机科学 2024-12-04 Kwanyoung Park , Youngwoon Lee

When the data used for reinforcement learning (RL) are collected by multiple agents in a distributed manner, federated versions of RL algorithms allow collaborative learning without the need for agents to share their local data. In this…

机器学习 · 计算机科学 2023-12-14 Jiin Woo , Gauri Joshi , Yuejie Chi

Offline reinforcement learning (RL) enables policy learning from fixed datasets without further environment interaction, making it particularly valuable in high-risk or costly domains. Extreme $Q$-Learning (XQL) is a recent offline RL…

机器学习 · 计算机科学 2026-04-15 Xinming Gao , Shangzhe Li , Yujin Cai , Wenwu Yu

Deep reinforcement learning (RL) algorithms have recently achieved remarkable successes in various sequential decision making tasks, leveraging advances in methods for training large deep networks. However, these methods usually require…

机器学习 · 计算机科学 2020-06-30 Kei Ota , Tomoaki Oiki , Devesh K. Jha , Toshisada Mariyama , Daniel Nikovski

In this work, we present two Deep Reinforcement Learning (Deep-RL) approaches to enhance the problem of mapless navigation for a terrestrial mobile robot. Our methodology focus on comparing a Deep-RL technique based on the Deep Q-Network…

Deep Reinforcement Learning (RL) is unquestionably a robust framework to train autonomous agents in a wide variety of disciplines. However, traditional deep and shallow model-free RL algorithms suffer from low sample efficiency and…

机器学习 · 计算机科学 2022-10-05 Per-Arne Andersen , Ole-Christoffer Granmo , Morten Goodwin

Tensor decomposition of high-dimensional data often struggles to capture semantically or physically meaningful structures, particularly when relying on reconstruction objectives and fixed-rank constraints. We introduce a no-rank tensor…

机器学习 · 计算机科学 2026-03-03 Maryam Bagherian

Reinforcement learning (RL) algorithms have proven transformative in a range of domains. To tackle real-world domains, these systems often use neural networks to learn policies directly from pixels or other high-dimensional sensory input.…

机器学习 · 计算机科学 2025-10-02 Nishil Patel , Sebastian Lee , Stefano Sarao Mannelli , Sebastian Goldt , Andrew Saxe

Modern reinforcement learning (RL) often faces an enormous state-action space. Existing analytical results are typically for settings with a small number of state-actions, or simple models such as linearly modeled Q-functions. To derive…

机器学习 · 计算机科学 2023-02-03 Sing-Yuan Yeh , Fu-Chieh Chang , Chang-Wei Yueh , Pei-Yuan Wu , Alberto Bernacchia , Sattar Vakili

Episodic tasks in Reinforcement Learning (RL) often pose challenges due to sparse reward signals and high-dimensional state spaces, which hinder efficient learning. Additionally, these tasks often feature hidden "trap states" --…

机器学习 · 计算机科学 2025-05-23 Yuxuan Li , Yicheng Gao , Ning Yang , Stephen Xia

A challenge in multi-agent reinforcement learning is to be able to generalize over intractable state-action spaces. Inspired from Tesseract [Mahajan et al., 2021], this position paper investigates generalisation in state-action space over…

机器学习 · 计算机科学 2021-10-28 Pascal Van Der Vaart , Anuj Mahajan , Shimon Whiteson

In recent years, $Q$-learning has become indispensable for model-free reinforcement learning (MFRL). However, it suffers from well-known problems such as under- and overestimation bias of the value, which may adversely affect the policy…

机器学习 · 计算机科学 2021-02-09 Youngmin Oh , Jinwoo Shin , Eunho Yang , Sung Ju Hwang

Cyber-attacks are becoming increasingly sophisticated and frequent, highlighting the importance of network intrusion detection systems. This paper explores the potential and challenges of using deep reinforcement learning (DRL) in network…

密码学与安全 · 计算机科学 2026-03-03 Wanrong Yang , Alberto Acuto , Yihang Zhou , Dominik Wojtczak

A major challenge in modern reinforcement learning (RL) is efficient control of dynamical systems from high-dimensional sensory observations. Learning controllable embedding (LCE) is a promising approach that addresses this challenge by…

机器学习 · 计算机科学 2020-06-25 Brandon Cui , Yinlam Chow , Mohammad Ghavamzadeh

The rapid advancement of quantum computing (QC) and machine learning (ML) has given rise to the burgeoning field of quantum machine learning (QML), aiming to capitalize on the strengths of quantum computing to propel ML forward. Despite its…

量子物理 · 物理学 2024-07-30 Xin Dai , Tzu-Chieh Wei , Shinjae Yoo , Samuel Yen-Chi Chen

Sequential data such as time series, video, or text can be challenging to analyse as the ordered structure gives rise to complex dependencies. At the heart of this is non-commutativity, in the sense that reordering the elements of a…

机器学习 · 计算机科学 2021-08-02 Csaba Toth , Patric Bonnier , Harald Oberhauser

In this work, we evaluate the effectiveness of representation learning approaches for decision making in visually complex environments. Representation learning is essential for effective reinforcement learning (RL) from high-dimensional…

机器学习 · 计算机科学 2022-04-26 Jun Yamada , Karl Pertsch , Anisha Gunjal , Joseph J. Lim

Although recent deep learning methods, especially generative models, have shown good performance in fast magnetic resonance imaging, there is still much room for improvement in high-dimensional generation. Considering that internal…

计算机视觉与模式识别 · 计算机科学 2022-12-13 Wei Zhang , Zengwei Xiao , Hui Tao , Minghui Zhang , Xiaoling Xu , Qiegen Liu

We introduce a tensor-based model of shared representation for meta-learning from a diverse set of tasks. Prior works on learning linear representations for meta-learning assume that there is a common shared representation across different…

机器学习 · 计算机科学 2022-01-20 Samuel Deng , Yilin Guo , Daniel Hsu , Debmalya Mandal