中文
相关论文

相关论文: Scaling Off-Policy Reinforcement Learning with Bat…

200 篇论文

The potential of offline reinforcement learning (RL) is that high-capacity models trained on large, heterogeneous datasets can lead to agents that generalize broadly, analogously to similar advances in vision and NLP. However, recent works…

机器学习 · 计算机科学 2023-04-19 Aviral Kumar , Rishabh Agarwal , Xinyang Geng , George Tucker , Sergey Levine

Reinforcement learning systems require good representations to work well. For decades practical success in reinforcement learning was limited to small domains. Deep reinforcement learning systems, on the other hand, are scalable, not…

机器学习 · 计算机科学 2020-03-18 Sina Ghiassian , Banafsheh Rafiee , Yat Long Lo , Adam White

Reinforcement learning has shown great promise in robotics thanks to its ability to develop efficient robotic control procedures through self-training. In particular, reinforcement learning has been successfully applied to solving the…

机器人学 · 计算机科学 2020-11-12 Pierre Aumjaud , David McAuliffe , Francisco Javier Rodríguez Lera , Philip Cardiff

Heavy goods vehicles are vital backbones of the supply chain delivery system but also contribute significantly to carbon emissions with only 60% loading efficiency in the United Kingdom. Collaborative vehicle routing has been proposed as a…

机器学习 · 计算机科学 2024-06-12 Stefan Schoepf , Stephen Mak , Julian Senoner , Liming Xu , Netland Torbjörn , Alexandra Brintrup

Transformer architecture gradually dominates the LLM field. Recent advances in training optimization for Transformer-based large language models (LLMs) primarily focus on architectural modifications or optimizer adjustments. However, these…

Reinforcement learning is structurally harder than supervised learning because the policy changes the data distribution it learns from. The resulting fragility is especially visible in large-model training, where the training and rollout…

机器学习 · 计算机科学 2026-05-13 Rasool Fakoor , Murdock Aubry , Nicholas Stranges , Alexander J. Smola

Reinforcement learning is commonly associated with training of reward-maximizing (or cost-minimizing) agents, in other words, controllers. It can be applied in model-free or model-based fashion, using a priori or online collected system…

系统与控制 · 电气工程与系统科学 2022-09-01 Lukas Beckenbach , Pavel Osinenko , Stefan Streif

Quantum Computing aims to streamline machine learning, making it more effective with fewer trainable parameters. This reduction of parameters can speed up the learning process and reduce the use of computational resources. However, in the…

量子物理 · 物理学 2024-05-22 Michael Kölle , Timo Witter , Tobias Rohe , Gerhard Stenzel , Philipp Altmann , Thomas Gabor

This paper investigates how to incorporate expert observations (without explicit information on expert actions) into a deep reinforcement learning setting to improve sample efficiency. First, we formulate an augmented policy loss combining…

机器学习 · 计算机科学 2025-02-28 Erhan Can Ozcan , Vittorio Giammarino , James Queeney , Ioannis Ch. Paschalidis

Reinforcement Learning (RL) algorithms can solve challenging control problems directly from image observations, but they often require millions of environment interactions to do so. Recently, model-based RL algorithms have greatly improved…

机器学习 · 计算机科学 2023-06-16 Yifan Xu , Nicklas Hansen , Zirui Wang , Yung-Chieh Chan , Hao Su , Zhuowen Tu

Reinforcement Learning (RL) enhances LLM reasoning, yet a paradox emerges as models scale: strong base models saturate standard benchmarks (e.g., MATH), yielding correct but homogeneous solutions. In such environments, the lack of failure…

机器学习 · 计算机科学 2026-04-21 Zhenwen Liang , Yujun Zhou , Sidi Lu , Xiangliang Zhang , Haitao Mi , Dong Yu

Using a high Update-To-Data (UTD) ratio, model-based methods have recently achieved much higher sample efficiency than previous model-free methods for continuous-action DRL benchmarks. In this paper, we introduce a simple model-free…

机器学习 · 计算机科学 2021-03-19 Xinyue Chen , Che Wang , Zijian Zhou , Keith Ross

In complex environments with high dimension, training a reinforcement learning (RL) model from scratch often suffers from lengthy and tedious collection of agent-environment interactions. Instead, leveraging expert demonstration to guide RL…

机器学习 · 计算机科学 2021-09-28 Zhaorun Chen , Binhao Chen , Shenghan Xie , Liang Gong , Chengliang Liu , Zhengfeng Zhang , Junping Zhang

Reinforcement learning is able to solve complex sequential decision-making tasks but is currently limited by sample efficiency and required computation. To improve sample efficiency, recent work focuses on model-based RL which interleaves…

机器学习 · 计算机科学 2023-06-19 Yi Zhao , Wenshuai Zhao , Rinu Boney , Juho Kannala , Joni Pajarinen

A recent trend in deep learning algorithms has been towards training large scale models, having high parameter count and trained on big dataset. However, robustness of such large scale models towards real-world settings is still a…

计算机视觉与模式识别 · 计算机科学 2023-09-15 Nishant Jain , Harkirat Behl , Yogesh Singh Rawat , Vibhav Vineet

Due to the realization that deep reinforcement learning algorithms trained on high-dimensional tasks can strongly overfit to their training environments, there have been several studies that investigated the generalization performance of…

机器学习 · 计算机科学 2020-07-06 Safa Alver , Doina Precup

With the rapid increase in the size of neural networks, model compression has become an important area of research. Quantization is an effective technique at decreasing the model size, memory access, and compute load of large models.…

音频与语音处理 · 电气工程与系统科学 2023-05-26 David Qiu , David Rim , Shaojin Ding , Oleg Rybakov , Yanzhang He

Deep neural networks have been shown to be very powerful modeling tools for many supervised learning tasks involving complex input patterns. However, they can also easily overfit to training set biases and label noises. In addition to…

机器学习 · 计算机科学 2019-05-07 Mengye Ren , Wenyuan Zeng , Bin Yang , Raquel Urtasun

Offline reinforcement learning (RL) is challenged by the distributional shift between learning policies and datasets. To address this problem, existing works mainly focus on designing sophisticated algorithms to explicitly or implicitly…

机器学习 · 计算机科学 2022-10-18 Yang Yue , Bingyi Kang , Xiao Ma , Zhongwen Xu , Gao Huang , Shuicheng Yan

Reinforcement Learning (RL) is a well-established framework for sequential decision-making in complex environments. However, state-of-the-art Deep RL (DRL) algorithms typically require large training datasets and often struggle to…

人工智能 · 计算机科学 2026-04-13 Celeste Veronese , Alessandro Farinelli , Daniele Meli