中文
相关论文

相关论文: Distributional Soft Actor-Critic with Diffusion Po…

200 篇论文

Robotic manipulation remains challenging for reinforcement learning due to contact-rich dynamics, long horizons, and training instability. Although off-policy actor-critic algorithms such as SAC and TD3 perform well in simulation, they…

机器人学 · 计算机科学 2026-04-03 Yu Zhang , Karl Mason

Multi-Agent Reinforcement Learning (MARL) has emerged as a foundational approach for addressing diverse, intelligent control tasks in various scenarios like the Internet of Vehicles, Internet of Things, and Unmanned Aerial Vehicles.…

多智能体系统 · 计算机科学 2024-10-15 Xiaoxue Yu , Rongpeng Li , Chengchao Liang , Zhifeng Zhao

Recently, diffusion policy has shown impressive results in handling multi-modal tasks in robotic manipulation. However, it has fundamental limitations in out-of-distribution failures that persist due to compounding errors and its limited…

机器人学 · 计算机科学 2025-03-25 Sung-Wook Lee , Xuhui Kang , Yen-Ling Kuo

Reinforcement learning has emerged as a powerful tool for improving diffusion-based text-to-image models, but existing methods are largely limited to single-task optimization. Extending RL to multiple tasks is challenging: joint…

机器学习 · 计算机科学 2026-05-15 Quanhao Li , Junqiu Yu , Kaixun Jiang , Yujie Wei , Zhen Xing , Pandeng Li , Ruihang Chu , Shiwei Zhang , Yu Liu , Zuxuan Wu

Many reinforcement learning (RL) problems in practice are offline, learning purely from observational data. A key challenge is how to ensure the learned policy is safe, which requires quantifying the risk associated with different actions.…

机器学习 · 计算机科学 2021-10-28 Yecheng Jason Ma , Dinesh Jayaraman , Osbert Bastani

In many real-world reinforcement learning applications, access to the environment is limited to a fixed dataset, instead of direct (online) interaction with the environment. When using this data for either evaluation or training of a new…

机器学习 · 计算机科学 2019-11-06 Ofir Nachum , Yinlam Chow , Bo Dai , Lihong Li

Current approaches to multi-agent cooperation rely heavily on centralized mechanisms or explicit communication protocols to ensure convergence. This paper studies the problem of distributed multi-agent learning without resorting to…

多智能体系统 · 计算机科学 2025-08-19 Caroline Wang , Ishan Durugkar , Elad Liebman , Peter Stone

Safety is essential for reinforcement learning (RL) applied in real-world situations. Chance constraints are suitable to represent the safety requirements in stochastic systems. Previous chance-constrained RL methods usually have a low…

机器学习 · 计算机科学 2021-03-17 Baiyu Peng , Yao Mu , Yang Guan , Shengbo Eben Li , Yuming Yin , Jianyu Chen

Diffusion policies are conditional diffusion models that learn robot action distributions conditioned on the robot and environment state. They have recently shown to outperform both deterministic and alternative action distribution learning…

机器人学 · 计算机科学 2024-07-26 Tsung-Wei Ke , Nikolaos Gkanatsios , Katerina Fragkiadaki

Distributionally robust policy learning aims to find a policy that performs well under the worst-case distributional shift, and yet most existing methods for robust policy learning consider the worst-case joint distribution of the covariate…

机器学习 · 计算机科学 2025-06-03 Jingyuan Wang , Zhimei Ren , Ruohan Zhan , Zhengyuan Zhou

We study a sequential decision-making problem for a profit-maximizing operator of an autonomous mobility-on-demand system. Optimizing a central operator's vehicle-to-request dispatching policy requires efficient and effective fleet control…

系统与控制 · 电气工程与系统科学 2025-06-24 Zeno Woywood , Jasper I. Wiltfang , Julius Luy , Tobias Enders , Maximilian Schiffer

In offline reinforcement learning, value overestimation caused by out-of-distribution (OOD) actions significantly limits policy performance. Recently, diffusion models have been leveraged for their strong distribution-matching capabilities,…

机器学习 · 计算机科学 2025-11-13 Yunchang Ma , Tenglong Liu , Yixing Lan , Xin Yin , Changxin Zhang , Xinglong Zhang , Xin Xu

The option framework has shown great promise by automatically extracting temporally-extended sub-tasks from a long-horizon task. Methods have been proposed for concurrently learning low-level intra-option policies and high-level option…

人工智能 · 计算机科学 2020-06-26 Chenghao Li , Xiaoteng Ma , Chongjie Zhang , Jun Yang , Li Xia , Qianchuan Zhao

Meta-reinforcement learning algorithms provide a data-driven way to acquire policies that quickly adapt to many tasks with varying rewards or dynamics functions. However, learned meta-policies are often effective only on the exact task…

机器学习 · 计算机科学 2023-07-13 Anurag Ajay , Abhishek Gupta , Dibya Ghosh , Sergey Levine , Pulkit Agrawal

Diffusion- and flow-based policies deliver state-of-the-art performance on long-horizon robotic manipulation and imitation learning tasks. However, these controllers employ a fixed inference budget at every control step, regardless of task…

机器人学 · 计算机科学 2025-11-27 Inkook Chun , Seungjae Lee , Michael S. Albergo , Saining Xie , Eric Vanden-Eijnden

Model-free deep reinforcement learning (RL) algorithms have achieved tremendous success on a range of challenging tasks. However, safety concerns remain when these methods are deployed on real-world applications, necessitating risk-aware…

机器学习 · 计算机科学 2026-02-10 Alonso Granados , Jason Pacheco

Most deep reinforcement learning algorithms are data inefficient in complex and rich environments, limiting their applicability to many scenarios. One direction for improving data efficiency is multitask learning with shared neural network…

Model-free deep reinforcement learning has achieved great success in many domains, such as video games, recommendation systems and robotic control tasks. In continuous control tasks, widely used policies with Gaussian distributions results…

机器学习 · 计算机科学 2023-06-05 Lingwei Peng , Hui Qian , Zhebang Shen , Chao Zhang , Fei Li

Deep off-policy actor-critic algorithms have emerged as the leading framework for reinforcement learning in continuous control domains. However, most of these algorithms suffer from poor sample efficiency, especially in environments with…

机器学习 · 计算机科学 2026-02-25 Zahra Shahrooei , Ali Baheri

TD($\lambda$) in value-based MARL algorithms or the Temporal Difference critic learning in Actor-Critic-based (AC-based) algorithms synergistically integrate elements from Monte-Carlo simulation and Q function bootstrapping via dynamic…

机器学习 · 计算机科学 2026-05-13 Yue Deng , Zirui Wang , Yin Zhang