中文
相关论文

相关论文: HyperPPO: A scalable method for finding small poli…

200 篇论文

We introduce a new algorithm for reinforcement learning called Maximum aposteriori Policy Optimisation (MPO) based on coordinate ascent on a relative entropy objective. We show that several existing methods can directly be related to our…

We tackle the problem of generalization to unseen configurations for dynamic tasks in the real world while learning from high-dimensional image input. The family of nonlinear dynamical system-based methods have successfully demonstrated…

机器学习 · 计算机科学 2021-07-13 Shikhar Bahl , Abhinav Gupta , Deepak Pathak

Learning a universal policy across different robot morphologies can significantly improve learning efficiency and generalization in continuous control. However, it poses a challenging multi-task reinforcement learning problem, as the…

人工智能 · 计算机科学 2023-08-07 Zheng Xiong , Jacob Beck , Shimon Whiteson

Chain-of-Thought (CoT) prompting has recently shown significant promise across various NLP and computer vision tasks by explicitly generating intermediate reasoning steps. However, we find that reinforcement learning (RL)-based fine-tuned…

计算机视觉与模式识别 · 计算机科学 2025-11-19 Qingyang Yan , Guangyao Chen , Yixiong Zou

We propose a decentralized reinforcement learning solution for multi-agent shepherding of non-cohesive targets using policy-gradient methods. Our architecture integrates target-selection with target-driving through Proximal Policy…

机器学习 · 计算机科学 2025-04-04 Stefano Covone , Italo Napolitano , Francesco De Lellis , Mario di Bernardo

Physics-informed neural networks (PINNs) have been widely used to develop neural surrogates for solutions of Partial Differential Equations. A drawback of PINNs is that they have to be retrained with every change in initial-boundary…

机器学习 · 计算机科学 2023-08-21 Ritam Majumdar , Vishal Jadhav , Anirudh Deodhar , Shirish Karande , Lovekesh Vig , Venkataramana Runkana

We present Memory Augmented Policy Optimization (MAPO), a simple and novel way to leverage a memory buffer of promising trajectories to reduce the variance of policy gradient estimate. MAPO is applicable to deterministic environments with…

机器学习 · 计算机科学 2019-01-15 Chen Liang , Mohammad Norouzi , Jonathan Berant , Quoc Le , Ni Lao

Over the past decade, the use of machine learning has increased exponentially. Models are far more complex than ever before, growing to gargantuan sizes and housing millions of weights. Unfortunately, the fact that large models have become…

机器学习 · 计算机科学 2025-05-19 Aditya Panangat

Reinforcement Learning with Verifiable Rewards (RLVR) has recently emerged as a powerful paradigm for facilitating the self-improvement of large language models (LLMs), particularly in the domain of complex reasoning tasks. However,…

机器学习 · 计算机科学 2025-07-17 Ziru Liu , Cheng Gong , Xinyu Fu , Yaofang Liu , Ran Chen , Shoubo Hu , Suiyun Zhang , Rui Liu , Qingfu Zhang , Dandan Tu

Reinforcement learning has emerged as a dominant technique for fine-tuning the behavior of large language models, with policy optimization (PO) algorithms such as GRPO, DAPO, and Dr. GRPO emerging in rapid succession to advance…

人机交互 · 计算机科学 2026-05-13 Aeree Cho , Alexander D. Greenhalgh , Jonathan Bodea , Anthony Peng , Duen Horng , Chau

Model predictive control can optimally deal with nonlinear systems under consideration of constraints. The control performance depends on the model accuracy and the prediction horizon. Recent advances propose to use reinforcement learning…

机器学习 · 计算机科学 2024-11-01 Dean Brandner , Sergio Lucia

The effectiveness of many optimal network control algorithms (e.g., BackPressure) relies on the premise that all of the nodes are fully controllable. However, these algorithms may yield poor performance in a partially-controllable network…

网络与互联网体系结构 · 计算机科学 2019-01-08 Qingkai Liang , Eytan Modiano

Reinforcement learning (RL) approaches for Large Language Models (LLMs) frequently use on-policy algorithms, such as PPO or GRPO. However, policy lag from distributed training architectures and differences between the training and inference…

机器学习 · 计算机科学 2026-03-03 Daniel Ritter , Owen Oertell , Bradley Guo , Jonathan Chang , Kianté Brantley , Wen Sun

Humanoid robots, with their human-like morphology, hold great potential for industrial applications. However, existing loco-manipulation methods primarily focus on dexterous manipulation, falling short of the combined requirements for…

机器人学 · 计算机科学 2025-11-27 Kaiyan Xiao , Zihan Xu , Cheng Zhe , Chengju Liu , Qijun Chen

Model-based reinforcement learning approaches leverage a forward dynamics model to support planning and decision making, which, however, may fail catastrophically if the model is inaccurate. Although there are several existing methods…

机器学习 · 计算机科学 2020-09-30 Hang Lai , Jian Shen , Weinan Zhang , Yong Yu

We introduce PPOPT - Proximal Policy Optimization using Pretraining, a novel, model-free deep-reinforcement-learning algorithm that leverages pretraining to achieve high training efficiency and stability on very small training samples in…

机器学习 · 计算机科学 2025-11-25 Ruoxing Yang

State-of-the-art reinforcement learning algorithms predominantly learn a policy from either a numerical state vector or images. Both approaches generally do not take structural knowledge of the task into account, which is especially…

机器学习 · 计算机科学 2022-03-14 Marco Oliva , Soubarna Banik , Josip Josifovski , Alois Knoll

Designing motion control and planning algorithms for multilift systems remains challenging due to the complexities of dynamics, collision avoidance, actuator limits, and scalability. Existing methods that use optimization and distributed…

机器人学 · 计算机科学 2024-10-08 Bingheng Wang , Rui Huang , Lin Zhao

Hierarchical Reinforcement Learning (HRL) algorithms have been demonstrated to perform well on high-dimensional decision making and robotic control tasks. However, because they solely optimize for rewards, the agent tends to search the same…

机器人学 · 计算机科学 2022-12-27 Kandai Watanabe , Mathew Strong , Omer Eldar

This study evaluates the performance of classical and modern control methods for real-world Cable-Driven Parallel Robots (CDPRs), focusing on underconstrained systems with limited time discretization. A comparative analysis is conducted…

机器人学 · 计算机科学 2025-10-10 Damir Nurtdinov , Aliaksei Korshuk , Alexei Kornaev , Alexander Maloletov