中文
相关论文

相关论文: Offline Critic-Guided Diffusion Policy for Multi-U…

200 篇论文

Continual Learning (CL) aims to learn from a non-stationary data stream where the underlying distribution changes over time. While recent advances have produced efficient memory-free methods in the offline CL (offCL) setting, where tasks…

机器学习 · 计算机科学 2025-06-10 Nicolas Michel , Maorong Wang , Jiangpeng He , Toshihiko Yamasaki

We study off-dynamics offline reinforcement learning, where the goal is to learn a policy from offline source and limited target datasets with mismatched dynamics. Existing methods either penalize the reward or discard source transitions…

机器学习 · 计算机科学 2026-03-19 Yihong Guo , Yu Yang , Pan Xu , Anqi Liu

Sample efficiency and exploration remain major challenges in online reinforcement learning (RL). A powerful approach that can be applied to address these issues is the inclusion of offline data, such as prior trajectories from a human…

机器学习 · 计算机科学 2023-06-01 Philip J. Ball , Laura Smith , Ilya Kostrikov , Sergey Levine

Drawing upon recent advances in language model alignment, we formulate offline Reinforcement Learning as a two-stage optimization problem: First pretraining expressive generative policies on reward-free behavior datasets, then fine-tuning…

机器学习 · 计算机科学 2024-10-31 Huayu Chen , Kaiwen Zheng , Hang Su , Jun Zhu

Diffusion policies have achieved superior performance in imitation learning and offline reinforcement learning (RL) due to their rich expressiveness. However, the conventional diffusion training procedure requires samples from target…

机器学习 · 计算机科学 2025-07-01 Haitong Ma , Tianyi Chen , Kai Wang , Na Li , Bo Dai

Recent advancements in offline Reinforcement Learning (Offline RL) have led to an increased focus on methods based on conservative policy updates to address the Out-of-Distribution (OOD) issue. These methods typically involve adding…

人工智能 · 计算机科学 2024-06-12 Zhao Wang , Briti Gangopadhyay , Jia-Fong Yeh , Shingo Takamatsu

Model-based offline optimization with dynamics-aware policy provides a new perspective for policy learning and out-of-distribution generalization, where the learned policy could adapt to different dynamics enumerated at the training stage.…

机器学习 · 计算机科学 2022-06-09 Chengxing Jia , Hao Yin , Chenxiao Gao , Tian Xu , Lei Yuan , Zongzhang Zhang , Yang Yu

A key problem in off-policy Reinforcement Learning (RL) is the mismatch, or distribution shift, between the dataset and the distribution over states and actions visited by the learned policy. This problem is exacerbated in the fully offline…

机器学习 · 计算机科学 2023-11-28 Melrose Roderick , Gaurav Manek , Felix Berkenkamp , J. Zico Kolter

A key operational challenge for call centers is to decide, in real time, which waiting customer should be served by which available agent. This is known as skill-based routing, and the decision becomes especially difficult in large systems…

系统与控制 · 电气工程与系统科学 2026-05-12 Baris Ata , Ebru Kasikaralar

Diffusion models have demonstrated their capabilities in modeling trajectories of multi-tasks. However, existing multi-task planners or policies typically rely on task-specific demonstrations via multi-task imitation, or require…

机器学习 · 计算机科学 2025-07-15 Chenyou Fan , Chenjia Bai , Zhao Shan , Haoran He , Yang Zhang , Zhen Wang

Out-of-distribution (OOD) detection is crucial for the reliable deployment of machine learning models in real-world scenarios, enabling the identification of unknown samples or objects. A prominent approach to enhance OOD detection…

机器学习 · 统计学 2025-08-05 Heng Gao , Jun Li

Mobile edge computing (a.k.a. fog computing) has recently emerged to enable in-situ processing of delay-sensitive applications at the edge of mobile networks. Providing grid power supply in support of mobile edge computing, however, is…

机器学习 · 计算机科学 2017-03-20 Jie Xu , Lixing Chen , Shaolei Ren

In this paper, a new population-guided parallel learning scheme is proposed to enhance the performance of off-policy reinforcement learning (RL). In the proposed scheme, multiple identical learners with their own value-functions and…

机器学习 · 计算机科学 2020-01-10 Whiyoung Jung , Giseung Park , Youngchul Sung

This work introduces DiffuseLoco, a framework for training multi-skill diffusion-based policies for dynamic legged locomotion from offline datasets, enabling real-time control of diverse skills on robots in the real world. Offline learning…

机器人学 · 计算机科学 2024-05-01 Xiaoyu Huang , Yufeng Chi , Ruofeng Wang , Zhongyu Li , Xue Bin Peng , Sophia Shao , Borivoje Nikolic , Koushil Sreenath

Highly automated assembly lines enable significant productivity gains in the manufacturing industry, particularly in mass production condition. Nonetheless, challenges persist in job scheduling for make-to-job and mass customization,…

神经与进化计算 · 计算机科学 2023-11-22 Lele Li , Liyong Lin

Combining offline and online reinforcement learning (RL) techniques is indeed crucial for achieving efficient and safe learning where data acquisition is expensive. Existing methods replay offline data directly in the online phase,…

机器学习 · 计算机科学 2024-09-05 Xu-Hui Liu , Tian-Shuo Liu , Shengyi Jiang , Ruifeng Chen , Zhilong Zhang , Xinwei Chen , Yang Yu

Offline Reinforcement Learning (RL) offers an attractive alternative to interactive data acquisition by leveraging pre-existing datasets. However, its effectiveness hinges on the quantity and quality of the data samples. This work explores…

机器学习 · 计算机科学 2024-10-17 Wen Zheng Terence Ng , Jianda Chen , Tianwei Zhang

Stochastic gradient descent (SGD) is a powerful optimization technique that is particularly useful in online learning scenarios. Its convergence analysis is relatively well understood under the assumption that the data samples are…

机器学习 · 计算机科学 2024-10-03 Ethan Che , Jing Dong , Xin T. Tong

Model-based reinforcement learning methods often use learning only for the purpose of estimating an approximate dynamics model, offloading the rest of the decision-making work to classical trajectory optimizers. While conceptually simple,…

机器学习 · 计算机科学 2022-12-22 Michael Janner , Yilun Du , Joshua B. Tenenbaum , Sergey Levine

With the shrinking of technology nodes and the use of parallel processor clusters in hostile and critical environments, such as space, run-time faults caused by radiation are a serious cross-cutting concern, also impacting architectural…

分布式、并行与集群计算 · 计算机科学 2023-11-30 Michael Rogenmoser , Nils Wistoff , Pirmin Vogel , Frank Gürkaynak , Luca Benini