中文
相关论文

相关论文: Towards Efficient and Expressive Offline RL via Fl…

200 篇论文

Offline reinforcement learning enables sample-efficient policy acquisition without risky online interaction, yet policies trained on static datasets remain brittle under action-space perturbations such as actuator faults. This study…

机器人学 · 计算机科学 2026-03-02 Shingo Ayabe , Hiroshi Kera , Kazuhiko Kawamoto

Most reinforcement learning (RL) algorithms assume online access to the environment, in which one may readily interleave updates to the policy with experience collection using that policy. However, in many real-world applications such as…

机器学习 · 计算机科学 2020-06-24 Tatsuya Matsushima , Hiroki Furuta , Yutaka Matsuo , Ofir Nachum , Shixiang Gu

Reinforcement learning (RL) with combinatorial action spaces remains challenging because feasible action sets are exponentially large and governed by complex feasibility constraints, making direct policy parameterization impractical.…

The exponential growth of Internet of Things (IoT) devices, smart vehicles, and latency-sensitive applications has created an urgent demand for efficient distributed computing paradigms. Multi-Fog Computing (MFC), as an extension of fog and…

网络与互联网体系结构 · 计算机科学 2025-11-04 Mohammad Hadi Akbarzadeh , Mahmood Ahmadi , Mohammad Saeed Jahangiry , Jae Young Hur

Offline reinforcement learning seeks to utilize offline (observational) data to guide the learning of (causal) sequential decision making strategies. The hope is that offline reinforcement learning coupled with function approximation…

机器学习 · 计算机科学 2020-10-23 Ruosong Wang , Dean P. Foster , Sham M. Kakade

Federated learning (FL) has been intensively investigated in terms of communication efficiency, privacy, and fairness. However, efficient annotation, which is a pain point in real-world FL applications, is less studied. In this project, we…

机器学习 · 计算机科学 2024-03-19 Jin-Hyun Ahn , Kyungsang Kim , Jeongwan Koh , Quanzheng Li

Offline reinforcement learning (RL) defines the task of learning from a fixed batch of data. Due to errors in value estimation from out-of-distribution actions, most offline RL algorithms take the approach of constraining or regularizing…

机器学习 · 计算机科学 2021-12-06 Scott Fujimoto , Shixiang Shane Gu

Current Reinforcement Learning (RL) is often limited by the large amount of data needed to learn a successful policy. Offline RL aims to solve this issue by using transitions collected by a different behavior policy. We address a novel…

机器学习 · 计算机科学 2024-05-29 Johannes Ackermann , Takayuki Osa , Masashi Sugiyama

Time series forecasting typically needs to address non-stationary data with evolving trend and seasonal patterns. To address the non-stationarity, reversible instance normalization has been recently proposed to alleviate impacts from the…

机器学习 · 计算机科学 2024-10-01 Weiwei Ye , Songgaojun Deng , Qiaosha Zou , Ning Gui

Function-as-a-Service (FaaS) is a cloud computing paradigm offering an event-driven execution model to applications. It features serverless attributes by eliminating resource management responsibilities from developers, and offers…

分布式、并行与集群计算 · 计算机科学 2024-11-14 Siddharth Agarwal , Maria A. Rodriguez , Rajkumar Buyya

Model-free reinforcement learning has been successfully applied to a range of challenging problems, and has recently been extended to handle large neural network policies and value functions. However, the sample complexity of model-free…

机器学习 · 计算机科学 2016-03-03 Shixiang Gu , Timothy Lillicrap , Ilya Sutskever , Sergey Levine

Offline reinforcement learning (RL) methods harness previous experiences to derive an optimal policy, forming the foundation for pre-trained large-scale models (PLMs). When encountering tasks not seen before, PLMs often utilize several…

机器学习 · 计算机科学 2024-11-05 Shengchao Hu , Wanru Zhao , Weixiong Lin , Li Shen , Ya Zhang , Dacheng Tao

The use of machine learning in fluid dynamics is becoming more common to expedite the computation when solving forward and inverse problems of partial differential equations. Yet, a notable challenge with existing convolutional neural…

流体动力学 · 物理学 2024-05-10 Siming Shan , Pengkai Wang , Song Chen , Jiaxu Liu , Chao Xu , Shengze Cai

Reliable value estimation serves as the cornerstone of reinforcement learning (RL) by evaluating long-term returns and guiding policy improvement, significantly influencing the convergence speed and final performance. Existing works improve…

机器学习 · 计算机科学 2025-10-28 Shan Zhong , Shutong Ding , He Diao , Xiangyu Wang , Kah Chan Teh , Bei Peng

Generative models such as diffusion and flow matching have become dominant paradigms for visuomotor policy learning, yet their reliance on iterative denoising incurs high inference latency incompatible with real-time robotic control. We…

机器人学 · 计算机科学 2026-05-18 Jiaqi Bai , Jindou Jia , Yuxuan Hu , Gen Li , Xiangyu Chen , Tuo An , Kuangji Zuo , Jianfei Yang

This paper describes a purely data-driven solution to a class of sequential decision-making problems with a large number of concurrent online decisions, with applications to computing systems and operations research. We assume that while…

人工智能 · 计算机科学 2019-10-02 Hardik Meisheri , Vinita Baniwal , Nazneen N Sultana , Balaraman Ravindran , Harshad Khadilkar

Recent advances in batch (offline) reinforcement learning have shown promising results in learning from available offline data and proved offline reinforcement learning to be an essential toolkit in learning control policies in a model-free…

机器学习 · 计算机科学 2022-12-19 Ashish Kumar , Ilya Kuzovkin

We introduce an offline reinforcement learning (RL) algorithm that explicitly clones a behavior policy to constrain value learning. In offline RL, it is often important to prevent a policy from selecting unobserved actions, since the…

机器学习 · 计算机科学 2022-06-03 Wonjoon Goo , Scott Niekum

Hierarchical goal-conditioned reinforcement learning (H-GCRL) provides a powerful framework for tackling complex, long-horizon tasks by decomposing them into structured subgoals. However, its practical adoption is hindered by poor data…

机器人学 · 计算机科学 2026-02-12 Shaswat Garg , Matin Moezzi , Brandon Da Silva

Behavior Cloning (BC) has emerged as a highly effective paradigm for robot learning. However, BC lacks a self-guided mechanism for online improvement after demonstrations have been collected. Existing offline-to-online learning methods…