中文
相关论文

相关论文: ChiPFormer: Transferable Chip Placement via Offlin…

200 篇论文

Offline reinforcement learning (RL) defines the task of learning from a fixed batch of data. Due to errors in value estimation from out-of-distribution actions, most offline RL algorithms take the approach of constraining or regularizing…

机器学习 · 计算机科学 2021-12-06 Scott Fujimoto , Shixiang Shane Gu

Chip placement plays an important role in physical design. While generative models like diffusion models offer promising learning-based solutions, current methods have the following limitations: they use random synthetic data for…

硬件体系结构 · 计算机科学 2026-04-28 Peng Xie , Ke Xue , Yunqi Shi , Ruo-Tong Chen , Chengrui Gao , Siyuan Xu , Chenjian Ding , Mingxuan Yuan , Chao Qian

The goal of an offline reinforcement learning (RL) algorithm is to learn optimal polices using historical (offline) data, without access to the environment for online exploration. One of the main challenges in offline RL is the distribution…

机器学习 · 计算机科学 2023-10-31 Kishan Panaganti , Zaiyan Xu , Dileep Kalathil , Mohammad Ghavamzadeh

Offline reinforcement learning (RL), also known as batch RL, offers the prospect of policy optimization from large pre-recorded datasets without online environment interaction. It addresses challenges with regard to the cost of data…

Training a generalizable agent to continually learn a sequence of tasks from offline trajectories is a natural requirement for long-lived agents, yet remains a significant challenge for current offline reinforcement learning (RL)…

机器学习 · 计算机科学 2024-11-19 Shengchao Hu , Yuhang Zhou , Ziqing Fan , Jifeng Hu , Li Shen , Ya Zhang , Dacheng Tao

Reinforcement Learning-based Recommender Systems (RLRS) have shown promise across a spectrum of applications, from e-commerce platforms to streaming services. Yet, they grapple with challenges, notably in crafting reward functions and…

信息检索 · 计算机科学 2024-03-27 Siyu Wang , Xiaocong Chen , Lina Yao

Offline Reinforcement Learning (RL) is a promising approach for next-generation wireless networks, where online exploration is unsafe and large amounts of operational data can be reused across the model lifecycle. However, the behavior of…

网络与互联网体系结构 · 计算机科学 2026-03-05 Nicolas Helson , Pegah Alizadeh , Anastasios Giovanidis

One of the ambitious goals of artificial intelligence is to build a machine that outperforms human intelligence, even if limited knowledge and data are provided. Reinforcement Learning (RL) provides one such possibility to reach this goal.…

介观与纳米尺度物理 · 物理学 2018-05-31 Xiao-Ming Zhang , Zi-Wei Cui , Xin Wang , Man-Hong Yung

Recently, successful applications of reinforcement learning to chip placement have emerged. Pretrained models are necessary to improve efficiency and effectiveness. Currently, the weights of objective metrics (e.g., wirelength, congestion,…

Process control is widely discussed in the manufacturing process, especially for semiconductor manufacturing. Due to unavoidable disturbances in manufacturing, different process controllers are proposed to realize variation reduction. Since…

系统与控制 · 电气工程与系统科学 2021-10-25 Yanrong Li , Juan Du , Wei Jiang

Large transformer models pretrained on offline reinforcement learning datasets have demonstrated remarkable in-context reinforcement learning (ICRL) capabilities, where they can make good decisions when prompted with interaction…

机器学习 · 计算机科学 2024-05-28 Licong Lin , Yu Bai , Song Mei

Conventional reinforcement learning (RL) needs an environment to collect fresh data, which is impractical when online interactions are costly. Offline RL provides an alternative solution by directly learning from the previously collected…

机器学习 · 计算机科学 2023-03-15 Han Zheng , Xufang Luo , Pengfei Wei , Xuan Song , Dongsheng Li , Jing Jiang

Offline Meta Reinforcement Learning (OMRL) aims to learn transferable knowledge from offline datasets to enhance the learning process for new target tasks. Context-based Reinforcement Learning (RL) adopts a context encoder to expediently…

机器学习 · 计算机科学 2023-05-24 Chenyang Zhao , Zihao Zhou , Bin Liu

Multirotors play a significant role in diverse field robotics applications but remain highly susceptible to actuator failures, leading to rapid instability and compromised mission reliability. While various fault-tolerant control (FTC)…

机器人学 · 计算机科学 2025-05-14 Dohyun Kim , Jayden Dongwoo Lee , Hyochoong Bang , Jungho Bae

The success of deep reinforcement learning (DRL) lies in its ability to learn a representation that is well-suited for the exploration and exploitation task. To understand how the choice of representation can improve the efficiency of…

机器学习 · 计算机科学 2024-02-15 Weitong Zhang , Jiafan He , Dongruo Zhou , Amy Zhang , Quanquan Gu

Offline reinforcement learning (RL) is a variant of RL where the policy is learned from a previously collected dataset of trajectories and rewards. In our work, we propose a practical approach to offline RL with large language models…

Offline reinforcement learning (RL) refers to the problem of learning policies entirely from a large batch of previously collected data. This problem setting offers the promise of utilizing such datasets to acquire policies without any…

机器学习 · 计算机科学 2020-11-24 Tianhe Yu , Garrett Thomas , Lantao Yu , Stefano Ermon , James Zou , Sergey Levine , Chelsea Finn , Tengyu Ma

Offline reinforcement learning (RL) can be used to improve future performance by leveraging historical data. There exist many different algorithms for offline RL, and it is well recognized that these algorithms, and their hyperparameter…

机器学习 · 计算机科学 2023-01-18 Allen Nie , Yannis Flet-Berliac , Deon R. Jordan , William Steenbergen , Emma Brunskill

Parameter-efficient transfer learning (PETL) aims to adapt pre-trained models to new downstream tasks while minimizing the number of fine-tuned parameters. Adapters, a popular approach in PETL, inject additional capacity into existing…

机器学习 · 计算机科学 2024-10-22 Aleksandra I. Nowak , Otniel-Bogdan Mercea , Anurag Arnab , Jonas Pfeiffer , Yann Dauphin , Utku Evci

We present a case for the use of Reinforcement Learning (RL) for the design of physics instrument as an alternative to gradient-based instrument-optimization methods. It's applicability is demonstrated using two empirical studies. One is…

仪器与探测器 · 物理学 2024-12-16 Shah Rukh Qasim , Patrick Owen , Nicola Serra