English
Related papers

Related papers: Component Centric Placement Using Deep Reinforceme…

200 papers

Placement is a critical step in modern chip design, aiming to determine the positions of circuit modules on the chip canvas. Recent works have shown that reinforcement learning (RL) can improve human performance in chip placement. However,…

Machine Learning · Computer Science 2023-08-02 Yao Lai , Jinxin Liu , Zhentao Tang , Bin Wang , Jianye Hao , Ping Luo

Ensuring reliability in modern software systems requires rigorous pre-production testing across highly heterogeneous and evolving environments. Because exhaustive evaluation is infeasible, practitioners must decide how to allocate limited…

Software Engineering · Computer Science 2025-10-08 Yu Zhu

In physical design, human designers typically place macros via trial and error, which is a Markov decision process. Reinforcement learning (RL) methods have demonstrated superhuman performance on the macro placement. In this paper, we…

Machine Learning · Computer Science 2021-09-07 Zixuan Jiang , Ebrahim Songhori , Shen Wang , Anna Goldie , Azalia Mirhoseini , Joe Jiang , Young-Joon Lee , David Z. Pan

With the rise in data centre virtualization, there are increasing choices as to where to place workloads, be it in web applications, Enterprise IT or in Network Function Virtualisation. Workload placement approaches available today…

Networking and Internet Architecture · Computer Science 2017-05-10 Ruoyang Xiu , John Evans

The controller is one of the most important modules in the autonomous driving pipeline, ensuring the vehicle reaches its desired position. In this work, a reinforcement learning based lateral control approach, despite the imperfections in…

Robotics · Computer Science 2025-06-05 Chengdong Wu , Sven Kirchner , Nils Purschke , Alois C. Knoll

Industrial robot manipulators are playing a more significant role in modern manufacturing industries. Though peg-in-hole assembly is a common industrial task which has been extensively researched, safely solving complex high precision…

We develop a portfolio allocation framework that leverages deep learning techniques to address challenges arising from high-dimensional, non-stationary, and low-signal-to-noise market information. Our approach includes a dynamic embedding…

Portfolio Management · Quantitative Finance 2025-01-31 Jinghai He , Cheng Hua , Chunyang Zhou , Zeyu Zheng

The rapid growth of electric vehicles (EVs) necessitates the strategic placement of charging stations to optimize resource utilization and minimize user inconvenience. Reinforcement learning (RL) offers an innovative approach to identifying…

Machine Learning · Computer Science 2025-11-04 Minh-Duc Nguyen , Dung D. Le , Phi Long Nguyen

Reinforcement learning (RL) is a branch of machine learning which is employed to solve various sequential decision making problems without proper supervision. Due to the recent advancement of deep learning, the newly proposed Deep-RL…

Artificial Intelligence · Computer Science 2019-04-17 Dhruv Ramani

We discuss deep reinforcement learning in an overview style. We draw a big picture, filled with details. We discuss six core elements, six important mechanisms, and twelve applications, focusing on contemporary work, and in historical…

Machine Learning · Computer Science 2018-10-16 Yuxi Li

Connector insertion and many other tasks commonly found in modern manufacturing settings involve complex contact dynamics and friction. Since it is difficult to capture related physical effects with first-order modeling, traditional control…

Due to the increasing complexity of chip design, existing placement methods still have many shortcomings in dealing with macro cells coverage and optimization efficiency. Aiming at the problems of layout overlap, inferior performance, and…

Hardware Architecture · Computer Science 2024-10-01 Tao Yu , Peng Gao , Fei Wang , Ru-Yue Yuan

Large multi-tenant production clusters often have to handle a variety of jobs and applications with a variety of complex resource usage characteristics. It is non-trivial and non-optimal to manually create placement rules for scheduling…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-07-31 Subrata Mitra , Shanka Subhra Mondal , Nikhil Sheoran , Neeraj Dhake , Ravinder Nehra , Ramanuja Simha

Chiplet-based systems, integrating various silicon dies manufactured at different integrated circuit technology nodes on a carrier interposer, have garnered significant attention in recent years due to their cost-effectiveness and…

Machine Learning · Computer Science 2024-04-09 Zhihui Deng , Yuanyuan Duan , Leilai Shao , Xiaolei Zhu

Reinforcement learning has been successfully applied to the problem of tuning PID controllers in several applications. The existing methods often utilize function approximation, such as neural networks, to update the controller parameters…

Deep reinforcement learning (RL) is an optimization-driven framework for producing control strategies for general dynamical systems without explicit reliance on process models. Good results have been reported in simulation. Here we…

Systems and Control · Electrical Eng. & Systems 2022-01-14 Nathan P. Lawrence , Michael G. Forbes , Philip D. Loewen , Daniel G. McClement , Johan U. Backstrom , R. Bhushan Gopaluni

To develop driving automation technologies for human, a human-centered methodology should be adopted for ensured safety and satisfactory user experience. Automated lane change decision in dense highway traffic is challenging, especially…

Robotics · Computer Science 2021-12-28 Daofei Li , Ao Liu

Printed Circuit Boards are the foundation for the functioning of any electronic device, and therefore are an essential component for various industries such as automobile, communication, computation, etc. However, one of the challenges…

Computer Vision and Pattern Recognition · Computer Science 2021-02-23 Tejas Khare , Vaibhav Bahel , Anuradha C. Phadke

Recent advances in GPU accelerated global and detail placement have reduced the time to solution by an order of magnitude. This advancement allows us to leverage data driven optimization (such as Reinforcement Learning) in an effort to…

Machine Learning · Computer Science 2021-09-07 Robert Kirby , Kolby Nottingham , Rajarshi Roy , Saad Godil , Bryan Catanzaro

Deep reinforcement learning is an emerging machine learning approach which can teach a computer to learn from their actions and rewards similar to the way humans learn from experience. It offers many advantages in automating decision…

Mesoscale and Nanoscale Physics · Physics 2021-07-08 V. Nguyen , S. B. Orbell , D. T. Lennon , H. Moon , F. Vigneau , L. C. Camenzind , L. Yu , D. M. Zumbühl , G. A. D. Briggs , M. A. Osborne , D. Sejdinovic , N. Ares