English
Related papers

Related papers: Delving into Macro Placement with Reinforcement Le…

200 papers

Reinforcement learning tasks are typically specified as Markov decision processes. This formalism has been highly successful, though specifications often couple the dynamics of the environment and the learning objective. This lack of…

Artificial Intelligence · Computer Science 2021-09-21 Martha White

Learned indices have been proposed to replace classic index structures like B-Tree with machine learning (ML) models. They require to replace both the indices and query processing algorithms currently deployed by the databases, and such a…

Databases · Computer Science 2021-10-12 Tu Gu , Kaiyu Feng , Gao Cong , Cheng Long , Zheng Wang , Sheng Wang

We provide an improved assessment of Google Brain's deep reinforcement learning approach to macro placement and its updated Circuit Training (CT) implementation in GitHub. A stronger simulated annealing (SA) baseline leverages the…

Machine Learning · Computer Science 2026-03-12 Chung-Kuan Cheng , Andrew B. Kahng , Sayak Kundu , Yucheng Wang , Zhiang Wang

Most of the current game-theoretic demand-side management methods focus primarily on the scheduling of home appliances, and the related numerical experiments are analyzed under various scenarios to achieve the corresponding Nash-equilibrium…

Computers and Society · Computer Science 2019-02-26 Jun Hao

Reinforcement learning (RL) has proven its worth in a series of artificial domains, and is beginning to show some successes in real-world scenarios. However, much of the research advances in RL are hard to leverage in real-world systems due…

Machine Learning · Computer Science 2021-03-05 Gabriel Dulac-Arnold , Nir Levine , Daniel J. Mankowitz , Jerry Li , Cosmin Paduraru , Sven Gowal , Todd Hester

Reinforcement learning (RL) has emerged as a promising approach to automating decision processes. This paper explores the application of RL techniques to optimise the polynomial order in the computational mesh when using high-order solvers.…

Machine Learning · Computer Science 2023-06-16 David Huergo , Gonzalo Rubio , Esteban Ferrer

The rapid changes in the finance industry due to the increasing amount of data have revolutionized the techniques on data processing and data analysis and brought new theoretical and computational challenges. In contrast to classical…

Mathematical Finance · Quantitative Finance 2023-03-01 Ben Hambly , Renyuan Xu , Huining Yang

This paper introduces the problem of learning to place logic blocks in Field-Programmable Gate Arrays (FPGAs) and a learning-based method. In contrast to previous search-based placement algorithms, we instead employ Reinforcement Learning…

Hardware Architecture · Computer Science 2024-04-23 Shang Wang , Deepak Ranganatha Sastry Mamillapalli , Tianpei Yang , Matthew E. Taylor

In this effort we consider a reinforcement learning (RL) technique for solving personalization tasks with complex reward signals. In particular, our approach is based on state space clustering with the use of a simplistic $k$-means…

Machine Learning · Computer Science 2021-12-28 Anton Dereventsov , Ranga Raju Vatsavai , Clayton Webster

Robotic insertion tasks are characterized by contact and friction mechanics, making them challenging for conventional feedback control methods due to unmodeled physical effects. Reinforcement learning (RL) is a promising approach for…

Machine Learning · Computer Science 2020-05-26 Gerrit Schoettler , Ashvin Nair , Juan Aparicio Ojea , Sergey Levine , Eugen Solowjow

Reinforcement learning (RL) is a powerful machine learning technique that enables an intelligent agent to learn an optimal policy that maximizes the cumulative rewards in sequential decision making. Most of methods in the existing…

Machine Learning · Statistics 2023-01-06 Chengchun Shi , Zhengling Qi , Jianing Wang , Fan Zhou

In recent years deep reinforcement learning (RL) systems have attained superhuman performance in a number of challenging task domains. However, a major limitation of such applications is their demand for massive amounts of training data. A…

Deep Reinforcement Learning (DRL) is emerging as a promising approach to generate adaptive behaviors for robotic platforms. However, a major drawback of using DRL is the data-hungry training regime that requires millions of trial and error…

Reinforcement learning (RL) is an innovative approach to financial decision making, offering specialized solutions to complex investment problems where traditional methods fail. This review analyzes 167 articles from 2017--2025, focusing on…

Computational Finance · Quantitative Finance 2025-12-12 Mohammad Rezoanul Hoque , Md Meftahul Ferdaus , M. Kabir Hassan

Flexibility design problems are a class of problems that appear in strategic decision-making across industries, where the objective is to design a ($e.g.$, manufacturing) network that affords flexibility and adaptivity. The underlying…

Machine Learning · Computer Science 2021-01-19 Yehua Wei , Lei Zhang , Ruiyi Zhang , Shijing Si , Hao Zhang , Lawrence Carin

Reinforcement Learning (RL) is a general framework concerned with an agent that seeks to maximize rewards in an environment. The learning typically happens through trial and error using explorative methods, such as epsilon-greedy. There are…

Machine Learning · Computer Science 2022-10-06 Per-Arne Andersen , Morten Goodwin , Ole-Christoffer Granmo

Reinforcement Learning (RL) has demonstrated strong potential for industrial process control, yet policies trained in simulation often suffer from a significant sim-to-real gap when deployed on physical hardware. This work systematically…

Machine Learning · Computer Science 2026-03-13 Tatjana Krau , Jorge Mandlmaier , Tobias Damm , Frieder Heieck

We propose using Vision-Language Models (VLMs) for macro placement in chip floorplanning, a complex optimization task that has recently shown promising advancements through machine learning methods. Because human designers rely heavily on…

Reinforcement learning (RL) solves sequential decision-making problems via a trial-and-error process interacting with the environment. While RL achieves outstanding success in playing complex video games that allow huge trial-and-error,…

Machine Learning · Computer Science 2022-06-22 Fan-Ming Luo , Tian Xu , Hang Lai , Xiong-Hui Chen , Weinan Zhang , Yang Yu

This paper demonstrates that continual relearning of control policies using incremental deep reinforcement learning (RL) can improve policy learning for non-stationary processes. We demonstrate this approach for a data-driven 'smart…

Machine Learning · Computer Science 2020-08-06 Avisek Naug , Marcos Quiñones-Grueiro , Gautam Biswas