English
Related papers

Related papers: An Updated Assessment of Reinforcement Learning fo…

200 papers

Macro placement is a critical phase in chip design, which becomes more intricate when involving general rectilinear macros and layout areas. Furthermore, macro placement that incorporates human-like constraints, such as design hierarchy and…

In physical design, human designers typically place macros via trial and error, which is a Markov decision process. Reinforcement learning (RL) methods have demonstrated superhuman performance on the macro placement. In this paper, we…

Machine Learning · Computer Science 2021-09-07 Zixuan Jiang , Ebrahim Songhori , Shen Wang , Anna Goldie , Azalia Mirhoseini , Joe Jiang , Young-Joon Lee , David Z. Pan

Reinforcement learning (RL) for physical design of silicon chips in a Google 2021 Nature paper stirred controversy due to poorly documented claims that raised eyebrows and drew critical media coverage. The paper withheld critical…

Machine Learning · Computer Science 2024-10-01 Igor L. Markov

Chip placement has been one of the most time consuming task in any semi conductor area, Due to this negligence, many projects are pushed and chips availability in real markets get delayed. An engineer placing macros on a chip also needs to…

Machine Learning · Computer Science 2022-05-20 Mrinal Mathur

For its advantage in GPU acceleration and less dependency on human experts, machine learning has been an emerging tool for solving the placement and routing problems, as two critical steps in modern chip design flow. Being still in its…

Machine Learning · Computer Science 2021-12-28 Ruoyu Cheng , Junchi Yan

In modern chip design, placement aims at placing millions of circuit modules, which is an essential step that significantly influences power, performance, and area (PPA) metrics. Recently, reinforcement learning (RL) has emerged as a…

Machine Learning · Computer Science 2024-12-11 Ke Xue , Ruo-Tong Chen , Xi Lin , Yunqi Shi , Shixiong Kai , Siyuan Xu , Chao Qian

Physical design and production of Integrated Circuits (IC) is becoming increasingly more challenging as the sophistication in IC technology is steadily increasing. Placement has been one of the most critical steps in IC physical design.…

Artificial Intelligence · Computer Science 2020-11-17 Dhruv Vashisht , Harshit Rampal , Haiguang Liao , Yang Lu , Devika Shanbhag , Elias Fallon , Levent Burak Kara

Chip placement is a critical step in physical design. While reinforcement learning (RL)-based methods have recently emerged, their training primarily focuses on wirelength optimization, and therefore often fail to achieve expert-quality…

Hardware Architecture · Computer Science 2026-04-29 Ruo-Tong Chen , Ke Xue , Chengrui Gao , Yunqi Shi , Tian Xu , Peng Xie , Siyuan Xu , Mingxuan Yuan , Chao Qian , Zhi-Hua Zhou

Intelligent agents should have the ability to leverage knowledge from previously learned tasks in order to learn new ones quickly and efficiently. Meta-learning approaches have emerged as a popular solution to achieve this. However,…

Machine Learning · Computer Science 2023-02-17 Zhao Mandi , Pieter Abbeel , Stephen James

Recently, researchers have made significant progress combining the advances in deep learning for learning feature representations with reinforcement learning. Some notable examples include training agents to play Atari games based on raw…

Machine Learning · Computer Science 2016-05-30 Yan Duan , Xi Chen , Rein Houthooft , John Schulman , Pieter Abbeel

Motion planning is an essential component in most of today's robotic applications. In this work, we consider the learning setting, where a set of solved motion planning problems is used to improve the efficiency of motion planning on…

Robotics · Computer Science 2019-06-04 Tom Jurgenson , Aviv Tamar

In recent years deep neural networks have been successfully applied to the domains of reinforcement learning \cite{bengio2009learning,krizhevsky2012imagenet,hinton2006reducing}. Deep reinforcement learning \cite{mnih2015human} is reported…

Machine Learning · Computer Science 2020-05-19 Huihui Zhang , Wu Huang

In recent years deep reinforcement learning (RL) systems have attained superhuman performance in a number of challenging task domains. However, a major limitation of such applications is their demand for massive amounts of training data. A…

In this work, we present a learning-based approach to chip placement, one of the most complex and time-consuming stages of the chip design process. Unlike prior methods, our approach has the ability to learn from past experience and improve…

The unprecedented growth in the field of machine learning has led to the development of deep neuromorphic networks trained on labelled dataset with capability to mimic or even exceed human capabilities. However, for applications involving…

Emerging Technologies · Computer Science 2024-07-12 Arjun Tyagi , Shubham Sahay

Reinforcement Learning (RL) has been widely used in many applications, particularly in gaming, which serves as an excellent training ground for AI models. Google DeepMind has pioneered innovations in this field, employing reinforcement…

Artificial Intelligence · Computer Science 2026-02-12 Abdelrhman Shaheen , Anas Badr , Ali Abohendy , Hatem Alsaadawy , Nadine Alsayad , Ehab H. El-Shazly

This paper introduces the problem of learning to place logic blocks in Field-Programmable Gate Arrays (FPGAs) and a learning-based method. In contrast to previous search-based placement algorithms, we instead employ Reinforcement Learning…

Hardware Architecture · Computer Science 2024-04-23 Shang Wang , Deepak Ranganatha Sastry Mamillapalli , Tianpei Yang , Matthew E. Taylor

A combined task-level reinforcement learning and motion planning framework is proposed in this paper to address a multi-class in-rack test tube rearrangement problem. At the task level, the framework uses reinforcement learning to infer a…

Robotics · Computer Science 2024-01-19 Hao Chen , Weiwei Wan , Masaki Matsushita , Takeyuki Kotaka , Kensuke Harada

Due to the increasing complexity of chip design, existing placement methods still have many shortcomings in dealing with macro cells coverage and optimization efficiency. Aiming at the problems of layout overlap, inferior performance, and…

Hardware Architecture · Computer Science 2024-10-01 Tao Yu , Peng Gao , Fei Wang , Ru-Yue Yuan

We develop a portfolio allocation framework that leverages deep learning techniques to address challenges arising from high-dimensional, non-stationary, and low-signal-to-noise market information. Our approach includes a dynamic embedding…

Portfolio Management · Quantitative Finance 2025-01-31 Jinghai He , Cheng Hua , Chunyang Zhou , Zeyu Zheng
‹ Prev 1 2 3 10 Next ›