English
Related papers

Related papers: PrefixRL: Optimization of Parallel Prefix Circuits…

200 papers

We study the problem of learning control policies for complex tasks given by logical specifications. Recent approaches automatically generate a reward function from a given specification and use a suitable reinforcement learning algorithm…

Machine Learning · Computer Science 2021-12-28 Kishor Jothimurugan , Suguman Bansal , Osbert Bastani , Rajeev Alur

This paper tackles a new problem setting: reinforcement learning with pixel-wise rewards (pixelRL) for image processing. After the introduction of the deep Q-network, deep RL has been achieving great success. However, the applications of…

Computer Vision and Pattern Recognition · Computer Science 2019-12-17 Ryosuke Furuta , Naoto Inoue , Toshihiko Yamasaki

Design of Voltage-Controlled Oscillator (VCO) inductors is a laborious and time-consuming task that is conventionally done manually by human experts. In this paper, we propose a framework for automating the design of VCO inductors, using…

Artificial Intelligence · Computer Science 2022-03-01 Cameron Haigh , Zichen Zhang , Negar Hassanpour , Khurram Javed , Yingying Fu , Shayan Shahramian , Shawn Zhang , Jun Luo

Prefix adders are widely used in compute-intensive applications for their high speed. However, designing optimized prefix adders is challenging due to strict design rules and an exponentially large design space. We introduce PrefixGPT, a…

Machine Learning · Computer Science 2025-11-27 Ruogu Ding , Xin Ning , Ulf Schlichtmann , Weikang Qian

Reinforcement learning (RL) has achieved notable performance in high-dimensional sequential decision-making tasks, yet remains limited by low sample efficiency, sensitivity to noise, and weak generalization under partial observability. Most…

Machine Learning · Computer Science 2026-02-18 Sibo Zhang , Rui Jing , Liangfu Lv , Jian Zhang , Yunliang Zang

The layout design of pipelines is a critical task in the construction industry. Currently, pipeline layout is designed manually by engineers, which is time-consuming and laborious. Automating and streamlining this process can reduce the…

Machine Learning · Computer Science 2023-05-19 Chen Yang , Zhe Zheng , Jia-Rui Lin

Quantum machine learning models use encoding circuits to map data into a quantum Hilbert space. While it is well known that the architecture of these circuits significantly influences core properties of the resulting model, they are often…

Quantum Physics · Physics 2025-03-03 Frederic Rapp , David A. Kreplin , Marco F. Huber , Marco Roth

Experience replay is an essential component in deep reinforcement learning (DRL), which stores the experiences and generates experiences for the agent to learn in real time. Recently, prioritized experience replay (PER) has been proven to…

Hardware Architecture · Computer Science 2024-03-06 Mengyuan Li , Arman Kazemi , Ann Franchesca Laguna , X. Sharon Hu

The past few years have seen rapid progress in combining reinforcement learning (RL) with deep learning. Various breakthroughs ranging from games to robotics have spurred the interest in designing sophisticated RL algorithms and systems.…

Machine Learning · Computer Science 2022-11-09 Zhihui Xie , Zichuan Lin , Junyou Li , Shuai Li , Deheng Ye

Federal Energy Regulatory Commission (FERC) Orders 841 and 2222 have recommended that distributed energy resources (DERs) should participate in energy and reserve markets; therefore, a mechanism needs to be developed to facilitate DERs'…

Systems and Control · Electrical Eng. & Systems 2023-05-09 Mukesh Gautam , Rakib Hossain , Mohammad MansourLakouraj , Narayan Bhusal , Mohammed Benidris , Hanif Livani

Quantum computing has promised significant improvement in solving difficult computational tasks over classical computers. Designing quantum circuits for practical use, however, is not a trivial objective and requires expert-level knowledge.…

Quantum Physics · Physics 2021-12-14 Esther Ye , Samuel Yen-Chi Chen

Reinforcement learning (RL) is a goal-oriented learning solution that has proven to be successful for Neural Architecture Search (NAS) on the CIFAR and ImageNet datasets. However, a limitation of this approach is its high computational…

Neural and Evolutionary Computing · Computer Science 2019-12-04 J. Gomez Robles , J. Vanschoren

Process optimization for metal additive manufacturing (AM) is crucial to ensure repeatability, control microstructure, and minimize defects. Despite efforts to address this via the traditional design of experiments and statistical process…

Machine Learning · Computer Science 2022-11-18 Susheel Dharmadhikari , Nandana Menon , Amrita Basak

We consider the problem of curriculum design for reinforcement learning (RL) agents in contextual multi-task settings. Existing techniques on automatic curriculum design typically require domain-specific hyperparameter tuning or have…

Machine Learning · Computer Science 2023-04-26 Georgios Tzannetos , Bárbara Gomes Ribeiro , Parameswaran Kamalaruban , Adish Singla

Inverse design of photonic integrated circuits (PICs) has traditionally relied on gradientbased optimization. However, this approach is prone to end up in local minima, which results in suboptimal design functionality. As interest in PICs…

Machine Learning · Computer Science 2025-06-24 Yannik Mahlau , Maximilian Schier , Christoph Reinders , Frederik Schubert , Marco Bügling , Bodo Rosenhahn

We present a novel reinforcement learning (RL) environment designed to both optimize industrial sorting systems and study agent behavior in evolving spaces. In simulating material flow within a sorting process our environment follows the…

Machine Learning · Computer Science 2025-03-14 Tom Maus , Nico Zengeler , Tobias Glasmachers

Deep reinforcement learning (DRL) allows a system to interact with its environment and take actions by training an efficient policy that maximizes self-defined rewards. In autonomous driving, it can be used as a strategy for high-level…

Robotics · Computer Science 2024-07-02 Xibo Li , Shruti Patel , Christof Büskens

A wide variety of deep reinforcement learning (DRL) models have recently been proposed to learn profitable investment strategies. The rules learned by these models outperform the previous strategies specially in high frequency trading…

Statistical Finance · Quantitative Finance 2021-01-12 Mehran Taghian , Ahmad Asadi , Reza Safabakhsh

Precise assembly of composite fuselages is critical for aircraft assembly to meet the ultra-high precision requirements. Due to dimensional variations, there is a gap when two fuselage assemble. In practice, actuators are required to adjust…

Systems and Control · Electrical Eng. & Systems 2025-04-25 Peng Ye , Juan Du

Reinforcement learning (RL) over text representations can be effective for finding high-value policies that can search over graphs. However, RL requires careful structuring of the search space and algorithm design to be effective in this…

Machine Learning · Computer Science 2023-10-05 Raj Ghugare , Santiago Miret , Adriana Hugessen , Mariano Phielipp , Glen Berseth