English
Related papers

Related papers: VERIRL: Boosting the LLM-based Verilog Code Genera…

200 papers

Designing effective reward functions remains a fundamental challenge in reinforcement learning (RL), as it often requires extensive human effort and domain expertise. While RL from human feedback has been successful in aligning agents with…

Machine Learning · Computer Science 2025-06-17 Tung Minh Luu , Younghwan Lee , Donghoon Lee , Sunho Kim , Min Jun Kim , Chang D. Yoo

Scalable Vector Graphics (SVG) offer a powerful format for representing visual designs as interpretable code. Recent advances in vision-language models (VLMs) have enabled high-quality SVG generation by framing the problem as a code…

Large language models (LLMs) have shown remarkable capabilities in natural language processing tasks, yet their application in hardware security verification remains limited due to scarcity of publicly available hardware description…

Cryptography and Security · Computer Science 2026-03-09 Touseef Hasan , Blessing Airehenbuwa , Nitin Pundir , Souvika Sarkar , Ujjwal Guin

Large language models (LLMs) have demonstrated strong capabilities in generating Verilog code from natural language descriptions. However, Verilog code inherently encodes structural information of hardware circuits. Effectively leveraging…

Hardware Architecture · Computer Science 2025-10-21 Jiayu Zhao , Song Chen

Large language models (LLMs) are playing an increasingly large role in domains such as code generation, including hardware code generation, where Verilog is the key language. However, the amount of publicly available Verilog code pales in…

Hardware Architecture · Computer Science 2025-07-10 Charles Hong , Brendan Roberts , Huijae An , Alex Um , Advay Ratan , Yakun Sophia Shao

Large Language Models (LLMs) have demonstrated great potential in automating the generation of Verilog hardware description language code for hardware design. This automation is critical to reducing human effort in the complex and…

Hardware Architecture · Computer Science 2025-08-20 Ping Guo , Yiting Wang , Wanghao Ye , Yexiao He , Ziyao Wang , Xiaopeng Dai , Ang Li , Qingfu Zhang

Recent advances in large language models have improved code generation, but their use in hardware description languages is still limited. Moreover, training data and testbenches for these models are often scarce. This paper presents a…

Hardware Architecture · Computer Science 2026-04-20 Mu-Chi Chen , Po-Hsuan Huang , Yu-Hung Kao , Yen-Fu Liu , Yu-Kai Hung , Cheng Liang , Shao-Chun Ho , Chia-Heng Tu , Shih-Hao Hung

The application of large-language models (LLMs) to digital hardware code generation is an emerging field, with most LLMs primarily trained on natural language and software code. Hardware code like Verilog constitutes a small portion of…

Hardware Architecture · Computer Science 2025-02-05 Nathaniel Pinckney , Christopher Batten , Mingjie Liu , Haoxing Ren , Brucek Khailany

Coding with hardware description languages (HDLs) such as Verilog is a time-intensive and laborious task. With the rapid advancement of large language models (LLMs), there is increasing interest in applying LLMs to assist with HDL coding.…

Artificial Intelligence · Computer Science 2025-05-27 Juxin Niu , Xiangfeng Liu , Dan Niu , Xi Wang , Zhe Jiang , Nan Guan

Large Language Models have emerged as powerful tools for automating Register-Transfer Level (RTL) code generation, yet they face critical limitations: existing approaches typically fail to simultaneously optimize functional correctness and…

Artificial Intelligence · Computer Science 2026-04-13 Zhirong Chen , Kaiyan Chang , Zhuolin Li , Cangyuan Li , Xinyang He , Chujie Chen , Mengdi Wang , Haobo Xu , Yinhe Han , Huawei Li , Ying Wang

Reinforcement learning (RL) has been widely used in training large language models (LLMs) for preventing unexpected outputs, eg reducing harmfulness and errors. However, existing RL methods mostly adopt the instance-level reward, which is…

Computation and Language · Computer Science 2024-06-18 Zhipeng Chen , Kun Zhou , Wayne Xin Zhao , Junchen Wan , Fuzheng Zhang , Di Zhang , Ji-Rong Wen

In practice, rigorous reasoning is often a key driver of correct code, while Reinforcement Learning (RL) for code generation often neglects optimizing reasoning quality. Bringing process-level supervision into RL is appealing, but it faces…

Software Engineering · Computer Science 2026-05-06 Lishui Fan , Yu Zhang , Mouxiang Chen , Zhongxin Liu

With the rapid evolution of large language models (LLM), reinforcement learning (RL) has emerged as a pivotal technique for code generation and optimization in various domains. This paper presents a systematic survey of the application of…

Large Language Models (LLMs) demonstrate transformative potential, yet their reasoning remains inconsistent and unreliable. Reinforcement learning (RL)-based fine-tuning is a key mechanism for improvement, but its effectiveness is…

Machine Learning · Computer Science 2026-02-11 Pei-Chi Pan , Yingbin Liang , Sen Lin

The remarkable progress of Large Language Models (LLMs) presents promising opportunities for Verilog code generation which is significantly important for automated circuit design. The lacking of meaningful functional rewards hinders the…

Machine Learning · Computer Science 2025-12-09 Yang Zhang , Rui Zhang , Jiaming Guo , Lei Huang , Di Huang , Yunpu Zhao , Shuyao Cheng , Pengwei Jin , Chongxiao Li , Zidong Du , Xing Hu , Qi Guo , Yunji Chen

Multimodal code generation has garnered significant interest within the research community. Despite the notable success of recent vision-language models (VLMs) on specialized tasks like chart-to-code generation, their reliance on…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Xuanle Zhao , Deyang Jiang , Zhixiong Zeng , Lei Chen , Haibo Qiu , Jing Huang , Yufeng Zhong , Liming Zheng , Yilin Cao , Lin Ma

Despite the significant progress made in code generation with large language models, challenges persist, especially with hardware description languages such as Verilog. This paper first presents an analysis of fine-tuned LLMs on Verilog…

Hardware Architecture · Computer Science 2025-02-10 Mingjie Liu , Yun-Da Tsai , Wenfei Zhou , Haoxing Ren

To meet the requirements of real-world applications, it is essential to control generations of large language models (LLMs). Prior research has tried to introduce reinforcement learning (RL) into controllable text generation while most…

Computation and Language · Computer Science 2024-03-19 Wendi Li , Wei Wei , Kaihe Xu , Wenfeng Xie , Dangyang Chen , Yu Cheng

Reinforcement Learning from Verifiable Rewards (RLVR) has driven recent progress in code large language models by leveraging execution-based feedback from unit tests, but its scalability is fundamentally constrained by the availability and…

Machine Learning · Computer Science 2026-05-19 Xiao Zhu , Xinyu Zhou , Boyu Zhu , Hanxu Hu , Mingzhe Du , Haotian Zhang , Huiming Wang , Zhijiang Guo

Recent advances in large language models (LLMs) have demonstrated strong performance in generating code for general-purpose programming languages. However, their potential for hardware description languages (HDLs), such as SystemVerilog,…

Hardware Architecture · Computer Science 2025-07-16 Arnav Sheth , Ivaxi Sheth , Mario Fritz