English
Related papers

Related papers: VRank: Enhancing Verilog Code Generation from Larg…

200 papers

Large language models (LLMs) have demonstrated impressive capabilities in natural language generation. However, their output quality can be inconsistent, posing challenges for generating natural language from logical forms (LFs). This task…

Computation and Language · Computer Science 2023-09-22 Levon Haroutunian , Zhuang Li , Lucian Galescu , Philip Cohen , Raj Tumuluri , Gholamreza Haffari

The rapid advancement of large language models (LLMs) has revolutionized code generation tasks across various programming languages. However, the unique characteristics of programming languages, particularly those like Verilog with specific…

Machine Learning · Computer Science 2025-03-19 Changran Xu , Yi Liu , Yunhao Zhou , Shan Huang , Ningyi Xu , Qiang Xu

Large Language Models (LLMs) have become increasingly popular for generating RTL code. However, producing error-free RTL code in a zero-shot setting remains highly challenging for even state-of-the-art LLMs, often leading to issues that…

Hardware Architecture · Computer Science 2024-12-09 Mubashir ul Islam , Humza Sami , Pierre-Emmanuel Gaillardon , Valerio Tenace

The use of Large Language Models (LLMs) in hardware design has taken off in recent years, principally through its incorporation in tools that increase chip designer productivity. There has been considerable discussion about the use of LLMs…

Hardware Architecture · Computer Science 2025-05-20 Nicolas Dupuis , Ravi Nair , Shyam Ramji , Sean McClintock , Nishant Chauhan , Priyanka Nagpal , Bart Blaner , Ken Valk , Leon Stok , Ruchir Puri

Large language models (LLMs) are playing an increasingly large role in domains such as code generation, including hardware code generation, where Verilog is the key language. However, the amount of publicly available Verilog code pales in…

Hardware Architecture · Computer Science 2025-07-10 Charles Hong , Brendan Roberts , Huijae An , Alex Um , Advay Ratan , Yakun Sophia Shao

Natural language interfaces have exhibited considerable potential in the automation of Verilog generation derived from high-level specifications through the utilization of large language models, garnering significant attention.…

Hardware Architecture · Computer Science 2024-07-12 Kaiyan Chang , Zhirong Chen , Yunhao Zhou , Wenlong Zhu , kun wang , Haobo Xu , Cangyuan Li , Mengdi Wang , Shengwen Liang , Huawei Li , Yinhe Han , Ying Wang

Rapid advances in language models (LMs) have created new opportunities for automated code generation while complicating trade-offs between model characteristics and prompt design choices. In this work, we provide an empirical map of recent…

Hardware Architecture · Computer Science 2026-04-14 Luca Collini , Andrew Hennesee , Patrick Yubeaton , Siddharth Garg , Ramesh Karri

The automatic generation of RTL code (e.g., Verilog) using natural language instructions and large language models (LLMs) has attracted significant research interest recently. However, most existing approaches heavily rely on commercial…

Programming Languages · Computer Science 2025-08-07 Shang Liu , Wenji Fang , Yao Lu , Qijun Zhang , Hongce Zhang , Zhiyao Xie

With Large Language Models (LLMs) recently demonstrating impressive proficiency in code generation, it is promising to extend their abilities to Hardware Description Language (HDL). However, LLMs tend to generate single HDL code blocks…

Machine Learning · Computer Science 2025-10-10 Jinwei Tang , Jiayin Qin , Kiran Thorat , Chen Zhu-Tian , Yu Cao , Yang , Zhao , Caiwen Ding

Large language models (LLMs) have demonstrated strong capabilities in generating Verilog code from natural language descriptions. However, Verilog code inherently encodes structural information of hardware circuits. Effectively leveraging…

Hardware Architecture · Computer Science 2025-10-21 Jiayu Zhao , Song Chen

The use of large language models (LLMs) for automated code generation has emerged as a significant focus within AI research. As these pretrained models continue to evolve, their ability to understand and generate complex code structures has…

Software Engineering · Computer Science 2025-05-06 Nazmus Ashrafi , Salah Bouktif , Mohammed Mediani

Large Language Models (LLMs) are one of the most promising developments in the field of artificial intelligence, and the software engineering community has readily noticed their potential role in the software development life-cycle.…

Software Engineering · Computer Science 2026-03-16 Greta Dolcetti , Vincenzo Arceri , Eleonora Iotti , Sergio Maffeis , Agostino Cortesi , Enea Zaffanella

Timely detection of hardware vulnerabilities during the early design stage is critical for reducing remediation costs. Existing early detection techniques often require specialized security expertise, limiting their usability. Recent…

Cryptography and Security · Computer Science 2025-08-22 Xiang Long , Yingjie Xia , Xiyuan Chen , Li Kuang

Large language models (LLMs) have recently achieved notable success in code-generation benchmarks such as HumanEval and LiveCodeBench. However, a detailed examination reveals that these evaluation suites often comprise only a limited number…

Computation and Language · Computer Science 2025-07-11 Zihan Ma , Taolin Zhang , Maosong Cao , Junnan Liu , Wenwei Zhang , Minnan Luo , Songyang Zhang , Kai Chen

Verilog's design cycle is inherently labor-intensive and necessitates extensive domain expertise. Although Large Language Models (LLMs) offer a promising pathway toward automation, their limited training data and intrinsic sequential…

Artificial Intelligence · Computer Science 2026-01-27 Wei-Po Hsin , Ren-Hao Deng , Yao-Ting Hsieh , En-Ming Huang , Shih-Hao Hung

This paper provides a comprehensive review of the current methods and metrics used to evaluate the performance of Large Language Models (LLMs) in code generation tasks. With the rapid growth in demand for automated software development,…

Software Engineering · Computer Science 2025-03-05 Liguo Chen , Qi Guo , Hongrui Jia , Zhengran Zeng , Xin Wang , Yijiang Xu , Jian Wu , Yidong Wang , Qing Gao , Jindong Wang , Wei Ye , Shikun Zhang

Developing safety-critical automotive software presents significant challenges due to increasing system complexity and strict regulatory demands. This paper proposes a novel framework integrating Generative Artificial Intelligence (GenAI)…

Software Engineering · Computer Science 2025-06-05 Sven Kirchner , Alois C. Knoll

Large Language Models (LLMs) have demonstrated great promise in generating code, especially when used inside an evolutionary computation framework to iteratively optimize the generated algorithms. However, in some cases they fail to…

Neural and Evolutionary Computing · Computer Science 2025-03-24 Niki van Stein , Anna V. Kononova , Lars Kotthoff , Thomas Bäck

Code Large Language Models (CodeLLMs) have ushered in a new era in code generation advancements. However, selecting the best code solutions from all possible CodeLLM outputs remains a challenge. Previous methods often overlooked the…

Software Engineering · Computer Science 2024-08-09 Hung Quoc To , Minh Huynh Nguyen , Nghi D. Q. Bui

Large Language Models (LLMs), particularly Code LLMs, have demonstrated impressive performance in code generation. Current research primarily focuses on the correctness of generated code, while efficiency remains less explored. Recent works…

Software Engineering · Computer Science 2025-02-27 Tong Ye , Weigang Huang , Xuhong Zhang , Tengfei Ma , Peiyu Liu , Jianwei Yin , Wenhai Wang