English
Related papers

Related papers: Insights from Verification: Training a Verilog Gen…

200 papers

Large language models (LLMs) have demonstrated impressive capabilities in natural language generation. However, their output quality can be inconsistent, posing challenges for generating natural language from logical forms (LFs). This task…

Computation and Language · Computer Science 2023-09-22 Levon Haroutunian , Zhuang Li , Lucian Galescu , Philip Cohen , Raj Tumuluri , Gholamreza Haffari

The use of Large Language Models (LLMs) in hardware design has taken off in recent years, principally through its incorporation in tools that increase chip designer productivity. There has been considerable discussion about the use of LLMs…

Hardware Architecture · Computer Science 2025-05-20 Nicolas Dupuis , Ravi Nair , Shyam Ramji , Sean McClintock , Nishant Chauhan , Priyanka Nagpal , Bart Blaner , Ken Valk , Leon Stok , Ruchir Puri

Large language models (LLMs) hold promise for automating integrated circuit (IC) engineering using register transfer level (RTL) hardware description languages (HDLs) like Verilog. However, challenges remain in ensuring the quality of…

Hardware Architecture · Computer Science 2025-11-18 Zhiteng Chao , Yonghao Wang , Xinyu Zhang , Jiaxin Zhou , Tenghui Hua , Husheng Han , Tianmeng Yang , Jianan Mu , Bei Yu , Rui Zhang , Jing Ye , Huawei Li

Scaling test-time computation with reinforcement learning (RL) has emerged as a reliable path to improve large language models (LLM) reasoning ability. Yet, outcome-based reward often incentivizes models to be overconfident, leading to…

Machine Learning · Computer Science 2026-04-28 Liaoyaqi Wang , Chunsheng Zuo , William Jurayj , Benjamin Van Durme , Anqi Liu

Large language models (LLMs) are increasingly used for program verification, and yet little is known about \emph{how} they reason about program semantics during this process. In this work, we focus on abstract interpretation based-reasoning…

Machine Learning · Computer Science 2025-10-01 Jacqueline L. Mitchell , Brian Hyeongseok Kim , Chenyu Zhou , Chao Wang

The recent paradigm shift towards training large language models (LLMs) using DeepSeek-R1-Zero-style reinforcement learning (RL) on verifiable rewards has led to impressive advancements in code and mathematical reasoning. However, this…

Machine Learning · Computer Science 2025-05-28 Xiangxin Zhou , Zichen Liu , Anya Sims , Haonan Wang , Tianyu Pang , Chongxuan Li , Liang Wang , Min Lin , Chao Du

Hardware design automation faces challenges in generating high-quality Verilog code efficiently. This paper introduces VFlow, an automated framework that optimizes agentic workflows for Verilog code generation. Unlike traditional approaches…

Hardware Architecture · Computer Science 2025-07-15 Yangbo Wei , Zhen Huang , Huang Li , Wei W. Xing , Ting-Jung Lin , Lei He

Developing safety-critical automotive software presents significant challenges due to increasing system complexity and strict regulatory demands. This paper proposes a novel framework integrating Generative Artificial Intelligence (GenAI)…

Software Engineering · Computer Science 2025-06-05 Sven Kirchner , Alois C. Knoll

The increasing design complexity of System-on-Chips (SoCs) has led to significant verification challenges, particularly in meeting coverage targets within a timely manner. At present, coverage closure is heavily dependent on constrained…

Artificial Intelligence · Computer Science 2025-12-09 Deepak Narayan Gadde , Thomas Nalapat , Aman Kumar , Djones Lettnin , Wolfgang Kunz , Sebastian Simon

With the rapid evolution of large language models (LLM), reinforcement learning (RL) has emerged as a pivotal technique for code generation and optimization in various domains. This paper presents a systematic survey of the application of…

Formally verifying properties of software code has been a highly desirable task, especially with the emergence of LLM-generated code. In the same vein, they provide an interesting avenue for the exploration of formal verification and…

Artificial Intelligence · Computer Science 2025-10-02 Balaji Rao , William Eiers , Carlo Lipizzi

Large Language Models (LLMs) pre-trained on code have recently emerged as the dominant approach to program synthesis. However, these models are trained using next-token prediction, which ignores the syntax and semantics of code. We propose…

Programming Languages · Computer Science 2023-12-27 Abhinav Jain , Chima Adiole , Swarat Chaudhuri , Thomas Reps , Chris Jermaine

Traditionally, digital hardware designs are written in the Verilog hardware description language (HDL) and debugged manually by engineers. This can be time-consuming and error-prone for complex designs. Large Language Models (LLMs) are…

Hardware Architecture · Computer Science 2025-03-06 Jason Blocklove , Shailja Thakur , Benjamin Tan , Hammond Pearce , Siddharth Garg , Ramesh Karri

Large Language Models (LLMs) show strong performance in RTL generation, but different models excel on different tasks because of architecture and training differences. Prior work mainly prompts or finetunes a single model. What remains not…

Machine Learning · Computer Science 2025-12-01 Zeng Wang , Weihua Xiao , Minghao Shao , Raghu Vamshi Hemadri , Ozgur Sinanoglu , Muhammad Shafique , Ramesh Karri

Iterative evaluation of LLMs during training is essential to ensure expected capability development, but can be time- and compute-intensive. While NLU tasks, where the model selects from fixed answer choices, are cheap to evaluate,…

Computation and Language · Computer Science 2025-09-17 Viktor Hangya , Fabian Küch , Darina Gold

Large language models (LLMs) exhibit remarkable generative capabilities but often suffer from hallucinations. Retrieval-augmented generation (RAG) offers an effective solution by incorporating external knowledge, but existing methods still…

Computation and Language · Computer Science 2024-12-17 Xiaoxi Li , Jiajie Jin , Yujia Zhou , Yongkang Wu , Zhonghua Li , Qi Ye , Zhicheng Dou

Existing Large Language Model (LLM) approaches to SystemVerilog Assertion (SVA) generation primarily focus on syntactic validity and formal verification outcomes, while semantic alignment between generated assertions and natural language…

Artificial Intelligence · Computer Science 2026-05-26 Jaime Rafael Imperial , Hao Zheng

Large Language Models (LLMs) demonstrate strong capabilities for solving scientific and mathematical problems, yet they struggle to produce valid, challenging, and novel problems - an essential component for advancing LLM training and…

Machine Learning · Computer Science 2026-05-08 Yuhang Lai , Jiazhan Feng , Yee Whye Teh , Ning Miao

Hallucination remains a major challenge for the safe and trustworthy deployment of large language models (LLMs) in factual content generation. Prior work has explored confidence estimation as an effective approach to hallucination…

Computation and Language · Computer Science 2026-05-15 Caiqi Zhang , Xiaochen Zhu , Chengzu Li , Nigel Collier , Andreas Vlachos

Visual reasoning (VR), which is crucial in many fields for enabling human-like visual understanding, remains highly challenging. Recently, compositional visual reasoning approaches, which leverage the reasoning abilities of large language…

Computer Vision and Pattern Recognition · Computer Science 2026-02-04 Fucai Ke , Vijay Kumar B G , Xingjian Leng , Zhixi Cai , Zaid Khan , Weiqing Wang , Pari Delir Haghighi , Hamid Rezatofighi , Manmohan Chandraker
‹ Prev 1 8 9 10 Next ›