中文
相关论文

相关论文: AssertLLM2: A Comprehensive LLM Benchmark for Asse…

200 篇论文

The automated generation of design RTL based on large language model (LLM) and natural language instructions has demonstrated great potential in agile circuit design. However, the lack of datasets and benchmarks in the public domain…

硬件体系结构 · 计算机科学 2025-03-20 Shang Liu , Yao Lu , Wenji Fang , Mengming Li , Zhiyao Xie

Hardware verification is crucial in modern SoC design, consuming around 70% of development time. SystemVerilog assertions ensure correct functionality. However, existing industrial practices rely on manual efforts for assertion generation,…

Large Language Models (LLMs) are computational models capable of performing complex natural language processing tasks. Leveraging these capabilities, LLMs hold the potential to transform the entire hardware design stack, with predictions…

人工智能 · 计算机科学 2024-09-19 Mubashir ul Islam , Humza Sami , Pierre-Emmanuel Gaillardon , Valerio Tenace

We introduce OSVBench, a new benchmark for evaluating Large Language Models (LLMs) on the task of generating complete formal specifications for verifying the functional correctness of operating system kernels. This benchmark is built upon a…

计算与语言 · 计算机科学 2025-12-09 Shangyu Li , Juyong Jiang , Tiancheng Zhao , Jiasi Shen

Generating SystemVerilog Assertions (SVAs) from natural language specifications remains a major challenge in formal verification (FV) due to the inherent ambiguity and incompleteness of specifications. Existing LLM-based approaches, such as…

人工智能 · 计算机科学 2025-05-16 Yunsheng Bai , Ghaith Bany Hamad , Syed Suhaib , Haoxing Ren

Formal Property Verification (FPV), using SystemVerilog Assertions (SVA), is crucial for ensuring the completeness of design with respect to the specification. However, writing SVA is a laborious task and has a steep learning curve. In this…

硬件体系结构 · 计算机科学 2024-11-26 Mohammad Shahidzadeh , Behnam Ghavami , Steve Wilton , Lesley Shannon

Existing Large Language Model (LLM) approaches to SystemVerilog Assertion (SVA) generation primarily focus on syntactic validity and formal verification outcomes, while semantic alignment between generated assertions and natural language…

人工智能 · 计算机科学 2026-05-26 Jaime Rafael Imperial , Hao Zheng

Verification presents a major bottleneck in Integrated Circuit (IC) development, consuming nearly 70% of the total development effort. While the Universal Verification Methodology (UVM) is widely used in industry to improve verification…

硬件体系结构 · 计算机科学 2026-04-08 Junhao Ye , Yuchen Hu , Ke Xu , Dingrong Pan , Qichun Chen , Jie Zhou , Shuai Zhao , Xinwei Fang , Xi Wang , Nan Guan , Zhe Jiang

Bug reproduction is critical in the software debugging and repair process, yet the majority of bugs in open-source and industrial settings lack executable tests to reproduce them at the time they are reported, making diagnosis and…

软件工程 · 计算机科学 2026-01-09 Lara Khatib , Noble Saji Mathews , Meiyappan Nagappan

The remarkable reasoning and code generation capabilities of large language models (LLMs) have spurred significant interest in applying LLMs to enable task automation in digital chip design. In particular, recent work has investigated early…

硬件体系结构 · 计算机科学 2024-11-01 Minwoo Kang , Mingjie Liu , Ghaith Bany Hamad , Syed Suhaib , Haoxing Ren

SystemVerilog Assertions (SVA) are essential for formal verification of digital hardware, yet their manual creation demands significant expertise in both the design under verification and temporal logic. Recent studies have explored using…

密码学与安全 · 计算机科学 2026-04-28 Nowfel Mashnoor , Hadi Kamali , Kimia Azar

While leveraging LLMs to automatically generate SystemVerilog assertions (SVAs) from natural language specifications holds great potential, existing techniques face a key challenge: LLMs often lack sufficient understanding of IC design,…

硬件体系结构 · 计算机科学 2026-02-18 Yonghao Wang , Jiaxin Zhou , Yang Yin , Hongqin Lyu , Zhiteng Chao , Wenchao Ding , Jing Ye , Tiancheng Wang , Huawei Li

Assertion messages significantly enhance unit tests by clearly explaining the reasons behind test failures, yet they are frequently omitted by developers and automated test-generation tools. Despite recent advancements, Large Language…

软件工程 · 计算机科学 2025-09-25 Ahmed Aljohani , Anamul Haque Mollah , Hyunsook Do

LLMs can generate SystemVerilog assertions (SVAs) from natural language specs, but single-pass outputs often lack functional coverage due to limited IC design understanding. We propose CoverAssert, an iterative framework that clusters…

硬件体系结构 · 计算机科学 2026-04-14 Yonghao Wang , Yang Yin , Hongqin Lyu , Jiaxin Zhou , Zhiteng Chao , Mingyu Shi , Wenchao Ding , Yunlin Du , Jing Ye , Tiancheng Wang , Huawei Li

The paper studies how code generation by LLMs can be combined with formal verification to produce critical embedded software. The first contribution is a general framework, spec2code, in which LLMs are combined with different types of…

软件工程 · 计算机科学 2024-11-21 Minal Suresh Patil , Gustav Ung , Mattias Nyberg

Large language models (LLMs) have demonstrated remarkable progress in code generation, but many existing benchmarks are approaching saturation and offer little guarantee on the trustworthiness of the generated programs. To improve…

软件工程 · 计算机科学 2025-10-08 Xun Deng , Sicheng Zhong , Barış Bayazıt , Andreas Veneris , Fan Long , Xujie Si

SystemVerilog Assertions (SVAs) are critical for verifying the correctness of hardware designs, but manually writing them from natural language property descriptions, i.e., NL2SVA, remains a labor-intensive and error-prone task. Recent…

计算与语言 · 计算机科学 2025-06-30 Weihua Xiao , Derek Ekberg , Siddharth Garg , Ramesh Karri

Large language models (LLMs) have shown remarkable capabilities in natural language processing tasks, yet their application in hardware security verification remains limited due to scarcity of publicly available hardware description…

密码学与安全 · 计算机科学 2026-03-09 Touseef Hasan , Blessing Airehenbuwa , Nitin Pundir , Souvika Sarkar , Ujjwal Guin

The automatic generation of Verilog code using Large Language Models (LLMs) has garnered significant interest in hardware design automation. However, existing benchmarks for evaluating LLMs in Verilog generation fall short in replicating…

Large language models (LLMs) have demonstrated significant potential in automating hardware synthesis, yet substantial barriers remain for industrial-scale, datapath-centric designs due to ambiguous specifications and a lack of formal…

硬件体系结构 · 计算机科学 2026-03-11 Kezhi Li , Min Li , Xiangyu Wen , Shibo Zhao , Jieying Wu , Junhua Huang , Qiang Xu