English
Related papers

Related papers: A New Benchmark for the Appropriate Evaluation of …

200 papers

Large language models (LLMs) are increasingly used to convert natural language descriptions into mathematical optimization formulations. Current evaluations often treat formulations as a whole, relying on coarse metrics like solution…

Machine Learning · Computer Science 2025-10-21 Dania Refai , Moataz Ahmed

We find ourselves in the midst of an explosion in artificial intelligence research, particularly with large language models (LLMs). These models have diverse applications spanning finance, commonsense knowledge graphs, medicine, and visual…

Software Engineering · Computer Science 2025-08-08 Gang Xu , Airong Wang , Yushan Pan

While Large Language Models (LLMs) show significant potential in hardware engineering, current benchmarks suffer from saturation and limited task diversity, failing to reflect LLMs' performance in real industrial workflows. To address this…

Artificial Intelligence · Computer Science 2026-02-03 Zhongkai Yu , Chenyang Zhou , Yichen Lin , Hejia Zhang , Haotian Ye , Junxia Cui , Zaifeng Pan , Jishen Zhao , Yufei Ding

Large Language Models (LLMs) have shown promising progress for generating Register Transfer Level (RTL) hardware designs, largely because they can rapidly propose alternative architectural realizations. However, single-shot LLM generation…

Hardware Architecture · Computer Science 2026-04-20 Shiva Ahir , Prajna Bhat , Alex Doboli

As hardware design complexity escalates, there is an urgent need for advanced automation in electronic design automation (EDA). Traditional register transfer level (RTL) design methods are manual, time-consuming, and prone to errors. While…

Programming Languages · Computer Science 2025-05-21 Mohammad Akyash , Kimia Azar , Hadi Kamali

Large Language Models (LLMs) show promise for automated code optimization but struggle without performance context. This work introduces Opal, a modular framework that connects performance analytics insights with the vast body of published…

Performance · Computer Science 2025-10-02 Mohammad Zaeed , Tanzima Z. Islam , Vladimir Inđić

The increasing use of Advanced Language Models (ALMs) in diverse sectors, particularly due to their impressive capability to generate top-tier content following linguistic instructions, forms the core of this investigation. This study…

Machine Learning · Computer Science 2024-01-10 Kiran Thorat , Jiahui Zhao , Yaotian Liu , Hongwu Peng , Xi Xie , Bin Lei , Jeff Zhang , Caiwen Ding

Large Language Models have emerged as powerful tools for automating Register-Transfer Level (RTL) code generation, yet they face critical limitations: existing approaches typically fail to simultaneously optimize functional correctness and…

Artificial Intelligence · Computer Science 2026-04-13 Zhirong Chen , Kaiyan Chang , Zhuolin Li , Cangyuan Li , Xinyang He , Chujie Chen , Mengdi Wang , Haobo Xu , Yinhe Han , Huawei Li , Ying Wang

In modern VLSI design flow, the register-transfer level (RTL) stage is a critical point, where designers define precise design behavior with hardware description languages (HDLs) like Verilog. Since the RTL design is in the format of HDL…

Hardware Architecture · Computer Science 2023-11-16 Wenji Fang , Yao Lu , Shang Liu , Qijun Zhang , Ceyu Xu , Lisa Wu Wills , Hongce Zhang , Zhiyao Xie

Building on advancements in Large Language Models (LLMs), we can tackle complex analytical and mathematical reasoning tasks requiring nuanced contextual understanding. A prime example of such complex tasks is modelling resource allocation…

Networking and Internet Architecture · Computer Science 2025-12-02 Tasnim Ahmed , Siana Rizwan , Naveed Ejaz , Salimur Choudhury

The challenge of designing effective reward functions in reinforcement learning (RL) represents a significant bottleneck, often requiring extensive human expertise and being time-consuming. Previous work and recent advancements in large…

Machine Learning · Computer Science 2025-11-25 Franklin Cardenoso , Wouter Caarls

Robotic path planning problems are often NP-hard, and practical solutions typically rely on approximation algorithms with provable performance guarantees for general cases. While designing such algorithms is challenging, formally proving…

Robotics · Computer Science 2026-03-23 Zhengbang Yang , Md. Tasin Tazwar , Minghan Wei , Zhuangdi Zhu

The use of Large Language Models (LLMs) in hardware design has taken off in recent years, principally through its incorporation in tools that increase chip designer productivity. There has been considerable discussion about the use of LLMs…

Hardware Architecture · Computer Science 2025-05-20 Nicolas Dupuis , Ravi Nair , Shyam Ramji , Sean McClintock , Nishant Chauhan , Priyanka Nagpal , Bart Blaner , Ken Valk , Leon Stok , Ruchir Puri

The programming capabilities of large language models (LLMs) have revolutionized automatic code generation and opened new avenues for automatic statistical analysis. However, the validity and quality of these generated codes need to be…

Optimization modeling plays a critical role in the application of Operations Research (OR) tools to address real-world problems, yet they pose challenges and require extensive expertise from OR experts. With the advent of large language…

Computation and Language · Computer Science 2025-07-30 Chenyu Huang , Zhengyang Tang , Shixi Hu , Ruoqing Jiang , Xin Zheng , Dongdong Ge , Benyou Wang , Zizhuo Wang

The automatic generation of RTL code (e.g., Verilog) using natural language instructions and large language models (LLMs) has attracted significant research interest recently. However, most existing approaches heavily rely on commercial…

Programming Languages · Computer Science 2025-08-07 Shang Liu , Wenji Fang , Yao Lu , Qijun Zhang , Hongce Zhang , Zhiyao Xie

A critical stage in the evolving landscape of VLSI design is the design phase that is transformed into register-transfer level (RTL), which specifies system functionality through hardware description languages like Verilog. Generally,…

Artificial Intelligence · Computer Science 2025-02-25 Anindita Chattopadhyay , Vijay Kumar Sutrakar

Large Language Models (LLMs) have demonstrated potential in assisting with Register Transfer Level (RTL) design tasks. Nevertheless, there remains to be a significant gap in benchmarks that accurately reflect the complexity of real-world…

Machine Learning · Computer Science 2024-05-28 Ahmed Allam , Mohamed Shalan

Optimization modeling and solving are fundamental to the application of Operations Research (OR) in real-world decision making, yet the process of translating natural language problem descriptions into formal models and solver code remains…

Artificial Intelligence · Computer Science 2025-11-13 Zezhen Ding , Zhen Tan , Jiheng Zhang , Tianlong Chen

Register-Transfer Level (RTL) coding is an iterative, repository-scale process in which Power, Performance, and Area (PPA) emerge from interactions across many files and the downstream toolchain. While large language models (LLMs) have…

Hardware Architecture · Computer Science 2026-03-11 Zhengyuan Shi , Jingxin Wang , Tairan Cheng , Changran Xu , Weikang Qian , Qiang Xu