English
Related papers

Related papers: HYPERHEURIST: A Simulated Annealing-Based Control …

200 papers

Power electronics, a critical component in modern power systems, face several challenges in control design, including model uncertainties, and lengthy and costly design cycles. This paper is aiming to propose a Large Language Models (LLMs)…

Systems and Control · Electrical Eng. & Systems 2024-06-19 Chenggang Cui , Jiaming Liu , Junkang Feng , Peifeng Hui , Amer M. Y. M. Ghias , Chuanlin Zhang

Reinforcement Learning (RL) has become the most effective post-training approach for improving the capabilities of Large Language Models (LLMs). In practice, because of the high demands on latency and memory, it is particularly challenging…

Transformer-based Large Language Models (LLMs) have made a significant impact on various domains. However, LLMs' efficiency suffers from both heavy computation and memory overheads. Compression techniques like sparsification and…

Despite recent advances, analog front-end design still relies heavily on expert intuition and iterative simulations, which limits the potential for automation. We present AnalogCoder-Pro, a multimodal large language model (LLM) framework…

Machine Learning · Computer Science 2025-09-03 Yao Lai , Souradip Poddar , Sungyoung Lee , Guojin Chen , Mengkang Hu , Bei Yu , Ping Luo , David Z. Pan

Analog layout synthesis faces significant challenges due to its dependence on manual processes, considerable time requirements, and performance instability. Current Bayesian Optimization (BO)-based techniques for analog layout synthesis,…

Artificial Intelligence · Computer Science 2024-12-09 Guojin Chen , Keren Zhu , Seunggeun Kim , Hanqing Zhu , Yao Lai , Bei Yu , David Z. Pan

FPGAs are increasingly adopted in datacenter environments for their reconfigurability and energy efficiency. High-Level Synthesis (HLS) tools have eased FPGA programming by raising the abstraction level from RTL to untimed C/C++, yet…

Machine Learning · Computer Science 2025-05-01 Neha Prakriya , Zijian Ding , Yizhou Sun , Jason Cong

Recent advancements have significantly enhanced the performance of large language models (LLMs) in tackling complex reasoning tasks, achieving notable success in domains like mathematical and logical reasoning. However, these methods…

Artificial Intelligence · Computer Science 2025-05-30 Runquan Gui , Zhihai Wang , Jie Wang , Chi Ma , Huiling Zhen , Mingxuan Yuan , Jianye Hao , Defu Lian , Enhong Chen , Feng Wu

Mechanism design has long been a cornerstone of economic theory, with traditional approaches relying on mathematical derivations. Recently, automated approaches, including differentiable economics with neural networks, have emerged for…

Machine Learning · Computer Science 2025-02-19 Jiayuan Liu , Mingyu Guo , Vincent Conitzer

Large language models (LLMs) have greatly accelerated the automation of algorithm generation and optimization. However, current methods such as EoH and FunSearch mainly rely on predefined templates and expert-specified functions that focus…

Software Engineering · Computer Science 2025-03-17 Zhe Zhao , Haibin Wen , Pengkun Wang , Ye Wei , Zaixi Zhang , Xi Lin , Fei Liu , Bo An , Hui Xiong , Yang Wang , Qingfu Zhang

Large Language Models (LLMs) have become extremely potent instruments with exceptional capacities for comprehending and producing human-like text in a wide range of applications. However, the increasing size and complexity of LLMs present…

Machine Learning · Computer Science 2024-06-18 Yingbing Huang , Lily Jiaxin Wan , Hanchen Ye , Manvi Jha , Jinghua Wang , Yuhong Li , Xiaofan Zhang , Deming Chen

The rapid adoption of large language models(LLMs) in hardware design has primarily focused on generating functionally correct Verilog code, overlooking critical Power Performance-Area(PPA) metrics essential for industrial-grade designs. To…

Software Engineering · Computer Science 2025-07-22 Kimia Tasnia , Alexander Garcia , Tasnuva Farheen , Sazadur Rahman

Transformer-based, pre-trained large language models (LLMs) have demonstrated outstanding performance across diverse domains, particularly in the emerging {\em pretrain-then-finetune} paradigm. Low-Rank Adaptation (LoRA), a…

Machine Learning · Computer Science 2024-09-19 Zhengmao Ye , Dengchun Li , Zetao Hu , Tingfeng Lan , Jian Sha , Sicong Zhang , Lei Duan , Jie Zuo , Hui Lu , Yuanchun Zhou , Mingjie Tang

Applying large language models (LLMs) to RTL code optimization for improved power, performance, and area (PPA) faces two key challenges: ensuring functional correctness of optimized designs despite LLM hallucination, and systematically…

Hardware Architecture · Computer Science 2026-03-23 Heng Ping , Peiyu Zhang , Zhenkun Wang , Shixuan Li , Anzhe Cheng , Wei Yang , Paul Bogdan , Shahin Nazarian

Recent breakthroughs in Large-scale language models (LLMs) have demonstrated impressive performance on various tasks. The immense sizes of LLMs have led to very high resource demand and cost for running the models. Though the models are…

Machine Learning · Computer Science 2024-03-05 Juntao Zhao , Borui Wan , Yanghua Peng , Haibin Lin , Chuan Wu

Register Transfer Level (RTL) design translates high-level specifications into hardware using HDLs such as Verilog. Although LLM-based RTL generation is promising, the scarcity of functionally verifiable high-quality data limits both…

Hardware Architecture · Computer Science 2026-03-31 Xinyu Zhang , Zhiteng Chao , Yonghao Wang , Bin Sun , Tianyun Ma , Tianmeng Yang , Jianan Mu , Jing Justin Ye , Huawei Li

Reinforcement learning (RL) has become a dominant paradigm for training large language models (LLMs), particularly for reasoning tasks. Effective RL for LLMs requires massive parallelization and poses an urgent need for efficient training…

Machine Learning · Computer Science 2026-03-03 Wei Fu , Jiaxuan Gao , Xujie Shen , Chen Zhu , Zhiyu Mei , Chuyi He , Shusheng Xu , Guo Wei , Jun Mei , Jiashu Wang , Tongkai Yang , Binhang Yuan , Yi Wu

Retrieval-augmented generation (RAG) has emerged as a promising solution for mitigating hallucinations of large language models (LLMs) with retrieved external knowledge. Adaptive RAG enhances this approach by enabling dynamic retrieval…

Computation and Language · Computer Science 2024-10-07 Huanshuo Liu , Hao Zhang , Zhijiang Guo , Jing Wang , Kuicai Dong , Xiangyang Li , Yi Quan Lee , Cong Zhang , Yong Liu

Reinforcement Learning (RL) is increasingly utilized to enhance the reasoning capabilities of Large Language Models (LLMs). However, effectively scaling these RL methods presents significant challenges, primarily due to the difficulty in…

Machine Learning · Computer Science 2025-09-30 Alexandre Piché , Ehsan Kamalloo , Rafael Pardinas , Xiaoyin Chen , Dzmitry Bahdanau

In this work, we present a new approach to high level synthesis (HLS), where high level functions are first mapped to an architectural template, before hardware synthesis is performed. As FPGA platforms are especially suitable for…

Hardware Architecture · Computer Science 2016-06-22 Shaoyi Cheng , John Wawrzynek

Large Language Models (LLMs) have demonstrated remarkable capabilities across various fields, from natural language understanding to text generation. Compared to non-generative LLMs like BERT and DeBERTa, generative LLMs like GPT series and…

Hardware Architecture · Computer Science 2025-06-16 Jinhao Li , Jiaming Xu , Shan Huang , Yonghua Chen , Wen Li , Jun Liu , Yaoxiu Lian , Jiayi Pan , Li Ding , Hao Zhou , Yu Wang , Guohao Dai