English
Related papers

Related papers: LLM-Enhanced Bayesian Optimization for Efficient A…

200 papers

Large language models (LLMs) have made significant advancements in natural language processing and are concurrently extending the language ability to other modalities, such as speech and vision. Nevertheless, most of the previous work…

Computation and Language · Computer Science 2024-01-02 Hongkun Hao , Long Zhou , Shujie Liu , Jinyu Li , Shujie Hu , Rui Wang , Furu Wei

The increasing use of Advanced Language Models (ALMs) in diverse sectors, particularly due to their impressive capability to generate top-tier content following linguistic instructions, forms the core of this investigation. This study…

Machine Learning · Computer Science 2024-01-10 Kiran Thorat , Jiahui Zhao , Yaotian Liu , Hongwu Peng , Xi Xie , Bin Lei , Jeff Zhang , Caiwen Ding

We propose LGGPT, an LLM-based model tailored for unified layout generation. First, we propose Arbitrary Layout Instruction (ALI) and Universal Layout Response (ULR) as the uniform I/O template. ALI accommodates arbitrary layout generation…

Machine Learning · Computer Science 2025-02-21 Peirong Zhang , Jiaxin Zhang , Jiahuan Cao , Hongliang Li , Lianwen Jin

Large Language Models (LLMs) are increasingly used to automate hardware design tasks, including the generation of Verilog code. While early benchmarks focus primarily on functional correctness, efficient hardware design demands additional…

Computation and Language · Computer Science 2025-10-17 Manar Abdelatty , Maryam Nouh , Jacob K. Rosenstein , Sherief Reda

Design optimisation offers the potential to develop lightweight aircraft structures with reduced environmental impact. Due to the high number of design variables and constraints, these challenges are typically addressed using gradient-based…

Computational Engineering, Finance, and Science · Computer Science 2025-08-04 Hauke F. Maathuis , Roeland De Breuker , Saullo G. P. Castro

Bayesian optimization (BO) is a widely-used sequential method for zeroth-order optimization of complex and expensive-to-compute black-box functions. The existing BO methods assume that the function evaluation (feedback) is available to the…

Machine Learning · Computer Science 2022-06-22 Arun Verma , Zhongxiang Dai , Bryan Kian Hsiang Low

Bayesian optimization (BO) has become an effective approach for black-box function optimization problems when function evaluations are expensive and the optimum can be achieved within a relatively small number of queries. However, many…

Machine Learning · Statistics 2018-08-06 Zi Wang , Clement Gehring , Pushmeet Kohli , Stefanie Jegelka

Tackling complex optimization problems often relies on expert-designed heuristics, typically crafted through extensive trial and error. Recent advances demonstrate that large language models (LLMs), when integrated into well-designed…

Neural and Evolutionary Computing · Computer Science 2025-05-20 Ziyao Huang , Weiwei Wu , Kui Wu , Jianping Wang , Wei-Bin Lee

The success of large language models (LLMs) depends heavily on large-scale, high-quality instruction-following and reinforcement datasets. However, generating such data through human annotation is prohibitively time-consuming particularly…

Computation and Language · Computer Science 2026-02-02 Chenhua Shi , Gregor Macdonald , Bhavika Jalli , Wanlu Lei , John Zou , Mridul Jain , Joji Philip

The abilities of modern large language models (LLMs) in solving natural language processing, complex reasoning, sentiment analysis and other tasks have been extraordinary which has prompted their extensive adoption. Unfortunately, these…

Artificial Intelligence · Computer Science 2024-05-29 Anthony Sarah , Sharath Nittur Sridhar , Maciej Szankin , Sairam Sundaresan

High-level synthesis (HLS) allows hardware designers to create hardware designs with high-level programming languages like C/C++/OpenCL, which greatly improves hardware design productivity. However, existing HLS flows require programmers'…

Hardware Architecture · Computer Science 2024-10-11 Haocheng Xu , Haotian Hu , Sitao Huang

This paper proposes a learning framework, RoSE-Opt, to achieve robust and efficient analog circuit parameter optimization. RoSE-Opt has two important features. First, it incorporates key domain knowledge of analog circuit design, such as…

Hardware Architecture · Computer Science 2024-07-30 Weidong Cao , Jian Gao , Tianrui Ma , Rui Ma , Mouhacine Benosman , Xuan Zhang

The machine learning community has witnessed impressive advancements since large language models (LLMs) first appeared. Yet, their massive memory consumption has become a significant roadblock to large-scale training. For instance, a 7B…

Machine Learning · Computer Science 2024-12-30 Rui Pan , Xiang Liu , Shizhe Diao , Renjie Pi , Jipeng Zhang , Chi Han , Tong Zhang

Recent years have witnessed the fast development of quantum computing. Researchers around the world are eager to run larger and larger quantum algorithms that promise speedups impossible to any classical algorithm. However, the available…

Hardware Architecture · Computer Science 2023-05-30 Bochen Tan , Jason Cong

The integration of Large Language Models (LLMs) into optimization has created a powerful synergy, opening exciting research opportunities. This paper investigates how LLMs can enhance existing optimization algorithms. Using their…

Artificial Intelligence · Computer Science 2025-02-13 Camilo Chacón Sartori , Christian Blum

Optimization of product and system characteristics is required in many fields, including design and control. Bayesian optimization (BO) is often used when there are high observing costs, because BO theoretically guarantees an upper bound on…

Machine Learning · Computer Science 2024-03-26 Yasunori Taguchi , Hiro Gangi

In robotics, deep learning (DL) methods are used more and more widely, but their general inability to provide reliable confidence estimates will ultimately lead to fragile and unreliable systems. This impedes the potential deployments of DL…

Robotics · Computer Science 2020-11-02 Matthias Humt , Jongseok Lee , Rudolph Triebel

The rapid development of large language models (LLM) has greatly enhanced everyday applications. While many FPGA-based accelerators, with flexibility for fine-grained data control, exhibit superior speed and energy efficiency compared to…

Hardware Architecture · Computer Science 2026-03-24 Zifan He , Shengyu Ye , Rui Ma , Yang Wang , Jason Cong

Traditional base station siting (BSS) methods rely heavily on drive testing and user feedback, which are laborious and require extensive expertise in communication, networking, and optimization. As large language models (LLMs) and their…

Artificial Intelligence · Computer Science 2024-12-30 Yanhu Wang , Muhammad Muzammil Afzal , Zhengyang Li , Jie Zhou , Chenyuan Feng , Shuaishuai Guo , Tony Q. S. Quek

Over the last few decades, researchers have made considerable efforts to make decision support more accessible for small and medium enterprises by reducing the cost of designing, developing and maintaining automated decision support…

Software Engineering · Computer Science 2025-04-07 Daniel Karapetyan