English
Related papers

Related papers: RAG-Enhanced Kernel-Based Heuristic Synthesis (RKH…

200 papers

Large Language Models (LLMs) deployed on edge devices learn through fine-tuning and updating a certain portion of their parameters. Although such learning methods can be optimized to reduce resource utilization, the overall required…

Machine Learning · Computer Science 2024-05-09 Ruiyang Qin , Zheyu Yan , Dewen Zeng , Zhenge Jia , Dancheng Liu , Jianbo Liu , Zhi Zheng , Ningyuan Cao , Kai Ni , Jinjun Xiong , Yiyu Shi

Recent work investigated the use of Reinforcement Learning (RL) for the synthesis of heuristic guidance to improve the performance of temporal planners when a domain is fixed and a set of training problems (not plans) is given. The idea is…

Artificial Intelligence · Computer Science 2025-05-20 Irene Brugnara , Alessandro Valentini , Andrea Micheli

Combining Large Language Models (LLMs) with heuristic search algorithms like A* holds the promise of enhanced LLM reasoning and scalable inference. To accelerate training and reduce computational demands, we investigate the coreset…

Artificial Intelligence · Computer Science 2024-10-25 Devaansh Gupta , Boyang Li

Retrieval-Augmented Generation (RAG) systems leverage Large Language Models (LLMs) to generate accurate and reliable responses that are grounded in retrieved context. However, LLMs often generate inconsistent outputs for semantically…

Computation and Language · Computer Science 2025-10-17 Xujun Peng , Anoop Kumar , Jingyu Wu , Parker Glenn , Daben Liu

Existing RAG benchmarks often overlook query difficulty, leading to inflated performance on simpler questions and unreliable evaluations. A robust benchmark dataset must satisfy three key criteria: quality, diversity, and difficulty, which…

Information Retrieval · Computer Science 2025-06-02 Jeongsoo Lee , Daeyong Kwon , Kyohoon Jin , Junnyeong Jeong , Minwoo Sim , Minwoo Kim

High-level synthesis (HLS) has significantly advanced the automation of digital circuits design, yet the need for expertise and time in pragma tuning remains challenging. Existing solutions for the design space exploration (DSE) adopt…

Hardware Architecture · Computer Science 2025-04-14 Ping Chang , Tosiron Adegbija , Yuchao Liao , Claudio Talarico , Ao Li , Janet Roveda

Retrieval-Augmented Generation (RAG) has emerged as a powerful paradigm for Large Language Models (LLMs) to address knowledge-intensive queries requiring domain-specific or up-to-date information. To handle complex multi-hop questions that…

Computation and Language · Computer Science 2026-01-05 Yuxin Wang , Shicheng Fang , Bo Wang , Qi Luo , Xuanjing Huang , Yining Zheng , Xipeng Qiu

High-Level Synthesis (HLS) is a pivotal electronic design automation (EDA) technology that enables the generation of hardware circuits from high-level language descriptions. A critical step in HLS is Design Space Exploration (DSE), which…

Hardware Architecture · Computer Science 2026-03-03 Lei Xu , Shanshan Wang , Chenglong Xiao

Heuristic algorithms such as simulated annealing, Concorde, and METIS are effective and widely used approaches to find solutions to combinatorial optimization problems. However, they are limited by the high sample complexity required to…

Machine Learning · Computer Science 2019-06-18 Qingpeng Cai , Will Hang , Azalia Mirhoseini , George Tucker , Jingtao Wang , Wei Wei

Retrieval-Augmented Generation (RAG) systems face significant performance gaps when applied to technical domains requiring precise information extraction from complex documents. Current evaluation methodologies relying on document-level…

Machine Learning · Computer Science 2025-02-25 Aryan Jadon , Avinash Patil , Shashank Kumar

Integrating Large Language Models (LLMs) within metaheuristics opens a novel path for solving complex combinatorial optimization problems. While most existing approaches leverage LLMs for code generation to create or refine specific…

Neural and Evolutionary Computing · Computer Science 2025-09-15 Camilo Chacón Sartori , Martín Isla Pino , Pedro Pinacho-Davidson , Christian Blum

High-Level Synthesis (HLS) serves as an agile hardware development tool that streamlines the circuit design by abstracting the register transfer level into behavioral descriptions, while allowing designers to customize the generated…

Hardware Architecture · Computer Science 2025-06-03 Runkai Li , Jia Xiong , Xi Wang

Large language models (LLMs) have demonstrated impressive capabilities in reasoning with the emergence of reasoning models like OpenAI-o1 and DeepSeek-R1. Recent research focuses on integrating reasoning capabilities into the realm of…

Computation and Language · Computer Science 2025-05-26 Qi Zhang , Shouqing Yang , Lirong Gao , Hao Chen , Xiaomeng Hu , Jinglei Chen , Jiexiang Wang , Sheng Guo , Bo Zheng , Haobo Wang , Junbo Zhao

Recent studies exploited Large Language Models (LLMs) to autonomously generate heuristics for solving Combinatorial Optimization Problems (COPs), by prompting LLMs to first provide search directions and then derive heuristics accordingly.…

Neural and Evolutionary Computing · Computer Science 2025-06-12 Xuan Wu , Di Wang , Chunguo Wu , Lijie Wen , Chunyan Miao , Yubin Xiao , You Zhou

High-Level Synthesis enables the rapid prototyping of hardware accelerators, by combining a high-level description of the functional behavior of a kernel with a set of micro-architecture optimizations as inputs. Such optimizations can be…

Hardware Architecture · Computer Science 2025-02-11 Stéphane Pouget , Louis-Noël Pouchet , Jason Cong

Although Large Language Models (LLMs) demonstrate significant capabilities, their reliance on parametric knowledge often leads to inaccuracies. Retrieval Augmented Generation (RAG) mitigates this by incorporating external knowledge, but…

Artificial Intelligence · Computer Science 2025-11-04 Hailong Yin , Bin Zhu , Jingjing Chen , Chong-Wah Ngo

Recent Large Language Models (LLMs) such as OpenAI o3-mini and DeepSeek-R1 use enhanced reasoning through Chain-of-Thought (CoT). Their potential in hardware design, which relies on expert-driven iterative optimization, remains unexplored.…

Artificial Intelligence · Computer Science 2025-04-15 Luca Collini , Andrew Hennessee , Ramesh Karri , Siddharth Garg

In this paper, we investigate the retrieval-augmented generation (RAG) based on Knowledge Graphs (KGs) to improve the accuracy and reliability of Large Language Models (LLMs). Recent approaches suffer from insufficient and repetitive…

Computation and Language · Computer Science 2024-04-22 Xinke Jiang , Ruizhe Zhang , Yongxin Xu , Rihong Qiu , Yue Fang , Zhiyuan Wang , Jinyi Tang , Hongxin Ding , Xu Chu , Junfeng Zhao , Yasha Wang

Large language models (LLMs) can improve their accuracy on various tasks through iteratively refining and revising their output based on feedback. We observe that these revisions can introduce errors, in which case it is better to roll back…

Artificial Intelligence · Computer Science 2023-09-26 Kumar Shridhar , Harsh Jhamtani , Hao Fang , Benjamin Van Durme , Jason Eisner , Patrick Xia

High-level synthesis (HLS) notably speeds up the hardware design process by avoiding RTL programming. However, the turnaround time of HLS increases significantly when post-route quality of results (QoR) are considered during optimization.…

Hardware Architecture · Computer Science 2024-01-18 Mingzhe Gao , Jieru Zhao , Zhe Lin , Minyi Guo