English
Related papers

Related papers: VeriDispatcher: Multi-Model Dispatching through Pr…

200 papers

Large Language Models (LLMs) have demonstrated remarkable capabilities in code generation. However, the quality of the generated code is heavily dependent on the structure and composition of the prompts used. Crafting high-quality prompts…

Software Engineering · Computer Science 2025-04-08 Jinyang Li , Sangwon Hyun , M. Ali Babar

Large language models (LLMs) are reshaping automated fact-checking (AFC) by enabling unified, end-to-end verification pipelines rather than isolated components. While large proprietary models achieve strong performance, their closed…

Computation and Language · Computer Science 2026-01-19 Malin Astrid Larsson , Harald Fosen Grunnaleite , Vinay Setty

Predictive analysis is a cornerstone of modern decision-making, with applications in various domains. Large Language Models (LLMs) have emerged as powerful tools in enabling nuanced, knowledge-intensive conversations, thus aiding in complex…

Computation and Language · Computer Science 2025-05-26 Qin Chen , Yuanyi Ren , Xiaojun Ma , Yuyang Shi

Large Language Models (LLMs), such as ChatGPT, are increasingly leveraged for generating both traditional software code and spreadsheet logic. Despite their impressive generative capabilities, these models frequently exhibit critical issues…

Software Engineering · Computer Science 2025-11-27 Simon Thorne , Advait Sarkar

AI agents powered by large language models (LLMs) are being used to solve increasingly complex software engineering challenges, but struggle with hardware design tasks. Register Transfer Level (RTL) code presents a unique challenge for…

Large Language Models (LLMs) have demonstrated remarkable performance across diverse domains, thereby prompting researchers to explore their potential for use in recommendation systems. Initial attempts have leveraged the exceptional…

Information Retrieval · Computer Science 2023-10-18 Keqin Bao , Jizhi Zhang , Yang Zhang , Wenjie Wang , Fuli Feng , Xiangnan He

The rapid evolution of Large Language Model (LLM) inference systems has yielded significant efficiency improvements. However, our systematic analysis reveals that current evaluation methodologies frequently exhibit fundamental flaws, often…

The evaluation of generative or discriminative large language model (LLM)-based systems is often a complex multi-dimensional problem. Typically, a set of system configuration alternatives are evaluated on one or more benchmark datasets,…

Applications · Statistics 2025-01-31 Samuel Ackerman , Eitan Farchi , Orna Raz , Assaf Toledo

Large Language Model (LLM) workloads have distinct prefill and decode phases with different compute and memory requirements which should ideally be accounted for when scheduling input queries across different LLM instances in a cluster.…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-01-08 Kunal Jain , Anjaly Parayil , Ankur Mallick , Esha Choukse , Xiaoting Qin , Jue Zhang , Íñigo Goiri , Rujia Wang , Chetan Bansal , Victor Rühle , Anoop Kulkarni , Steve Kofsky , Saravan Rajmohan

Large Language Models (LLMs) have demonstrated strong reasoning capabilities in solving complex problems. However, current approaches primarily enhance reasoning through the elaboration of thoughts while neglecting the diversity of…

Computation and Language · Computer Science 2025-04-25 Danqing Wang , Jianxin Ma , Fei Fang , Lei Li

The Large Language Models (LLM) are increasingly being deployed in robotics to generate robot control programs for specific user tasks, enabling embodied intelligence. Existing methods primarily focus on LLM training and prompt design that…

Robotics · Computer Science 2025-08-27 ZhenDong Chen , ZhanShang Nie , ShiXing Wan , JunYi Li , YongTian Cheng , Shuai Zhao

Large language models (LLMs) have demonstrated outstanding performance in natural language processing tasks. However, in the field of recommender systems, due to the inherent structural discrepancy between user behavior data and natural…

Information Retrieval · Computer Science 2026-01-01 Zekun Liu , Xiaowen Huang , Jitao Sang

There is a rapidly growing number of open-source Large Language Models (LLMs) and benchmark datasets to compare them. While some models dominate these benchmarks, no single model typically achieves the best accuracy in all tasks and use…

Computation and Language · Computer Science 2023-09-28 Tal Shnitzer , Anthony Ou , Mírian Silva , Kate Soule , Yuekai Sun , Justin Solomon , Neil Thompson , Mikhail Yurochkin

Automated Machine Learning (AutoML) frameworks increasingly leverage Large Language Models (LLMs) for tasks such as hyperparameter optimization and neural architecture code generation. However, current LLM-based approaches focus on…

Machine Learning · Computer Science 2026-05-07 Mahmoud Hanouneh , Radu Timofte , Dmitry Ignatov

Claim verification with large language models (LLMs) has recently attracted growing attention, due to their strong reasoning capabilities and transparent verification processes compared to traditional answer-only judgments. However,…

Computation and Language · Computer Science 2025-10-07 Qi He , Cheng Qian , Xiusi Chen , Bingxiang He , Yi R. Fung , Heng Ji

As large language models (LLMs) continue to advance and gain widespread use, establishing systematic and reliable evaluation methodologies for LLMs and vision-language models (VLMs) has become essential to ensure their real-world…

Artificial Intelligence · Computer Science 2025-06-03 Jie Feng , Jun Zhang , Tianhui Liu , Xin Zhang , Tianjian Ouyang , Junbo Yan , Yuwei Du , Siqi Guo , Yong Li

Large language models (LLMs) can be used as accessible and intelligent chatbots by constructing natural language queries and directly inputting the prompt into the large language model. However, different prompt' constructions often lead to…

Computation and Language · Computer Science 2023-12-14 Jinta Weng , Jiarui Zhang , Yue Hu , Daidong Fa , Xiaofeng Xuand , Heyan Huang

Large language models (LLMs) demonstrate impressive multilingual capability, but their performance varies substantially across different languages. In this work, we introduce a simple yet effective method, called cross-lingual-thought…

Computation and Language · Computer Science 2023-10-24 Haoyang Huang , Tianyi Tang , Dongdong Zhang , Wayne Xin Zhao , Ting Song , Yan Xia , Furu Wei

The automatic generation of deep learning (DL) kernels using large language models (LLMs) has emerged as a promising approach to reduce the manual effort and hardware-specific expertise required for writing high-performance operator…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-07-29 Zhongzhen Wen , Yinghui Zhang , Zhong Li , Zhongxin Liu , Linna Xie , Tian Zhang

Large language models (LLMs) have demonstrated strong capabilities in generating Verilog code from natural language descriptions. However, Verilog code inherently encodes structural information of hardware circuits. Effectively leveraging…

Hardware Architecture · Computer Science 2025-10-21 Jiayu Zhao , Song Chen