English
Related papers

Related papers: Agentic Compilation: Mitigating the LLM Rerun Cris…

200 papers

Large language models (LLMs) can serve as the semantic-matching engine of a content-based publish/subscribe broker for agentic AI across the edge-cloud computing continuum, bridging the vocabulary and modality gaps that defeat keyword and…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-05-26 Lauri Lovén , Abhishek Kumar , Alexander Engelhardt , Alaa Saleh , Roberto Morabito , Xiaoli Liu , Naser Hossein Motlagh , Sasu Tarkoma

The advanced capabilities of Large Language Models (LLMs) have inspired the development of various interactive web services or applications, such as ChatGPT, which offer query inference services for users. Unlike traditional DNN model, the…

Machine Learning · Computer Science 2024-10-25 Peizhuang Cong , Qizhi Chen , Haochen Zhao , Tong Yang

Large language model retrievers improve performance on complex queries, but their practical value depends on efficiency, robustness, and reliable confidence signals in addition to accuracy. We reproduce a reasoning-intensive retrieval…

Information Retrieval · Computer Science 2026-04-07 Abdelrahman Abdallah , Jamie Holdcroft , Mohammed Ali , Adam Jatowt

Large language models now serve millions of users daily, with providers incurring costs exceeding $700,000 per day. Each request requires token-by-token inference, making GPU scheduling central to latency, capacity, and cost. The difficulty…

Machine Learning · Computer Science 2026-05-18 Ruicheng Ao , Gan Luo , David Simchi-Levi , Xinshang Wang

Large language models (LLMs) and high-capacity encoders have advanced zero and few-shot classification, but their inference cost and latency limit practical deployment. We propose training lightweight text classifiers using dynamically…

Computation and Language · Computer Science 2026-01-26 Gaurav Maheshwari , Kevin El Haddad

The rise of agentic AI workflows unlocks novel opportunities for computer systems design and optimization. However, for specialized domains such as program synthesis, the relative scarcity of HDL and proprietary EDA resources online…

Hardware Architecture · Computer Science 2025-09-25 Amulya Bhattaram , Janani Ramamoorthy , Ranit Gupta , Diana Marculescu , Dimitrios Stamoulis

Designing high-performance system heuristics is a creative, iterative process requiring experts to form hypotheses and execute multi-step conceptual shifts. While Large Language Models (LLMs) show promise in automating this loop, they…

Artificial Intelligence · Computer Science 2026-03-24 Pantea Karimi , Kimia Noorbakhsh , Mohammad Alizadeh , Hari Balakrishnan

A multi-agent pipeline with N agents typically issues N LLM calls per run. Merging agents into fewer calls (compound execution) promises token savings, but naively merged calls silently degrade quality through tool loss and prompt…

Computation and Language · Computer Science 2026-05-04 Aninda Ray

Indirect prompt injection threatens LLM agents by embedding malicious instructions in external content, enabling unauthorized actions and data theft. LLM agents maintain working memory through their context window, which stores interaction…

Cryptography and Security · Computer Science 2026-02-10 Ruoyao Wen , Hao Li , Chaowei Xiao , Ning Zhang

Recent advances in LLM-based multi-agent systems (MAS) show that workflows composed of multiple LLM agents with distinct roles, tools, and communication patterns can outperform single-LLM baselines on complex tasks. However, most frameworks…

Multiagent Systems · Computer Science 2026-01-21 Jiawei Xu , Arief Koesdwiady , Sisong Bei , Yan Han , Baixiang Huang , Dakuo Wang , Yutong Chen , Zheshen Wang , Peihao Wang , Pan Li , Ying Ding

Recent deep research agents primarily improve performance by scaling reasoning depth, but this leads to high inference cost and latency in search-intensive scenarios. Moreover, generalization across heterogeneous research settings remains…

Recent advances in code generation models have unlocked unprecedented opportunities for automating feature engineering, yet their adoption in real-world ML teams remains constrained by critical challenges: (i) the scarcity of datasets…

Machine Learning · Computer Science 2026-01-19 Himanshu Thakur , Anusha Kamath , Anurag Muthyala , Dhwani Sanmukhani , Smruthi Mukund , Jay Katukuri

This paper focuses on extending the success of large language models (LLMs) to sequential decision making. Existing efforts either (i) re-train or finetune LLMs for decision making, or (ii) design prompts for pretrained LLMs. The former…

Machine Learning · Computer Science 2025-06-17 Dingyang Chen , Qi Zhang , Yinglun Zhu

Modern retrieval agents expose many configuration choices -- LLM, retriever, number of documents, number of hops, and synthesis strategy -- each shaping both answer quality and serving cost. Today, these pipelines are typically hand-tuned…

Artificial Intelligence · Computer Science 2026-05-27 Melissa Z. Pan , Negar Arabzadeh , Mathew Jacob , Fiodar Kazhamiaka , Esha Choukse , Matei Zaharia

Large language models (LLMs) have demonstrated remarkable potential in solving complex tasks across diverse domains, typically by employing agentic workflows that follow detailed instructions and operational sequences. However, constructing…

Strategic model selection and reasoning settings are more effective than ensembling for optimizing automated scoring with large language models (LLMs). We examined self-consistency (intra-model majority voting) and reasoning effort for…

Computers and Society · Computer Science 2026-05-01 Scott Frohn

We introduce SLR, an end-to-end framework for systematic evaluation and training of Large Language Models (LLMs) via Scalable Logical Reasoning. Given a user's task specification, SLR automatically synthesizes (i) an instruction prompt for…

Efficient agentic systems should incur expensive frontier-model costs only on decisions where a cheaper local model is likely to fail. Existing LLM cascades usually route whole queries before execution, but task difficulty shifts…

Graphical User Interface (GUI) agents can automate complex tasks across digital environments, but their development is hindered by the scarcity of high-quality trajectory data for training. Existing approaches rely on expensive human…

Computation and Language · Computer Science 2025-03-04 Yiheng Xu , Dunjie Lu , Zhennan Shen , Junli Wang , Zekun Wang , Yuchen Mao , Caiming Xiong , Tao Yu

Large Language Model (LLM) agents struggle with long-horizon software engineering tasks due to "Context Bloat." As interaction history grows, computational costs explode, latency increases, and reasoning capabilities degrade due to…

Artificial Intelligence · Computer Science 2026-01-13 Nikhil Verma