English
Related papers

Related papers: Adaptive Cost-Efficient Evaluation for Reliable Pa…

200 papers

Accurate information extraction from specialized texts is a critical challenge for automated rule checking (ARC) in the architecture, engineering, and construction (AEC) domain. While large language models (LLMs) possess strong reasoning…

Computation and Language · Computer Science 2026-01-29 Jian Chen , Jiabao Dou

Embedding tables are usually huge in click-through rate (CTR) prediction models. To train and deploy the CTR models efficiently and economically, it is necessary to compress their embedding tables at the training stage. To this end, we…

Machine Learning · Computer Science 2024-08-07 Shiwei Li , Huifeng Guo , Lu Hou , Wei Zhang , Xing Tang , Ruiming Tang , Rui Zhang , Ruixuan Li

In real-world Tool-Integrated Reasoning (TIR) scenarios, where LLMs interleave reasoning with external tool calls, a major source of inefficiency is that the toolcalls create pauses between LLM requests and cause KV-Cache eviction, forcing…

Performance · Computer Science 2026-04-15 Qisheng Su , Shiting Huang , Zhen Fang , Ziyan Chen , Zehui Chen , Feng Zhao

Label space expansion for multi-label classification (MLC) is a methodology that encodes the original label vectors to higher dimensional codes before training and decodes the predicted codes back to the label vectors during testing. The…

Machine Learning · Computer Science 2018-10-29 Yao-Yuan Yang , Kuan-Hao Huang , Chih-Wei Chang , Hsuan-Tien Lin

As fully fault-tolerant quantum computers capable of solving useful problems remain a distant goal, we anticipate an era of "early fault tolerance" where limited error correction is available. We propose a framework for designing early…

Inference-time compute scaling has emerged as a powerful technique for improving the reliability of large language model (LLM) agents, but existing methods apply compute uniformly: every decision step receives the same budget regardless of…

Artificial Intelligence · Computer Science 2026-04-10 Khushal Sethi

Advanced persistent threats (APTs) pose significant challenges for organizations, leading to data breaches, financial losses, and reputational damage. Existing provenance-based approaches for APT detection often struggle with high false…

Cryptography and Security · Computer Science 2024-06-11 Yonatan Amaru , Prasanna Wudali , Yuval Elovici , Asaf Shabtai

Large language models (LLMs) have shown great potential in code-related tasks, yet open-source models lag behind their closed-source counterparts. To bridge this performance gap, existing methods generate vast amounts of synthetic data for…

Computation and Language · Computer Science 2024-08-06 Weijie Lv , Xuan Xia , Sheng-Jun Huang

Error correction codes (ECC) are crucial for ensuring reliable information transmission in communication systems. Choukroun & Wolf (2022b) recently introduced the Error Correction Code Transformer (ECCT), which has demonstrated promising…

Machine Learning · Computer Science 2024-10-10 Matan Levy , Yoni Choukroun , Lior Wolf

Large Language Models (LLMs) using Chain-of-Thought (CoT) prompting excel at complex reasoning but generate verbose thought processes with considerable redundancy, leading to increased inference costs and reduced efficiency. We introduce a…

Artificial Intelligence · Computer Science 2026-02-17 Zeju Li , Jianyuan Zhong , Ziyang Zheng , Xiangyu Wen , Zhijian Xu , Yingying Cheng , Fan Zhang , Qiang Xu

Large Language Models have seen increasing use in various software development tasks, especially in code generation. The most advanced recent methods attempt to incorporate feedback from code execution into prompts to help guide LLMs in…

Software Engineering · Computer Science 2025-07-31 Hamed Taherkhani , Melika Sepindband , Hung Viet Pham , Song Wang , Hadi Hemmati

The development lifecycle of generative AI systems requires continual evaluation, data acquisition, and annotation, which is costly in both resources and time. In practice, rapid iteration often makes it necessary to rely on synthetic…

Machine Learning · Computer Science 2025-06-10 Anastasios N. Angelopoulos , Jacob Eisenstein , Jonathan Berant , Alekh Agarwal , Adam Fisch

Large language models (LLMs) have shown impressive capabilities in real-world applications. The capability of in-context learning (ICL) allows us to adapt an LLM to downstream tasks by including input-label exemplars in the prompt without…

Artificial Intelligence · Computer Science 2024-10-30 Zhaoxuan Wu , Xiaoqiang Lin , Zhongxiang Dai , Wenyang Hu , Yao Shu , See-Kiong Ng , Patrick Jaillet , Bryan Kian Hsiang Low

Simulation-based design space exploration (DSE) aims to efficiently optimize high-dimensional structured designs under complex constraints and expensive evaluation costs. Existing approaches, including heuristic and multi-step reinforcement…

Machine Learning · Computer Science 2025-06-05 Yifeng Xiao , Yurong Xu , Ning Yan , Masood Mortazavi , Pierluigi Nuzzo

This paper presents an extremum seeking control algorithm with an adaptive step-size that adjusts the aggressiveness of the controller based on the quality of the gradient estimate. The adaptive step-size ensures that the integral-action…

Optimization and Control · Mathematics 2021-12-21 Claus Danielson , Scott A. Bortoff , Ankush Chakrabarty

Context-augmented generation (CAG) techniques, including RAG and ICL, require the efficient combination of multiple contexts to generate responses to user queries. Directly inputting these contexts as a sequence introduces a considerable…

Machine Learning · Computer Science 2025-02-13 Xinyu Yang , Tianqi Chen , Beidi Chen

Reasoning models often outperform smaller models but at 3--5$\times$ higher cost and added latency. We present entropy-guided refinement: a lightweight, test-time loop that uses token-level uncertainty to trigger a single, targeted…

Artificial Intelligence · Computer Science 2025-09-03 Andrew G. A. Correa , Ana C. H de Matos

Prompt routing dynamically selects the most appropriate large language model from a pool of candidates for each query, optimizing performance while managing costs. As model pools scale to include dozens of frontier models with narrow…

Computation and Language · Computer Science 2026-03-24 Yunyi Zhang , Soji Adeshina , Sheng Guan , Ashwin Ganesh , Zhen Han , Vassilis N. Ioannidis , Huzefa Rangwala , George Karypis

Although machine learning (ML) shows potential in improving query optimization by generating and selecting more efficient plans, ensuring the robustness of learning-based cost models (LCMs) remains challenging. These LCMs currently lack…

Databases · Computer Science 2026-01-13 Baoming Chang , Amin Kamali , Verena Kantere

2026 has brought an explosion of interest in LLM-guided evolution of agentic artifacts, with systems like GEPA and Autoresearch demonstrating that LLMs can iteratively improve prompts, code, and agent architectures across diverse domains.…

Artificial Intelligence · Computer Science 2026-04-07 Andrew Borthwick , Stephen Ash , Anthony Galczak