English
Related papers

Related papers: Tool-Schema Compression Enables Agentic RAG Under …

200 papers

Retrieval-Augmented Generation (RAG) effectively grounds Large Language Models (LLMs) with external knowledge and is widely applied to Web-related tasks. However, its scalability is hindered by excessive context length and redundant…

Computation and Language · Computer Science 2026-03-24 Yunhao Liu , Zian Jia , Xinyu Gao , Kanjun Xu , Yun Xiong

Foundation models face growing compute and memory bottlenecks, hindering deployment on resource-limited platforms. While compression techniques such as pruning and quantization are widely used, most rely on uniform heuristics that ignore…

Machine Learning · Computer Science 2025-09-09 Sadegh Jafari , Aishwarya Sarkar , Mohiuddin Bilwal , Ali Jannesari

Large language model (LLM) agents are moving beyond prompting alone. ChatGPT marked the rise of general-purpose LLM assistants, DeepSeek showed that on-policy reinforcement learning with verifiable rewards can improve reasoning and tool…

Advancements in deep learning are often associated with increasing model sizes. The model size dramatically affects the deployment cost and latency of deep models. For instance, models like BERT cannot be deployed on edge devices and…

Machine Learning · Computer Science 2022-07-25 Aditya Desai , Keren Zhou , Anshumali Shrivastava

Agentic AI systems represent a new frontier in artificial intelligence, where agents often based on large language models(LLMs) interact with tools, environments, and other agents to accomplish tasks with a degree of autonomy. These systems…

Artificial Intelligence · Computer Science 2025-05-13 Sivasathivel Kandasamy

Rare word recognition can be improved by adapting ASR models to synthetic data that includes these words. Further improvements can be achieved through contextual biasing, which trains and adds a biasing module into the model architecture to…

Computation and Language · Computer Science 2025-09-12 Chin Yuen Kwok , Jia Qi Yip , Eng Siong Chng

Many recent long-context and agentic systems address context-length limitations by adding hierarchical memory: they extract atomic units from raw data, build multi-level representatives by grouping and compression, and traverse this…

Information Retrieval · Computer Science 2026-03-24 Yashar Talebirad , Ali Parsaee , Csongor Y. Szepesvari , Amirhossein Nadiri , Osmar Zaiane

Foundation models have reshaped AI by unifying fragmented architectures into scalable backbones with multimodal reasoning and contextual adaptation. In parallel, the long-standing notion of AI agents, defined by the sensing-decision-action…

Machine Learning · Computer Science 2025-10-02 Sicong Liu , Weiye Wu , Xiangrui Xu , Teng Li , Bowen Pang , Bin Guo , Zhiwen Yu

Retrieval-augmented generation (RAG) often suffers from long and noisy retrieved contexts. Prior context compression methods rely on predefined importance metrics or supervised compression models, rather than on the model's own…

Computation and Language · Computer Science 2026-01-27 Yong Zhang , Heng Li , Yanwen Huang , Ning Cheng , Yang Guo , Yun Zhu , Yanmeng Wang , Shaojun Wang , Jing Xiao

Retrieval-Augmented Generation (RAG) has emerged as the predominant paradigm for grounding Large Language Model outputs in factual knowledge, effectively mitigating hallucinations. However, conventional RAG systems operate under a…

Information Retrieval · Computer Science 2026-01-13 Sergii Voloshyn

We formalize Rollout Informativeness under a Fixed Budget (RIFB) as the expected non-vanishing policy-gradient mass that a tool-use rollout set injects into Group Relative Policy Optimization (GRPO). We prove that any budget-agnostic…

Machine Learning · Statistics 2026-05-08 Yuelin Hu , Zhenbo Yu , Zhengxue Cheng , Wei Liu , Li Song

AI-agent guardrails are memoryless: each message is judged in isolation, so an adversary who spreads a single attack across dozens of sessions slips past every session-bound detector because only the aggregate carries the payload. We make…

Cryptography and Security · Computer Science 2026-04-24 Ari Azarafrooz

An agent that operates sequentially must incorporate new experience without forgetting old experience, under a fixed memory budget. We propose a framework in which memory is not a parameter vector but a stochastic process: a Bridge…

Machine Learning · Computer Science 2026-04-02 Michael Chertkov

Large Language Model (LLM) agents are increasingly deployed in complex, multi-step workflows involving planning, tool use, reflection, and interaction with external knowledge systems. These workflows generate rapidly expanding contexts that…

Artificial Intelligence · Computer Science 2025-12-22 Kamer Ali Yuksel

The demand for edge AI in vision-language tasks requires models that achieve real-time performance on resource-constrained devices with limited power and memory. This paper proposes two adaptive compression techniques -- Sparse Temporal…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Md Tasnin Tanvir , Soumitra Das , Sk Md Abidar Rahaman , Ali Shiri Sichani

Space-air-ground integrated networks (SAGIN) promise ubiquitous 6G connectivity but face significant resource management challenges due to heterogeneous infrastructure, dynamic topologies, and stringent quality-of-service (QoS)…

Networking and Internet Architecture · Computer Science 2026-03-18 Linghao Zhang , Haitao Zhao , Bo Xu , Hongbo Zhu , Xianbin Wang

Intrusion Detection and Prevention Systems (IDS/IPS) in large enterprises can generate hundreds of thousands of alerts per hour, overwhelming analysts with logs requiring rapidly evolving expertise. Conventional machine-learning detectors…

Cryptography and Security · Computer Science 2026-02-10 Francesco Blefari , Cristian Cosentino , Francesco Aurelio Pironti , Angelo Furfaro , Fabrizio Marozzo

Current Retrieval-Augmented Generation systems use uniform processing, causing inefficiency as simple queries consume resources similar to complex multi-hop tasks. We present SymRAG, a framework that introduces adaptive query routing via…

Artificial Intelligence · Computer Science 2025-07-15 Safayat Bin Hakim , Muhammad Adil , Alvaro Velasquez , Houbing Herbert Song

Deploying language models as autonomous agents requires more than per-task accuracy: when an agent faces a queue of problems under a finite token budget, it must decide which to attempt, in what order, and how much compute to commit to…

Artificial Intelligence · Computer Science 2026-05-14 Zabir Al Nazi , Shubhashis Roy Dipta

Early-stage engineering design involves complex, iterative reasoning, yet existing large language model (LLM) workflows struggle to maintain task continuity and generate executable models. We evaluate whether a structured multi-agent system…

Artificial Intelligence · Computer Science 2025-11-04 Soheyl Massoudi , Mark Fuge