English
Related papers

Related papers: Structured Context Engineering for File-Native Age…

200 papers

We describe a new semantic parsing setting that allows users to query the system using both natural language questions and actions within a graphical user interface. Multiple time series belonging to an entity of interest are stored in a…

Computation and Language · Computer Science 2019-05-02 Charles Chen , Razvan Bunescu

Large language models (LLMs) excel across diverse natural language processing tasks but face resource demands and limited context windows. Although techniques like pruning, quantization, and token dropping can mitigate these issues, their…

Computation and Language · Computer Science 2025-08-04 Ammar Ahmed , Sheng Di , Franck Cappello , Zirui Liu , Jingoo Han , Ali Anwar

The deployment of agent systems in an enterprise environment is often hindered by several challenges: common models lack domain-specific process knowledge, leading to disorganized plans, missing key tools, and poor execution stability. To…

Retrieval-Augmented Generation (RAG) enhances factual grounding in large language models (LLMs) by incorporating retrieved evidence, but LLM accuracy declines when long or noisy contexts exceed the model's effective attention span. Existing…

Computation and Language · Computer Science 2026-03-25 Debashish Chakraborty , Eugene Yang , Daniel Khashabi , Dawn Lawrie , Kevin Duh

Solving complex or long-horizon problems often requires large language models (LLMs) to use external tools and operate over a significantly longer context window. New LLMs enable longer context windows and support tool calling capabilities.…

Machine Learning · Computer Science 2025-12-03 Tsimur Hadeliya , Mohammad Ali Jauhar , Nidhi Sakpal , Diogo Cruz

Large Language Model (LLM) agents struggle with long-horizon software engineering tasks due to "Context Bloat." As interaction history grows, computational costs explode, latency increases, and reasoning capabilities degrade due to…

Artificial Intelligence · Computer Science 2026-01-13 Nikhil Verma

Agentic systems operating over large tool ecosystems must plan and execute long-horizon workflows under weak or non-verifiable supervision. While frontier models mitigate these challenges through scale and large context budgets, small…

Machine Learning · Computer Science 2026-03-10 Karan Gupta , Pranav Vajreshwari , Yash Pandya , Raghav Magazine , Akshay Nambi , Ahmed Awadallah

Recent advances in code generation models have unlocked unprecedented opportunities for automating feature engineering, yet their adoption in real-world ML teams remains constrained by critical challenges: (i) the scarcity of datasets…

Machine Learning · Computer Science 2026-01-19 Himanshu Thakur , Anusha Kamath , Anurag Muthyala , Dhwani Sanmukhani , Smruthi Mukund , Jay Katukuri

Modern code intelligence agents operate in contexts exceeding 1 million tokens--far beyond the scale where humans manually locate relevant files. Yet agents consistently fail to discover architecturally critical files when solving…

Artificial Intelligence · Computer Science 2026-02-24 Tarakanath Paipuru

Building effective clinical decision support systems requires the synthesis of complex heterogeneous multimodal data. Such modalities include temporal electronic health records data, medical images, radiology reports, and clinical notes.…

Artificial Intelligence · Computer Science 2026-05-12 Baraa Al Jorf , Farah E. Shamout

Large language models (LLMs) have shown promise for automated patching, but their effectiveness depends strongly on how they are integrated into patching systems. While prior work explores prompting strategies and individual agent designs,…

Cryptography and Security · Computer Science 2026-03-03 Qingxiao Xu , Ze Sheng , Zhicheng Chen , Jeff Huang

Large Language Models (LLMs) have shown remarkable performance on general Question Answering (QA), yet they often struggle in domain-specific scenarios where accurate and up-to-date information is required. Retrieval-Augmented Generation…

Computation and Language · Computer Science 2026-02-13 Haoyue Bai , Haoyu Wang , Shengyu Chen , Zhengzhang Chen , Lu-An Tang , Wei Cheng , Haifeng Chen , Yanjie Fu

This paper presents a high-quality multilingual dataset for the documentation domain to advance research on localization of structured text. Unlike widely-used datasets for translation of plain text, we collect XML-structured parallel text…

Computation and Language · Computer Science 2020-06-25 Kazuma Hashimoto , Raffaella Buschiazzo , James Bradbury , Teresa Marshall , Richard Socher , Caiming Xiong

We propose a methodology that combines several advanced techniques in Large Language Model (LLM) retrieval to support the development of robust, multi-source question-answer systems. This methodology is designed to integrate information…

Artificial Intelligence · Computer Science 2024-12-25 Antony Seabra , Claudio Cavalcante , Joao Nepomuceno , Lucas Lago , Nicolaas Ruberg , Sergio Lifschitz

Extracting structured information from scientific literature is critical for accelerating discovery, yet Large Language Models (LLMs) often struggle in specialized domains that require expert knowledge and generalize poorly across tasks. We…

Computation and Language · Computer Science 2026-05-22 Tek Raj Chhetri , Yibei Chen , Puja Trivedi , Dorota Jarecka , Saif Haobsh , Patrick Ray , Lydia Ng , Satrajit S. Ghosh

Improving Large Language Model (LLM) agents for sequential decision-making tasks typically requires extensive task-specific knowledge engineering--custom prompts, curated examples, and specialized observation/action spaces. We investigate a…

Machine Learning · Computer Science 2025-05-20 Vishnu Sarukkai , Zhiqiang Xie , Kayvon Fatahalian

Current LLM agents typically lack instance-level context, which comprises concrete facts such as environment structure, system configurations, and local mechanics. Consequently, existing methods are forced to intertwine exploration with…

Computation and Language · Computer Science 2026-01-14 Kuntai Cai , Juncheng Liu , Xianglin Yang , Zhaojie Niu , Xiaokui Xiao , Xing Chen

Large Language Models (LLMs) have shown strong capabilities in solving problems across domains, including graph-related tasks traditionally addressed by symbolic or algorithmic methods. In this work, we present a framework for structured…

Artificial Intelligence · Computer Science 2025-09-03 Govind Waghmare , Sumedh BG , Sonia Gupta , Srikanta Bedathur

In this paper, we explore the question of whether large language models can support cost-efficient information extraction from tables. We introduce schema-driven information extraction, a new task that transforms tabular data into…

Computation and Language · Computer Science 2024-11-22 Fan Bai , Junmo Kang , Gabriel Stanovsky , Dayne Freitag , Mark Dredze , Alan Ritter

Current approaches to AI agent orchestration typically involve building multi-agent frameworks that manage context passing, memory, error handling, and step coordination through code. These frameworks work well for complex, concurrent…

Artificial Intelligence · Computer Science 2026-03-19 Jake Van Clief , David McDermott