English
Related papers

Related papers: Structured Context Engineering for File-Native Age…

200 papers

Large Language Models (LLMs) like GPT-4 have revolutionized natural language processing, showing remarkable linguistic proficiency and reasoning capabilities. However, their application in strategic multi-agent decision-making environments…

Computation and Language · Computer Science 2024-05-29 Chuanhao Li , Runhan Yang , Tiankai Li , Milad Bafarassat , Kourosh Sharifi , Dirk Bergemann , Zhuoran Yang

LLM-based code agents treat repositories as unstructured text, applying edits through brittle string matching that frequently fails due to formatting drift or ambiguous patterns. We propose reframing the codebase as a structured action…

Artificial Intelligence · Computer Science 2026-04-17 Myeongsoo Kim , Joe Hsu , Dingmin Wang , Shweta Garg , Varun Kumar , Murali Krishna Ramanathan

Large language models (LLMs) are increasingly deployed as optimization modules in agentic systems, yet the fundamental limits of such LLM-mediated improvement remain poorly understood. Here we propose a theory of LLM information…

Machine Learning · Computer Science 2026-03-26 Zhuo-Yang Song , Hua Xing Zhu

Time-series data is central to decision-making in financial markets, yet building high-performing, interpretable, and auditable models remains a major challenge. While Automated Machine Learning (AutoML) frameworks streamline model…

Artificial Intelligence · Computer Science 2025-08-27 Yihao Ang , Yifan Bao , Lei Jiang , Jiajie Tao , Anthony K. H. Tung , Lukasz Szpruch , Hao Ni

Deep research is emerging as a representative long-horizon task for large language model (LLM) agents. However, long trajectories in deep research often exceed model context limits, compressing token budgets for both evidence collection and…

Computation and Language · Computer Science 2026-04-20 Chiwei Zhu , Benfeng Xu , Mingxuan Du , Shaohan Wang , Xiaorui Wang , Zhendong Mao , Yongdong Zhang

Large Language Models (LLMs) have shown promise in automating code generation and software engineering tasks, yet they often struggle with complex, multi-file projects due to context limitations and knowledge gaps. We propose a novel…

Software Engineering · Computer Science 2025-08-13 Muhammad Haseeb

Recent advancements in Large Language Model (LLM)-based frameworks have extended their capabilities to complex real-world applications, such as interactive web navigation. These systems, driven by user commands, navigate web browsers to…

Computation and Language · Computer Science 2024-11-06 Nalin Tiwary , Vardhan Dongre , Sanil Arun Chawla , Ashwin Lamani , Dilek Hakkani-Tür

Large Language Models are being increasingly deployed as the decision-making core of autonomous agents capable of effecting change in external environments. Yet, in conversational benchmarks, which simulate real-world customer-centric issue…

Computation and Language · Computer Science 2026-04-29 Amir Saeidi , Venkatesh Mishra , Souradeep Mukhopadhyay , Gaowen Liu , Ali Payani , Jayanth Srinivasa , Chitta Baral

Recent advancements in long-context large language models have attracted significant attention, yet their practical applications often suffer from suboptimal context utilization. This study investigates structuring training data to enhance…

Computation and Language · Computer Science 2025-03-03 Konrad Staniszewski , Szymon Tworkowski , Sebastian Jaszczur , Yu Zhao , Henryk Michalewski , Łukasz Kuciński , Piotr Miłoś

Foundation model-enabled generative artificial intelligence facilitates the development and implementation of agents, which can leverage distinguished reasoning and language processing capabilities to takes a proactive, autonomous role to…

Artificial Intelligence · Computer Science 2024-11-07 Yue Liu , Sin Kit Lo , Qinghua Lu , Liming Zhu , Dehai Zhao , Xiwei Xu , Stefan Harrer , Jon Whittle

Despite their widespread adoption, large language models (LLMs) remain prohibitive to use under resource constraints, with their ever growing sizes only increasing the barrier for use. One noted issue is the high latency associated with…

Machine Learning · Computer Science 2024-12-17 Jerry Huang , Prasanna Parthasarathi , Mehdi Rezagholizadeh , Sarath Chandar

When deploying LLMs in agentic architectures requiring real-time decisions under temporal constraints, we assume they reliably determine whether action windows remain open or have closed. This assumption is untested. We characterize…

Computation and Language · Computer Science 2025-11-17 Javier Marín

With the advent of large language models (LLMs), the vast unstructured text within millions of academic papers is increasingly accessible for materials discovery, although significant challenges remain. While LLMs offer promising few- and…

Computation and Language · Computer Science 2025-09-30 Amit K Verma , Zhisong Zhang , Junwon Seo , Robin Kuo , Runbo Jiang , Emma Strubell , Anthony D Rollett

Foundation models, such as large language models (LLMs), have been widely recognised as transformative AI technologies due to their capabilities to understand and generate content, including plans with reasoning capabilities. Foundation…

Artificial Intelligence · Computer Science 2024-04-04 Qinghua Lu , Liming Zhu , Xiwei Xu , Zhenchang Xing , Stefan Harrer , Jon Whittle

Large Language Models (LLMs) have shown useful applications in a variety of tasks, including data wrangling. In this paper, we investigate the use of an off-the-shelf LLM for schema matching. Our objective is to identify semantic…

Databases · Computer Science 2024-07-17 Marcel Parciak , Brecht Vandevoort , Frank Neven , Liesbet M. Peeters , Stijn Vansummeren

State-of-the-art results in large language models (LLMs) often rely on scale, which becomes computationally expensive. This has sparked a research agenda to reduce these models' parameter counts and computational costs without significantly…

Computation and Language · Computer Science 2024-11-07 Xiuying Wei , Skander Moalla , Razvan Pascanu , Caglar Gulcehre

Understanding how large language models (LLMs) represent and reason about spatial information is crucial for building robust agentic systems that can navigate real and simulated environments. In this work, we investigate the influence of…

Artificial Intelligence · Computer Science 2025-02-25 Nicolas Martorell

Large Language Models (LLMs) and Vision Language Models (VLMs) have shown impressive reasoning abilities, yet they struggle with spatial understanding and layout consistency when performing fine-grained visual editing. We introduce a…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Haoyu Zhen , Xiaolong Li , Yilin Zhao , Han Zhang , Sifei Liu , Kaichun Mo , Chuang Gan , Subhashree Radhakrishnan

The effective utilization of structured data, integral to corporate data strategies, has been challenged by the rise of large language models (LLMs) capable of processing unstructured information. This shift prompts the question: can LLMs…

Computation and Language · Computer Science 2024-10-22 Zhouhong Gu , Haoning Ye , Xingzhou Chen , Zeyang Zhou , Hongwei Feng , Yanghua Xiao

Open data repositories hold potential for evidence-based decision-making, yet are inaccessible to non-experts lacking expertise in dataset discovery, schema mapping, and statistical analysis. Large language models show promise for…

Artificial Intelligence · Computer Science 2025-11-06 Sina Montazeri , Yunhe Feng , Kewei Sha