English
Related papers

Related papers: Meta Context Engineering via Agentic Skill Evoluti…

200 papers

The rapid development and adoption of Generative AI (GAI) technology in the form of chatbots such as ChatGPT and Claude has greatly increased interest in agentic machines. This paper introduces the Autonomous Cognitive Entity (ACE) model, a…

Human-Computer Interaction · Computer Science 2023-11-02 David Shapiro , Wangfan Li , Manuel Delaflor , Carlos Toxtli

Large language models (LLMs) are increasingly trained in complex Reinforcement Learning, multi-agent environments, making it difficult to understand how behavior changes over training. Sparse Autoencoders (SAEs) have recently shown to be…

Machine Learning · Computer Science 2026-02-09 John Yan , Michael Yu , Yuqi Sun , Alexander Duffy , Tyler Marques , Matthew Lyle Olson

Large Language Models (LLMs) deployed in agentic environments must exercise multiple capabilities across different task instances, where a capability is performing one or more actions in a trajectory that are necessary for successfully…

Artificial Intelligence · Computer Science 2026-04-08 Hangoo Kang , Tarun Suresh , Jon Saad-Falcon , Azalia Mirhoseini

Manufacturing Operations Management (MOM) systems are complex in the sense that they integrate data from heterogeneous systems inside the automation pyramid. The need for context-aware analytics arises from the dynamics of these systems…

Artificial Intelligence · Computer Science 2014-12-30 Martin Ringsquandl , Steffen Lamparter , Raffaello Lepratti

Current LLM agents typically lack instance-level context, which comprises concrete facts such as environment structure, system configurations, and local mechanics. Consequently, existing methods are forced to intertwine exploration with…

Computation and Language · Computer Science 2026-01-14 Kuntai Cai , Juncheng Liu , Xianglin Yang , Zhaojie Niu , Xiaokui Xiao , Xing Chen

Large Pre-trained Transformers exhibit an intriguing capacity for in-context learning. Without gradient updates, these models can rapidly construct new predictors from demonstrations presented in the inputs. Recent works promote this…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Yi-Syuan Chen , Yun-Zhu Song , Cheng Yu Yeo , Bei Liu , Jianlong Fu , Hong-Han Shuai

Creativity has become a core competence in the era of LLMs and human-AI collaboration, underpinning innovation in real-world problem solving. Crucially, the systematic improvement of creativity necessitates scientifically valid assessment…

Computation and Language · Computer Science 2026-04-28 Yixuan Wang , Yue Huang , Hong Qian , Yunzhao Wei , Yifei Ding , Wenkai Wang , Zhi Liu , Zhongjing Huang , Aimin Zhou , Jiajun Guo

Multi-Agent Discussion (MAD) has garnered increasing attention very recently, where multiple LLM instances collaboratively solve problems via structured discussion. However, we find that current MAD methods easily suffer from discussion…

Artificial Intelligence · Computer Science 2026-05-14 Xingyuan Hua , Sheng Yue , Xinyi Li , Yizhe Zhao , Jinrui Zhang , Ju Ren

In scenarios where language models must incorporate new information efficiently without extensive retraining, traditional fine-tuning methods are prone to overfitting, degraded generalization, and unnatural language generation. To address…

Computation and Language · Computer Science 2025-04-01 Siyuan Qi , Bangcheng Yang , Kailin Jiang , Xiaobo Wang , Jiaqi Li , Yifan Zhong , Yaodong Yang , Zilong Zheng

In this paper, we present our submission to the Tenth Conference on Machine Translation (WMT25) Shared Task on Automated Translation Quality Evaluation. Our systems are built upon the COMET framework and trained to predict segment-level…

Computation and Language · Computer Science 2025-09-18 Sami Ul Haq , Chinonso Cynthia Osuji , Sheila Castilho , Brian Davis

Language model (LM) agents are increasingly being used to automate complicated tasks in digital environments. Just as humans benefit from powerful software applications, such as integrated development environments, for complex tasks like…

Software Engineering · Computer Science 2024-11-13 John Yang , Carlos E. Jimenez , Alexander Wettig , Kilian Lieret , Shunyu Yao , Karthik Narasimhan , Ofir Press

We present a new recurrent neural network topology to enhance state-of-the-art machine learning systems by incorporating a broader context. Our approach overcomes recent limitations with extended narratives through a multi-layered…

Computation and Language · Computer Science 2018-08-07 Patrick Huber , Jan Niehues , Alex Waibel

This paper introduces CMASE, a framework for Computational Multi-Agent Society Experiments that integrates generative agent-based modeling with virtual ethnographic methods to support researcher embedding, interactive participation, and…

Artificial Intelligence · Computer Science 2026-03-11 Hanzhong Zhang , Muhua Huang , Jindong Wang

Deep neural networks exhibit exceptional accuracy when they are trained and tested on the same data distributions. However, neural classifiers are often extremely brittle when confronted with domain shift---changes in the input distribution…

Computer Vision and Pattern Recognition · Computer Science 2019-04-15 Zuxuan Wu , Xin Wang , Joseph E. Gonzalez , Tom Goldstein , Larry S. Davis

Organizations increasingly deploy separate purpose-built AI tools across professional domains, often hiring domain specialists for each, recreating the staffing models AI was expected to transform. Yet the meta-skills that make these tools…

Software Engineering · Computer Science 2026-05-27 Elias Calboreanu

Reinforcement learning (RL) has made a lot of advances for solving a single problem in a given environment; but learning policies that generalize to unseen variations of a problem remains challenging. To improve sample efficiency for…

Machine Learning · Computer Science 2021-12-07 Theresa Eimer , André Biedenkapp , Frank Hutter , Marius Lindauer

Context engineering for large language model (LLM) agents requires distinguishing pragmatically useful information from misleading distractors. We introduce Entropic Context Shaping (ECS), an information-theoretic framework that measures…

Computation and Language · Computer Science 2026-01-21 Hyunjun Kim

Model Driven Engineering (MDE) has been widely applied in software development, aiming to facilitate the coordination among various stakeholders. Such a methodology allows for a more efficient and effective development process.…

Software Engineering · Computer Science 2022-03-14 Juri Di Rocco , Davide Di Ruscio , Claudio Di Sipio , Phuong T. Nguyen , Alfonso Pierantonio

Large language model (LLM) agents have demonstrated strong capabilities in long-horizon tasks by interleaving reasoning with tool use. However, as these agents scale to complex workflows such as software engineering and open-ended research,…

Software Engineering · Computer Science 2026-03-03 Junde Wu , Minhao Hu , Jiayuan Zhu , Jiazhen Pan , Yuyuan Liu , Min Xu , Yueming Jin

Large language models are increasingly deployed as multi-agent systems, where specialized roles communicate and collaborate through structured interactions to solve complex tasks that often exceed the capacity of a single agent. However,…

Computation and Language · Computer Science 2026-01-28 Yimeng Wang , Jiaxing Zhao , Hongbin Xie , Hexing Ma , Yuzhen Lei , Shuangxue Liu , Xuan Song , Zichen Zhang , Haoran Zhang