English
Related papers

Related papers: Agentic Harness Engineering: Observability-Driven …

200 papers

Foundation models have transformed automated code generation, yet autonomous software-engineering agents remain unreliable in realistic development settings. The dominant explanation locates this gap in model capability. We propose a…

Software Engineering · Computer Science 2026-05-14 Hailin Zhong , Shengxin Zhu

AI agents are increasingly deployed on complex, domain-specific workflows -- navigating enterprise web applications that require dozens of clicks and form fills, orchestrating multi-step research pipelines that span search, extraction, and…

Artificial Intelligence · Computer Science 2026-05-05 Haebin Seong , Li Yin , Haoran Zhang , Zhan Shi

Recent advances in agentic systems increasingly treat code as an executable operational substrate rather than as a disposable output artifact. Prior work such as \emph{Code as Agent Harness} frames validated agent-generated artifacts as…

Software Engineering · Computer Science 2026-05-27 Mariano Garralda-Barrio

Recent large language models (LLMs) have demonstrated strong capabilities in understanding and generating code, from competitive programming to repository-level software engineering. In emerging agentic systems, code is no longer only a…

This paper studies the next major bottleneck in agentic AI as system scaling, not only model scaling: the design of auditable, persistent, modular, and verifiable architectures around foundation models. We refer to this shift as scaling the…

Artificial Intelligence · Computer Science 2026-05-26 Shangding Gu

Agentic AI coding systems can inspect repositories, plan implementation steps, edit files, call tools, run tests, and submit pull requests. These capabilities make software and hardware development faster in some settings, but current…

Software Engineering · Computer Science 2026-05-21 Christopher Koch

Agent performance is strongly shaped by the surrounding harness: the external execution system around a model that organizes a task run. Yet this logic is usually buried in tightly coupled controller code, which makes harnesses hard to…

Computation and Language · Computer Science 2026-05-19 Linyue Pan , Lexiao Zou , Shuo Guo , Jingchen Ni , Hai-Tao Zheng

Agentic Software Engineering (SE 3.0) represents a new era where intelligent agents are tasked not with simple code generation, but with achieving complex, goal-oriented SE objectives. To harness these new capabilities while ensuring…

Software Engineering · Computer Science 2025-09-24 Ahmed E. Hassan , Hao Li , Dayi Lin , Bram Adams , Tse-Hsun Chen , Yutaro Kashiwa , Dong Qiu

AI-based systems, currently driven largely by LLMs and tool-using agentic harnesses, are increasingly discussed as a possible threat to software engineering. Foundation models get stronger, agents can plan and act across multiple steps, and…

Software Engineering · Computer Science 2026-04-24 Robert Feldt , Per Lenberg , Julian Frattini , Dhasarathy Parthasarathy

Existing Agent benchmarks suffer from two critical limitations: high environment interaction overhead (up to 41\% of total evaluation time) and imbalanced task horizon and difficulty distributions that make aggregate scores unreliable. To…

Artificial Intelligence · Computer Science 2026-04-13 Wang Yang , Chaoda Song , Xinpeng Li , Debargha Ganguly , Chuang Ma , Shouren Wang , Zhihao Dou , Yuli Zhou , Vipin Chaudhary , Xiaotian Han

Agent harness evolution improves frozen language-model agents by modifying the executable structures around them. We study this paradigm as a form of sample-efficient fast adaptation: instead of updating model weights, an agent can acquire…

Artificial Intelligence · Computer Science 2026-05-26 Lirong Che , Yuzhe yang , Peiwen lin , Chuang wang , Xueqian wang , Jian su

This work examines how AI, especially agentic systems, is being adopted in engineering and manufacturing workflows, what value it provides today, and what is needed for broader deployment. This is an exploratory and qualitative…

Computers and Society · Computer Science 2026-04-14 Kristen M. Edwards , Maxwell Bauer , Claire Jacquillat , A. John Hart , Faez Ahmed

Agentic evolution has emerged as a powerful paradigm for improving programs, workflows, and scientific solutions by iteratively generating candidates, evaluating them, and using feedback to guide future search. However, existing methods are…

Artificial Intelligence · Computer Science 2026-05-14 Jiayi Zhang , Yongfeng Gu , Jianhao Ruan , Maojia Song , Yiran Peng , Zhiguang Han , Jinyu Xiang , Zhitao Wang , Caiyin Yang , Yixi Ouyang , Bang Liu , Chenglin Wu , Yuyu Luo

LLM agents are shaped not only by their language models, but also by the runtime harness that mediates observation, tool use, action execution, feedback interpretation, and trajectory control. While existing agent adaptation methods mainly…

Artificial Intelligence · Computer Science 2026-05-28 Tianshi Xu , Huifeng Wen , Meng Li

Large Language Models produce a controllability gap in safety-critical engineering: even low rates of undetected constraint violations render a system undeployable. Current orchestration paradigms suffer from sycophantic compliance, context…

Artificial Intelligence · Computer Science 2026-05-05 Tianbao Zhang

AI-native software development is often evaluated at the level of individual models, prompts, or generated artifacts. This framing is insufficient for production environments where software must be continuously produced, verified, deployed,…

Software Engineering · Computer Science 2026-05-26 Satadru Sengupta , Tamunokorite Briggs , Ivan Myshakivskyi

AI agents are promising for high-stakes enterprise workflows, but dependable deployment remains limited because tool-use failures are difficult to diagnose and control. Agents may skip required tool calls, invoke tools unnecessarily, or…

Artificial Intelligence · Computer Science 2026-05-22 Hariom Tatsat , Ariye Shater

The agent harness, the system layer comprising prompts, tools, memory, and orchestration logic that surrounds the model, has emerged as the central engineering abstraction for LLMbased agents. Yet harness design remains ad hoc, with no…

Programming Languages · Computer Science 2026-05-13 Bogdan Banu

Coding harnesses such as Claude Code and OpenHands wrap foundation models with tools, memory, and planning, but no equivalent exists for embodied agents' long-horizon partial-observability decision-making. We first report our Gemini Plays…

Machine Learning · Computer Science 2026-05-12 Seth Karten , Joel Zhang , Tersoo Upaa , Ruirong Feng , Wenzhe Li , Chengshuai Shi , Chi Jin , Kiran Vodrahalli

Edge AI is often framed as model compression and deployment under tight constraints. We argue a stronger operational thesis: Edge AI in realistic deployments is necessarily adaptive. In long-horizon operation, a fixed (non-adaptive)…

Hardware Architecture · Computer Science 2026-04-10 Fabrizio Pittorino , Manuel Roveri
‹ Prev 1 2 3 10 Next ›