English
Related papers

Related papers: DockSmith: Scaling Reliable Coding Environments vi…

200 papers

Agentic systems increasingly rely on reusable procedural capabilities, \textit{a.k.a., agentic skills}, to execute long-horizon workflows reliably. These capabilities are callable modules that package procedural knowledge with explicit…

Cryptography and Security · Computer Science 2026-02-25 Yanna Jiang , Delong Li , Haiyu Deng , Baihe Ma , Xu Wang , Qin Wang , Guangsheng Yu

Large Language Model agents face fundamental challenges in adapting to novel tasks due to limitations in tool availability and experience reuse. Existing approaches either rely on predefined tools with limited coverage or build tools from…

Computation and Language · Computer Science 2025-12-15 Jiarun Liu , Shiyue Xu , Yang Li , Shangkun Liu , Yongli Yu , Peng Cao

Large language model based agents are increasingly deployed in complex, tool augmented environments. While reinforcement learning provides a principled mechanism for such agents to improve through interaction, its effectiveness critically…

Artificial Intelligence · Computer Science 2025-12-04 Shinji Mai , Yunpeng Zhai , Ziqian Chen , Cheng Chen , Anni Zou , Shuchang Tao , Zhaoyang Liu , Bolin Ding

Linux Containers, such as those managed by Docker, are an increasingly popular way to package and deploy complex applications. However, the fundamental security primitive of network access control for a distributed microservice deployment…

Networking and Internet Architecture · Computer Science 2019-03-06 Cornelius Diekmann , Johannes Naab , Andreas Korsten , Georg Carle

Executing complex terminal tasks remains a significant challenge for open-weight LLMs, constrained by two fundamental limitations. First, high-fidelity, executable training environments are scarce: environments synthesized from real-world…

Artificial Intelligence · Computer Science 2026-02-10 Kaijie Zhu , Yuzhou Nie , Yijiang Li , Yiming Huang , Jialian Wu , Jiang Liu , Ximeng Sun , Zhenfei Yin , Lun Wang , Zicheng Liu , Emad Barsoum , William Yang Wang , Wenbo Guo

The evaluation of code-generating Large Language Models (LLMs) is fundamentally constrained by two intertwined challenges: a reliance on static, easily contaminated problem sources and the use of superficial, low-rigor testing. This paper…

Software Engineering · Computer Science 2026-02-04 Zhe Zhang , Runlin Liu , Aishan Liu , Xingyu Liu , Xiang Gao , Hailong Sun

Large Language Models (LLMs) based autonomous agents demonstrate multifaceted capabilities to contribute substantially to economic production. However, existing benchmarks remain focused on single agentic capability, failing to capture…

Artificial Intelligence · Computer Science 2026-04-24 Keyu Li , Junhao Shi , Yang Xiao , Mohan Jiang , Jie Sun , Yunze Wu , Dayuan Fu , Shijie Xia , Xiaojie Cai , Tianze Xu , Weiye Si , Wenjie Li , Dequan Wang , Pengfei Liu

Large language models (LLMs) have shown impressive capabilities in code generation. However, because most LLMs are trained on public domain corpora, directly applying them to real-world software development often yields low success rates,…

Artificial Intelligence · Computer Science 2026-03-26 Shuai Wang , Dhasarathy Parthasarathy , Robert Feldt , Yinan Yu

To close the gap between LLM-based agents and humans in planning and reasoning, agents need large-scale, diverse environments for continuous learning -- yet building such environments is itself prohibitively expensive. We present C-World,…

Artificial Intelligence · Computer Science 2026-04-21 Ziqiao Xi , Shuang Liang , Qi Liu , Jiaqing Zhang , Letian Peng , Fang Nan , Meshal Nayim , Tianhui Zhang , Rishika Mundada , Lianhui Qin , Biwei Huang , Kun Zhou

Frontier scientific reasoning is rapidly emerging as a key foundation for advancing AI agents in automated scientific discovery. Deep research agents offer a promising approach to this challenge. These models develop robust problem-solving…

Artificial Intelligence · Computer Science 2026-05-27 Tianshi Zheng , Rui Wang , Xiyun Li , Kelvin Kiu Wai Tam , Newt Nguyen Kim Hue Nam , Wei Fan , Yangqiu Song , Tianqing Fang

Swarm robotic systems are currently being used to address many real-world problems. One interesting application of swarm robotics is the self-organized formation of structures and shapes. Some of the key challenges in the swarm robotic…

Robotics · Computer Science 2017-11-20 Yasir R. Darr , Muaz A. Niazi

The rapid progress of Large Language Models has advanced agentic systems in decision-making, coordination, and task execution. Yet, existing agentic system generation frameworks lack full autonomy, missing from-scratch agent generation,…

Artificial Intelligence · Computer Science 2025-06-19 Yao Zhang , Chenyang Lin , Shijie Tang , Haokun Chen , Shijie Zhou , Yunpu Ma , Volker Tresp

Accurate blind docking has the potential to lead to new biological breakthroughs, but for this promise to be realized, docking methods must generalize well across the proteome. Existing benchmarks, however, fail to rigorously assess…

Biomolecules · Quantitative Biology 2024-02-29 Gabriele Corso , Arthur Deng , Benjamin Fry , Nicholas Polizzi , Regina Barzilay , Tommi Jaakkola

Early-stage engineering design involves complex, iterative reasoning, yet existing large language model (LLM) workflows struggle to maintain task continuity and generate executable models. We evaluate whether a structured multi-agent system…

Artificial Intelligence · Computer Science 2025-11-04 Soheyl Massoudi , Mark Fuge

As LLMs shift toward autonomous agents, Deep Research has emerged as a pivotal metric. However, existing academic benchmarks like BrowseComp often fail to meet real-world demands for open-ended research, which requires robust skills in…

Autonomous agents are increasingly expected to support scientific research, and recent benchmarks report progress in code repair and autonomous experimentation. However, these evaluations typically assume a pre-configured execution…

Software Engineering · Computer Science 2026-03-12 Yubang Wang , Chenxi Zhang , Bowen Chen , Zezheng Huai , Zihao Dai , Xinchi Chen , Yuxin Wang , Yining Zheng , Jingjing Gong , Xipeng Qiu

As autonomous code agents move toward end-to-end software development, evaluating their practical autonomy becomes critical. Current benchmarks hide friction by testing agents in pre-configured environments, and their static evaluation…

Software Engineering · Computer Science 2026-05-14 Hao Guan , Lingyue Fu , Shao Zhang , Yaoming Zhu , Kangning Zhang , Lin Qiu , Xunliang Cai , Xuezhi Cao , Weiwen Liu , Weinan Zhang , Yong Yu

Software development agents powered by large language models (LLMs) have shown great promise in automating tasks like environment setup, issue solving, and program repair. Unfortunately, understanding and debugging such agents remain…

Software Engineering · Computer Science 2026-02-09 Robert Hutter , Michael Pradel

Constructing environments for training and evaluating claw-like agents remains a manual, human-intensive process that does not scale. We argue that what is needed is not just a dataset, but an automated pipeline capable of generating…

Artificial Intelligence · Computer Science 2026-04-30 Xirui Li , Ming Li , Ion Stoica , Cho-Jui Hsieh , Tianyi Zhou

This technical brief introduces Deep Agent, an advanced autonomous AI system designed to manage complex multi-phase tasks through a novel hierarchical task management architecture. The system's foundation is built on our Hierarchical Task…

Artificial Intelligence · Computer Science 2025-02-12 Amy Yu , Erik Lebedev , Lincoln Everett , Xiaoxin Chen , Terry Chen