English
Related papers

Related papers: CLI-Gym: Scalable CLI Task Generation via Agentic …

200 papers

The capability of a reinforcement learning (RL) agent heavily depends on the diversity of the learning scenarios generated by the environment. Generation of diverse realistic scenarios is challenging for real-time strategy (RTS)…

Machine Learning · Computer Science 2023-03-30 Abdus Salam Azad , Edward Kim , Qiancheng Wu , Kimin Lee , Ion Stoica , Pieter Abbeel , Sanjit A. Seshia

Building human-like agent, which aims to learn and think like human intelligence, has long been an important research topic in AI. To train and test human-like agents, we need an environment that imposes the agent to rich multimodal…

Artificial Intelligence · Computer Science 2021-05-04 Kwanyoung Park , Hyunseok Oh , Youngki Lee

Large Language Models (LLMs) agents augmented with domain tools promise to autonomously execute complex tasks requiring human-level intelligence, such as customer service and digital assistance. However, their practical deployment is often…

Multiagent Systems · Computer Science 2025-08-28 Kevin Song , Anand Jayarajan , Yaoyao Ding , Qidong Su , Zhanda Zhu , Sihang Liu , Gennady Pekhimenko

Even though demonstrating extraordinary capabilities in code generation and software issue resolving, AI agents' capabilities in the full software DevOps cycle are still unknown. Different from pure code generation, handling the DevOps…

Computer-Use Agents (CUA) are becoming increasingly capable of autonomously operating digital environments through Graphical User Interfaces (GUI). Yet, most GUI remain designed primarily for humans--prioritizing aesthetics and…

Computer Vision and Pattern Recognition · Computer Science 2025-11-20 Kevin Qinghong Lin , Siyuan Hu , Linjie Li , Zhengyuan Yang , Lijuan Wang , Philip Torr , Mike Zheng Shou

We introduce ComputerRL, a framework for autonomous desktop intelligence that enables agents to operate complex digital workspaces skillfully. ComputerRL features the API-GUI paradigm, which unifies programmatic API calls and direct GUI…

Artificial Intelligence · Computer Science 2025-10-22 Hanyu Lai , Xiao Liu , Yanxiao Zhao , Han Xu , Hanchen Zhang , Bohao Jing , Yanyu Ren , Shuntian Yao , Yuxiao Dong , Jie Tang

Training capable Large Language Model (LLM) agents is critically bottlenecked by the high cost and static nature of real-world interaction data. We address this by introducing GenEnv, a framework that establishes a difficulty-aligned…

Computation and Language · Computer Science 2025-12-24 Jiacheng Guo , Ling Yang , Peter Chen , Qixin Xiao , Yinjie Wang , Xinzhe Juan , Jiahao Qiu , Ke Shen , Mengdi Wang

Autonomous agents powered by large language models (LLMs) have the potential to enhance human capabilities, assisting with digital tasks from sending emails to performing data analysis. The abilities of existing LLMs at such tasks are often…

Machine Learning · Computer Science 2025-01-22 Hongjin Su , Ruoxi Sun , Jinsung Yoon , Pengcheng Yin , Tao Yu , Sercan Ö. Arık

As LLM-based agents are increasingly deployed in real-life scenarios, existing benchmarks fail to capture their inherent complexity of handling extensive information, leveraging diverse resources, and managing dynamic user interactions. To…

Computation and Language · Computer Science 2025-10-20 Wei He , Yueqing Sun , Hongyan Hao , Xueyuan Hao , Zhikang Xia , Qi Gu , Chengcheng Han , Dengchang Zhao , Hui Su , Kefeng Zhang , Man Gao , Xi Su , Xiaodong Cai , Xunliang Cai , Yu Yang , Yunke Zhao

Coding agents are rapidly changing the landscape of software development, moving from inline completion to autonomous systems that edit repositories, open pull requests, respond to issues, and run scheduled or webhook triggered routines…

Software Engineering · Computer Science 2026-05-11 Nghi D. Q. Bui , Georgios Evangelopoulos

We study what actually works and what doesn't for training large language models as agents via multi-turn reinforcement learning. Despite rapid progress, existing frameworks and definitions are fragmented, and there is no systematic…

Machine Learning · Computer Science 2025-12-09 Ruiyi Wang , Prithviraj Ammanabrolu

Recent progress in GUI agents has substantially improved visual grounding, yet robust planning remains challenging, particularly when the environment deviates from a canonical initial state. In real applications, users often invoke…

Artificial Intelligence · Computer Science 2026-05-26 Henry Hengyuan Zhao , Kaiming Yang , Wendi Yu , Difei Gao , Mike Zheng Shou

Mobile GUI agents excel at immediate reactive control but frequently fail in realistic, long-horizon tasks that require memory. This failure stems from a fundamental conflict between limited context windows and token-heavy screenshots. To…

Computation and Language · Computer Science 2026-05-29 Junyang Wang , Haiyang Xu , Xi Zhang , Zhaoqing Zhu , Ming Yan , Jieping Ye , Jitao Sang

Graphical User Interface (GUI) agents are autonomous systems that interpret and generate actions, enabling intelligent user assistance and automation. Effective training of these agent presents unique challenges, such as sparsity in…

Computation and Language · Computer Science 2025-03-28 Yiqiao Jin , Stefano Petrangeli , Yu Shen , Gang Wu

The introduction of large language models ignited great retooling and rethinking of the software development models. The ensuing response of software engineering research yielded a massive body of tools and approaches. In this paper, we…

Software Engineering · Computer Science 2026-02-05 Marian Kica , Lukas Radosky , David Slivka , Karin Kubinova , Daniel Dovhun , Tomas Uhercik , Erik Bircak , Ivan Polasek

This review presents a comprehensive analysis of two emerging paradigms in AI-assisted software development: vibe coding and agentic coding. While both leverage large language models (LLMs), they differ fundamentally in autonomy,…

Software Engineering · Computer Science 2025-05-27 Ranjan Sapkota , Konstantinos I. Roumeliotis , Manoj Karkee

Large Language Model (LLM) agents represent a promising shift in human-AI interaction, moving beyond passive prompt-response systems to autonomous agents capable of reasoning, planning, and goal-directed action. While LLM agents are…

Computation and Language · Computer Science 2026-02-06 Weiwen Liu , Jiarui Qin , Xu Huang , Xingshan Zeng , Yunjia Xi , Jianghao Lin , Chuhan Wu , Yasheng Wang , Lifeng Shang , Ruiming Tang , Defu Lian , Yong Yu , Weinan Zhang

Large Language Models (LLMs) offer a promising basis for creating agents that can tackle complex tasks through iterative environmental interaction. Existing methods either require these agents to mimic expert-provided trajectories or rely…

Computation and Language · Computer Science 2024-12-02 Dihong Gong , Pu Lu , Zelong Wang , Meng Zhou , Xiuqiang He

Adapting autonomous agents for real-world industrial, domestic, and other daily tasks is currently gaining momentum. However, in global or cross-lingual application contexts, ensuring effective interaction with the environment and executing…

Robotics · Computer Science 2025-10-07 Linus Nwankwo , Bjoern Ellensohn , Ozan Özdenizci , Elmar Rueckert

With ChatGPT-like large language models (LLM) prevailing in the community, how to evaluate the ability of LLMs is an open question. Existing evaluation methods suffer from following shortcomings: (1) constrained evaluation abilities, (2)…

Artificial Intelligence · Computer Science 2023-08-09 Jiaju Lin , Haoran Zhao , Aochi Zhang , Yiting Wu , Huqiuyue Ping , Qin Chen