English
Related papers

Related papers: UI-Evol: Automatic Knowledge Evolving for Computer…

200 papers

High-quality dialogue is crucial for e-commerce customer service, yet traditional intent-based systems struggle with dynamic, multi-turn interactions. We present MindFlow+, a self-evolving dialogue agent that learns domain-specific behavior…

Computation and Language · Computer Science 2025-07-28 Ming Gong , Xucheng Huang , Ziheng Xu , Vijayan K. Asari

Large Language Models have demonstrated remarkable capabilities across diverse domains, yet significant challenges persist when deploying them as AI agents for real-world long-horizon tasks. Existing LLM agents suffer from a critical…

Computation and Language · Computer Science 2025-10-10 Cheng Yang , Xuemeng Yang , Licheng Wen , Daocheng Fu , Jianbiao Mei , Rong Wu , Pinlong Cai , Yufan Shen , Nianchen Deng , Botian Shi , Yu Qiao , Haifeng Li

Computer-use agents face a fundamental limitation. They rely exclusively on primitive GUI actions (click, type, scroll), creating brittle execution chains prone to cascading failures. While API-driven agents harness rich capabilities…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Yuhao Yang , Zhen Yang , Zi-Yi Dou , Anh Nguyen , Keen You , Omar Attia , Andrew Szot , Michael Feng , Ram Ramrakhya , Alexander Toshev , Chao Huang , Yinfei Yang , Zhe Gan

The emergence of Multimodal Large Language Models (MLLMs) has driven significant advances in Graphical User Interface (GUI) agent capabilities. Nevertheless, existing GUI agent training and inference techniques still suffer from a dilemma…

Artificial Intelligence · Computer Science 2026-04-09 Shuquan Lian , Yuhang Wu , Jia Ma , Yifan Ding , Zihan Song , Bingqi Chen , Xiawu Zheng , Hui Li , Rongrong Ji

Recent advancements in large language models (LLMs) have brought significant changes to various domains, especially through LLM-driven autonomous agents. A representative scenario is in software development, where LLM agents demonstrate…

Computation and Language · Computer Science 2024-06-06 Chen Qian , Yufan Dang , Jiahao Li , Wei Liu , Zihao Xie , Yifei Wang , Weize Chen , Cheng Yang , Xin Cong , Xiaoyin Che , Zhiyuan Liu , Maosong Sun

Current evaluations of agents remain centered around one-shot task completion, failing to account for the inherently iterative and collaborative nature of many real-world problems, where human goals are often underspecified and evolve. We…

Autonomous agents powered by large language models (LLMs) have the potential to significantly enhance human productivity by reasoning, using tools, and executing complex tasks in diverse environments. However, current approaches to…

As more and more AI agents are used in practice, it is time to think about how to make these agents fully autonomous so that they can (1) learn by themselves continually in a self-motivated and self-initiated manner rather than being…

Artificial Intelligence · Computer Science 2023-04-21 Bing Liu , Sahisnu Mazumder , Eric Robertson , Scott Grigsby

As more and more AI agents are used in practice, it is time to think about how to make these agents fully autonomous so that they can learn by themselves in a self-motivated and self-supervised manner rather than being retrained…

Artificial Intelligence · Computer Science 2024-03-01 Bing Liu , Eric Robertson , Scott Grigsby , Sahisnu Mazumder

Recent advances in large language models (LLMs) have enabled the development of autonomous agents capable of complex reasoning and multi-step problem solving. However, these agents struggle to adapt to specialized environments and do not…

Machine Learning · Computer Science 2026-04-02 Marc-Antoine Allard , Arnaud Teinturier , Victor Xing , Gautier Viaud

LLM-based autonomous agents have demonstrated strong capabilities in reasoning, planning, and tool use, yet remain limited when tasks require sustained coordination across roles, tools, and environments. Multi-agent systems address this…

Despite the rapid progress of multimodal large language models in building Graphical User Interface (GUI) agents, their real-world task completion is fundamentally bottlenecked by a lack of world knowledge about GUI operations. Existing…

Computation and Language · Computer Science 2026-05-28 Zheng Wu , Chengcheng Han , Zhengxi Lu , Tianjie Ju , Yanyu Chen , Qi Gu , Xunliang Cai , Zhuosheng Zhang

User eXperience (UX) is becoming increasingly important for success of software products. Yet, many companies still face various challenges in their work with UX. Part of these challenges relate to inadequate knowledge and awareness of UX…

Software Engineering · Computer Science 2016-06-30 Pariya Kashfi , Robert Feldt , Agneta Nilsson , Richard Berntsson Svensson

Large Language Model (LLM) agents are increasingly improved through interaction, yet most self-evolution methods adapt either the policy or the learning environment in isolation. We identify this structural gap as \emph{Agent-Environment…

Computation and Language · Computer Science 2026-05-26 Yihao Hu , Zhihao Wen , Xiujin Liu , Pan Wang , Xin Zhang , Wei Wu

Recent advancements in GUI agents have significantly expanded their ability to interpret natural language commands to manage software interfaces. However, acquiring GUI data remains a significant challenge. Existing methods often involve…

Artificial Intelligence · Computer Science 2025-11-11 Xiangwu Guo , Difei Gao , Mike Zheng Shou

Simulated user agents are increasingly used in usability testing to support fast, iterative UX workflows, as they generate rich data such as action logs and think-aloud reasoning, but the unstructured nature of this output often obscures…

Human-Computer Interaction · Computer Science 2026-01-23 Steffen Holter , Eunyee Koh , Mustafa Doga Dogan , Gromit Yeuk-Yin Chan

Comprehensive evaluation of mobile agents can significantly advance their development and real-world applicability. However, existing benchmarks lack practicality and scalability due to the extensive manual effort in defining task reward…

Artificial Intelligence · Computer Science 2025-09-25 Jiahui Sun , Zhichao Hua , Yubin Xia

The exponential rise in mobile device usage necessitates streamlined automation for effective task management, yet many AI frameworks fall short due to inadequate operational expertise. While manually written knowledge can bridge this gap,…

Artificial Intelligence · Computer Science 2025-06-04 Junyang Wang , Haiyang Xu , Xi Zhang , Ming Yan , Ji Zhang , Fei Huang , Jitao Sang

The exponential rise in mobile device usage necessitates streamlined automation for effective task management, yet many AI frameworks fall short due to inadequate operational expertise. While manually written knowledge can bridge this gap,…

Computation and Language · Computer Science 2025-06-04 Junyang Wang , Haiyang Xu , Xi Zhang , Ming Yan , Ji Zhang , Fei Huang , Jitao Sang

In this work, we propose MetaAgent, an agentic paradigm inspired by the principle of learning-by-doing, where expertise is developed through hands-on practice and continual self-improvement. MetaAgent starts with a minimal workflow,…

Artificial Intelligence · Computer Science 2025-09-03 Hongjin Qian , Zheng Liu
‹ Prev 1 3 4 5 6 7 10 Next ›