English
Related papers

Related papers: TreeCUA: Efficiently Scaling GUI Automation with T…

200 papers

Monte Carlo Tree Search (MCTS) algorithms have achieved great success on many challenging benchmarks (e.g., Computer Go). However, they generally require a large number of rollouts, making their applications costly. Furthermore, it is also…

Machine Learning · Computer Science 2020-02-27 Anji Liu , Jianshu Chen , Mingze Yu , Yu Zhai , Xuewen Zhou , Ji Liu

GUI automation faces critical challenges in dynamic environments. MLLMs suffer from two key issues: misinterpreting UI components and outdated knowledge. Traditional fine-tuning methods are costly for app-specific knowledge updates. We…

Artificial Intelligence · Computer Science 2025-05-23 Bin Xie , Rui Shao , Gongwei Chen , Kaiwen Zhou , Yinchuan Li , Jie Liu , Min Zhang , Liqiang Nie

Many real-world applications collect data in a streaming environment, where learning tasks are encountered sequentially. This necessitates continual learning (CL) to update models online, enabling adaptation to new tasks while preserving…

Machine Learning · Computer Science 2025-06-13 Yu-Yang Qian , Yuan-Ze Xu , Zhen-Yu Zhang , Peng Zhao , Zhi-Hua Zhou

The dynamic trees problem is to maintain a tree under edge updates while supporting queries like connectivity queries or path queries. Despite the first data structure for this fundamental problem -- the link-cut tree -- being invented 40…

Data Structures and Algorithms · Computer Science 2026-01-16 Quinten De Man , Atharva Sharma , Kishen N Gowda , Laxman Dhulipala

Graphical user interface (GUI) agents autonomously complete tasks across platforms (\eg, Linux) by sequentially decomposing user instructions into action proposals that iteratively interact with visual elements in the evolving environment.…

One of the most important challenges of Smart City Applications is to adapt the system to interact with non-expert users. Robot imitation frameworks aim to simplify and reduce times of robot programming by allowing users to program directly…

Robotics · Computer Science 2024-02-02 Raul Fernandez-Fernandez , Juan G. Victores , David Estevez , Carlos Balaguer

Agents for computer use (ACUs) are an emerging class of systems capable of executing complex tasks on digital devices -- such as desktops, mobile phones, and web platforms -- given instructions in natural language. These agents can automate…

Real-world software engineering tasks require coding agents that can operate on massive repositories, sustain long-horizon sessions, and reliably coordinate complex toolchains at test time. Existing research-grade coding agents offer…

Computation and Language · Computer Science 2026-02-04 Sherman Wong , Zhenting Qi , Zhaodong Wang , Nathan Hu , Samuel Lin , Jun Ge , Erwin Gao , Wenlin Chen , Yilun Du , Minlan Yu , Ying Zhang

Tackling simulation optimization problems with non-convex objective functions remains a fundamental challenge in operations research. In this paper, we propose a class of random search algorithms, called Regular Tree Search, which…

Optimization and Control · Mathematics 2025-06-24 Du-Yi Wang , Guo Liang , Guangwu Liu , Kun Zhang

Recently program learning techniques have been proposed to process source code based on syntactical structures (e.g., Abstract Syntax Trees) and/or semantic information (e.g., Dependency Graphs). Although graphs may be better at capturing…

Software Engineering · Computer Science 2020-12-15 Nghi D. Q. Bui , Yijun Yu , Lingxiao Jiang

The focus of this paper is the analysis of real-time systems with recursion, through the development of good theoretical techniques which are implementable. Time is modeled using clock variables, and recursion using stacks. Our technique…

Formal Languages and Automata Theory · Computer Science 2017-07-11 S. Akshay , Paul Gastin , Shankara Narayanan Krishna , Ilias Sarkar

Evaluating GUI agents presents a distinct challenge: trajectories are long, visually grounded, and open-ended, yet evaluation must be both accurate and interpretable. Existing approaches typically apply a single holistic judgment over the…

Artificial Intelligence · Computer Science 2026-04-07 Yuwen Zhai , Runze Li , Liang Wang , Nian Shi , Liwu Xu , Wei Zhang , Ran Lin , Bo Xu , Benlei Cui

While current Computer Use Agent (CUA) benchmarks measure task completion effectively, they provide limited assessment of enterprise deployment readiness, emphasizing functional correctness over the operational reliability required for…

Software Engineering · Computer Science 2025-11-24 Horia Cristescu , Charles Park , Trong Canh Nguyen , Sergiu Talmacel , Alexandru-Gabriel Ilie , Stefan Adam

With the rise of mobile-first consumption, users increasingly engage with data visualizations on mobile devices. However, the vast majority of existing visualizations are originally authored for desktop environments. Due to significant…

Human-Computer Interaction · Computer Science 2026-04-28 Can Liu , Sizhe Cheng , Feng Liang , Zhibang Jiang , Lingru Huang , Kavinda Athapaththu , Yong Wang

Autonomous navigation is reshaping various domains in people's life by enabling efficient and safe movement in complex environments. Reliable navigation requires algorithmic approaches that compute optimal or near-optimal trajectories while…

Robotics · Computer Science 2025-03-05 Yifei Wang , Jacky Keung , Haohan Xu , Yuchen Cao , Zhenyu Mao

Verification planning is a sequential decision-making problem that specifies a set of verification activities (VA) and correction activities (CA) at different phases of system development. While VAs are used to identify errors and defects,…

Software Engineering · Computer Science 2022-04-05 Peng Xu , Xinwei Deng , Alejandro Salado

Scaling laws for inference compute in multi-agent systems remain under-explored compared to single-agent scenarios. This work aims to bridge this gap by investigating the problem of data synthesis through multi-agent sampling, where…

Computation and Language · Computer Science 2025-05-20 Hai Ye , Mingbao Lin , Hwee Tou Ng , Shuicheng Yan

In this paper, we propose a method that extends the persistence-based topological data analysis (TDA) that is typically used for characterizing shapes to general networks. We introduce the concept of the community tree, a tree structure…

Social and Information Networks · Computer Science 2022-04-08 Wei Guo , Ruqian Chen , Yen-Chi Chen , Ashis G. Banerjee

Graphical User Interface (GUI) agents are designed to automate complex tasks on digital devices, such as smartphones and desktops. Most existing GUI agents interact with the environment through extracted structured data, which can be…

Human-Computer Interaction · Computer Science 2024-02-26 Kanzhi Cheng , Qiushi Sun , Yougang Chu , Fangzhi Xu , Yantao Li , Jianbing Zhang , Zhiyong Wu

Computer-Using Agents (CUAs) aim to autonomously operate computer systems to complete real-world tasks. However, existing agentic systems remain difficult to scale and lag behind human performance. A key limitation is the absence of…