English
Related papers

Related papers: Fara-7B: An Efficient Agentic Model for Computer U…

200 papers

Computer use agents (CUAs) can operate real-world digital interfaces but remain difficult to train due to the high cost of graphical user interface (GUI) interaction and the scarcity of high-quality trajectory data. Existing datasets rely…

Machine Learning · Computer Science 2026-02-06 Yifei He , Pranit Chawla , Yaser Souri , Subhojit Som , Xia Song

Computer-use agents (CUAs) automate on-screen work, as illustrated by GPT-5.4 and Claude. Yet their reliability on complex, low-frequency interactions is still poor, limiting user trust. Our analysis of failure cases from advanced models…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Miaosen Zhang , Xiaohan Zhao , Zhihong Tan , Zhou Huoshen , Yijia Fan , Yifan Yang , Kai Qiu , Bei Liu , Justin Wagle , Chenzhong Yin , Mingxi Cheng , Ji Li , Qi Dai , Chong Luo , Xu Yang , Xin Geng , Baining Guo

Vision-language models have demonstrated impressive capabilities as computer-use agents (CUAs) capable of automating diverse computer tasks. As their commercial potential grows, critical details of the most capable CUA systems remain…

Large-scale, high-quality interaction trajectories are essential for advancing mobile Graphical User Interface (GUI) agents. While existing methods typically rely on labor-intensive human demonstrations or automated model exploration to…

Artificial Intelligence · Computer Science 2026-02-02 Linjia Kang , Zhimin Wang , Yongkang Zhang , Duo Wu , Jinghe Wang , Ming Ma , Haopeng Yan , Zhi Wang

Computer-use agents face a fundamental limitation. They rely exclusively on primitive GUI actions (click, type, scroll), creating brittle execution chains prone to cascading failures. While API-driven agents harness rich capabilities…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Yuhao Yang , Zhen Yang , Zi-Yi Dou , Anh Nguyen , Keen You , Omar Attia , Andrew Szot , Michael Feng , Ram Ramrakhya , Alexander Toshev , Chao Huang , Yinfei Yang , Zhe Gan

Computer-use agents provide a promising path toward general software automation because they can interact directly with arbitrary graphical user interfaces instead of relying on brittle, application-specific integrations. Despite recent…

Artificial Intelligence · Computer Science 2026-05-01 Jinbiao Wei , Kangqi Ni , Yilun Zhao , Guo Gan , Arman Cohan

Training GUI agents with traditional centralized methods faces significant cost and scalability challenges. Federated learning (FL) offers a promising solution, yet its potential is hindered by the lack of benchmarks that capture…

Multiagent Systems · Computer Science 2026-04-17 Wenhao Wang , Haoting Shi , Mengying Yuan , Yiquan Lin , Panrong Tong , Hanzhang Zhou , Guangyi Liu , Pengxiang Zhao , Yue Wang , Siheng Chen

With the advancement of web techniques, they have significantly revolutionized various aspects of people's lives. Despite the importance of the web, many tasks performed on it are repetitive and time-consuming, negatively impacting overall…

Artificial Intelligence · Computer Science 2025-08-06 Liangbo Ning , Ziran Liang , Zhuohang Jiang , Haohao Qu , Yujuan Ding , Wenqi Fan , Xiao-yong Wei , Shanru Lin , Hui Liu , Philip S. Yu , Qing Li

Agents for computer use (ACUs) are an emerging class of systems capable of executing complex tasks on digital devices -- such as desktops, mobile phones, and web platforms -- given instructions in natural language. These agents can automate…

We introduce GUI-360$^\circ$, a large-scale, comprehensive dataset and benchmark suite designed to advance computer-using agents (CUAs). CUAs present unique challenges and is constrained by three persistent gaps: a scarcity of real-world…

The evolution of Large Language Models (LLMs) from static instruction-followers to autonomous agents necessitates operating within complex, stateful environments to achieve precise state-transition objectives. However, this paradigm is…

Artificial Intelligence · Computer Science 2026-03-03 Yucheng Zeng , Weipeng Lu , Linyun Liu , Shupeng Li , Zitian Qu , Chenghao Zhu , Shaofei Li , Zhengdong Tan , Mengyue Liu , Haotian Zhao , Zhe Zhou , Jianmin Wu

Despite rapid recent progress in the terminal capabilities of large language models, the training data strategies behind state-of-the-art terminal agents remain largely undisclosed. We address this gap through a systematic study of data…

Computation and Language · Computer Science 2026-02-25 Renjie Pi , Grace Lam , Mohammad Shoeybi , Pooya Jannaty , Bryan Catanzaro , Wei Ping

Language model agents (LMA) recently emerged as a promising paradigm on muti-step decision making tasks, often outperforming humans and other reinforcement learning agents. Despite the promise, their performance on real-world applications…

Machine Learning · Computer Science 2025-01-03 Hiroki Furuta , Yutaka Matsuo , Aleksandra Faust , Izzeddin Gur

Coworking AI agents operating within local file systems are rapidly emerging as a paradigm in human-AI interaction; however, effective personalization remains limited by severe data constraints, as strict privacy barriers and the difficulty…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Shuai Liu , Shulin Tian , Kairui Hu , Yuhao Dong , Zhe Yang , Bo Li , Jingkang Yang , Chen Change Loy , Ziwei Liu

The advancement of LLM agents with tool-use capabilities requires diverse and complex training corpora. Existing data generation methods, which predominantly follow a paradigm of random sampling and shallow generation, often yield simple…

Fuzzy Cognitive Maps (FCMs) are computational models that represent how factors (nodes) change over discrete interactions based on causal impacts (weighted directed edges) from other factors. This approach has traditionally been used as an…

Artificial Intelligence · Computer Science 2022-11-15 Maciej K Wozniak , Samvel Mkhitaryan , Philippe j. Giabbanelli

Retrieval Augmented Generation (RAG) has become prevalent in question-answering (QA) tasks due to its ability of utilizing search engine to enhance the quality of long-form question-answering (LFQA). Despite the emergence of various open…

Computation and Language · Computer Science 2024-07-02 Tianchi Cai , Zhiwen Tan , Xierui Song , Tao Sun , Jiyan Jiang , Yunqi Xu , Yinger Zhang , Jinjie Gu

Large language models (LLMs) show promising performance on small-scale graph reasoning tasks but fail when handling real-world graphs with complex queries. This phenomenon arises from LLMs' working memory constraints, which result in their…

Artificial Intelligence · Computer Science 2025-10-01 Rongzheng Wang , Shuang Liang , Qizhi Chen , Yihong Huang , Muquan Li , Yizhuo Ma , Dongyang Zhang , Ke Qin , Man-Fai Leung

Synthetic healthcare data generation offers a promising solution to research limitations in clinical settings caused by privacy and regulatory constraints. However, current synthetic data generation approaches require specialized knowledge…

Machine Learning · Computer Science 2026-02-19 Nitish Nagesh , Salar Shakibhamedan , Mahdi Bagheri , Ziyu Wang , Nima TaheriNejad , Axel Jantsch , Amir M. Rahmani

GUI agents that interact with graphical interfaces on behalf of users represent a promising direction for practical AI assistants. However, training such agents is hindered by the scarcity of suitable environments. We present InfiniteWeb, a…

Computation and Language · Computer Science 2026-01-09 Ziyun Zhang , Zezhou Wang , Xiaoyi Zhang , Zongyu Guo , Jiahao Li , Bin Li , Yan Lu
‹ Prev 1 2 3 10 Next ›