English
Related papers

Related papers: CUA-Skill: Develop Skills for Computer Using Agent

200 papers

Computational notebooks became indispensable tools for research-related development, offering unprecedented interactivity and flexibility in the development process. However, these benefits come at the cost of reproducibility and an…

Machine Learning · Computer Science 2024-10-21 Konstantin Grotov , Artem Borzilov , Maksim Krivobok , Timofey Bryksin , Yaroslav Zharov

In the midst of the growing integration of Artificial Intelligence (AI) into various aspects of our lives, agents are experiencing a resurgence. These autonomous programs that act on behalf of humans are neither new nor exclusive to the…

Artificial Intelligence · Computer Science 2024-12-24 Chirag Shah , Ryen W. White

This survey paper examines the recent advancements in AI agent implementations, with a focus on their ability to achieve complex goals that require enhanced reasoning, planning, and tool execution capabilities. The primary objectives of…

Artificial Intelligence · Computer Science 2024-04-18 Tula Masterman , Sandi Besen , Mason Sawtell , Alex Chao

The visual analytics community has long aimed to understand users better and assist them in their analytic endeavors. As a result, numerous conceptual models of visual analytics aim to formalize common workflows, techniques, and goals…

Human-Computer Interaction · Computer Science 2023-04-20 Shayan Monadjemi , Mengtian Guo , David Gotz , Roman Garnett , Alvitta Ottley

As more and more AI agents are used in practice, it is time to think about how to make these agents fully autonomous so that they can (1) learn by themselves continually in a self-motivated and self-initiated manner rather than being…

Artificial Intelligence · Computer Science 2023-04-21 Bing Liu , Sahisnu Mazumder , Eric Robertson , Scott Grigsby

Advanced agentic intelligence is a prerequisite for deploying Large Language Models in practical, real-world applications. Diverse real-world APIs demand precise, robust function-calling intelligence, which needs agents to develop these…

With the recent rapid advancement of Agentic Intelligence, agentic tool use in LLMs has become increasingly important. During multi-turn interactions between agents and users, the dynamic, uncertain, and stochastic nature of user demands…

Artificial Intelligence · Computer Science 2025-08-27 Weikang Zhao , Xili Wang , Chengdi Ma , Lingbin Kong , Zhaohua Yang , Mingxiang Tuo , Xiaowei Shi , Yitao Zhai , Xunliang Cai

While Large Language Models demonstrate remarkable proficiency in high-level semantic planning, they remain limited in handling fine-grained, low-level web component manipulations. To address this limitation, extensive research has focused…

Artificial Intelligence · Computer Science 2026-01-22 Zhi Qiu , Jiazheng Sun , Chenxiao Xia , Jun Zheng , Xin Peng

Although computer-use agents (CUAs) hold significant potential to automate increasingly complex OS workflows, they can demonstrate unsafe unintended behaviors that deviate from expected outcomes even under benign input contexts. However,…

Computation and Language · Computer Science 2026-02-10 Jaylen Jones , Zhehao Zhang , Yuting Ning , Eric Fosler-Lussier , Pierre-Luc St-Charles , Yoshua Bengio , Dawn Song , Yu Su , Huan Sun

While much work on web agents emphasizes the promise of autonomously performing tasks on behalf of users, in reality, agents often fall short on complex tasks in real-world contexts and modeling user preference. This presents an opportunity…

Artificial Intelligence · Computer Science 2026-03-02 Faria Huq , Zora Zhiruo Wang , Frank F. Xu , Tianyue Ou , Shuyan Zhou , Jeffrey P. Bigham , Graham Neubig

(M)LLM-powered computer use agents (CUA) are emerging as a transformative technique to automate human-computer interaction. However, existing CUA benchmarks predominantly target GUI agents, whose evaluation methods are susceptible to UI…

We introduce SCUBA, a benchmark designed to evaluate computer-use agents on customer relationship management (CRM) workflows within the Salesforce platform. SCUBA contains 300 task instances derived from real user interviews, spanning three…

Artificial Intelligence · Computer Science 2025-10-01 Yutong Dai , Krithika Ramakrishnan , Jing Gu , Matthew Fernandez , Yanqi Luo , Viraj Prabhu , Zhenyu Hu , Silvio Savarese , Caiming Xiong , Zeyuan Chen , Ran Xu

This paper explores the intersection of quantum computing and agentic AI by examining how quantum technologies can enhance the capabilities of autonomous agents, and, conversely, how agentic AI can support the advancement of quantum…

Brain-Computer Interfaces (BCIs) offer a direct communication pathway between the human brain and external devices, holding significant promise for individuals with severe neurological impairments. However, their widespread adoption is…

Artificial Intelligence · Computer Science 2025-10-28 Yankai Chen , Xinni Zhang , Yifei Zhang , Yangning Li , Henry Peng Zou , Chunyu Miao , Weizhi Zhang , Xue Liu , Philip S. Yu

Agentic AI represents a significant shift in how intelligence is applied within organizations, moving beyond AI-assisted tools toward autonomous systems capable of reasoning, decision-making, and coordinated action across workflows. As…

Many challenges remain before AI agents can be deployed in real-world environments. However, one virtue of such environments is that they are inherently multi-agent and contain human experts. Using advanced social intelligence in such an…

Machine Learning · Computer Science 2025-08-22 Eric Ye , Ren Tao , Natasha Jaques

Agentic code assistants are a new generation of AI systems capable of performing end-to-end software engineering tasks. While these systems promise unprecedented productivity gains, their behavior and effectiveness depend heavily on…

Software Engineering · Computer Science 2026-05-26 Helio Victor F. Santos , Vitor Costa , Joao Eduardo Montandon , Marco Tulio Valente

The development of autonomous agents for graphical user interfaces (GUIs) presents major challenges in artificial intelligence. While recent advances in native agent models have shown promise by unifying perception, reasoning, action, and…

Artificial Intelligence · Computer Science 2025-09-08 Haoming Wang , Haoyang Zou , Huatong Song , Jiazhan Feng , Junjie Fang , Junting Lu , Longxiang Liu , Qinyu Luo , Shihao Liang , Shijue Huang , Wanjun Zhong , Yining Ye , Yujia Qin , Yuwen Xiong , Yuxin Song , Zhiyong Wu , Aoyan Li , Bo Li , Chen Dun , Chong Liu , Daoguang Zan , Fuxing Leng , Hanbin Wang , Hao Yu , Haobin Chen , Hongyi Guo , Jing Su , Jingjia Huang , Kai Shen , Kaiyu Shi , Lin Yan , Peiyao Zhao , Pengfei Liu , Qinghao Ye , Renjie Zheng , Shulin Xin , Wayne Xin Zhao , Wen Heng , Wenhao Huang , Wenqian Wang , Xiaobo Qin , Yi Lin , Youbin Wu , Zehui Chen , Zihao Wang , Baoquan Zhong , Xinchun Zhang , Xujing Li , Yuanfan Li , Zhongkai Zhao , Chengquan Jiang , Faming Wu , Haotian Zhou , Jinlin Pang , Li Han , Qi Liu , Qianli Ma , Siyao Liu , Songhua Cai , Wenqi Fu , Xin Liu , Yaohui Wang , Zhi Zhang , Bo Zhou , Guoliang Li , Jiajun Shi , Jiale Yang , Jie Tang , Li Li , Qihua Han , Taoran Lu , Woyu Lin , Xiaokang Tong , Xinyao Li , Yichi Zhang , Yu Miao , Zhengxuan Jiang , Zili Li , Ziyuan Zhao , Chenxin Li , Dehua Ma , Feng Lin , Ge Zhang , Haihua Yang , Hangyu Guo , Hongda Zhu , Jiaheng Liu , Junda Du , Kai Cai , Kuanye Li , Lichen Yuan , Meilan Han , Minchao Wang , Shuyue Guo , Tianhao Cheng , Xiaobo Ma , Xiaojun Xiao , Xiaolong Huang , Xinjie Chen , Yidi Du , Yilin Chen , Yiwen Wang , Zhaojian Li , Zhenzhu Yang , Zhiyuan Zeng , Chaolin Jin , Chen Li , Hao Chen , Haoli Chen , Jian Chen , Qinghao Zhao , Guang Shi

The emergence of agentic Artificial Intelligence (AI), which can operate autonomously, demonstrate goal-directed behavior, and adaptively learn, indicates the onset of a massive change in today's computing infrastructure. This study…

Emerging Technologies · Computer Science 2025-09-23 Nauman Ali Murad , Safia Baloch

This paper is an opinion paper that looks at the future of computing in the age of Generative \& Agentic AI. Current software systems are static and inflexible, leading to significant challenges in translating human goals into computational…

Software Engineering · Computer Science 2024-08-06 Jules White