English
Related papers

Related papers: Agent S: An Open Agentic Framework that Uses Compu…

200 papers

Human-like Agents with diverse and dynamic personalities could serve as an essential design probe in the process of user-centered design, thereby enabling designers to enhance the user experience of interactive applications. In this…

Human-Computer Interaction · Computer Science 2024-06-18 Jiale Li , Jiayang Li , Jiahao Chen , Yifan Li , Shijie Wang , Hugo Zhou , Minjun Ye , Yunsheng Su

Agentic AI networking (AgentNet) is a novel AI-native networking paradigm that relies on a large number of specialized AI agents to collaborate and coordinate for autonomous decision-making, dynamic environmental adaptation, and complex…

Artificial Intelligence · Computer Science 2025-05-27 Yong Xiao , Haoran Zhou , Xubo Li , Yayu Gao , Guangming Shi , Ping Zhang

AI Agents powered by Large Language Models are transforming the world through enormous applications. A super agent has the potential to fulfill diverse user needs, such as summarization, coding, and research, by accurately understanding…

Artificial Intelligence · Computer Science 2025-07-28 Yuhang Yao , Haixin Wang , Yibo Chen , Jiawen Wang , Min Chang Jordan Ren , Bosheng Ding , Salman Avestimehr , Chaoyang He

GUI agents hold significant potential to enhance the experience and efficiency of human-device interaction. However, current methods face challenges in generalizing across applications (apps) and tasks, primarily due to two fundamental…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Yuchen Sun , Shanhui Zhao , Tao Yu , Hao Wen , Samith Va , Mengwei Xu , Yuanchun Li , Chongyang Zhang

Automating GUI tasks remains challenging due to reliance on textual representations, platform-specific action spaces, and limited reasoning capabilities. We introduce Aguvis, a unified vision-based framework for autonomous GUI agents that…

Computation and Language · Computer Science 2025-05-06 Yiheng Xu , Zekun Wang , Junli Wang , Dunjie Lu , Tianbao Xie , Amrita Saha , Doyen Sahoo , Tao Yu , Caiming Xiong

AI agents plan and execute interactions in open-ended environments. For example, OpenAI's Operator can use a web browser to do product comparisons and buy online goods. Much research on making agents useful and safe focuses on directly…

Artificial Intelligence · Computer Science 2025-06-23 Alan Chan , Kevin Wei , Sihao Huang , Nitarshan Rajkumar , Elija Perrier , Seth Lazar , Gillian K. Hadfield , Markus Anderljung

Adapting production-level computer vision tools to bespoke scientific datasets is a critical "last mile" bottleneck. Current solutions are impractical: fine-tuning requires large annotated datasets scientists often lack, while manual code…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Xuefei , Wang , Kai A. Horstmann , Ethan Lin , Jonathan Chen , Alexander R. Farhang , Sophia Stiles , Atharva Sehgal , Jonathan Light , David Van Valen , Yisong Yue , Jennifer J. Sun

Computational notebooks became indispensable tools for research-related development, offering unprecedented interactivity and flexibility in the development process. However, these benefits come at the cost of reproducibility and an…

Machine Learning · Computer Science 2024-10-21 Konstantin Grotov , Artem Borzilov , Maksim Krivobok , Timofey Bryksin , Yaroslav Zharov

Telecommunication networks are increasingly expected to operate autonomously while supporting heterogeneous services with diverse and often conflicting intents -- that is, performance objectives, constraints, and requirements specific to…

Machine Learning · Computer Science 2026-02-03 Burak Demirel , Pablo Soldati , Yu Wang

With recent advances in Large Language Models (LLMs), Agentic AI has become phenomenal in real-world applications, moving toward multiple LLM-based agents to perceive, learn, reason, and act collaboratively. These LLM-based Multi-Agent…

Artificial Intelligence · Computer Science 2025-01-14 Khanh-Tung Tran , Dung Dao , Minh-Duong Nguyen , Quoc-Viet Pham , Barry O'Sullivan , Hoang D. Nguyen

GUIs have long been central to human-computer interaction, providing an intuitive and visually-driven way to access and interact with digital systems. The advent of LLMs, particularly multimodal models, has ushered in a new era of GUI…

Artificial Intelligence · Computer Science 2025-05-07 Chaoyun Zhang , Shilin He , Jiaxu Qian , Bowen Li , Liqun Li , Si Qin , Yu Kang , Minghua Ma , Guyue Liu , Qingwei Lin , Saravan Rajmohan , Dongmei Zhang , Qi Zhang

Recent advances in large language models have sparked growing interest in AI agents capable of solving complex, real-world tasks. However, most existing agent systems rely on manually crafted configurations that remain static after…

Artificial Intelligence · Computer Science 2025-09-03 Jinyuan Fang , Yanwen Peng , Xi Zhang , Yingxu Wang , Xinhao Yi , Guibin Zhang , Yi Xu , Bin Wu , Siwei Liu , Zihao Li , Zhaochun Ren , Nikos Aletras , Xi Wang , Han Zhou , Zaiqiao Meng

In the age of large language models (LLMs), autonomous agents have emerged as a powerful paradigm for achieving general intelligence. These agents dynamically leverage tools, memory, and reasoning capabilities to accomplish user-defined…

Artificial Intelligence · Computer Science 2025-08-05 Chaojia Yu , Zihan Cheng , Hanwen Cui , Yishuo Gao , Zexu Luo , Yijin Wang , Hangbin Zheng , Yong Zhao

Recent advances in agentic AI have led to systems capable of autonomous task execution and language-based reasoning, yet their spatial reasoning abilities remain limited and underexplored, largely constrained to symbolic and sequential…

Artificial Intelligence · Computer Science 2025-09-12 Bui Duc Manh , Soumyaratna Debnath , Zetong Zhang , Shriram Damodaran , Arvind Kumar , Yueyi Zhang , Lu Mi , Erik Cambria , Lin Wang

The field of Artificial Intelligence is undergoing a transition from Generative AI -- probabilistic generation of text and images -- to Agentic AI, in which autonomous systems execute actions within external environments on behalf of users.…

Artificial Intelligence · Computer Science 2026-03-02 Sheng Cao , Zhao Chang , Chang Li , Hannan Li , Liyao Fu , Ji Tang

As interfaces evolve from static user pathways to dynamic human-AI collaboration, no standard methods exist for selecting appropriate interface patterns based on user needs and task complexity. Existing frameworks only provide guiding…

Human-Computer Interaction · Computer Science 2026-02-27 Shruthi Andru , Shrut Kirti Saksena

Real-world data collection for embodied agents remains costly and unsafe, calling for scalable, realistic, and simulator-ready 3D environments. However, existing scene-generation systems often rely on rule-based or task-specific pipelines,…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Hongchi Xia , Xuan Li , Zhaoshuo Li , Qianli Ma , Jiashu Xu , Ming-Yu Liu , Yin Cui , Tsung-Yi Lin , Wei-Chiu Ma , Shenlong Wang , Shuran Song , Fangyin Wei

Tool use has turned large language models (LLMs) into powerful agents that can perform complex multi-step tasks by dynamically utilising external software components. However, these tools must be implemented in advance by human developers,…

Computation and Language · Computer Science 2025-06-02 Georg Wölflein , Dyke Ferber , Daniel Truhn , Ognjen Arandjelović , Jakob Nikolas Kather

To succeed in common digital tasks such as web navigation, agents must carry out a variety of specialized tasks such as searching for products or planning a travel route. To tackle these tasks, agents can bootstrap themselves by learning…

Computation and Language · Computer Science 2025-09-01 Zora Zhiruo Wang , Apurva Gandhi , Graham Neubig , Daniel Fried

The rise of large language model (LLM)-powered agents is transforming services computing, moving it beyond static, request-driven functions toward dynamic, goal-oriented, and socially embedded multi-agent ecosystems. We propose Agentic…