English
Related papers

Related papers: Qualixar OS: A Universal Operating System for AI A…

200 papers

The evolution of Multimodal Large Language Models (MLLMs) has shifted the focus from text generation to active behavioral execution, particularly via OS agents navigating complex GUIs. However, the transition of these agents into…

Computation and Language · Computer Science 2026-04-28 Zheng Wu , Yi Hua , Zhaoyuan Huang , Chenhao Xue , Yijie Lu , Pengzhou Cheng , Zongru Wu , Lingzhong Dong , Gongshen Liu , Xinghao Jiang , Zhuosheng Zhang

With the rapid advancement of Vision-Language Models (VLMs), GUI-based mobile agents have emerged as a key development direction for intelligent mobile systems. However, existing agent models continue to face significant challenges in…

Multiagent Systems · Computer Science 2025-09-03 Cheng Zhang , Erhu Feng , Xi Zhao , Yisheng Zhao , Wangbo Gong , Jiahui Sun , Dong Du , Zhichao Hua , Yubin Xia , Haibo Chen

Real-world visualization tasks involve complex, multi-modal requirements that extend beyond simple text-to-chart generation, requiring reference images, code examples, and iterative refinement. Current systems exhibit fundamental…

Computation and Language · Computer Science 2026-01-27 Jinwei Lu , Yuanfeng Song , Chen Zhang , Raymond Chi-Wing Wong

Artificial Intelligence (AI) has transformed robotics, healthcare, industry, and scientific discovery, yet a major frontier may lie beyond Earth. Space exploration and settlement offer vast environments and resources, but impose constraints…

Multiagent Systems · Computer Science 2026-02-17 Ziyang Wang

Large Language Models (LLMs) face a crucial challenge from fixed context windows and inadequate memory management, leading to a severe shortage of long-term memory capabilities and limited personalization in the interactive experience with…

Artificial Intelligence · Computer Science 2025-06-10 Jiazheng Kang , Mingming Ji , Zhe Zhao , Ting Bai

We present an agentic AI framework for autonomous multimodal query processing that coordinates specialized tools across text, image, audio, video, and document modalities. A central Supervisor dynamically decomposes user queries, delegates…

Computation and Language · Computer Science 2026-03-16 Mayank Saini , Arit Kumar Bishwas

In this paper, we introduce OSUniverse: a benchmark of complex, multimodal desktop-oriented tasks for advanced GUI-navigation AI agents that focuses on ease of use, extensibility, comprehensive coverage of test cases, and automated…

Artificial Intelligence · Computer Science 2025-05-07 Mariya Davydova , Daniel Jeffries , Patrick Barker , Arturo Márquez Flores , Sinéad Ryan

Single-agent systems (SAS) have become the default pattern for LLM-driven scientific workflows, but routing planning, tool use, and synthesis through a single context window comes with a well-known cost: as tool specifications and…

Artificial Intelligence · Computer Science 2026-05-05 Jinpai Zhao , Albert Cerrone , Joannes Westerink , Clint Dawson

While multi-agent systems (MAS) have demonstrated superior performance over single-agent approaches in complex reasoning tasks, they often suffer from significant computational inefficiencies. Existing frameworks typically deploy large…

Artificial Intelligence · Computer Science 2026-01-27 Jingbo Wang , Sendong Zhao , Jiatong Liu , Haochun Wang , Wanting Li , Bing Qin , Ting Liu

Much previous AI research has focused on developing monolithic models to maximize their intelligence, with the primary goal of enhancing performance on specific tasks. In contrast, this work attempts to study using LLM-based agents to…

Computation and Language · Computer Science 2026-02-10 Xiangyuan Xue , Zeyu Lu , Di Huang , Zidong Wang , Wanli Ouyang , Lei Bai

LLM-based intelligent agents face significant deployment challenges, particularly related to resource management. Allowing unrestricted access to LLM or tool resources can lead to inefficient or even potentially harmful resource allocation…

Operating Systems · Computer Science 2025-08-13 Kai Mei , Xi Zhu , Wujiang Xu , Wenyue Hua , Mingyu Jin , Zelong Li , Shuyuan Xu , Ruosong Ye , Yingqiang Ge , Yongfeng Zhang

AI for IT Operations (AIOps) aims to automate complex operational tasks, such as fault localization and root cause analysis, to reduce human workload and minimize customer impact. While traditional DevOps tools and AIOps algorithms often…

Artificial Intelligence · Computer Science 2025-01-14 Yinfang Chen , Manish Shetty , Gagan Somashekar , Minghua Ma , Yogesh Simmhan , Jonathan Mace , Chetan Bansal , Rujia Wang , Saravan Rajmohan

Existing efforts in building GUI agents heavily rely on the availability of robust commercial Vision-Language Models (VLMs) such as GPT-4o and GeminiProVision. Practitioners are often reluctant to use open-source VLMs due to their…

Computation and Language · Computer Science 2024-10-31 Zhiyong Wu , Zhenyu Wu , Fangzhi Xu , Yian Wang , Qiushi Sun , Chengyou Jia , Kanzhi Cheng , Zichen Ding , Liheng Chen , Paul Pu Liang , Yu Qiao

Agent orchestration frameworks have proliferated, collectively exceeding 290,000 GitHub stars across LangGraph, CrewAI, Google ADK, OpenAI Agents SDK, Semantic Kernel, Strands, and LlamaIndex. All follow the same pattern: an external…

Artificial Intelligence · Computer Science 2026-05-22 Simon Dennis , Rivaan Patil , Kevin Shabahang , Hao Guo

This paper introduces GUI-Owl, a foundational GUI agent model that achieves state-of-the-art performance among open-source end-to-end models on ten GUI benchmarks across desktop and mobile environments, covering grounding, question…

Artificial Intelligence · Computer Science 2025-09-03 Jiabo Ye , Xi Zhang , Haiyang Xu , Haowei Liu , Junyang Wang , Zhaoqing Zhu , Ziwei Zheng , Feiyu Gao , Junjie Cao , Zhengxi Lu , Jitong Liao , Qi Zheng , Fei Huang , Jingren Zhou , Ming Yan

The integration of Artificial Intelligence (AI) with High-Performance Computing (HPC) is transforming scientific workflows from human-directed pipelines into adaptive systems capable of autonomous decision-making. Large language models…

Multi-agent systems (MAS) have emerged as a powerful paradigm for orchestrating large language models (LLMs) and specialized tools to collaboratively address complex tasks. However, existing MAS frameworks often require manual workflow…

Artificial Intelligence · Computer Science 2025-09-24 Yingxu Wang , Siwei Liu , Jinyuan Fang , Zaiqiao Meng

AI agents are increasingly deployed in multi-tenant cloud environments, where they execute diverse tool calls within sandboxed containers, each call with distinct resource demands and rapid fluctuations. We present a systematic…

Operating Systems · Computer Science 2026-02-24 Yusheng Zheng , Jiakun Fan , Quanzhi Fu , Yiwei Yang , Wei Zhang , Andi Quinn

We introduce OrchVis, a multi-agent orchestration framework that visualizes, verifies, and coordinates goal-driven collaboration among LLM-based agents. Through hierarchical goal alignment, task assignment, and conflict resolution, OrchVis…

Human-Computer Interaction · Computer Science 2025-10-30 Jieyu Zhou

AI agents are emerging as a dominant workload in a wide range of applications, promising to be the vehicle that delivers the promised benefits of AI to enterprises and consumers. Unlike conventional software or static inference, agentic…

Machine Learning · Computer Science 2025-07-29 Zain Asgar , Michelle Nguyen , Sachin Katti