English
Related papers

Related papers: COLA: A Scalable Multi-Agent Framework For Windows…

200 papers

Large language models (LLMs) have enabled remarkable advances in automated task-solving with multi-agent systems. However, most existing LLM-based multi-agent approaches rely on predefined agents to handle simple tasks, limiting the…

Artificial Intelligence · Computer Science 2024-05-01 Guangyao Chen , Siwei Dong , Yu Shu , Ge Zhang , Jaward Sesay , Börje F. Karlsson , Jie Fu , Yemin Shi

While Large Vision-Language Models (LVLMs) have significantly advanced GUI agents' capabilities in parsing textual instructions, interpreting screen content, and executing tasks, a critical challenge persists: the irreversibility of agent…

Artificial Intelligence · Computer Science 2026-01-27 Shaokang Wang , Pei Fu , Ruoceng Zhang , Shaojie Zhang , Xiuwen Xi , Jiahui Yang , Bin Qin , Ying Huang , Zhenbo Luo , Jian Luan

Multimodal Large Language Models (MLLMs) have significantly advanced GUI agents, yet long-horizon automation remains constrained by two critical bottlenecks: context overload from raw sequential trajectory dependence and architectural…

Artificial Intelligence · Computer Science 2026-04-15 Weihua Cheng , Junming Liu , Yifei Sun , Botian Shi , Yirong Chen , Ding Wang

Graphical User Interface (GUI) agents, driven by Multi-modal Large Language Models (MLLMs), have emerged as a promising paradigm for enabling intelligent interaction with digital systems. This paper provides a structured survey of recent…

Artificial Intelligence · Computer Science 2025-05-14 Jiahao Li , Kaer Huang

Large language models (LLMs) have recently emerged as promising tools for solving challenging robotic tasks, even in the presence of action and observation uncertainties. Recent LLM-based decision-making methods (also referred to as…

Artificial Intelligence · Computer Science 2024-09-20 Abhinav Jain , Chris Jermaine , Vaibhav Unhelkar

Recent advances in Large Language Models (LLMs) have significantly improved table understanding tasks such as Table Question Answering (TableQA), yet challenges remain in ensuring reliability, scalability, and efficiency, especially in…

Computation and Language · Computer Science 2026-04-22 Sieun Hyeon , Jusang Oh , Sunghwan Steve Cho , Jaeyoung Do

Graphical User Interface (GUI) agents powered by Multimodal Large Language Models (MLLMs) promise human-like interaction with software applications, yet long-horizon tasks remain challenging due to memory limitations. Existing approaches…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Zikang Liu , Junyi Li , Wayne Xin Zhao , Dawei Gao , Yaliang Li , Ji-rong Wen

Language model (LM)-based agents have demonstrated promising capabilities in automating complex tasks from natural language instructions, yet they continue to struggle with long-horizon planning and reasoning. To address this, we propose an…

Artificial Intelligence · Computer Science 2026-05-05 Wenyi Wu , Sibo Zhu , Kun Zhou , Biwei Huang

Recent advances in large language models (LLMs) have substantially accelerated the development of embodied agents. LLM-based multi-agent systems mitigate the inefficiency of single agents in complex tasks. However, they still suffer from…

Emerging Technologies · Computer Science 2026-02-02 XiaoJie Zhang , JianHan Wu , Xiaoyang Qu , Jianzong Wang

The integration of Large Language Models (LLMs) into robotics has unlocked unprecedented capabilities in high-level task planning. However, most current systems operate in an open-loop fashion, where LLMs act as one-shot planners, rendering…

Robotics · Computer Science 2025-12-30 Anjali R. Menon , Rohit K. Sharma , Priya Singh , Chengyu Wang , Aurora M. Ferreira , Mateja Novak

As AI agents take on increasingly long-running tasks involving sophisticated planning and execution, there is a corresponding need for novel interaction designs that enable deeper human-agent collaboration. However, most prior works…

Human-Computer Interaction · Computer Science 2026-02-19 K. J. Kevin Feng , Kevin Pu , Matt Latzke , Tal August , Pao Siangliulue , Jonathan Bragg , Daniel S. Weld , Amy X. Zhang , Joseph Chee Chang

The integration of Artificial Intelligence (AI) with High-Performance Computing (HPC) is transforming scientific workflows from human-directed pipelines into adaptive systems capable of autonomous decision-making. Large language models…

Large language models (LLMs) are increasingly being applied to programming tasks, ranging from single-turn code completion to autonomous agents. Current code agent designs frequently depend on complex, hand-crafted workflows and tool sets.…

Artificial Intelligence · Computer Science 2025-10-01 Hankun Dai , Maoquan Wang , Mengnan Qi , Yikai Zhang , Zijian Jin , Yongqiang Yao , Yufan Huang , Shengyu Fu , Elsie Nallipogu

Graphical User Interface (GUI) Agents have emerged as a transformative paradigm in human-computer interaction, evolving from rule-based automation scripts to sophisticated AI-driven systems capable of understanding and executing complex…

Human-Computer Interaction · Computer Science 2025-06-05 Fei Tang , Haolei Xu , Hang Zhang , Siqi Chen , Xingyu Wu , Yongliang Shen , Wenqi Zhang , Guiyang Hou , Zeqi Tan , Yuchen Yan , Kaitao Song , Jian Shao , Weiming Lu , Jun Xiao , Yueting Zhuang

Digital agents require diverse, large-scale UI trajectories to generalize across real-world tasks, yet collecting such data is prohibitively expensive in both human annotation, infra and engineering perspectives. To this end, we introduce…

Computation and Language · Computer Science 2025-10-17 Yiming Wang , Da Yin , Yuedong Cui , Ruichen Zheng , Zhiqian Li , Zongyu Lin , Di Wu , Xueqing Wu , Chenchen Ye , Yu Zhou , Kai-Wei Chang

Complex table question answering (TQA) aims to answer questions that require complex reasoning, such as multi-step or multi-category reasoning, over data represented in tabular form. Previous approaches demonstrated notable performance by…

Computation and Language · Computer Science 2025-02-11 Wei Zhou , Mohsen Mesgar , Annemarie Friedrich , Heike Adel

Language agents powered by large language models (LLMs) have demonstrated remarkable capabilities in understanding, reasoning, and executing complex tasks. However, developing robust agents presents significant challenges: substantial…

Computation and Language · Computer Science 2025-06-02 Qianqian Zhang , Jiajia Liao , Heting Ying , Yibo Ma , Haozhan Shen , Jingcheng Li , Peng Liu , Lu Zhang , Chunxin Fang , Kyusong Lee , Ruochen Xu , Tiancheng Zhao

Computer-use agents operate over long horizons under noisy perception, multi-window contexts, evolving environment states. Existing approaches, from RL-based planners to trajectory retrieval, often drift from user intent and repeatedly…

Artificial Intelligence · Computer Science 2026-03-02 Seoyoung Lee , Seobin Yoon , Seongbeen Lee , Yoojung Chun , Dayoung Park , Doyeon Kim , Joo Yong Sim

Autonomous agents powered by large language models (LLMs) perform complex tasks through long-horizon reasoning and tool interaction, where a fundamental trade-off arises between execution efficiency and reasoning robustness. Models at…

Computation and Language · Computer Science 2026-03-30 Wenbo Gao , Renxi Liu , Xian Wang , Fang Guo , Shuai Yang , Xi Chen , Hui-Ling Zhen , Hanting Chen , Weizhe Lin , Xiaosong Li , Yaoyuan Wang

Evaluating large language models (LLM) in clinical scenarios is crucial to assessing their potential clinical utility. Existing benchmarks rely heavily on static question-answering, which does not accurately depict the complex, sequential…

Human-Computer Interaction · Computer Science 2025-05-27 Samuel Schmidgall , Rojin Ziaei , Carl Harris , Eduardo Reis , Jeffrey Jopling , Michael Moor