English
Related papers

Related papers: GUI Agents with Foundation Models: A Comprehensive…

200 papers

A graph is a fundamental data model to represent various entities and their complex relationships in society and nature, such as social networks, transportation networks, and financial networks. Recently, large language models (LLMs) have…

Computation and Language · Computer Science 2025-07-08 Wenbo Shang , Xin Huang

This article explores the dynamic influence of computational entities based on multi-agent systems theory (SMA) combined with large language models (LLM), which are characterized by their ability to simulate complex human interactions, as a…

Artificial Intelligence · Computer Science 2024-03-18 Carlos Jose Xavier Cruz

In the rapidly evolving landscape of large language models (LLMs), most research has primarily viewed them as independent individuals, focusing on assessing their capabilities through standardized benchmarks and enhancing their general…

Human-Computer Interaction · Computer Science 2024-01-17 Jiayin Wang , Weizhi Ma , Peijie Sun , Min Zhang , Jian-Yun Nie

Despite recent advancements in Large Language Models (LLMs), complex Software Engineering (SE) tasks require more collaborative and specialized approaches. This concept paper systematically reviews the emerging paradigm of LLM-based…

Software Engineering · Computer Science 2026-01-21 Yongjian Tang , Thomas Runkler

Graphical User Interface (GUI) agents possess significant commercial and social value, and GUI agents powered by advanced multimodal large language models (MLLMs) have demonstrated remarkable potential. Currently, existing GUI agents…

Artificial Intelligence · Computer Science 2025-09-05 Weizhi Chen , Ziwei Wang , Leyang Yang , Sheng Zhou , Xiaoxuan Tang , Jiajun Bu , Yong Li , Wei Jiang

Large language models (LLMs) are catalyzing the development of autonomous AI research agents for scientific and engineering discovery. We present FM Agent, a novel and general-purpose multi-agent framework that leverages a synergistic…

Multi-agent large language models (MA-LLMs) are a rapidly growing research area that leverages multiple interacting language agents to tackle complex tasks, outperforming single-agent large language models. This literature review…

Multiagent Systems · Computer Science 2025-06-03 Arne Tillmann

Large Language Models (LLMs) have emerged as transformative tools for natural language understanding and user intent resolution, enabling tasks such as translation, summarization, and, increasingly, the orchestration of complex workflows.…

Software Engineering · Computer Science 2025-11-12 Justus Flerlage , Alexander Acker , Odej Kao

A wide range of real-world applications is characterized by their symbolic nature, necessitating a strong capability for symbolic reasoning. This paper investigates the potential application of Large Language Models (LLMs) as symbolic…

Computation and Language · Computer Science 2024-01-18 Meng Fang , Shilong Deng , Yudi Zhang , Zijing Shi , Ling Chen , Mykola Pechenizkiy , Jun Wang

Large Language Models (LLMs) have emerged as formidable instruments capable of comprehending and producing human-like text. This paper explores the potential of LLMs, to shape user perspectives and subsequently influence their decisions on…

Artificial Intelligence · Computer Science 2024-09-04 Ganesh Prasath Ramani , Shirish Karande , Santhosh V , Yash Bhatia

Large Language Models(LLMs)have become effective tools for natural language processing and have been used in many different fields. This essay offers a succinct summary of various LLM subcategories. The survey emphasizes recent developments…

Computation and Language · Computer Science 2023-07-21 Saurabh Pahune , Manoj Chandrasekharan

Computer-use agents (CUAs) powered by large language models (LLMs) have emerged as a promising approach to automating computer tasks, yet they struggle with the existing human-oriented OS interfaces - graphical user interfaces (GUIs). GUIs…

Operating Systems · Computer Science 2026-03-26 Yuan Wang , Mingyu Li , Haibo Chen

Large Language Models (LLMs) represent a class of deep learning models adept at understanding natural language and generating coherent responses to various prompts or queries. These models far exceed the complexity of conventional neural…

Machine Learning · Computer Science 2024-12-05 Minghao Shao , Abdul Basit , Ramesh Karri , Muhammad Shafique

Large Language Model (LLM) agents represent a promising shift in human-AI interaction, moving beyond passive prompt-response systems to autonomous agents capable of reasoning, planning, and goal-directed action. While LLM agents are…

Computation and Language · Computer Science 2026-02-06 Weiwen Liu , Jiarui Qin , Xu Huang , Xingshan Zeng , Yunjia Xi , Jianghao Lin , Chuhan Wu , Yasheng Wang , Lifeng Shang , Ruiming Tang , Defu Lian , Yong Yu , Weinan Zhang

Large Language Models (LLMs) have revolutionized various aspects of engineering and science. Their utility is often bottlenecked by the lack of interaction with the external digital environment. To overcome this limitation and achieve…

Software Engineering · Computer Science 2024-12-24 Ioannis Tzachristas

Scientific Large Language Models (Sci-LLMs) are transforming how knowledge is represented, integrated, and applied in scientific research, yet their progress is shaped by the complex nature of scientific data. This survey presents a…

Computation and Language · Computer Science 2025-10-21 Ming Hu , Chenglong Ma , Wei Li , Wanghan Xu , Jiamin Wu , Jucheng Hu , Tianbin Li , Guohang Zhuang , Jiaqi Liu , Yingzhou Lu , Ying Chen , Chaoyang Zhang , Cheng Tan , Jie Ying , Guocheng Wu , Shujian Gao , Pengcheng Chen , Jiashi Lin , Haitao Wu , Lulu Chen , Fengxiang Wang , Yuanyuan Zhang , Xiangyu Zhao , Feilong Tang , Encheng Su , Junzhi Ning , Xinyao Liu , Ye Du , Changkai Ji , Pengfei Jiang , Cheng Tang , Ziyan Huang , Jiyao Liu , Jiaqi Wei , Yuejin Yang , Xiang Zhang , Guangshuai Wang , Yue Yang , Huihui Xu , Ziyang Chen , Yizhou Wang , Chen Tang , Jianyu Wu , Yuchen Ren , Siyuan Yan , Zhonghua Wang , Zhongxing Xu , Shiyan Su , Shangquan Sun , Runkai Zhao , Zhisheng Zhang , Dingkang Yang , Jinjie Wei , Jiaqi Wang , Jiahao Xu , Jiangtao Yan , Wenhao Tang , Hongze Zhu , Yu Liu , Fudi Wang , Yiqing Shen , Yuanfeng Ji , Yanzhou Su , Tong Xie , Hongming Shan , Chun-Mei Feng , Zhi Hou , Diping Song , Lihao Liu , Yanyan Huang , Lequan Yu , Bin Fu , Shujun Wang , Xiaomeng Li , Xiaowei Hu , Yun Gu , Ben Fei , Benyou Wang , Yuewen Cao , Minjie Shen , Jie Xu , Haodong Duan , Fang Yan , Hongxia Hao , Jielan Li , Jiajun Du , Yanbo Wang , Imran Razzak , Zhongying Deng , Chi Zhang , Lijun Wu , Conghui He , Zhaohui Lu , Jinhai Huang , Wenqi Shao , Yihao Liu , Siqi Luo , Yi Xin , Xiaohong Liu , Fenghua Ling , Yuqiang Li , Aoran Wang , Siqi Sun , Qihao Zheng , Nanqing Dong , Tianfan Fu , Dongzhan Zhou , Yan Lu , Wenlong Zhang , Jin Ye , Jianfei Cai , Yirong Chen , Wanli Ouyang , Yu Qiao , Zongyuan Ge , Shixiang Tang , Junjun He , Chunfeng Song , Lei Bai , Bowen Zhou

Large Language Models (LLMs) have extended their impact beyond Natural Language Processing, substantially fostering the development of interdisciplinary research. Recently, various LLM-based agents have been developed to assist scientific…

The rapid development of Large Language Models (LLMs) demonstrates remarkable multilingual capabilities in natural language processing, attracting global attention in both academia and industry. To mitigate potential discrimination and…

Computation and Language · Computer Science 2025-01-08 Kaiyu Huang , Fengran Mo , Xinyu Zhang , Hongliang Li , You Li , Yuanchi Zhang , Weijian Yi , Yulong Mao , Jinchen Liu , Yuzhuang Xu , Jinan Xu , Jian-Yun Nie , Yang Liu

Graphical user interface (GUI) has become integral to modern society, making it crucial to be understood for human-centric systems. However, unlike natural images or documents, GUIs comprise artificially designed graphical elements arranged…

Computer Vision and Pattern Recognition · Computer Science 2025-03-19 Ziwei Wang , Weizhi Chen , Leyang Yang , Sheng Zhou , Shengchu Zhao , Hanbei Zhan , Jiongchao Jin , Liangcheng Li , Zirui Shao , Jiajun Bu