English
Related papers

Related papers: AutoRPA: Efficient GUI Automation through LLM-Driv…

200 papers

Applying reinforcement learning (RL) to real-world tasks requires converting informal descriptions into a formal Markov decision process (MDP), implementing an executable environment, and training a policy agent. Automating this process is…

Artificial Intelligence · Computer Science 2025-12-15 Hong Je-Gal , Chan-Bin Yi , Hyun-Suk Lee

This paper presents a novel approach for unified retrieval-augmented generation (RAG) systems using the recent emerging large language model (LLM) agent concept. Specifically, Agent LLM, which utilizes LLM as fundamental controllers, has…

Computation and Language · Computer Science 2025-06-02 Hoang Pham , Thuy-Duong Nguyen , Khac-Hoai Nam Bui

The advent of large language models (LLMs) has significantly propelled the advancement of Role-Playing Agents (RPAs). However, current Role-Playing Agents predominantly focus on mimicking a character's fundamental attributes while…

Computation and Language · Computer Science 2024-11-06 Siyuan Chen , Qingyi Si , Chenxu Yang , Yunzhi Liang , Zheng Lin , Huan Liu , Weiping Wang

The integration of Large Language Models (LLMs) into autonomous driving systems demonstrates strong common sense and reasoning abilities, effectively addressing the pitfalls of purely data-driven methods. Current LLM-based agents require…

Robotics · Computer Science 2024-10-22 Sihao Wu , Jiaxu Liu , Xiangyu Yin , Guangliang Cheng , Xingyu Zhao , Meng Fang , Xinping Yi , Xiaowei Huang

For effective human-robot interaction, robots need to understand, plan, and execute complex, long-horizon tasks described by natural language. Recent advances in large language models (LLMs) have shown promise for translating natural…

Robotics · Computer Science 2024-03-25 Yongchao Chen , Jacob Arkin , Charles Dawson , Yang Zhang , Nicholas Roy , Chuchu Fan

AI agents, empowered by Large Language Models (LLMs) and communication protocols such as MCP and A2A, have rapidly evolved from simple chatbots to autonomous entities capable of executing complex, multi-step tasks, demonstrating great…

Machine Learning · Computer Science 2025-05-26 Erhu Feng , Wenbo Zhou , Zibin Liu , Le Chen , Yunpeng Dong , Cheng Zhang , Yisheng Zhao , Dong Du , Zhichao Hua , Yubin Xia , Haibo Chen

Graphical User Interface (GUI) agents, driven by Multi-modal Large Language Models (MLLMs), have emerged as a promising paradigm for enabling intelligent interaction with digital systems. This paper provides a structured survey of recent…

Artificial Intelligence · Computer Science 2025-05-14 Jiahao Li , Kaer Huang

AI tasks encompass a wide range of domains and fields. While numerous AI models have been designed for specific tasks and applications, they often require considerable human efforts in finding the right model architecture, optimization…

Computation and Language · Computer Science 2023-05-05 Shujian Zhang , Chengyue Gong , Lemeng Wu , Xingchao Liu , Mingyuan Zhou

We introduce Meta-Reasoning Prompting (MRP), a novel and efficient system prompting method for large language models (LLMs) inspired by human meta-reasoning. Traditional in-context learning-based reasoning techniques, such as…

Computation and Language · Computer Science 2024-06-18 Peizhong Gao , Ao Xie , Shaoguang Mao , Wenshan Wu , Yan Xia , Haipeng Mi , Furu Wei

The recent success of Large Language Models (LLMs) signifies an impressive stride towards artificial general intelligence. They have shown a promising prospect in automatically completing tasks upon user instructions, functioning as…

Artificial Intelligence · Computer Science 2023-12-05 Zhizheng Zhang , Xiaoyi Zhang , Wenxuan Xie , Yan Lu

Traditional Reinforcement Learning (RL) suffers from replicating human-like behaviors, generalizing effectively in multi-agent scenarios, and overcoming inherent interpretability issues.These tasks are compounded when deep environment…

Computer Vision and Pattern Recognition · Computer Science 2025-07-09 Miao Zhang , Zhenlong Fang , Tianyi Wang , Qian Zhang , Shuai Lu , Junfeng Jiao , Tianyu Shi

Ensuring reliable data-driven decisions is crucial in domains where analytical accuracy directly impacts safety, compliance, or operational outcomes. Decision support in such domains relies on large tabular datasets, where manual analysis…

Software Engineering · Computer Science 2026-03-11 Arsham Gholamzadeh Khoee , Shuai Wang , Robert Feldt , Dhasarathy Parthasarathy , Yinan Yu

Large Language Model (LLM)-based agents are increasingly employed to automate complex software engineering tasks, such as program repair and issue resolution. These agents operate by autonomously generating natural language thoughts,…

Software Engineering · Computer Science 2025-10-09 Islem Bouzenia , Michael Pradel

Retrieval-Augmented Generation (RAG) enables large language models (LLMs) to access external knowledge sources, but the effectiveness of RAG relies on the coordination between the retriever and the generator. Since these components are…

Computation and Language · Computer Science 2025-09-24 Junlin Wang , Zehao Wu , Shaowei Lu , Yanlan Li , Xinghao Huang

Large language models (LLMs) have recently emerged as promising tools for solving challenging robotic tasks, even in the presence of action and observation uncertainties. Recent LLM-based decision-making methods (also referred to as…

Artificial Intelligence · Computer Science 2024-09-20 Abhinav Jain , Chris Jermaine , Vaibhav Unhelkar

Robotic process automation (RPA) has emerged as the leading approach to automate tasks in business processes. Moving away from back-end automation, RPA automated the mouse-click on user interfaces; this outside-in approach reduced the…

Artificial Intelligence · Computer Science 2020-07-28 Yara Rizk , Vatche Isahagian , Scott Boag , Yasaman Khazaeni , Merve Unuvar , Vinod Muthusamy , Rania Khalaf

Since the advent of Large Language Models (LLMs), various research based on such models have maintained significant academic attention and impact, especially in AI and robotics. In this paper, we propose a multi-agent framework with LLMs to…

Robotics · Computer Science 2025-05-12 Junhong Chen , Ziqi Yang , Haoyuan G Xu , Dandan Zhang , George Mylonas

Automated optimization modeling (AOM) has evoked considerable interest with the rapid evolution of large language models (LLMs). Existing approaches predominantly rely on prompt engineering, utilizing meticulously designed expert response…

Artificial Intelligence · Computer Science 2025-01-31 Tianpeng Pan , Wenqiang Pu , Licheng Zhao , Rui Zhou

Graphical User Interface (GUI) agents possess significant commercial and social value, and GUI agents powered by advanced multimodal large language models (MLLMs) have demonstrated remarkable potential. Currently, existing GUI agents…

Artificial Intelligence · Computer Science 2025-09-05 Weizhi Chen , Ziwei Wang , Leyang Yang , Sheng Zhou , Xiaoxuan Tang , Jiajun Bu , Yong Li , Wei Jiang

AI agents powered by Large Language Models (LLMs) have made significant advances, enabling them to assist humans in diverse complex tasks and leading to a revolution in human-AI coordination. LLM-powered agents typically require invoking…

Artificial Intelligence · Computer Science 2024-01-10 Jijia Liu , Chao Yu , Jiaxuan Gao , Yuqing Xie , Qingmin Liao , Yi Wu , Yu Wang