English
Related papers

Related papers: AgentMove: A Large Language Model based Agentic Fr…

200 papers

There is a burgeoning discussion around the capabilities of Large Language Models (LLMs) in acting as fundamental components that can be seamlessly incorporated into Artificial Intelligence of Things (AIoT) to interpret complex…

Computation and Language · Computer Science 2024-03-12 Huanqi Yang , Sijie Ji , Rucheng Wu , Weitao Xu

We introduce DriveAgent, a novel multi-agent autonomous driving framework that leverages large language model (LLM) reasoning combined with multimodal sensor fusion to enhance situational understanding and decision-making. DriveAgent…

Robotics · Computer Science 2025-05-06 Xinmeng Hou , Wuqi Wang , Long Yang , Hao Lin , Jinglun Feng , Haigen Min , Xiangmo Zhao

Recent work has investigated the capabilities of large language models (LLMs) as zero-shot models for generating individual-level characteristics (e.g., to serve as risk models or augment survey datasets). However, when should a user have…

This paper presents an innovative large language model (LLM) agent framework for enhancing diagnostic accuracy in simulated clinical environments using the AgentClinic benchmark. The proposed automatic correction enables doctor agents to…

Artificial Intelligence · Computer Science 2024-10-15 Abhishek Dutta , Yen-Che Hsiao

The ability to understand and reason the 3D real world is a crucial milestone towards artificial general intelligence. The current common practice is to finetune Large Language Models (LLMs) with 3D data and texts to enable 3D…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Sha Zhang , Di Huang , Jiajun Deng , Shixiang Tang , Wanli Ouyang , Tong He , Yanyong Zhang

Recent advances in large vision-language models (VLMs) have demonstrated generalizable open-vocabulary perception and reasoning, yet their real-robot manipulation capability remains unclear for long-horizon, closed-loop execution in…

Large Language Model (LLM) agents are increasingly deployed to automate complex workflows in mobile and desktop environments. However, current model-centric agent architectures struggle to self-evolve post-deployment: improving…

Artificial Intelligence · Computer Science 2025-12-19 Zibin Liu , Cheng Zhang , Xi Zhao , Yunfei Feng , Bingyu Bai , Dahu Feng , Erhu Feng , Yubin Xia , Haibo Chen

Large language models (LLMs) have fueled many intelligent web agents, but most existing ones perform far from satisfying in real-world web navigation tasks due to three factors: (1) the complexity of HTML text data (2) versatility of…

Computation and Language · Computer Science 2024-10-15 Hanyu Lai , Xiao Liu , Iat Long Iong , Shuntian Yao , Yuxuan Chen , Pengbo Shen , Hao Yu , Hanchen Zhang , Xiaohan Zhang , Yuxiao Dong , Jie Tang

Large Audio-Language Models (LALMs) perform well on audio understanding tasks but lack multistep reasoning and tool-calling found in recent Large Language Models (LLMs). This paper presents AudioToolAgent, a framework that coordinates…

Sound · Computer Science 2026-02-16 Gijs Wijngaard , Elia Formisano , Michel Dumontier , Jenia Jitsev

The rapid evolution of Large Language Models (LLM) and subsequent Agentic AI technologies requires systematic architectural guidance for building sophisticated, production-grade systems. This paper presents an approach for architecting such…

Artificial Intelligence · Computer Science 2026-05-26 Zoran Milosevic , Fethi Rabhi

Agentic artificial intelligence (AI) -- multi-agent systems that combine large language models with external tools and autonomous planning -- are rapidly transitioning from research laboratories into high-stakes domains. Our earlier "Basic"…

Artificial Intelligence · Computer Science 2025-09-16 Manish Shukla

Multi-agent systems driven by large language models (LLMs) have shown promising abilities for solving complex tasks in a collaborative manner. This work considers a fundamental problem in multi-agent collaboration: consensus seeking. When…

Computation and Language · Computer Science 2025-01-22 Huaben Chen , Wenkang Ji , Lufeng Xu , Shiyu Zhao

The rapid advancement of large language models (LLMs) has led to the rise of LLM-based agents. Recent research shows that multi-agent systems (MAS), where each agent plays a specific role, can outperform individual LLMs. However,…

Computation and Language · Computer Science 2024-08-28 Chi-Min Chan , Jianxuan Yu , Weize Chen , Chunyang Jiang , Xinyu Liu , Weijie Shi , Zhiyuan Liu , Wei Xue , Yike Guo

The task of long-term action anticipation demands solutions that can effectively model temporal dynamics over extended periods while deeply understanding the inherent semantics of actions. Traditional approaches, which primarily rely on…

Computer Vision and Pattern Recognition · Computer Science 2025-01-03 Binglu Wang , Yao Tian , Shunzhou Wang , Le Yang

Automated machine learning (AutoML) accelerates AI development by automating tasks in the development pipeline, such as optimal model search and hyperparameter tuning. Existing AutoML systems often require technical expertise to set up…

Machine Learning · Computer Science 2025-06-09 Patara Trirat , Wonyong Jeong , Sung Ju Hwang

Large language models (LLMs) have demonstrated remarkable capabilities across diverse tasks, but optimizing LLM-based agentic systems remains challenging due to the vast search space of agent configurations, prompting strategies, and…

Machine Learning · Computer Science 2026-03-02 Patara Trirat , Wonyong Jeong , Sung Ju Hwang

Despite rapid development, large language models (LLMs) still encounter challenges in multi-turn decision-making tasks (i.e., agent tasks) like web shopping and browser navigation, which require making a sequence of intelligent decisions…

Computation and Language · Computer Science 2025-11-12 Zhiheng Xi , Chenyang Liao , Guanyu Li , Yajie Yang , Wenxiang Chen , Zhihao Zhang , Binghai Wang , Senjie Jin , Yuhao Zhou , Jian Guan , Wei Wu , Tao Ji , Tao Gui , Qi Zhang , Xuanjing Huang

Enabling humanoid robots to perform autonomously loco-manipulation in unstructured environments is crucial and highly challenging for achieving embodied intelligence. This involves robots being able to plan their actions and behaviors in…

Robotics · Computer Science 2024-08-16 Jin Wang , Arturo Laurenzi , Nikos Tsagarakis

Leveraging multiple Large Language Models(LLMs) has proven effective for addressing complex, high-dimensional tasks, but current approaches often rely on static, manually engineered multi-agent configurations. To overcome these constraints,…

Machine Learning · Computer Science 2025-07-21 Xiaowen Ma , Chenyang Lin , Yao Zhang , Volker Tresp , Yunpu Ma

Recent advances in large language models (LLMs) have empowered AI agents capable of performing various sequential decision-making tasks. However, effectively guiding LLMs to perform well in unfamiliar domains like web navigation, where they…

Computation and Language · Computer Science 2024-12-04 Yao Fu , Dong-Ki Kim , Jaekyeom Kim , Sungryull Sohn , Lajanugen Logeswaran , Kyunghoon Bae , Honglak Lee