English
Related papers

Related papers: MASEval: Extending Multi-Agent Evaluation from Mod…

200 papers

Commonly, AI or machine learning (ML) models are evaluated on benchmark datasets. This practice supports innovative methodological research, but benchmark performance can be poorly correlated with performance in real-world applications -- a…

Machine Learning · Computer Science 2024-06-18 Olivier Binette , Jerome P. Reiter

Systematic literature reviews and meta-analyses are essential for synthesizing research insights, but they remain time-intensive and labor-intensive due to the iterative processes of screening, evaluation, and data extraction. This paper…

Computation and Language · Computer Science 2025-10-09 Pouria Rouzrokh , Bardia Khosravi , Parsa Rouzrokh , Moein Shariatnia

In recent years, instruction fine-tuning (IFT) on large language models (LLMs) has garnered considerable attention to enhance model performance on unseen tasks. Attempts have been made on automatic construction and effective selection for…

Computation and Language · Computer Science 2024-10-25 Renhao Li , Minghuan Tan , Derek F. Wong , Min Yang

Large Language Models (LLMs) have demonstrated remarkable capabilities in various reasoning and generation tasks. However, their proficiency in complex causal reasoning, discovery, and estimation remains an area of active development, often…

Artificial Intelligence · Computer Science 2025-09-03 Adib Bazgir , Amir Habibdoust , Yuwen Zhang , Xing Song

With the rapid advancement of artificial intelligence, multi-agent systems (MASs) are evolving from classical paradigms toward architectures built upon large foundation models (LFMs). This survey provides a systematic review and comparative…

Artificial Intelligence · Computer Science 2026-04-21 Zixiang Wang , Mengjia Gong , Qiyu Sun , Jing Xu , Shuai Mao , Xin Jin , Qing-Long Han , Yang Tang

Autonomous agents driven by Large Language Models (LLMs) offer enormous potential for automation. Early proof of this technology can be found in various demonstrations of agents solving complex tasks, interacting with external systems to…

Therapy recommendation for chronic patients with multimorbidity is challenging due to risks of treatment conflicts. Existing decision support systems face scalability limitations. Inspired by the way in which general practitioners (GP)…

Artificial Intelligence · Computer Science 2025-07-16 Yicong Wu , Ting Chen , Irit Hochberg , Zhoujian Sun , Ruth Edry , Zhengxing Huang , Mor Peleg

Advancements in Large Language Models (LLMs) are revolutionizing the development of autonomous agentic systems by enabling dynamic, context-aware task decomposition and automated tool selection. These sophisticated systems possess…

Artificial Intelligence · Computer Science 2024-10-31 Adrian Garret Gabriel , Alaa Alameer Ahmad , Shankar Kumar Jeyakumar

Agentic AI has significantly extended the capabilities of large language models (LLMs) by enabling complex reasoning and tool use. However, most existing frameworks are tailored to domains such as mathematics, coding, or web automation, and…

Artificial Intelligence · Computer Science 2025-10-15 Md Hasebul Hasan , Mahir Labib Dihan , Tanzima Hashem , Mohammed Eunus Ali , Md Rizwan Parvez

While Multi-Agent Systems (MAS) are increasingly deployed for complex workflows, their emergent properties-particularly the accumulation of bias-remain poorly understood. Because real-world MAS are too complex to analyze entirely,…

Multiagent Systems · Computer Science 2026-04-14 Keyu Li , Jin Gao , Dequan Wang

While multi-agent systems (MAS) have demonstrated superior performance over single-agent approaches in complex reasoning tasks, they often suffer from significant computational inefficiencies. Existing frameworks typically deploy large…

Artificial Intelligence · Computer Science 2026-01-27 Jingbo Wang , Sendong Zhao , Jiatong Liu , Haochun Wang , Wanting Li , Bing Qin , Ting Liu

Several Multi-Agent System (MAS) metamodels and languages have been proposed in the literature to support the development of agent-based applications. MAS metamodels are used to capture a collection of concepts the relevant entities and…

Multiagent Systems · Computer Science 2021-11-29 Marx Viana , Paulo Alencar , Carlos Lucena

Agents, language model-based systems capable of reasoning, planning, and acting are widely adopted in real-world tasks, yet how their performance changes as these systems scale across key dimensions remains underexplored. We introduce…

Agentic recommendations cast recommenders as large language model (LLM) agents that can plan, reason, use tools, and interact with users of varying preferences in web applications. However, most existing agentic recommender systems focus on…

Computation and Language · Computer Science 2026-01-27 Yu Xia , Sungchul Kim , Tong Yu , Ryan A. Rossi , Julian McAuley

The rapid integration of Large Language Models (LLMs) into high-stakes domains necessitates reliable safety and compliance evaluation. However, existing static benchmarks are ill-equipped to address the dynamic nature of AI risks and…

Artificial Intelligence · Computer Science 2026-05-15 Yixu Wang , Xin Wang , Yang Yao , Xinyuan Li , Xibang Yang , Yan Teng , Xingjun Ma , Yingchun Wang

Self-evolving multi-agent systems (MAS) have emerged as a promising route to LLM agents that continually improve from experience, with persistent memory at their foundation. However, existing designs almost exclusively adopt a centralized…

Multiagent Systems · Computer Science 2026-05-22 Guangya Hao , Yunbo Long , Zhuokai Zhao

Large Language Model (LLM)-based agents are widely used in real-world applications such as customer service, web navigation, and software engineering. As these systems become more autonomous and are deployed at scale, understanding why an…

Artificial Intelligence · Computer Science 2026-02-06 Chen Qian , Peng Wang , Dongrui Liu , Junyao Yang , Dadi Guo , Ling Tang , Jilin Mei , Qihan Ren , Shuai Shao , Yong Liu , Jie Fu , Jing Shao , Xia Hu

Large language models (LLMs) show remarkable potential to act as computer agents, enhancing human productivity and software accessibility in multi-modal tasks that require planning and reasoning. However, measuring agent performance in…

In this paper, we introduce InfiAgent-DABench, the first benchmark specifically designed to evaluate LLM-based agents on data analysis tasks. These tasks require agents to end-to-end solving complex tasks by interacting with an execution…

Computation and Language · Computer Science 2024-03-12 Xueyu Hu , Ziyu Zhao , Shuang Wei , Ziwei Chai , Qianli Ma , Guoyin Wang , Xuwu Wang , Jing Su , Jingjing Xu , Ming Zhu , Yao Cheng , Jianbo Yuan , Jiwei Li , Kun Kuang , Yang Yang , Hongxia Yang , Fei Wu

Lifelong learning is essential for intelligent agents operating in dynamic environments. Current large language model (LLM)-based agents, however, remain stateless and unable to accumulate or transfer knowledge over time. Existing…

Artificial Intelligence · Computer Science 2025-06-02 Junhao Zheng , Xidi Cai , Qiuke Li , Duzhen Zhang , ZhongZhi Li , Yingying Zhang , Le Song , Qianli Ma