English
Related papers

Related papers: Meta-Thinking in LLMs via Multi-Agent Reinforcemen…

200 papers

Recent research on Reasoning of Large Language Models (LLMs) has sought to further enhance their performance by integrating meta-thinking -- enabling models to monitor, evaluate, and control their reasoning processes for more adaptive and…

Artificial Intelligence · Computer Science 2025-05-28 Ziyu Wan , Yunxiang Li , Xiaoyu Wen , Yan Song , Hanjing Wang , Linyi Yang , Mark Schmidt , Jun Wang , Weinan Zhang , Shuyue Hu , Ying Wen

In recent years, Large Language Models (LLMs) have shown great abilities in various tasks, including question answering, arithmetic problem solving, and poem writing, among others. Although research on LLM-as-an-agent has shown that LLM can…

Multiagent Systems · Computer Science 2024-05-21 Chuanneng Sun , Songjun Huang , Dario Pompili

While Large Language Models (LLMs) enable complex autonomous behavior, current agents remain constrained by static, human-designed prompts that limit adaptability. Existing self-improving frameworks attempt to bridge this gap but typically…

Artificial Intelligence · Computer Science 2026-01-21 Xinmeng Hou , Peiliang Gong , Bohao Qu , Wuqi Wang , Qing Guo , Yang Liu

Reinforcement Learning (RL) has traditionally focused on training specialized agents to optimize predefined reward functions within narrowly defined environments. However, the advent of powerful Large Language Models (LLMs) and increasingly…

Artificial Intelligence · Computer Science 2026-05-18 Fangming Cui , Ruixiao Zhu , Cheng Fang , Sunan Li , Jiahong Li

Multi-agent systems (MAS) have shown great potential in executing complex tasks, but coordination and safety remain significant challenges. Multi-Agent Reinforcement Learning (MARL) offers a promising framework for agent collaboration, but…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Ziqi Jia , Junjie Li , Xiaoyang Qu , Jianzong Wang

Large Language Models (LLMs) have shown remarkable reasoning capabilities in mathematical and scientific tasks. To enhance complex reasoning, multi-agent systems have been proposed to harness the collective intelligence of LLM agents.…

Artificial Intelligence · Computer Science 2025-10-22 Zhenyu Bi , Meng Lu , Yang Li , Swastik Roy , Weijie Guan , Morteza Ziyadi , Xuan Wang

While large language models (LLMs) have shown great potential across various domains, their applications in robotics remain largely limited to static prompt-based behaviors and still face challenges in complex tasks under zero-shot or…

Modern Large Language Models (LLMs) exhibit impressive zero-shot and few-shot generalization capabilities across complex natural language tasks, enabling their widespread use as virtual assistants for diverse applications such as…

Computation and Language · Computer Science 2025-06-19 Arjun Vaithilingam Sudhakar

The popularity of Large Language Models (LLMs) have unleashed a new age ofLanguage Agents for solving a diverse range of tasks. While contemporary frontier LLMs are capable enough to power reasonably good Language agents, the closed-API…

Computation and Language · Computer Science 2024-10-11 Priyanshu Gupta , Shashank Kirtania , Ananya Singha , Sumit Gulwani , Arjun Radhakrishna , Sherry Shi , Gustavo Soares

The ability to reason is one of the most fundamental capabilities of large language models (LLMs), enabling a wide range of downstream tasks through sophisticated problem-solving. A critical aspect of this is code reasoning, which involves…

Computation and Language · Computer Science 2025-05-26 Yusheng Zhao , Xiao Luo , Weizhi Zhang , Wei Ju , Zhiping Xiao , Philip S. Yu , Ming Zhang

Remarkable performance of large language models (LLMs) in a variety of tasks brings forth many opportunities as well as challenges of utilizing them in production settings. Towards practical adoption of LLMs, multi-agent systems hold great…

Computation and Language · Computer Science 2024-02-05 Pouya Pezeshkpour , Eser Kandogan , Nikita Bhutani , Sajjadur Rahman , Tom Mitchell , Estevam Hruschka

Multi-agent reinforcement learning (MARL) methods struggle with the non-stationarity of multi-agent systems and fail to adaptively learn online when tested with novel agents. Here, we leverage large language models (LLMs) to create an…

Artificial Intelligence · Computer Science 2024-12-13 Logan Cross , Violet Xiang , Agam Bhatia , Daniel LK Yamins , Nick Haber

Reinforcement Learning (RL) has emerged as a crucial method for training or fine-tuning large language models (LLMs), enabling adaptive, task-specific optimizations through interactive feedback. Multi-Agent Reinforcement Learning (MARL), in…

Machine Learning · Computer Science 2026-02-10 Junwei Su , Chuan Wu

Reinforcement learning (RL) has demonstrated potential in enhancing the reasoning capabilities of large language models (LLMs), but such training typically demands substantial efforts in creating and annotating data. In this work, we…

Computation and Language · Computer Science 2025-10-06 Hangfan Zhang , Siyuan Xu , Zhimeng Guo , Huaisheng Zhu , Shicheng Liu , Xinrun Wang , Qiaosheng Zhang , Yang Chen , Peng Ye , Lei Bai , Shuyue Hu

Large Language Models (LLMs) trained with reinforcement learning and verifiable rewards have achieved strong results on complex reasoning tasks. Recent work extends this paradigm to a multi-agent setting, where a meta-thinking agent…

Artificial Intelligence · Computer Science 2025-11-05 Zhiwei Zhang , Xiaomin Li , Yudi Lin , Hui Liu , Ramraj Chandradevan , Linlin Wu , Minhua Lin , Fali Wang , Xianfeng Tang , Qi He , Suhang Wang

Large language models (LLMs) have made significant advances in the field of natural language processing, but they still face challenges such as continuous decision-making, lack of long-term memory, and limited context windows in dynamic…

Computation and Language · Computer Science 2025-04-10 Xuechen Liang , Meiling Tao , Yinghui Xia , Jianhui Wang , Kun Li , Yijin Wang , Jingsong Yang , Tianyu Shi , Yuantao Wang , Miao Zhang , Xueqian Wang

Multi-agent large language models (MA-LLMs) are a rapidly growing research area that leverages multiple interacting language agents to tackle complex tasks, outperforming single-agent large language models. This literature review…

Multiagent Systems · Computer Science 2025-06-03 Arne Tillmann

Developing Large Language Models (LLMs) to cooperate and compete effectively within multi-agent systems (MASs) is a critical step towards more advanced intelligence. While reinforcement learning (RL) has proven effective for enhancing…

Artificial Intelligence · Computer Science 2026-02-13 Huining Yuan , Zelai Xu , Zheyue Tan , Xiangmin Yi , Mo Guang , Kaiwen Long , Haojia Hui , Boxun Li , Xinlei Chen , Bo Zhao , Xiao-Ping Zhang , Chao Yu , Yu Wang

Large Language Models (LLMs) often produce answers with a single chain-of-thought, which restricts their ability to explore reasoning paths or self-correct flawed outputs in complex tasks. In this paper, we introduce MALT (Multi-Agent LLM…

Large Language Models (LLMs) have shown remarkable capabilities in general natural language processing tasks but often fall short in complex reasoning tasks. Recent studies have explored human-like problem-solving strategies, such as…

Computation and Language · Computer Science 2023-12-19 Zhenran Xu , Senbao Shi , Baotian Hu , Jindi Yu , Dongfang Li , Min Zhang , Yuxiang Wu
‹ Prev 1 2 3 10 Next ›