English
Related papers

Related papers: Internalizing Multi-Agent Reasoning for Accurate a…

200 papers

Recent years have witnessed the rapid development of Large Language Model-based Multi-Agent Systems (MAS), which excel at collaborative decision-making and complex problem-solving. However, malicious agents in MAS may inject misinformation…

Artificial Intelligence · Computer Science 2026-05-28 Yaoyang Luo , Zhi Zheng , Ziwei Zhao , Tong Xu , Zhao Jielun , Wenjun Xue , Yong Chen , Enhong Chen

LinkedIn, one of the world's largest platforms for professional networking and job seeking, encounters various modeling challenges in building recommendation systems for its job matching product, including cold-start, filter bubbles, and…

Large Language Models (LLMs) often produce answers with a single chain-of-thought, which restricts their ability to explore reasoning paths or self-correct flawed outputs in complex tasks. In this paper, we introduce MALT (Multi-Agent LLM…

Autonomous agents, which perceive environments and take actions to achieve goals, have become increasingly feasible with the advancements in large language models (LLMs). However, current powerful agents often depend on sophisticated prompt…

Computation and Language · Computer Science 2025-05-27 Yihan Chen , Benfeng Xu , Xiaorui Wang , Yongdong Zhang , Zhendong Mao

Reinforcement learning for Large Language Model agents is often hindered by sparse rewards in multi-step reasoning tasks. Existing approaches like Group Relative Policy Optimization treat sampled trajectories as independent chains,…

Artificial Intelligence · Computer Science 2026-04-16 Yu Li , Sizhe Tang , Tian Lan

Strategic planning is critical for multi-step reasoning, yet compact Large Language Models (LLMs) often lack the capacity to formulate global strategies, leading to error propagation in long-horizon tasks. Our analysis reveals that LLMs…

Computation and Language · Computer Science 2026-04-15 Haoyu Zheng , Yun Zhu , Yuqian Yuan , Bo Yuan , Wenqiao Zhang , Siliang Tang , Jun Xiao

Agents based on large language models (LLMs) for machine learning engineering (MLE) can automatically implement ML models via code generation. However, existing approaches to build such agents often rely heavily on inherent LLM knowledge…

Machine Learning · Computer Science 2025-08-29 Jaehyun Nam , Jinsung Yoon , Jiefeng Chen , Jinwoo Shin , Sercan Ö. Arık , Tomas Pfister

Adaptive Traffic Signal Control (ATSC) aims to optimize traffic flow and minimize delays by adjusting traffic lights in real time. Recent advances in Multi-agent Reinforcement Learning (MARL) have shown promise for ATSC, yet existing…

Robotics · Computer Science 2026-03-26 Yifeng Zhang , Peizhuo Li , Tingguang Zhou , Mingfeng Fan , Guillaume Sartoretti

Table reasoning with large language models (LLMs) plays a critical role in building intelligent systems capable of understanding and analyzing tabular data. Despite recent progress, existing methods still face key limitations: their…

Artificial Intelligence · Computer Science 2026-01-27 Huajian Zhang , Mingyue Cheng , Yucong Luo , Xiaoyu Tao

Large Language Models (LLMs) trained with reinforcement learning and verifiable rewards have achieved strong results on complex reasoning tasks. Recent work extends this paradigm to a multi-agent setting, where a meta-thinking agent…

Artificial Intelligence · Computer Science 2025-11-05 Zhiwei Zhang , Xiaomin Li , Yudi Lin , Hui Liu , Ramraj Chandradevan , Linlin Wu , Minhua Lin , Fali Wang , Xianfeng Tang , Qi He , Suhang Wang

Large language models (LLMs) often struggle with mathematical problems that require exact computation or multi-step algebraic reasoning. Tool-integrated reasoning (TIR) offers a promising solution by leveraging external tools such as code…

Machine Learning · Computer Science 2025-06-25 Xingyue Huang , Xianglong Hu , Zifeng Ding , Yuan He , Rishabh , Waleed Alzarooni , Ziyu Ye , Wendong Fan , Bailan He , Haige Bo , Changran Hu , Guohao Li

Large Language Models (LLMs) have shown remarkable capabilities in general natural language processing tasks but often fall short in complex reasoning tasks. Recent studies have explored human-like problem-solving strategies, such as…

Computation and Language · Computer Science 2023-12-19 Zhenran Xu , Senbao Shi , Baotian Hu , Jindi Yu , Dongfang Li , Min Zhang , Yuxiang Wu

Large language models (LLMs) demonstrate strong reasoning abilities across mathematical, strategic, and linguistic tasks, yet little is known about how well they reason in dynamic, real-time, multi-agent scenarios, such as collaborative…

Multiagent Systems · Computer Science 2026-01-01 Shaurya Mallampati , Rashed Shelim , Walid Saad , Naren Ramakrishnan

Multi-agent systems have evolved into practical LLM-driven collaborators for many applications, gaining robustness from diversity and cross-checking. However, multi-agent RL (MARL) training is resource-intensive and unstable: co-adapting…

The emergence of multi-agent systems powered by large language models (LLMs) has unlocked new frontiers in complex task-solving, enabling diverse agents to integrate unique expertise, collaborate flexibly, and address challenges…

Artificial Intelligence · Computer Science 2025-11-05 Jingbo Wang , Sendong Zhao , Haochun Wang , Yuzheng Fan , Lizhe Zhang , Yan Liu , Ting Liu

Large Language Models (LLMs) have revolutionized recommendation agents by providing superior reasoning and flexible decision-making capabilities. However, existing methods mainly follow a passive information acquisition paradigm, where…

Information Retrieval · Computer Science 2026-03-11 Haobo Zhang , Yutao Zhu , Kelong Mao , Tianhao Li , Zhicheng Dou

Existing large language models (LLMs) show exceptional problem-solving capabilities but might struggle with complex reasoning tasks. Despite the successes of chain-of-thought and tree-based search methods, they mainly depend on the internal…

Computation and Language · Computer Science 2024-12-18 Jinhao Jiang , Jiayi Chen , Junyi Li , Ruiyang Ren , Shijie Wang , Wayne Xin Zhao , Yang Song , Tao Zhang

The Stop-Think-AutoRegress Language Diffusion Model (STAR-LDM) integrates latent diffusion planning with autoregressive generation. Unlike conventional autoregressive language models limited to token-by-token decisions, STAR-LDM…

Computation and Language · Computer Science 2026-02-25 Justin Lovelace , Christian Belardi , Sofian Zalouk , Adhitya Polavaram , Srivatsa Kundurthy , Kilian Q. Weinberger

Effective collaboration in multi-agent systems requires communicating goals and intentions between agents. Current agent frameworks often suffer from dependencies on single-agent execution and lack robust inter-module communication,…

Computation and Language · Computer Science 2024-07-18 Xihe Qiu , Haoyu Wang , Xiaoyu Tan , Chao Qu , Yujie Xiong , Yuan Cheng , Yinghui Xu , Wei Chu , Yuan Qi

Recent LLMs increasingly integrate reasoning mechanisms like Chain-of-Thought (CoT). However, this explicit reasoning exposes a new attack surface for inference-time backdoors, which inject malicious reasoning paths without altering model…

Computation and Language · Computer Science 2026-01-14 Seong-Gyu Park , Sohee Park , Jisu Lee , Hyunsik Na , Daeseon Choi