English
Related papers

Related papers: Systematic Failures in Collective Reasoning under …

200 papers

Large language model (LLM) web agents are increasingly used for web navigation but remain far from human reliability on realistic, long-horizon tasks. Existing evaluations focus primarily on end-to-end success, offering limited insight into…

Artificial Intelligence · Computer Science 2026-04-29 Mohamed Aghzal , Gregory J. Stein , Ziyu Yao

Decision conferences are structured, collaborative meetings that bring together experts from various fields to address complex issues and reach a consensus on recommendations for future actions or policies. These conferences often rely on…

Computation and Language · Computer Science 2025-07-14 Selina Heller , Mohamed Ibrahim , David Antony Selby , Sebastian Vollmer

In recent years, Large Language Models (LLMs) have demonstrated remarkable capabilities across diverse NLP tasks. Extensive research has explored how to enhance the logical reasoning abilities such as Chain-of-Thought, Chain-of-Thought with…

Computation and Language · Computer Science 2025-12-29 Tongxuan Liu , Xingyu Wang , Weizhe Huang , Wenjiang Xu , Yuting Zeng , Lei Jiang , Hailong Yang , Jing Li

Large Language Models (LLMs) based autonomous agents demonstrate multifaceted capabilities to contribute substantially to economic production. However, existing benchmarks remain focused on single agentic capability, failing to capture…

Artificial Intelligence · Computer Science 2026-04-24 Keyu Li , Junhao Shi , Yang Xiao , Mohan Jiang , Jie Sun , Yunze Wu , Dayuan Fu , Shijie Xia , Xiaojie Cai , Tianze Xu , Weiye Si , Wenjie Li , Dequan Wang , Pengfei Liu

The reasoning capabilities of LLM (Large Language Model) are widely acknowledged in recent research, inspiring studies on tool learning and autonomous agents. LLM serves as the "brain" of the agent, orchestrating multiple tools for…

Machine Learning · Computer Science 2024-03-26 Xiangyan Liu , Rongxue Li , Wei Ji , Tao Lin

While advances in fairness and alignment have helped mitigate overt biases exhibited by large language models (LLMs) when explicitly prompted, we hypothesize that these models may still exhibit implicit biases when simulating human…

Computation and Language · Computer Science 2025-01-30 Yuxuan Li , Hirokazu Shirado , Sauvik Das

Multi-agent debate (MAD) has recently emerged as a promising framework for improving the reasoning performance of large language models (LLMs). Yet, whether LLM agents can genuinely engage in deliberative reasoning, beyond simple ensembling…

Multiagent Systems · Computer Science 2025-11-12 Haolun Wu , Zhenkun Li , Lingyao Li

Large Language Models (LLMs) have the potential to enhance Agent-Based Modeling by better representing complex interdependent cybersecurity systems, improving cybersecurity threat modeling and risk management. However, evaluating LLMs in…

Cryptography and Security · Computer Science 2024-06-12 Tam n. Nguyen

Large Language Model (LLM) agents, while proficient in the digital realm, face a significant gap in physical-world deployment due to the challenge of forming and maintaining a robust spatial mental model. We identify three core cognitive…

Artificial Intelligence · Computer Science 2026-01-05 Huan-ang Gao , Zikang Zhang , Tianwei Luo , Kaisen Yang , Xinzhe Juan , Jiahao Qiu , Tianxing Chen , Bingxiang He , Hao Zhao , Hao Zhou , Shilong Liu , Mengdi Wang

Recent advancements in large language models (LLMs) revolutionize the field of intelligent agents, enabling collaborative multi-agent systems capable of tackling complex problems across various domains. However, the potential of conformity…

Computation and Language · Computer Science 2025-02-12 Zhiyuan Weng , Guikun Chen , Wenguan Wang

Collaborative information from user-item interactions is a fundamental source of signal in successful recommender systems. Recently, researchers have attempted to incorporate this knowledge into large language model-based recommender…

Information Retrieval · Computer Science 2026-03-24 Shahrooz Pouryousef , Ali Montazeralghaem

Benefiting from the strong reasoning capabilities, Large language models (LLMs) have demonstrated remarkable performance in recommender systems. Various efforts have been made to distill knowledge from LLMs to enhance collaborative models,…

Information Retrieval · Computer Science 2024-12-24 Xihong Yang , Heming Jing , Zixing Zhang , Jindong Wang , Huakang Niu , Shuaiqiang Wang , Yu Lu , Junfeng Wang , Dawei Yin , Xinwang Liu , En Zhu , Defu Lian , Erxue Min

Existing benchmarks for multimodal memory reasoning largely evaluate systems within pre-assembled contexts, but under-evaluate whether agents can use evidence distributed across independently originated sources. We argue that…

Computation and Language · Computer Science 2026-05-18 Huacan Chai , Yukai Wang , Yingxuan Yang , Dan Peng , Yuanyi Song , Zhihui Fu , Weiwen Liu , Jianghao Lin , Jun Wang , Weinan Zhang

The rapid development of large language models (LLMs) has motivated research on decision-making in multi-agent systems, where multiple agents collaborate to achieve shared objectives. Existing aggregation approaches, such as voting and…

Machine Learning · Computer Science 2026-05-08 Zheng Zhang , Cuong C. Nguyen , Kevin Wells , Gustavo Carneiro

We aim to evaluate Large Language Models (LLMs) for embodied decision making. While a significant body of work has been leveraging LLMs for decision making in embodied environments, we still lack a systematic understanding of their…

As large language models (LLMs) have demonstrated strong reasoning abilities in structured tasks (e.g., coding and mathematics), we explore whether these abilities extend to strategic multi-agent environments. We investigate strategic…

General Economics · Economics 2025-10-23 Gavin Kader , Dongwoo Lee

Multi-agent large language model (LLM) systems have shown promise for solving complex tasks through agent collaboration. However, existing frameworks assign tasks based on predefined roles without considering whether an agent can accurately…

Artificial Intelligence · Computer Science 2026-05-19 Chenyu Wang , Yang Shu

The recent work by Shojaee et al. (2025), titled The Illusion of Thinking: Understanding the Strengths and Limitations of Reasoning Models via the Lens of Problem Complexity, presents a compelling empirical finding, a reasoning cliff, where…

Artificial Intelligence · Computer Science 2025-06-25 Sheraz Khan , Subha Madhavan , Kannan Natarajan

The justice system has increasingly employed AI techniques to enhance efficiency, yet limitations remain in improving the quality of decision-making, particularly regarding transparency and explainability needed to uphold public trust in…

Artificial Intelligence · Computer Science 2024-12-30 Cong Jiang , Xiaolei Yang

Large Language Models (LLMs) excel at producing broadly relevant text, but this generality becomes a limitation when user-specific preferences are required, such as recommending restaurants or planning travel. In these scenarios, users…

Machine Learning · Computer Science 2025-10-21 Ioannis Tsaknakis , Bingqing Song , Shuyu Gan , Dongyeop Kang , Alfredo Garcia , Gaowen Liu , Charles Fleming , Mingyi Hong