English
Related papers

Related papers: Textualized Agent-Style Reasoning for Complex Task…

200 papers

Recent advances in large language models (LLMs) and multi-agent systems have demonstrated remarkable capabilities in complex problem-solving tasks such as deep research, vibe coding, and mathematical reasoning. However, most existing…

Large language models (LLMs) are rapidly evolving from passive engines of text generation into agentic entities that can plan, remember, invoke external tools, and co-operate with one another. This perspective paper investigates how such…

Information Retrieval · Computer Science 2025-07-11 Reza Yousefi Maragheh , Yashar Deldjoo

Autonomous agents powered by large language models (LLMs) have the potential to significantly enhance human productivity by reasoning, using tools, and executing complex tasks in diverse environments. However, current approaches to…

Large Language Models (LLMs) have increasingly demonstrated the ability to facilitate the development of multi-agent systems that allow the interpretation of thoughts and actions generated by each individual. Promising advancements have…

Multiagent Systems · Computer Science 2024-09-24 Asher Sprigler , Alexander Drobek , Keagan Weinstock , Wendpanga Tapsoba , Gavin Childress , Andy Dao , Lucas Gral

Large language models (LLMs) have achieved commendable accomplishments in various natural language processing tasks. However, LLMs still encounter significant challenges when dealing with complex scenarios involving multiple entities. These…

Computation and Language · Computer Science 2024-06-07 Yanming Liu , Xinyue Peng , Tianyu Du , Jianwei Yin , Weihao Liu , Xuhong Zhang

While diffusion models excel at generating high-quality images, they often struggle with accurate counting, attributes, and spatial relationships in complex multi-object scenes. One potential solution involves employing Multimodal Large…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Jiayang Sun , Hongbo Wang , Jie Cao , Huaibo Huang , Ran He

Multi-agent systems (MAS) powered by large language models (LLMs) hold significant promise for solving complex decision-making tasks. However, the core process of collaborative decision-making (CDM) within these systems remains…

Artificial Intelligence · Computer Science 2025-08-19 Xuyang Zhao , Shiwan Zhao , Hualong Yu , Liting Zhang , Qicheng Li

Large language models (LLMs) have recently gained significant attention as a promising approach to accelerate scientific discovery. However, their application in open-ended scientific domains such as biology remains limited, primarily due…

Machine Learning · Computer Science 2026-05-21 Yunhui Jang , Lu Zhu , Jake Fawkes , Alisandra Kaye Denton , Dominique Beaini , Emmanuel Noutahi

Large Language Models (LLMs) were shown to struggle with long-term planning, which may be caused by the limited way in which they explore the space of possible solutions. We propose an architecture where a Reinforcement Learning (RL) Agent…

Machine Learning · Computer Science 2024-10-18 Yoav Alon , Cristina David

Leveraging multiple Large Language Models(LLMs) has proven effective for addressing complex, high-dimensional tasks, but current approaches often rely on static, manually engineered multi-agent configurations. To overcome these constraints,…

Machine Learning · Computer Science 2025-07-21 Xiaowen Ma , Chenyang Lin , Yao Zhang , Volker Tresp , Yunpu Ma

Retrieval-Augmented Generation (RAG) lifts the factuality of Large Language Models (LLMs) by injecting external knowledge, yet it falls short on problems that demand multi-step inference; conversely, purely reasoning-oriented approaches…

Reasoning is a fundamental cognitive process that enables logical inference, problem-solving, and decision-making. With the rapid advancement of large language models (LLMs), reasoning has emerged as a key capability that distinguishes…

Large language models (LLMs) and agent-based frameworks have advanced rapidly, enabling diverse applications. Yet, with the proliferation of models and agentic strategies, practitioners face substantial uncertainty in selecting the best…

Computation and Language · Computer Science 2025-10-08 Zheyuan Zhang , Kaiwen Shi , Zhengqing Yuan , Zehong Wang , Tianyi Ma , Keerthiram Murugesan , Vincent Galassi , Chuxu Zhang , Yanfang Ye

Automatically generating formal ontologies from unstructured natural language remains a central challenge in knowledge engineering. While large language models (LLMs) show promise, it remains unclear which architectural design choices drive…

Artificial Intelligence · Computer Science 2026-04-28 Abid Talukder , Maruf Ahmed Mridul , Oshani Seneviratne

Writing compelling fiction is a multifaceted process combining elements such as crafting a plot, developing interesting characters, and using evocative language. While large language models (LLMs) show promise for story writing, they…

Computation and Language · Computer Science 2025-03-17 Fantine Huot , Reinald Kim Amplayo , Jennimaria Palomaki , Alice Shoshana Jakobovits , Elizabeth Clark , Mirella Lapata

Monitoring autonomous large language model (LLM) agents for covert malicious behavior is challenging due to delayed, context-dependent, and long-horizon attack patterns. Agents may pursue hidden objectives while maintaining superficially…

Machine Learning · Computer Science 2026-05-26 Nesreen K. Ahmed , Nima Nafisi

Addressing the challenge of effectively processing long contexts has become a critical issue for Large Language Models (LLMs). Two common strategies have emerged: 1) reducing the input length, such as retrieving relevant chunks by…

Computation and Language · Computer Science 2024-06-06 Yusen Zhang , Ruoxi Sun , Yanfei Chen , Tomas Pfister , Rui Zhang , Sercan Ö. Arik

Despite the outstanding capabilities of large language models (LLMs), knowledge-intensive reasoning still remains a challenging task due to LLMs' limitations in compositional reasoning and the hallucination problem. A prevalent solution is…

Computation and Language · Computer Science 2025-09-29 Amy Xin , Jinxin Liu , Zijun Yao , Zhicheng Lee , Shulin Cao , Lei Hou , Juanzi Li

Recent research has explored the use of Large Language Models (LLMs) for tackling complex graph reasoning tasks. However, due to the intricacies of graph structures and the inherent limitations of LLMs in handling long text, current…

Artificial Intelligence · Computer Science 2025-11-26 Yuwei Hu , Runlin Lei , Xinyi Huang , Zhewei Wei , Yongchao Liu

Large Language Models (LLMs) have enabled multi-agent systems to perform autonomous code generation for complex tasks. Despite the recent growth in research and industrial applications in this area, there is little work on synthesizing…

Software Engineering · Computer Science 2026-04-21 Zeeshan Rasheeda , Muhammad Waseema , Kai-Kristian Kemella , Mika Saari , Pekka Abrahamsson