English
Related papers

Related papers: ARIES: Autonomous Reasoning with LLMs on Interacti…

200 papers

Large language model (LLM) agents often struggle in environments where rules and required domain knowledge frequently change, such as regulatory compliance and user risk screening. Current approaches, like offline fine-tuning and standard…

Machine Learning · Computer Science 2025-10-13 Yufei He , Ruoyu Li , Alex Chen , Yue Liu , Yulin Chen , Yuan Sui , Cheng Chen , Yi Zhu , Luca Luo , Frank Yang , Bryan Hooi

Large Language Model (LLM)-based agents are increasingly employed to automate complex software engineering tasks, such as program repair and issue resolution. These agents operate by autonomously generating natural language thoughts,…

Software Engineering · Computer Science 2025-10-09 Islem Bouzenia , Michael Pradel

This survey paper outlines the key developments in the field of Large Language Models (LLMs), including enhancements to their reasoning skills, adaptability to various tasks, increased computational efficiency, and the ability to make…

Computation and Language · Computer Science 2026-02-12 Asifullah Khan , Muhammad Zaeem Khan , Aleesha Zainab , Saleha Jamshed , Sadia Ahmad , Kaynat Khatib , Faria Bibi , Abdul Rehman

As LLMs are increasingly deployed as agents, agentic reasoning - the ability to combine tool use, especially search, and reasoning - becomes a critical skill. However, it is hard to disentangle agentic reasoning when evaluated in complex…

Artificial Intelligence · Computer Science 2025-10-03 Hanlin Zhu , Tianyu Guo , Song Mei , Stuart Russell , Nikhil Ghosh , Alberto Bietti , Jiantao Jiao

AI Agents rely on Large Language Models (LLMs) and Multimodal-LLMs (MLLMs) to perform interpretation and inference in text and image tasks without post-training, where LLMs and MLLMs play the most critical role and determine the initial…

Artificial Intelligence · Computer Science 2025-07-14 Haoran Sun , Shaoning Zeng

In this paper, we aim to improve the reasoning ability of large language models (LLMs) over knowledge graphs (KGs) to answer complex questions. Inspired by existing methods that design the interaction strategy between LLMs and KG, we…

Computation and Language · Computer Science 2024-02-20 Jinhao Jiang , Kun Zhou , Wayne Xin Zhao , Yang Song , Chen Zhu , Hengshu Zhu , Ji-Rong Wen

This report describes ARIS (Auto-Research-in-sleep), an open-source research harness for autonomous research, including its architecture, assurance mechanisms, and early deployment experience. The performance of agent systems built on LLMs…

Software Engineering · Computer Science 2026-05-06 Ruofeng Yang , Yongcan Li , Shuai Li

The booming success of LLMs initiates rapid development in LLM agents. Though the foundation of an LLM agent is the generative model, it is critical to devise the optimal reasoning strategies and agent architectures. Accordingly, LLM agent…

Large language models (LLMs) have achieved remarkable progress in complex reasoning tasks, yet they remain fundamentally limited by their reliance on static internal knowledge and text-only reasoning. Real-world problem solving often…

Artificial Intelligence · Computer Science 2025-05-06 Joykirat Singh , Raghav Magazine , Yash Pandya , Akshay Nambi

Large language models (LLMs) possess extensive knowledge bases and strong reasoning capabilities, making them promising tools for complex, multi-agent planning in embodied environments. However, despite LLMs' advanced abilities and the…

Multiagent Systems · Computer Science 2025-06-10 Xinran Li , Chenjia Bai , Zijian Li , Jiakun Zheng , Ting Xiao , Jun Zhang

Recent advances in test-time scaling have enabled Large Language Models (LLMs) to display sophisticated reasoning abilities via extended Chain-of-Thought (CoT) generation. Despite their potential, these Reasoning LLMs (RLMs) often…

Computation and Language · Computer Science 2025-05-21 Zhen Xiong , Yujun Cai , Zhecheng Li , Yiwei Wang

Agentic AI systems built on large language models (LLMs) offer significant potential for automating complex workflows, from software development to customer support. However, LLM agents often underperform due to suboptimal configurations;…

Graph computational tasks are inherently challenging and often demand the development of advanced algorithms for effective solutions. With the emergence of large language models (LLMs), researchers have begun investigating their potential…

Computation and Language · Computer Science 2025-01-24 Chang Gong , Wanrui Bian , Zhijie Zhang , Weiguo Zheng

As large language models (LLMs) have demonstrated strong reasoning abilities in structured tasks (e.g., coding and mathematics), we explore whether these abilities extend to strategic multi-agent environments. We investigate strategic…

General Economics · Economics 2025-10-23 Gavin Kader , Dongwoo Lee

Recent Large Language Models (LLMs) such as OpenAI o3-mini and DeepSeek-R1 use enhanced reasoning through Chain-of-Thought (CoT). Their potential in hardware design, which relies on expert-driven iterative optimization, remains unexplored.…

Artificial Intelligence · Computer Science 2025-04-15 Luca Collini , Andrew Hennessee , Ramesh Karri , Siddharth Garg

LLM-empowered multi-agent systems offer new potential to accelerate scientific discovery by generating novel research ideas. However, existing methods typically coordinate agents through temporary texts, such as drafts or chat logs; it is…

Multiagent Systems · Computer Science 2026-05-07 Jiangwen Dong , Bo Li , Wanyu Lin

Test-time scaling (TTS) enhances the performance of large language models (LLMs) by allocating additional compute resources during inference. However, existing research primarily investigates TTS in single-stage tasks; while many real-world…

Artificial Intelligence · Computer Science 2025-10-23 Fali Wang , Hui Liu , Zhenwei Dai , Jingying Zeng , Zhiwei Zhang , Zongyu Wu , Chen Luo , Zhen Li , Xianfeng Tang , Qi He , Suhang Wang

Recent advancements have showcased the potential of Large Language Models (LLMs) in executing reasoning tasks, particularly facilitated by Chain-of-Thought (CoT) prompting. While tasks like arithmetic reasoning involve clear, definitive…

Information Retrieval · Computer Science 2024-08-05 Alicia Y. Tsai , Adam Kraft , Long Jin , Chenwei Cai , Anahita Hosseini , Taibai Xu , Zemin Zhang , Lichan Hong , Ed H. Chi , Xinyang Yi

Agents powered by Large Language Models (LLMs) have recently demonstrated impressive capabilities in various tasks. Still, they face limitations in tasks requiring specific, structured knowledge, flexibility, or accountable decision-making.…

Artificial Intelligence · Computer Science 2025-04-14 Kostas Hatalis , Despina Christou , Vyshnavi Kondapalli

Graph Retrieval Augmented Generation (GraphRAG) effectively enhances external knowledge integration capabilities by explicitly modeling knowledge relationships, thereby improving the factual accuracy and generation quality of Large Language…

Artificial Intelligence · Computer Science 2025-06-05 Junqi Gao , Xiang Zou , YIng Ai , Dong Li , Yichen Niu , Biqing Qi , Jianxing Liu