English
Related papers

Related papers: Awakening the Sleeping Agent: Lean-Specific Agenti…

200 papers

The deployment of Large Language Models (LLMs) as agentic orchestrators has revolutionized task automation, but the need for privacy-preserving, cost-effective solutions demands on-device inference capabilities. However, local LLMs…

Artificial Intelligence · Computer Science 2025-11-13 Rohan Kadekodi , Zhan Jin , Keisuke Kamahori , Yile Gu , Sean Khatiri , Noah H. Bayindirli , Sergey Gorbunov , Baris Kasikci

Can a committee of weak reasoning-model calls reach the performance of much stronger models? We study verifier-backed committee search as inference-time boosting for reasoning language models. The mechanism is not simply that ``more agents…

Artificial Intelligence · Computer Science 2026-05-15 Varun Sunkaraneni , Pierfrancesco Beneventano , Riccardo Neumarker , Tomaso Poggio , Tomer Galanti

We introduce Agent2 RL-Bench, a compact diagnostic benchmark for evaluating agentic RL post-training, which tests whether LLM agents can autonomously design, implement, debug, and execute post-training pipelines that improve foundation…

Artificial Intelligence · Computer Science 2026-05-14 Wanyi Chen , Xiao Yang , Xu Yang , Tianming Sha , Qizheng Li , Zhuo Wang , Bowen Xian , Fang Kong , Weiqing Liu , Jiang Bian

Tool-augmented large language models (LLMs) are usually trained with supervised imitation or coarse-grained reinforcement learning that optimizes single tool calls. Current self-reflection practices rely on heuristic prompts or one-way…

Computer Vision and Pattern Recognition · Computer Science 2026-04-16 Junhao Su , Yuanliang Wan , Junwei Yang , Hengyu Shi , Tianyang Han , Junfeng Luo , Yurui Qiu

Large language models (LLMs) are becoming the foundation for autonomous agents that can use tools to solve complex tasks. Reinforcement learning (RL) has emerged as a common approach for injecting such agentic capabilities, but typically…

Machine Learning · Computer Science 2026-02-26 Emre Can Acikgoz , Cheng Qian , Jonas Hübotter , Heng Ji , Dilek Hakkani-Tür , Gokhan Tur

While Large Language Models (LLMs) have evolved into tool-using agents, they remain brittle in long-horizon interactions. Unlike mathematical reasoning where errors are often rectifiable via backtracking, tool-use failures frequently induce…

Artificial Intelligence · Computer Science 2026-03-17 Shengda Fan , Xuyan Ye , Yupeng Huo , Zhi-Yuan Chen , Yiju Guo , Shenzhi Yang , Wenkai Yang , Shuqi Ye , Jingwen Chen , Haotian Chen , Xin Cong , Yankai Lin

Agentic theorem provers combine a reasoning model, retrieval, search, and a proof assistant verifier, yet it remains unclear which components actually improve finite-budget proof success and why they help on real mathematical workloads. We…

Machine Learning · Statistics 2026-05-26 Sho Sonoda , Shunta Akiyama , Yuya Uezato

Autonomous inspection in hazardous environments requires AI agents that can interpret high-level goals and execute precise control. A key capability for such agents is spatial grounding, for example when a drone must center a detected…

Artificial Intelligence · Computer Science 2025-11-25 Xian Yeow Lee , Lasitha Vidyaratne , Gregory Sin , Ahmed Farahat , Chetan Gupta

General-purpose Large Language Models (LLMs) have achieved remarkable success in intelligence, performing comparably to human experts on complex reasoning tasks such as coding and mathematical reasoning. However, generating formal proofs in…

Tool-calling agents are evaluated on tool selection, parameter accuracy, and scope recognition, yet LLM trajectory assessments remain inherently post-hoc. Disconnected from the active execution loop, such assessments identify errors that…

Artificial Intelligence · Computer Science 2026-05-01 Anh Ta , Junjie Zhu , Shahin Shayandeh

Recent work has shown that layer pruning can effectively compress large language models (LLMs) while retaining strong performance on classification benchmarks, often with little or no finetuning. In contrast, generative reasoning tasks,…

Machine Learning · Computer Science 2026-04-13 Safal Shrestha , Anubhav Shrestha , Aadim Nepal , Minwu Kim , Keith Ross

Recent studies have shown that Large Language Models (LLMs) struggle to accurately retrieve information and maintain reasoning capabilities when processing long-context inputs. To address these limitations, we propose a finetuning approach…

Machine Learning · Computer Science 2024-10-15 Zheyang Xiong , Vasilis Papageorgiou , Kangwook Lee , Dimitris Papailiopoulos

This technical report details a novel approach to combining reasoning and retrieval augmented generation (RAG) within a single, lean language model architecture. While existing RAG systems typically rely on large-scale models and external…

AI coding agents can resolve real-world software issues, yet they frequently introduce regressions -- breaking tests that previously passed. Current benchmarks focus almost exclusively on resolution rate, leaving regression behavior…

Software Engineering · Computer Science 2026-03-20 Pepe Alonso , Sergio Yovine , Victor A. Braberman

While retrieval-augmented generation (RAG) has been shown to enhance factuality of large language model (LLM) outputs, LLMs still suffer from hallucination, generating incorrect or irrelevant information. A common detection strategy…

Computation and Language · Computer Science 2025-03-17 Tobias Leemann , Periklis Petridis , Giuseppe Vietri , Dionysis Manousakas , Aaron Roth , Sergul Aydore

Large language model (LLM) agents deployed for multi-step tasks frequently fail in predictable ways: attempting actions with unmet preconditions, issuing redundant commands, or mishandling environment constraints. While retrieval-augmented…

Artificial Intelligence · Computer Science 2025-10-03 Humaid Ibrahim , Nikolai Rozanov , Marek Rei

Large Language Model (LLM) based agents have proved their ability to perform complex tasks like humans. However, there is still a large gap between open-sourced LLMs and commercial models like the GPT series. In this paper, we focus on…

Artificial Intelligence · Computer Science 2025-02-25 Dayuan Fu , Keqing He , Yejie Wang , Wentao Hong , Zhuoma Gongque , Weihao Zeng , Wei Wang , Jingang Wang , Xunliang Cai , Weiran Xu

Nowadays, formal theorem provers have made monumental progress on high-school and competition-level mathematics, but few of them generalize to more advanced mathematics. In this paper, we present REAL-Prover, a new open-source stepwise…

Computation and Language · Computer Science 2025-11-25 Ziju Shen , Naohao Huang , Fanyi Yang , Yutong Wang , Guoxiong Gao , Tianyi Xu , Jiedong Jiang , Wanyi He , Pu Yang , Mengzhou Sun , Haocheng Ju , Peihao Wu , Bryan Dai , Bin Dong

Neuron pruning is widely used to reduce the computational cost and parameter footprint of large language models, yet it remains unclear whether neurons in task-specific models contribute uniformly to task performance. In this work, we…

Open-domain table question answering traditionally relies on a two-stage pipeline: static table retrieval followed by a closed-domain answer. In contrast, we propose an end-to-end agentic framework that embeds multi-turn tool calls-using a…

Computation and Language · Computer Science 2025-07-08 Zipeng Qiu