English
Related papers

Related papers: Scaling Agentic Verifier for Competitive Coding

200 papers

Test-time computation has become a primary driver of progress in large language model (LLM) reasoning, but it is increasingly bottlenecked by expensive verification. In many reasoning systems, a large fraction of verifier calls are spent on…

Artificial Intelligence · Computer Science 2026-02-05 Shuhui Qu

In this work, we present a modular and interpretable framework that uses Large Language Models (LLMs) to automate candidate assessment in recruitment. The system integrates diverse sources, including job descriptions, CVs, interview…

Information Retrieval · Computer Science 2026-03-31 Kamer Ali Yuksel , Abdul Basit Anees , Ashraf Elneima , Sanjika Hewavitharana , Mohamed Al-Badrashiny , Hassan Sawaf

We introduce a novel large language model (LLM)-driven agent framework, which iteratively refines queries and filters contextual evidence by leveraging dynamically evolving knowledge. A defining feature of the system is its decoupling of…

Artificial Intelligence · Computer Science 2025-04-02 Seyoung Song

Benchmarks are essential for quantitatively tracking progress in AI. As AI agents become increasingly capable, researchers and practitioners have introduced agentic benchmarks to evaluate agents on complex, real-world tasks. These…

Autonomous agents powered by large language models (LLMs) have the potential to significantly enhance human productivity by reasoning, using tools, and executing complex tasks in diverse environments. However, current approaches to…

Effective information seeking in the vast and ever-growing digital landscape requires balancing expansive search with strategic reasoning. Current large language model (LLM)-based agents struggle to achieve this balance due to limitations…

Artificial Intelligence · Computer Science 2025-08-13 Xianghe Pang , Shuo Tang , Rui Ye , Yuwen Du , Yaxin Du , Siheng Chen

Large Language Models (LLMs) have shown remarkable performance in completing various tasks. However, solving complex problems often requires the coordination of multiple agents, raising a fundamental question: how to effectively select and…

Computation and Language · Computer Science 2026-04-02 Eric Hanchen Jiang , Levina Li , Rui Sun , Xiao Liang , Yubei Li , Yuchen Wu , Haozheng Luo , Hengli Li , Zhi Zhang , Zhaolu Kang , Kai-Wei Chang , Ying Nian Wu

AI-powered recruitment tools are increasingly adopted in personnel selection, yet they struggle to capture the requisition (req)-specific personal competencies (PCs) that distinguish successful candidates beyond job categories. We propose a…

Computation and Language · Computer Science 2026-04-02 Wanxin Li , Denver McNeney , Nivedita Prabhu , Charlene Zhang , Renee Barr , Matthew Kitching , Khanh Dao Duc , Anthony S. Boyce

As language model (LM) outputs get more and more natural, it is becoming more difficult than ever to evaluate their quality. Simultaneously, increasing LMs' "thinking" time through scaling test-time compute has proven an effective technique…

Large Language Model (LLM) agents represent a promising shift in human-AI interaction, moving beyond passive prompt-response systems to autonomous agents capable of reasoning, planning, and goal-directed action. While LLM agents are…

Computation and Language · Computer Science 2026-02-06 Weiwen Liu , Jiarui Qin , Xu Huang , Xingshan Zeng , Yunjia Xi , Jianghao Lin , Chuhan Wu , Yasheng Wang , Lifeng Shang , Ruiming Tang , Defu Lian , Yong Yu , Weinan Zhang

Writing competitive programming problems is exacting. Authors must: set constraints, input distributions, and edge cases that rule out shortcuts; target specific algorithms (e.g., max-flow, dynamic programming, data structures); and…

Large language models still struggle with contest-level programming, while many agentic remedies rely on massive inference-time sampling or expensive multi-stage post-training. We study when execution feedback reliably helps an LLM CP…

Computation and Language · Computer Science 2026-05-26 Peisong Wang , Bowen Liu , Zehua Li , Yuyao Wang , Zhiwei Ma , Yuhan Li , Jia Li

This paper introduces a framework that integrates reinforcement learning (RL) with autonomous agents to enable continuous improvement in the automated process of software test cases authoring from business requirement documents within…

Software Engineering · Computer Science 2025-12-09 Mohanakrishnan Hariharan

The reasoning abilities of Large Language Models (LLMs) remain a topic of debate. Some methods such as ReAct-based prompting, have gained popularity for claiming to enhance sequential decision-making abilities of agentic LLMs. However, it…

Artificial Intelligence · Computer Science 2024-05-24 Mudit Verma , Siddhant Bhambri , Subbarao Kambhampati

Large Language Models (LLMs) and Vision Language Models (VLMs) possess extensive knowledge and exhibit promising reasoning abilities, however, they still struggle to perform well in complex, dynamic environments. Real-world tasks require…

Recent advances in frontier large language models have enabled code review agents that operate in open-ended, reasoning-intensive settings. However, the lack of standardized benchmarks and granular evaluation protocols makes it difficult to…

Software Engineering · Computer Science 2026-03-13 Kristen Pereira , Neelabh Sinha , Rajat Ghosh , Debojyoti Dutta

Large language models (LLMs) augmented with multi-step reasoning and action generation abilities have shown promise in leveraging external tools to tackle complex tasks that require long-horizon planning. However, existing approaches either…

Artificial Intelligence · Computer Science 2025-10-16 Wei Fan , Wenlin Yao , Zheng Li , Feng Yao , Xin Liu , Liang Qiu , Qingyu Yin , Yangqiu Song , Bing Yin

With the advancement of Agentic AI, researchers are increasingly leveraging autonomous agents to address challenges in software engineering (SE). However, the large language models (LLMs) that underpin these agents often function as black…

Software Engineering · Computer Science 2026-04-03 Jingyue Li , André Storhaug

Large language models (LLMs) have made rapid advancements in code generation for popular languages such as Python and C++. Many of these recent gains can be attributed to the use of ``agents'' that wrap domain-relevant tools alongside LLMs.…

Hardware Architecture · Computer Science 2026-03-31 Patrick Yubeaton , Siddharth Garg , Chinmay Hegde

Large Language Models (LLMs) have shown remarkable capabilities in solving various programming tasks, such as code generation. However, their potential for code optimization, particularly in performance enhancement, remains largely…

Programming Languages · Computer Science 2026-02-26 Tong Ye , Tengfei Ma , Xuhong Zhang , Hang Yu , Jianwei Yin , Wenhai Wang