English
Related papers

Related papers: Procedural Refinement by LLM-driven Algorithmic De…

200 papers

Retrieval-augmented generation (RAG) is now standard for knowledge-intensive LLM tasks, but most systems still treat every query as fresh, repeatedly re-retrieving long passages and re-reasoning from scratch, inflating tokens, latency, and…

Databases · Computer Science 2026-02-06 Ning Wang , Kuanyan Zhu , Daniel Yuehwoon Yee , Yitang Gao , Shiying Huang , Zirun Xu , Sainyam Galhotra

[...] Since then, various APR approaches, especially those leveraging the power of large language models (LLMs), have been rapidly developed to fix general software bugs. Unfortunately, the effectiveness of these advanced techniques in the…

Software Engineering · Computer Science 2025-06-17 Anh Ho , Thanh Le-Cong , Bach Le , Christine Rizkallah

Automated Program Repair (APR) agents leverage Large Language Models (LLMs) to autonomously diagnose and fix software bugs through reasoning, planning, and tool use. Despite impressive leaderboard gains on benchmarks such as SWE-bench,…

Software Engineering · Computer Science 2026-05-28 Ira Ceka , Hailie Mitchell , Saurabh Pujar , Luca Buratti , Shyam Ramji , Junfeng Yang , Gail Kaiser , Baishakhi Ray

Automated Program Repair (APR) can help developers automatically generate patches for bugs. Due to the impressive performance obtained using Large Pre-Trained Language Models (LLMs) on many code related tasks, researchers have started to…

Software Engineering · Computer Science 2023-02-01 Chunqiu Steven Xia , Lingming Zhang

Large language model (LLM)-driven automated program repair (APR) has advanced rapidly, but most methods remain code-centric: they directly rewrite source code and thereby risk hallucinated, behaviorally inconsistent fixes. This limitation…

Software Engineering · Computer Science 2026-02-10 Taohong Zhu , Lucas C. Cordeiro , Mustafa A. Mustafa , Youcheng Sun

Typical LLM responses tend to follow a default style, even though users often have distinct preferences regarding tone, verbosity, and formality that they do not explicitly state in their prompts. Evaluating whether personalization methods…

Computation and Language · Computer Science 2026-05-21 Philipp Spohn , Leander Girrbach , Zeynep Akata

We introduce the Abductive Rule Learner with Context-awareness (ARLC), a model that solves abstract reasoning tasks based on Learn-VRF. ARLC features a novel and more broadly applicable training objective for abductive reasoning, resulting…

Machine Learning · Computer Science 2024-09-02 Giacomo Camposampiero , Michael Hersche , Aleksandar Terzić , Roger Wattenhofer , Abu Sebastian , Abbas Rahimi

We introduce the \textit{Extract-Refine-Retrieve-Read} (ERRR) framework, a novel approach designed to bridge the pre-retrieval information gap in Retrieval-Augmented Generation (RAG) systems through query optimization tailored to meet the…

Computation and Language · Computer Science 2025-09-22 Youan Cong , Pritom Saha Akash , Cheng Wang , Kevin Chen-Chuan Chang

The ARC-AGI benchmark series serves as a critical measure of few-shot generalization on novel tasks, a core aspect of intelligence. The ARC Prize 2025 global competition targeted the newly released ARC-AGI-2 dataset, which features greater…

Artificial Intelligence · Computer Science 2026-01-19 François Chollet , Mike Knoop , Gregory Kamradt , Bryan Landers

Large Language Models (LLMs) show promising performance on various programming tasks, including Automatic Program Repair (APR). However, most approaches to LLM-based APR are limited to the static analysis of the programs, while disregarding…

Machine Learning · Computer Science 2025-05-09 Mirazul Haque , Petr Babkin , Farima Farmahinifarahani , Manuela Veloso

Recent advancements in large language models (LLMs) have shown strong performance in natural language understanding and generation tasks. However, LLMs continue to encounter challenges with hallucinations, where models generate plausible…

Computation and Language · Computer Science 2025-10-15 Jung-Woo Shim , Yeong-Joon Ju , Ji-Hoon Park , Seong-Whan Lee

We study structured abstraction-based reasoning for the Abstraction and Reasoning Corpus (ARC) and compare its generalization to test-time approaches. Purely neural architectures lack reliable combinatorial generalization, while strictly…

Artificial Intelligence · Computer Science 2026-04-06 Anugyan Das , Omkar Ghugarkar , Vishvesh Bhat , Asad Aali

Algebraic effects and handlers are a mechanism to structure programs with computational effects in a modular way. They are recently gaining popularity and being adopted in practical languages, such as OCaml. Meanwhile, there has been…

Programming Languages · Computer Science 2023-11-20 Fuga Kawamata , Hiroshi Unno , Taro Sekiyama , Tachio Terauchi

Large Language Models (LLMs) enhanced with retrieval -- commonly referred to as Retrieval-Augmented Generation (RAG) -- have demonstrated strong performance in knowledge-intensive tasks. However, RAG pipelines often fail when retrieved…

Computation and Language · Computer Science 2025-11-07 Shiyin Lin

Neural retrievers are often trained on large-scale triplet data comprising a query, a positive passage, and a set of hard negatives. In practice, hard-negative mining can introduce false negatives and other ambiguous negatives, including…

Information Retrieval · Computer Science 2026-04-14 Hyewon Choi , Jooyoung Choi , Hansol Jang , Hyun Kim , Chulmin Yun , ChangWook Jun , Stanley Jungkyu Choi

Repository-level automated program repair (APR) requires long-horizon reasoning over interdependent decisions. However, most LLM-based approaches reconstruct repair reasoning independently for each issue, failing to reuse successful…

Software Engineering · Computer Science 2026-05-29 Chenglin Li , Yisen Xu , Zehao Wang , Shin Hwei Tan , Tse-Hsun , Chen

Large language models (LLMs) have recently shown strong potential for automated program repair (APR), particularly through iterative refinement that generates and improves candidate patches. However, state-of-the-art iterative refinement…

Software Engineering · Computer Science 2026-04-03 Cuong Chi Le , Minh Le-Anh , Cuong Duc Van , Tien N. Nguyen

Large Language Models (LLMs) demonstrate strong potential for automated code generation, yet their ability to iteratively refine solutions using execution feedback remains underexplored. Competitive programming offers an ideal testbed for…

Software Engineering · Computer Science 2026-05-19 Anika Tabassum , Md Sifat Hossain , Md. Fahim Arefin , Tariqul Islam , Tarannum Shaila Zaman

Large Language Models (LLMs) perform well on automatic program repair (APR) for high-resource programming languages (HRPLs), but their effectiveness drops sharply in low-resource programming languages (LRPLs), due to a lack of sufficient…

Software Engineering · Computer Science 2026-05-26 Zhipeng Wang , Boyang Yang , Yidong Wan , Liuye Guo , You Lv , Tao Zheng , Zhuowei Wang , Tieke He

Recent advances in large language models (LLMs) have accelerated the development of AI-driven automated program repair (APR) solutions. However, these solutions are typically evaluated using static benchmarks such as Defects4J and…

Software Engineering · Computer Science 2025-10-01 Yinghang Ma , Jiho Shin , Leuson Da Silva , Zhen Ming , Jiang , Song Wang , Foutse Khomh , Shin Hwei Tan