English
Related papers

Related papers: CodeScout: An Effective Recipe for Reinforcement L…

200 papers

Reinforcement learning is increasingly used for code-centric tasks. These tasks include code generation, summarization, understanding, repair, testing, and optimization. This trend is growing faster with large language models and autonomous…

Software Engineering · Computer Science 2026-01-28 Md Rayhanul Masud , Azmine Toushik Wasi , Salman Rahman , Md Rizwan Parvez

Code completion can help developers improve efficiency and ease the development lifecycle. Although code completion is available in modern integrated development environments (IDEs), research lacks in determining what makes a good context…

Software Engineering · Computer Science 2025-10-13 Imranur Rahman , Md Rayhanur Rahman

We introduce DA-Code, a code generation benchmark specifically designed to assess LLMs on agent-based data science tasks. This benchmark features three core elements: First, the tasks within DA-Code are inherently challenging, setting them…

Computation and Language · Computer Science 2024-10-14 Yiming Huang , Jianwen Luo , Yan Yu , Yitong Zhang , Fangyu Lei , Yifan Wei , Shizhu He , Lifu Huang , Xiao Liu , Jun Zhao , Kang Liu

Code synthesis, which requires a deep understanding of complex natural language problem descriptions, generation of code instructions for complex algorithms and data structures, and the successful execution of comprehensive unit tests,…

Computation and Language · Computer Science 2024-05-21 Md. Ashraful Islam , Mohammed Eunus Ali , Md Rizwan Parvez

Achieving the effective design and improvement of reward functions in reinforcement learning (RL) tasks with complex custom environments and multiple requirements presents considerable challenges. In this paper, we propose ERFSL, an…

Machine Learning · Computer Science 2026-05-19 Guanwen Xie , Jingzehua Xu , Yiyuan Yang , Yimian Ding , Shuai Zhang

As large Pre-trained Language Models (PLMs) trained on large amounts of data in an unsupervised manner become more ubiquitous, identifying various types of bias in the text has come into sharp focus. Existing "Stereotype Detection" datasets…

Computation and Language · Computer Science 2022-03-29 Rajkumar Pujari , Erik Oveson , Priyanka Kulkarni , Elnaz Nouri

Code generation models based on large language models (LLMs) have gained wide adoption, but challenges remain in ensuring safety, accuracy, and controllability, especially for complex tasks. Existing methods often lack dynamic integration…

Software Engineering · Computer Science 2025-10-13 Aofan Liu , Haoxuan Li , Bin Wang , Ao Yang , Hui Li

Reproducing computational research is often assumed to be as simple as rerunning the original code with provided data. In practice, missing packages, fragile file paths, version conflicts, or incomplete logic frequently cause analyses to…

Software Engineering · Computer Science 2026-04-24 Syed Mehtab Hussain Shah , Frank Hopfgartner , Arnim Bleier

Large language model (LLM)-based search agents have proven promising for addressing knowledge-intensive problems by incorporating information retrieval capabilities. Existing works largely focus on optimizing the reasoning paradigms of…

Artificial Intelligence · Computer Science 2026-01-09 Tongyu Wen , Guanting Dong , Zhicheng Dou

A major challenge for niche scientific and technical domains in leveraging coding agents is the lack of access to up-to-date, domain- specific knowledge. Foundational models often demonstrate limited reasoning capabilities in specialized…

Artificial Intelligence · Computer Science 2026-04-22 Santosh Ganji

Issue localization, the process of identifying code locations that need modification to resolve software issues, is a critical yet challenging task in software development. The semantic gap between natural language issue descriptions and…

Software Engineering · Computer Science 2025-08-07 Zexiong Ma , Chao Peng , Qunhong Zeng , Pengfei Gao , Yanzhen Zou , Bing Xie

Quantum machine learning models use encoding circuits to map data into a quantum Hilbert space. While it is well known that the architecture of these circuits significantly influences core properties of the resulting model, they are often…

Quantum Physics · Physics 2025-03-03 Frederic Rapp , David A. Kreplin , Marco F. Huber , Marco Roth

Training multimodal agents via reinforcement learning for knowledge-intensive visual reasoning is fundamentally hindered by the extreme sparsity of outcome-based supervision and the unpredictability of live web environments. To resolve…

Computer Vision and Pattern Recognition · Computer Science 2026-04-23 Wentao Yan , Shengqin Wang , Huichi Zhou , Yihang Chen , Kun Shao , Yuan Xie , Zhizhong Zhang

Code summarization provides a high level natural language description of the function performed by code, as it can benefit the software maintenance, code categorization and retrieval. To the best of our knowledge, most state-of-the-art…

Software Engineering · Computer Science 2018-11-20 Yao Wan , Zhou Zhao , Min Yang , Guandong Xu , Haochao Ying , Jian Wu , Philip S. Yu

Large language models (LLMs) excel at knowledge-intensive question answering and reasoning, yet their real-world deployment remains constrained by knowledge cutoff, hallucination, and limited interaction modalities. Augmenting LLMs with…

Computation and Language · Computer Science 2025-10-13 Daocheng Fu , Jianbiao Mei , Licheng Wen , Xuemeng Yang , Cheng Yang , Rong Wu , Tao Hu , Siqi Li , Yufan Shen , Xinyu Cai , Pinlong Cai , Botian Shi , Yong Liu , Yu Qiao

Large language models (LLMs) can face factual limitations when responding to time-sensitive queries about recent events that arise after their knowledge thresholds in the training corpus. Existing search-augmented approaches fall into two…

Information Retrieval · Computer Science 2025-06-11 Wentao Shi , Yiqing Shen

Performance metrics-driven context caching has a profound impact on throughput and response time in distributed context management systems for real-time context queries. This paper proposes a reinforcement learning based approach to…

Systems and Control · Electrical Eng. & Systems 2023-02-10 Shakthi Weerasinghe , Arkady Zaslavsky , Seng W. Loke , Amin Abken , Alireza Hassani

Most existing large language models (LLMs) are expensive to adapt after deployment, especially when a task requires newly produced information or niche domain knowledge. Recent work has shown that, by manipulating and optimizing their…

Computation and Language · Computer Science 2026-05-15 Zeyu Huang , Adhiguna Kuncoro , Qixuan Feng , Jiajun Shen , Lucio Dery , Arthur Szlam , Marc'Aurelio Ranzato

Code search is a core software engineering task. Effective code search tools can help developers substantially improve their software development efficiency and effectiveness. In recent years, many code search studies have leveraged…

Software Engineering · Computer Science 2021-10-12 Chao Liu , Xin Xia , David Lo , Cuiyun Gao , Xiaohu Yang , John Grundy

Topological error correcting codes, and particularly the surface code, currently provide the most feasible roadmap towards large-scale fault-tolerant quantum computation. As such, obtaining fast and flexible decoding algorithms for these…

Quantum Physics · Physics 2021-01-12 Ryan Sweke , Markus S. Kesselring , Evert P. L. van Nieuwenburg , Jens Eisert