English
Related papers

Related papers: SGCR: A Specification-Grounded Framework for Trust…

200 papers

Language models (LMs) are susceptible to in-context reward hacking, where they exploit flaws in tainted or faulty written specifications or rubrics to achieve high scores without fulfilling the user's true intent. We introduce Specification…

Computation and Language · Computer Science 2025-07-28 Víctor Gallego

Requirements traceability, the process of establishing and maintaining relationships between requirements and various software development artifacts, is paramount for ensuring system integrity and fulfilling requirements throughout the…

Software Engineering · Computer Science 2026-05-25 Nouf Alturayeif , Irfan Ahmad , Jameleddine Hassine

Successful software projects depend on the quality of software requirements. Creating high-quality requirements is a crucial step toward successful software development. Effective support in this area can significantly reduce development…

In this paper, we introduce Rule-Guided Feedback (RGF), a framework designed to enhance Large Language Model (LLM) performance through structured rule adherence and strategic information seeking. RGF implements a teacher-student paradigm…

Computation and Language · Computer Science 2025-03-17 Aissatou Diallo , Antonis Bikakis , Luke Dickens , Anthony Hunter , Rob Miller

The rise of Large Language Models (LLMs) in software engineering, particularly in code generation, has garnered significant attention. However, assessing the quality of AI-generated code remains a challenge due to the inherent complexity of…

Software Engineering · Computer Science 2025-02-13 Ahilan Ayyachamy Nadar Ponnusamy

Large Language Models (LLMs) have recently demonstrated remarkable performance in various Natural Language Processing (NLP) applications, such as sentiment analysis, content generation, and personalized recommendations. Despite their…

Computation and Language · Computer Science 2024-12-10 Mahaman Sanoussi Yahaya Alassan , Jessica López Espejel , Merieme Bouhandi , Walid Dahhane , El Hassane Ettifouri

It is known that user-centered approaches to requirements engineering in general lead to a better suited product for the end-users. LLM4RE provides promising approaches to support the requirements elicitation process (e.g. classification of…

Software Engineering · Computer Science 2026-05-14 Cedric Wellhausen , Laura Reinhardt , Kurt Schneider

Large Language models have achieved impressive performance in automated software engineering. Extensive efforts have been made to evaluate the abilities of code LLMs in various aspects, with an increasing number of benchmarks and evaluation…

Software Engineering · Computer Science 2025-03-25 Lezhi Ma , Shangqing Liu , Lei Bu , Shangru Li , Yida Wang , Yang Liu

This research addresses the time-consuming and error-prone nature of manual code compliance checking in Building Information Modeling (BIM) by introducing a Large Language Model (LLM)-driven approach to semi-automate this critical process.…

Software Engineering · Computer Science 2025-06-26 Soumya Madireddy , Lu Gao , Zia Din , Kinam Kim , Ahmed Senouci , Zhe Han , Yunpeng Zhang

Software specifications are essential for many Software Engineering (SE) tasks such as bug detection and test generation. Many existing approaches are proposed to extract the specifications defined in natural language form (e.g., comments)…

Software Engineering · Computer Science 2025-02-11 Danning Xie , Byungwoo Yoo , Nan Jiang , Mijung Kim , Lin Tan , Xiangyu Zhang , Judy S. Lee

Compliance at web scale poses practical challenges: each request may require a regulatory assessment. Regulatory texts (e.g., the General Data Protection Regulation, GDPR) are cross-referential and normative, while runtime contexts are…

Artificial Intelligence · Computer Science 2025-10-31 Jiseong Chung , Ronny Ko , Wonchul Yoo , Makoto Onizuka , Sungmok Kim , Tae-Wan Kim , Won-Yong Shin

Modern Code Review (MCR) is a standard in all kinds of organizations that develop software. MCR pays for itself through perceived and proven benefits in quality assurance and knowledge transfer. However, the time invest in MCR is generally…

Software Engineering · Computer Science 2021-04-20 Robert Heumüller

The advent of Large Language Models (LLMs) has ushered in a new era for design science in Information Systems, demanding a paradigm shift in tailoring LLMs design for business contexts. We propose and test a novel framework to customize…

Computers and Society · Computer Science 2024-05-15 Wen Wang , Zhenyue Zhao , Tianshu Sun

Public Code Review (PCR) is developed in the Software Question Answering (SQA) community, assisting developers in exploring high-quality and efficient review services. Current methods on PCR mainly focus on the reviewer's perspective,…

Software Engineering · Computer Science 2025-11-11 Lin Li , Xinchun Yu , Xinyu Chen , Peng Liang

Code clone detection is a critical task in software engineering, aimed at identifying duplicated or similar code fragments within or across software systems. Traditional methods often fail to capture functional equivalence, particularly for…

Software Engineering · Computer Science 2025-08-05 Yunhao Liang , Ruixuan Ying , Takuya Taniguchi , Guwen Lyu , Zhe Cui

We present \synver{}, a novel synthesis and verification framework for C programs, that deploys a Large Language Model (LLM) to search for a candidate program that satisfies the given specification. Our key idea is to impose syntactic and…

Programming Languages · Computer Science 2025-10-21 Prasita Mukherjee , Benjamin Delaware

Large Language Models (LLMs) are increasingly embedded in software engineering (SE) tools, powering applications such as code generation, automated code review, and bug triage. As these LLM-based AI for Software Engineering (AI4SE) systems…

Software Engineering · Computer Science 2026-04-28 Utku Boran Torun , Veli Karakaya , Ali Babar , Eray Tüzün

Robotic path planning problems are often NP-hard, and practical solutions typically rely on approximation algorithms with provable performance guarantees for general cases. While designing such algorithms is challenging, formally proving…

Robotics · Computer Science 2026-03-23 Zhengbang Yang , Md. Tasin Tazwar , Minghan Wei , Zhuangdi Zhu

Inspired by the recent success of large language models (LLMs) like ChatGPT, researchers start to explore the adoption of LLMs for agile hardware design, such as generating design RTL based on natural-language instructions. However, in…

Machine Learning · Computer Science 2023-11-14 Yao Lu , Shang Liu , Qijun Zhang , Zhiyao Xie

Matching person names across heterogeneous records is a core challenge in entity resolution, especially within linguistically and culturally complex environments. Variations in naming conventions, inconsistent transliteration across…

Computation and Language · Computer Science 2026-05-25 Shivam Chourasia , Hitesh Kapoor , Nilesh Patil