English
Related papers

Related papers: LineBreaker: Finding Token-Inconsistency Bugs with…

200 papers

With the rapid growth of data volume in modern telecommunication networks and the continuous expansion of their scale, maintaining high reliability has become a critical requirement. These networks support a wide range of applications and…

Networking and Internet Architecture · Computer Science 2025-12-24 Parsa Hatami , Ahmadreza Majlesara , Ali Majlesi , Babak Hossein Khalaj

We introduce a novel technique for finding real errors in programs. The technique is based on a synergy of three well-known methods: metacompilation, slicing, and symbolic execution. More precisely, we instrument a given program with a code…

Programming Languages · Computer Science 2012-01-24 Jiří Slabý , Jan Strejček , Marek Trtík

The Language Server Protocol (LSP) has revolutionized the integration of code intelligence in modern software development. There are approximately 300 LSP server implementations for various languages and 50 editors offering LSP integration.…

Software Engineering · Computer Science 2026-01-29 Hengcheng Zhu , Songqiang Chen , Valerio Terragni , Lili Wei , Yepang Liu , Jiarong Wu , Shing-Chi Cheung

Despite the advancements in software testing, bugs still plague deployed software and result in crashes in production. When debugging issues -- sometimes caused by "heisenbugs" -- there is the need to interpret core dumps and reproduce the…

Large language models (LLMs) such as GPT-5 and Gemini 3 have pushed the frontier of automated reasoning and code generation. Yet current benchmarks emphasize accuracy and output quality, neglecting a critical dimension: efficiency of token…

Computation and Language · Computer Science 2026-02-25 Zheng Du , Hao Kang , Song Han , Tushar Krishna , Ligeng Zhu

Bug reports contain the information developers need to triage and fix software bugs. However, unclear, incomplete, or ambiguous information may lead to delays and excessive manual effort spent on bug triage and resolution. In this paper, we…

Software Engineering · Computer Science 2025-04-29 Jagrit Acharya , Gouri Ginde

Deep Learning (DL) library bugs affect downstream DL applications, emphasizing the need for reliable systems. Generating valid input programs for fuzzing DL libraries is challenging due to the need for satisfying both language…

Software Engineering · Computer Science 2023-04-05 Yinlin Deng , Chunqiu Steven Xia , Chenyuan Yang , Shizhuo Dylan Zhang , Shujing Yang , Lingming Zhang

Large Language Models (LLMs) have successfully been applied to code generation tasks, raising the question of how well these models understand programming. Typical programming languages have invariances and equivariances in their semantics…

Computation and Language · Computer Science 2023-05-26 Antonio Valerio Miceli-Barone , Fazl Barez , Ioannis Konstas , Shay B. Cohen

Large language models (LLMs) have manifested strong ability to generate codes for productive activities. However, current benchmarks for code synthesis, such as HumanEval, MBPP, and DS-1000, are predominantly oriented towards introductory…

Computation and Language · Computer Science 2024-05-08 Shudan Zhang , Hanlin Zhao , Xiao Liu , Qinkai Zheng , Zehan Qi , Xiaotao Gu , Xiaohan Zhang , Yuxiao Dong , Jie Tang

Failure-inducing inputs play a crucial role in diagnosing and analyzing software bugs. Bug reports typically contain these inputs, which developers extract to facilitate debugging. Since bug reports are written in natural language, prior…

Software Engineering · Computer Science 2025-12-16 Alif Al Hasan , Subarna Saha , Mia Mohammad Imran , Tarannum Shaila Zaman

Computer manufacturers offer platforms for users to describe device faults using textual reports such as "My screen is flickering". Identifying the faulty component from the report is essential for automating tests and improving user…

Recent advances have shown that scaling test-time computation enables large language models (LLMs) to solve increasingly complex problems across diverse domains. One effective paradigm for test-time scaling (TTS) involves LLM generators…

Computation and Language · Computer Science 2026-04-15 Yefan Zhou , Austin Xu , Yilun Zhou , Janvijay Singh , Jiang Gui , Shafiq Joty

Evaluating test cases automatically generated by Large Language Models (LLMs) is a critical yet challenging task. Existing benchmarks often evaluate the exclusion ratio on large, unstructured collections of wrong codes, suffering from high…

Computation and Language · Computer Science 2026-03-26 Xianzhen Luo , Jinyang Huang , Wenzhen Zheng , Qingfu Zhu , Mingzheng Xu , Yiheng Xu , Yuantao Fan , Wanxiang Che

Code Large Language Models (Code LLMs) are being increasingly employed in real-life applications, so evaluating them is critical. While the conventional accuracy evaluates the performance of Code LLMs on a set of individual tasks, their…

Machine Learning · Computer Science 2024-02-27 Marcus J. Min , Yangruibo Ding , Luca Buratti , Saurabh Pujar , Gail Kaiser , Suman Jana , Baishakhi Ray

In this paper, we present a challenging code reasoning task: vulnerability detection. Large Language Models (LLMs) have shown promising results in natural-language and math reasoning, but state-of-the-art (SOTA) models reported only 54.5%…

Software Engineering · Computer Science 2025-01-09 Benjamin Steenhoek , Md Mahbubur Rahman , Monoshi Kumar Roy , Mirza Sanjida Alam , Hengbo Tong , Swarna Das , Earl T. Barr , Wei Le

The rapid evolution of software libraries presents a significant challenge for code generation models, which must adapt to frequent version updates while maintaining compatibility with previous versions. Existing code completion benchmarks…

Software Engineering · Computer Science 2024-11-12 Nizar Islah , Justine Gehring , Diganta Misra , Eilif Muller , Irina Rish , Terry Yue Zhuo , Massimo Caccia

False-positive bug reports represent a significant yet underexplored challenge in the development and maintenance of the Linux kernel. They occur when correct system behavior is mistakenly flagged as a defect, consuming developer effort…

Software Engineering · Computer Science 2026-05-11 Jiashuo Tian , Dong Wang , Chen Yang , Haichi Wang , Zan Wang , Junjie Chen

Ensuring semantic consistency between source code and its accompanying comments is crucial for program comprehension, effective debugging, and long-term maintainability. Comment inconsistency arises when developers modify code but neglect…

Software Engineering · Computer Science 2025-12-25 Phong Nguyen , Anh M. T. Bui , Phuong T. Nguyen

Large Language Models (LLMs) have shown remarkable capabilities in language understanding and generation. Nonetheless, it was also witnessed that LLMs tend to produce inaccurate responses to specific queries. This deficiency can be traced…

Computation and Language · Computer Science 2025-05-16 Dixuan Wang , Yanda Li , Junyuan Jiang , Zepeng Ding , Ziqin Luo , Guochao Jiang , Jiaqing Liang , Deqing Yang

This research addresses the time-consuming and error-prone nature of manual code compliance checking in Building Information Modeling (BIM) by introducing a Large Language Model (LLM)-driven approach to semi-automate this critical process.…

Software Engineering · Computer Science 2025-06-26 Soumya Madireddy , Lu Gao , Zia Din , Kinam Kim , Ahmed Senouci , Zhe Han , Yunpeng Zhang