English
Related papers

Related papers: Effective Random Test Generation for Deep Learning…

200 papers

Automated test generation is crucial for ensuring the reliability and robustness of software applications while at the same time reducing the effort needed. While significant progress has been made in test generation research, generating…

Software Engineering · Computer Science 2025-01-30 Shaker Mahmud Khandaker , Fitsum Kifetew , Davide Prandi , Angelo Susi

Automated unit test generation using large language models (LLMs) holds great promise but often struggles with generating tests that are both correct and maintainable in real-world projects. This paper presents KTester, a novel framework…

Software Engineering · Computer Science 2026-02-09 Anji Li , Mingwei Liu , Zhenxi Chen , Zheng Pei , Zike Li , Dekun Dai , Yanlin Wang , Zibin Zheng

Optimizing deep learning models is generally performed in two steps: (i) high-level graph optimizations such as kernel fusion and (ii) low level kernel optimizations such as those found in vendor libraries. This approach often leaves…

Machine Learning · Computer Science 2021-03-08 Pratik Fegade , Tianqi Chen , Phillip B. Gibbons , Todd C. Mowry

Deep learning (DL) compilers are core infrastructure in modern DL systems, offering flexibility and scalability beyond vendor-specific libraries. This work uncovers a fundamental vulnerability in their design: can an official, unmodified…

Cryptography and Security · Computer Science 2025-10-28 Simin Chen , Jinjun Peng , Yixin He , Junfeng Yang , Baishakhi Ray

Among the machine learning applications to business, recommender systems would take one of the top places when it comes to success and adoption. They help the user in accelerating the process of search while helping businesses maximize…

Information Retrieval · Computer Science 2019-07-23 Kiran Rama , Pradeep Kumar , Bharat Bhasker

As deep learning based models are increasingly being used for information retrieval (IR), a major challenge is to ensure the availability of test collections for measuring their quality. Test collections are generated based on pooling…

Information Retrieval · Computer Science 2020-04-29 Emine Yilmaz , Nick Craswell , Bhaskar Mitra , Daniel Campos

Generating tests that can reveal performance issues in large and complex software systems within a reasonable amount of time is a challenging task. On one hand, there are numerous combinations of input data values to explore. On the other…

Software Engineering · Computer Science 2021-04-07 Ali Sedaghatbaf , Mahshid Helali Moghadam , Mehrdad Saadatmand

Writing tests is a time-consuming yet essential task during software development. We propose to leverage recent advances in deep learning for text and code generation to assist developers in writing tests. We formalize the novel task of…

Software Engineering · Computer Science 2023-03-08 Pengyu Nie , Rahul Banerjee , Junyi Jessy Li , Raymond J. Mooney , Milos Gligoric

Large language models (LLMs) are a new and powerful tool for a wide span of applications involving natural language and demonstrate impressive code generation abilities. The goal of this work is to automatically generate tests and use these…

Artificial Intelligence · Computer Science 2024-03-12 Christian Munley , Aaron Jarmusch , Sunita Chandrasekaran

The main goal of this research is to produce a useful software for United Nations (UN), that could help to speed up the process of qualifying the UN documents following the Sustainable Development Goals (SDGs) in order to monitor the…

Information Retrieval · Computer Science 2021-09-14 Francesco Sovrano , Monica Palmirani , Fabio Vitali

Deep learning (DL) defines a new data-driven programming paradigm that constructs the internal system logic of a crafted neuron network through a set of training data. We have seen wide adoption of DL in many safety-critical scenarios.…

Software Engineering · Computer Science 2018-08-16 Lei Ma , Felix Juefei-Xu , Fuyuan Zhang , Jiyuan Sun , Minhui Xue , Bo Li , Chunyang Chen , Ting Su , Li Li , Yang Liu , Jianjun Zhao , Yadong Wang

Requirements elicitation is an important phase of any software project: the errors in requirements are more expensive to fix than the errors introduced at later stages of software life cycle. Nevertheless, many projects do not devote…

Software Engineering · Computer Science 2021-05-18 Maria Naumcheva

Test collections play a vital role in evaluation of information retrieval (IR) systems. Obtaining a diverse set of user queries for test collection construction can be challenging, and acquiring relevance judgments, which indicate the…

Information Retrieval · Computer Science 2024-05-14 Hossein A. Rahmani , Nick Craswell , Emine Yilmaz , Bhaskar Mitra , Daniel Campos

Verifiers play a crucial role in large language model (LLM) reasoning, needed by post-training techniques such as reinforcement learning. However, reliable verifiers are hard to get for difficult coding problems, because a well-disguised…

Computation and Language · Computer Science 2025-06-02 Zhongmou He , Yee Man Choi , Kexun Zhang , Jiabao Ji , Junting Zhou , Dejia Xu , Ivan Bercovich , Aidan Zhang , Lei Li

Compiler pass selection and phase ordering present a significant challenge in achieving optimal program performance, particularly for objectives like code size reduction. Standard compiler heuristics offer general applicability but often…

Software Engineering · Computer Science 2025-10-16 Haolin Pan , Chao Zha , Jinyuan Dong , Mingjie Xing , Yanjun Wu

Generating effective test inputs for a software system requires that these inputs be valid, as they will otherwise be rejected without reaching actual functionality. In the absence of a specification for the input language, common test…

Software Engineering · Computer Science 2025-03-12 Leon Bettscheider , Andreas Zeller

Interest in applying Artificial Intelligence (AI) techniques to compiler optimizations is increasing rapidly, but compiler research has a high entry barrier. Unlike in other domains, compiler and AI researchers do not have access to the…

By July 2025, smart contracts collectively manage roughly $120 billion in assets. With Solidity remaining the dominant language for smart contract development, the correctness of Solidity compilers has become critically important. However,…

Programming Languages · Computer Science 2025-12-03 Haoyang Ma , Alastair F. Donaldson , Qingchao Shen , Yongqiang Tian , Junjie Chen , Shing-Chi Cheung

The quality of software is closely tied to the effectiveness of the tests it undergoes. Manual test writing, though crucial for bug detection, is time-consuming, which has driven significant research into automated test case generation.…

Software Engineering · Computer Science 2025-03-21 Wendkûuni C. Ouédraogo , Laura Plein , Kader Kaboré , Andrew Habib , Jacques Klein , David Lo , Tegawendé F. Bissyandé

Large language models (LLMs) enable state-of-the-art semantic capabilities to be added to software systems such as semantic search of unstructured documents and text generation. However, these models are computationally expensive. At scale,…

Software Engineering · Computer Science 2024-01-17 Zafaryab Rasool , Scott Barnett , David Willie , Stefanus Kurniawan , Sherwin Balugo , Srikanth Thudumu , Mohamed Abdelrazek