English
Related papers

Related papers: CIDR: A Large-Scale Industrial Source Code Dataset…

200 papers

We would like to present the idea of our Continuous Defect Prediction (CDP) research and a related dataset that we created and share. Our dataset is currently a set of more than 11 million data rows, representing files involved in…

Software Engineering · Computer Science 2017-06-23 Lech Madeyski , Marcin Kawalerowicz

SciLaD is a novel, large-scale dataset of scientific language constructed entirely using open-source frameworks and publicly available data sources. It comprises a curated English split containing over 10 million scientific publications and…

According to GitGuardian's monitoring of public GitHub repositories, the exposure of secrets (API keys and other credentials) increased two-fold in 2021 compared to 2020, totaling more than six million secrets. However, no benchmark dataset…

Cryptography and Security · Computer Science 2023-03-14 Setu Kumar Basak , Lorenzo Neil , Bradley Reaves , Laurie Williams

Code retrieval is essential in modern software development, as it boosts code reuse and accelerates debugging. However, current benchmarks primarily emphasize functional relevance while neglecting critical dimensions of software quality.…

Software Engineering · Computer Science 2025-08-28 Jiahui Geng , Fengyu Cai , Shaobo Cui , Qing Li , Liangwei Chen , Chenyang Lyu , Haonan Li , Derui Zhu , Walter Pretschner , Heinz Koeppl , Fakhri Karray

This paper introduces IGGA, a dataset of 160 industry guidelines and policy statements for the use of Generative AIs (GAIs) and Large Language Models (LLMs) in industry and workplace settings, collected from official company websites, and…

Computers and Society · Computer Science 2025-03-19 Junfeng Jiao , Saleh Afroogh , Kevin Chen , David Atkinson , Amit Dhurandhar

Large-scale code datasets have acquired an increasingly central role in software engineering (SE) research. This is the result of (i) the success of the mining software repositories (MSR) community, that pushed the standards of empirical…

Software Engineering · Computer Science 2024-09-30 Ozren Dabić , Rosalia Tufano , Gabriele Bavota

Despite the substantial success of Information Retrieval (IR) in various NLP tasks, most IR systems predominantly handle queries and corpora in natural language, neglecting the domain of code retrieval. Code retrieval is critically…

Information Retrieval · Computer Science 2025-06-09 Xiangyang Li , Kuicai Dong , Yi Quan Lee , Wei Xia , Hao Zhang , Xinyi Dai , Yasheng Wang , Ruiming Tang

AI is transforming pharmaceutical search, where traditional systems struggle with multimodal content and manual curation. Finder is a scalable AI-powered framework that unifies retrieval across text, images, audio, and video using hybrid…

Information Retrieval · Computer Science 2026-03-18 Suyash Mishra , Srikanth Patil , Satyanarayan Pati , Sagar Sahu , Baddu Narendra

Requirements quality is central to successful software and systems engineering. Empirical research on quality defects in natural language requirements relies heavily on datasets, ideally as realistic and representative as possible. However,…

Software Engineering · Computer Science 2025-08-13 Henning Femmer , Frank Houdek , Max Unterbusch , Andreas Vogelsang

Phabricator is a modern code collaboration tool used by popular projects like FreeBSD and Mozilla. However, unlike the other well-known code review environments, such as Gerrit or GitHub, there is no readily accessible public code review…

Software Engineering · Computer Science 2022-12-01 Gunnar Kudrjavets , Nachiappan Nagappan , Ayushi Rastogi

Constructing scientific multimodal document reasoning datasets for foundation model training involves an inherent trade-off among scale, faithfulness, and realism. To address this challenge, we introduce the synthesize-and-reground…

Computation and Language · Computer Science 2026-04-30 Ziyu Chen , Yilun Zhao , Chengye Wang , Rilyn Han , Manasi Patwardhan , Arman Cohan

GitHub hosts hundreds of millions of code repositories written in hundreds of different programming languages. In addition to its hosting services, GitHub provides data and insights into code, such as vulnerability analysis and code…

Software Engineering · Computer Science 2022-06-22 Patrick Thomson , Rob Rix , Nicolas Wu , Tom Schrijvers

Machine learning (ML) has gained much attention and been incorporated into our daily lives. While there are numerous publicly available ML projects on open source platforms such as GitHub, there have been limited attempts in filtering those…

Software Engineering · Computer Science 2023-03-14 Ratnadira Widyasari , Zhou Yang , Ferdian Thung , Sheng Qin Sim , Fiona Wee , Camellia Lok , Jack Phan , Haodi Qi , Constance Tan , Qijin Tay , David Lo

The advancement of machine learning for compiler optimization, particularly within the polyhedral model, is constrained by the scarcity of large-scale, public performance datasets. This data bottleneck forces researchers to undertake costly…

Programming Languages · Computer Science 2025-12-30 Massinissa Merouani , Afif Boudaoud , Riyadh Baghdadi

AI coding agents are rapidly transforming software engineering by performing tasks such as feature development, debugging, and testing. Despite their growing impact, the research community lacks a comprehensive dataset capturing how these…

Software Engineering · Computer Science 2026-02-11 Hao Li , Haoxiang Zhang , Ahmed E. Hassan

Dockerfiles are one of the most prevalent kinds of DevOps artifacts used in industry. Despite their prevalence, there is a lack of sophisticated semantics-aware static analysis of Dockerfiles. In this paper, we introduce a dataset of…

Software Engineering · Computer Science 2020-03-31 Jordan Henkel , Christian Bird , Shuvendu K. Lahiri , Thomas Reps

The rapid development of large language models has revolutionized code intelligence in software development. However, the predominance of closed-source models has restricted extensive research and development. To address this, we introduce…

Software Engineering · Computer Science 2024-01-29 Daya Guo , Qihao Zhu , Dejian Yang , Zhenda Xie , Kai Dong , Wentao Zhang , Guanting Chen , Xiao Bi , Y. Wu , Y. K. Li , Fuli Luo , Yingfei Xiong , Wenfeng Liang

Efficient code retrieval is critical for developer productivity, yet existing benchmarks largely focus on Python and rarely stress-test robustness beyond superficial lexical cues. To address the gap, we introduce an automated pipeline for…

Software Engineering · Computer Science 2026-03-06 Kaicheng Wang , Liyan Huang , Weike Fang , Weihang Wang

Large language models (LMs) of code have recently shown tremendous promise in completing code and synthesizing code from natural language descriptions. However, the current state-of-the-art code LMs (e.g., Codex (Chen et al., 2021)) are not…

Programming Languages · Computer Science 2022-05-05 Frank F. Xu , Uri Alon , Graham Neubig , Vincent J. Hellendoorn

Agile software development is nowadays a widely adopted practise in both open-source and industrial software projects. Agile teams typically heavily rely on issue management tools to document new issues and keep track of outstanding ones,…

Software Engineering · Computer Science 2022-02-03 Vali Tawosi , Afnan Al-Subaihin , Rebecca Moussa , Federica Sarro