English
Related papers

Related papers: Contrasting the Hyperparameter Tuning Impact Acros…

200 papers

Multistage stochastic programming provides a modeling framework for sequential decision-making problems that involve uncertainty. One typically overlooked aspect of this methodology is how uncertainty is incorporated into modeling.…

Optimization and Control · Mathematics 2021-09-24 Juyoung Wang , Mucahit Cevik , Merve Bodur

The performance of modern reinforcement learning algorithms critically relies on tuning ever-increasing numbers of hyperparameters. Often, small changes in a hyperparameter can lead to drastic changes in performance, and different…

Machine Learning · Computer Science 2025-02-05 Jacob Adkins , Michael Bowling , Adam White

Machine Learning approaches are good in solving problems that have less information. In most cases, the software domain problems characterize as a process of learning that depend on the various circumstances and changes accordingly. A…

Software Engineering · Computer Science 2015-06-26 Saiqa Aleem , Luiz Fernando Capretz , Faheem Ahmed

Deep learning (DL)-based code completion tools have transformed software development by enabling advanced code generation. These tools leverage models trained on vast amounts of code from numerous repositories, capturing general coding…

Software Engineering · Computer Science 2025-03-19 Alessandro Giagnorio , Alberto Martin-Lopez , Gabriele Bavota

Models need to be trained with privacy-preserving learning algorithms to prevent leakage of possibly sensitive information contained in their training data. However, canonical algorithms like differentially private stochastic gradient…

Machine Learning · Computer Science 2022-10-06 Yannis Cattan , Christopher A. Choquette-Choo , Nicolas Papernot , Abhradeep Thakurta

Software fault-proneness prediction is an active research area, with many factors affecting prediction performance extensively studied. However, the impact of the learning approach (i.e., the specifics of the data used for training and the…

Software Engineering · Computer Science 2022-07-13 Mohammad Jamil Ahmad , Katerina Goseva-Popstojanova , Robyn R. Lutz

Large language models (LLMs) are increasingly integrated into real-time machine learning applications, where safeguarding user privacy is paramount. Traditional differential privacy mechanisms often struggle to balance privacy and accuracy,…

Cryptography and Security · Computer Science 2024-10-04 Jessica Smith , David Williams , Emily Brown

In the context of Just-In-Time Software Defect Prediction (JIT-SDP), Concept drift (CD) can occur due to changes in the software development process, the complexity of the software, or changes in user behavior that may affect the stability…

Software Engineering · Computer Science 2023-05-29 Zeynab Chitsazian , Saeed Sedighian Kashi , Amin Nikanjam

Dataset pruning aims to select a subset of a dataset for efficient model training. While data efficiency in natural language processing has primarily focused on within-corpus scenarios during model pre-training, efficient dataset pruning…

Computation and Language · Computer Science 2025-01-07 Binh-Nguyen Nguyen , Yang He

Defect prediction can be a powerful tool to guide the use of quality assurance resources. However, while lots of research covered methods for defect prediction as well as methodological aspects of defect prediction research, the actual cost…

Software Engineering · Computer Science 2019-12-16 Steffen Herbold

The size of a software artifact influences the software quality and impacts the development process. In industry, when software size exceeds certain thresholds, memory errors accumulate and development tools might not be able to cope…

Software Engineering · Computer Science 2017-08-10 Jan Schroeder , Christian Berger , Alessia Knauss , Harri Preenja , Mohammad Ali , Miroslaw Staron , Thomas Herpel

In semidefinite programming (SDP), a number of pre-processing techniques have been developed including chordal-completion procedures, which reduce the dimension of individual constraints by exploiting sparsity therein, and facial reduction,…

Optimization and Control · Mathematics 2020-09-22 Vyacheslav Kungurtsev , Jakub Marecek

Finely tuning MPI applications and understanding the influence of keyparameters (number of processes, granularity, collective operationalgorithms, virtual topology, and process placement) is critical toobtain good performance on…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-01-10 Tom Cornebize , Arnaud Legrand

Several studies point out different causes of performance degradation in supervised machine learning. Problems such as class imbalance, overlapping, small-disjuncts, noisy labels, and sparseness limit accuracy in classification algorithms.…

Machine Learning · Computer Science 2020-04-17 Gustavo A. Valencia-Zapata , Carolina Gonzalez-Canas , Michael G. Zentner , Okan Ersoy , Gerhard Klimeck

Context: There is considerable diversity in the range and design of computational experiments to assess classifiers for software defect prediction. This is particularly so, regarding the choice of classifier performance metrics.…

Software Engineering · Computer Science 2020-03-04 Jingxiu Yao , Martin Shepperd

Software defect prediction using code metrics has been extensively researched over the past five decades. However, prediction harnessing non-software metrics is under-researched. Considering that the root cause of software defects is often…

Software Engineering · Computer Science 2025-08-07 Carlos Andrés Ramírez Cataño , Makoto Itoh

Strong empirical evidence that one machine-learning algorithm A outperforms another one B ideally calls for multiple trials optimizing the learning pipeline over sources of variation such as data sampling, data augmentation, parameter…

Recent developments have underscored the critical role of \textit{differential privacy} (DP) in safeguarding individual data for training machine learning models. However, integrating DP oftentimes incurs significant model performance…

Machine Learning · Computer Science 2024-03-06 Zihao Wang , Rui Zhu , Dongruo Zhou , Zhikun Zhang , John Mitchell , Haixu Tang , XiaoFeng Wang

Differential Privacy (DP) provides a formal framework for training machine learning models with individual example level privacy. In the field of deep learning, Differentially Private Stochastic Gradient Descent (DP-SGD) has emerged as a…

Machine Learning · Computer Science 2022-05-24 Harsh Mehta , Abhradeep Thakurta , Alexey Kurakin , Ashok Cutkosky

In the recent years, various gradient descent algorithms including the methods of gradient descent, gradient descent with momentum, adaptive gradient (AdaGrad), root-mean-square propagation (RMSProp) and adaptive moment estimation (Adam)…

Machine Learning · Computer Science 2024-09-19 Abel C. H. Chen