English
Related papers

Related papers: On Leakage in Machine Learning Pipelines

200 papers

Over the past two decades, Machine Learning (ML) techniques have been increasingly utilized for the purpose of predicting outcomes in sport. In this paper, we provide a review of studies that have used ML for predicting results in team…

Machine Learning · Computer Science 2022-04-19 Rory Bunker , Teo Susnjak

Machine learning models leak information about their training data every time they reveal a prediction. This is problematic when the training data needs to remain private. Private prediction methods limit how much information about the…

Machine Learning · Computer Science 2020-07-13 Laurens van der Maaten , Awni Hannun

The open-world deployment of Machine Learning (ML) algorithms in safety-critical applications such as autonomous vehicles needs to address a variety of ML vulnerabilities such as interpretability, verifiability, and performance limitations.…

Machine Learning · Computer Science 2022-03-09 Sina Mohseni , Haotao Wang , Zhiding Yu , Chaowei Xiao , Zhangyang Wang , Jay Yadawa

Large language models (LLMs) have recently been applied to forecasting tasks, with some works claiming these systems match or exceed human performance. In this paper, we argue that, as a community, we should be careful about such…

Machine Learning · Computer Science 2025-06-03 Daniel Paleka , Shashwat Goel , Jonas Geiping , Florian Tramèr

Machine learning has been increasingly applied in climate modeling on system emulation acceleration, data-driven parameter inference, forecasting, and knowledge discovery, addressing challenges such as physical consistency, multi-scale…

Machine Learning (ML) models are increasingly integrated into safety-critical systems, such as autonomous vehicle platooning, to enable real-time decision-making. However, their inherent imperfection introduces a new class of failure:…

Artificial Intelligence · Computer Science 2025-06-10 Razieh Arshadizadeh , Mahmoud Asgari , Zeinab Khosravi , Yiannis Papadopoulos , Koorosh Aslansefat

Machine learning (ML) is a rapidly growing area of research in the field of particle physics, with a vast array of applications at the CERN LHC. ML has changed the way particle physicists conduct searches and measurements as a versatile…

High Energy Physics - Experiment · Physics 2024-10-01 Javier M. Duarte

This paper considers the problem of estimating the information leakage of a system in the black-box scenario. It is assumed that the system's internals are unknown to the learner, or anyway too complicated to analyze, and the only available…

Cryptography and Security · Computer Science 2021-11-29 Marco Romanelli , Konstantinos Chatzikokolakis , Catuscia Palamidessi , Pablo Piantanida

In this big data era, the use of large dataset in conjunction with machine learning (ML) has been increasingly popular in both industry and academia. In recent times, the field of materials science is also undergoing a big data revolution,…

Materials Science · Physics 2023-09-27 Sue Sin Chong , Yi Sheng Ng , Hui-Qiong Wang , Jin-Cheng Zheng

Machine learning and AI have been recently embraced by many companies. Machine Learning Operations, (MLOps), refers to the use of continuous software engineering processes, such as DevOps, in the deployment of machine learning models to…

Software Engineering · Computer Science 2024-10-01 Abhijit Chakraborty , Suddhasvatta Das , Kevin Gary

Pointwise maximal leakage (PML) is an operationally meaningful privacy measure that quantifies the amount of information leaking about a secret $X$ to a single outcome of a related random variable $Y$. In this paper, we extend the notion of…

Information Theory · Computer Science 2023-04-18 Sara Saeidian , Giulia Cervia , Tobias J. Oechtering , Mikael Skoglund

Machine learning (ML) techniques are increasingly prevalent in education, from their use in predicting student dropout, to assisting in university admissions, and facilitating the rise of MOOCs. Given the rapid growth of these novel uses,…

Artificial Intelligence · Computer Science 2022-09-09 Lydia T. Liu , Serena Wang , Tolani Britton , Rediet Abebe

Machine-learning models contain information about the data they were trained on. This information leaks either through the model itself or through predictions made by the model. Consequently, when the training data contains sensitive…

Machine Learning · Computer Science 2021-08-25 Awni Hannun , Chuan Guo , Laurens van der Maaten

Machine Learning models are being utilized extensively to drive recommender systems, which is a widely explored topic today. This is especially true of the music industry, where we are witnessing a surge in growth. Besides a large chunk of…

Information Retrieval · Computer Science 2023-09-26 Rahul Singh , Pranav Kanuparthi

ML models have errors when used for predictions. The errors are unknown but can be quantified by model uncertainty. When multiple ML models are trained using the same training points, their model uncertainties may be statistically…

Machine Learning · Statistics 2025-09-23 Xiaoping Du

The Machine learning (ML) is a rapidly evolving field of technology that has the potential to greatly impact society in a variety of ways. However, there are also concerns about the potential negative effects of ML on society, such as job…

Computers and Society · Computer Science 2024-04-17 Md Kamrul Hossain Siam , Manidipa Bhattacharjee , Shakik Mahmud , Md. Saem Sarkar , Md. Masud Rana

Machine learning (ML) is finding its way into safety-critical systems (SCS). Current safety standards and practice were not designed to cope with ML techniques, and it is difficult to be confident that SCSs that contain ML components are…

Machine Learning · Computer Science 2021-11-30 Mehrnoosh Askarpour , Alan Wassyng , Mark Lawford , Richard Paige , Zinovy Diskin

Hyperparameter optimization constitutes a large part of typical modern machine learning workflows. This arises from the fact that machine learning methods and corresponding preprocessing steps often only yield optimal performance when…

Machine learning (ML)-based solutions are rapidly changing the landscape of many fields, including structural engineering. Despite their promising performance, these approaches are usually only demonstrated as proof-of-concept in structural…

Machine Learning · Computer Science 2025-08-20 Mohsen Zaker Esteghamati , Brennan Bean , Henry V. Burton , M. Z. Naser

In today's data-driven world, the proliferation of publicly available information raises security concerns due to the information leakage (IL) problem. IL involves unintentionally exposing sensitive information to unauthorized parties via…

Machine Learning · Statistics 2025-06-02 Pritha Gupta , Marcel Wever , Eyke Hüllermeier