English
Related papers

Related papers: Provenance Data in the Machine Learning Lifecycle …

200 papers

In this survey, we discuss the challenges of executing scientific workflows as well as existing Machine Learning (ML) techniques to alleviate those challenges. We provide the context and motivation for applying ML to each step of the…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-10-28 Azita Nouri , Philip E. Davis , Pradeep Subedi , Manish Parashar

Machine learning has the potential to fuel further advances in data science, but it is greatly hindered by an ad hoc design process, poor data hygiene, and a lack of statistical rigor in model evaluation. Recently, these issues have begun…

Machine Learning · Computer Science 2021-08-19 Stella Biderman , Walter J. Scheirer

Getting the best performance from the ever-increasing number of hardware platforms has been a recurring challenge for data processing systems. In recent years, the advent of data science with its increasingly numerous and complex types of…

The use of machine learning (ML) methods for prediction and forecasting has become widespread across the quantitative sciences. However, there are many known methodological pitfalls, including data leakage, in ML-based science. In this…

Machine Learning · Computer Science 2022-07-15 Sayash Kapoor , Arvind Narayanan

The performance analytics domain in High Performance Computing (HPC) uses tabular data to solve regression problems, such as predicting the execution time. Existing Machine Learning (ML) techniques leverage the correlations among features…

Machine Learning · Computer Science 2024-01-22 Tarek Ramadan , Ankur Lahiry , Tanzima Z. Islam

Data provenance describes how data came to be in its present form. It includes data sources and the transformations that have been applied to them. Data provenance has many uses, from forensics and security to aiding the reproducibility of…

Cryptography and Security · Computer Science 2017-11-16 Thomas Pasquier , Xueyuan Han , Mark Goldstein , Thomas Moyer , David Eyers , Margo Seltzer , Jean Bacon

Machine Learning (ML) techniques have been rapidly adopted by smart Cyber-Physical Systems (CPS) and Internet-of-Things (IoT) due to their powerful decision-making capabilities. However, they are vulnerable to various security and…

Cryptography and Security · Computer Science 2021-01-08 Muhammad Shafique , Mahum Naseer , Theocharis Theocharides , Christos Kyrkou , Onur Mutlu , Lois Orosa , Jungwook Choi

In the last couple of years we have witnessed an enormous increase of machine learning (ML) applications. More and more program functions are no longer written in code, but learnt from a huge amount of data samples using an ML algorithm.…

Software Engineering · Computer Science 2022-09-07 Peter Kriens , Tim Verbelen

Efficient and timely calculations of Machine Learning (ML) algorithms are essential for emerging technologies like autonomous driving, the Internet of Things (IoT), and edge computing. One of the primary ML algorithms used in such systems…

Hardware Architecture · Computer Science 2023-08-11 Christopher A. Metz

Particle track reconstruction is the most computationally intensive process in nuclear physics experiments. Traditional algorithms use a combinatorial approach that exhaustively tests track measurements ("hits") to identify those that form…

Computer Vision and Pattern Recognition · Computer Science 2022-04-29 Polykarpos Thomadakis , Angelos Angelopoulos , Gagik Gavalian , Nikos Chrisochoides

Representation learning is an important step in the machine learning pipeline. Given the current biological sequencing data volume, learning an explicit representation is prohibitive due to the dimensionality of the resulting feature…

Machine Learning · Computer Science 2023-04-04 Sarwan Ali , Usama Sardar , Murray Patterson , Imdad Ullah Khan

Machine learning is an established and frequently used technique in industry and academia but a standard process model to improve success and efficiency of machine learning applications is still missing. Project organizations and machine…

Nowadays, software analytics tools using machine learning (ML) models to, for example, predict the risk of a code change are well established. However, as the goals of a project shift over time, and developers and their habits change, the…

Software Engineering · Computer Science 2024-05-06 Doriane Olewicki , Sarra Habchi , Mathieu Nayrolles , Mojtaba Faramarzi , Sarath Chandar , Bram Adams

Machine learning (ML) has seen a significant surge and uptake across many diverse applications. The high flexibility, adaptability and computing capabilities it provides extends traditional approaches used in multiple fields including…

Networking and Internet Architecture · Computer Science 2020-10-23 Huiling Jiang , Qing Li , Yong Jiang , Gengbiao Shen , Richard Sinnott , Chen Tian , Mingwei Xu

Specifying data requirements for machine learning (ML) software systems remains a challenge in requirements engineering (RE). This vision paper explores causal modelling as an RE activity that allows the systematic integration of prior…

Software Engineering · Computer Science 2025-04-24 Hans-Martin Heyn , Yufei Mao , Roland Weiss , Eric Knauss

The emergence and continued reliance on the Internet and related technologies has resulted in the generation of large amounts of data that can be made available for analyses. However, humans do not possess the cognitive capabilities to…

Machine Learning · Computer Science 2021-01-12 MohammadNoor Injadat , Abdallah Moubayed , Ali Bou Nassif , Abdallah Shami

The integration of renewable and distributed energy resources reshapes modern power systems, challenging conventional protection schemes. This scoping review synthesizes recent literature on machine learning (ML) applications in power…

Machine Learning · Computer Science 2025-10-21 Julian Oelhaf , Georg Kordowich , Mehran Pashaei , Christian Bergler , Andreas Maier , Johann Jäger , Siming Bayer

Machine learning (ML) is about computational methods that enable machines to learn concepts from experience. In handling a wide variety of experience ranging from data instances, knowledge, constraints, to rewards, adversaries, and lifelong…

Machine Learning · Computer Science 2023-01-11 Zhiting Hu , Eric P. Xing

Study reproducibility is essential to corroborate, build on, and learn from the results of scientific research but is notoriously challenging in bioinformatics, which often involves large data sets and complex analytic workflows involving…

Quantitative Methods · Quantitative Biology 2023-05-22 Christopher R. Keefe , Matthew R. Dillon , Chloe Herman , Mary Jewell , Colin V. Wood , Evan Bolyen , J. Gregory Caporaso

Machine learning (ML) has been widely used in the literature to automate software engineering tasks. However, ML outcomes may be sensitive to randomization in data sampling mechanisms and learning procedures. To understand whether and how…

Software Engineering · Computer Science 2020-12-16 Cynthia C. S. Liem , Annibale Panichella