English
Related papers

Related papers: Kafka-ML: connecting the data stream with ML/AI fr…

200 papers

Machine Learning (ML) will play a significant role in the success of the upcoming High-Luminosity LHC (HL-LHC) program at CERN. An unprecedented amount of data at the exascale will be collected by LHC experiments in the next decade, and…

High Energy Physics - Experiment · Physics 2020-12-14 Valentin Kuznetsov , Luca Giommi , Daniele Bonacorsi

Applied machine learning (ML) has rapidly spread throughout the physical sciences; in fact, ML-based data analysis and experimental decision-making has become commonplace. We suggest a shift in the conversation from proving that ML can be…

Materials Science · Physics 2021-12-21 Naohiro Fujinuma , Brian L. DeCost , Jason Hattrick-Simpers , Samuel E. Lofland

The emergence and continued reliance on the Internet and related technologies has resulted in the generation of large amounts of data that can be made available for analyses. However, humans do not possess the cognitive capabilities to…

Machine Learning · Computer Science 2021-01-12 MohammadNoor Injadat , Abdallah Moubayed , Ali Bou Nassif , Abdallah Shami

Large Language Models (LLMs) have become central in academia and industry, raising concerns about privacy, transparency, and misuse. A key issue is the trustworthiness of proprietary models, with open-sourcing often proposed as a solution.…

Software Engineering · Computer Science 2025-01-29 Domen Vake , Bogdan Šinik , Jernej Vičič , Aleksandar Tošić

The automated machine learning (AutoML) process can require searching through complex configuration spaces of not only machine learning (ML) components and their hyperparameters but also ways of composing them together, i.e. forming ML…

Machine Learning · Computer Science 2022-08-10 David Jacob Kedziora , Tien-Dung Nguyen , Katarzyna Musial , Bogdan Gabrys

Machine learning (ML) applications that learn from data are increasingly used to automate impactful decisions. Unfortunately, these applications often fall short of adequately managing critical data and complying with upcoming regulations.…

Databases · Computer Science 2024-09-17 Sebastian Schelter , Stefan Grafberger

Software engineering of network-centric Artificial Intelligence (AI) and Internet of Things (IoT) enabled Cyber-Physical Systems (CPS) and services, involves complex design and validation challenges. In this paper, we propose a novel…

Software Engineering · Computer Science 2022-07-12 Armin Moin , Moharram Challenger , Atta Badii , Stephan Günnemann

Driven by the rapid ascent of artificial intelligence (AI), organizations are at the epicenter of a seismic shift, facing a crucial question: How can AI be successfully integrated into existing operations? To help answer it, manage…

Software Engineering · Computer Science 2024-02-09 Tamen Jadad-Garcia , Alejandro R. Jadad

Machine learning algorithms have become indispensable in today's world. They support and accelerate the way we make decisions based on the data at hand. This acceleration means that data structures that were valid at one moment could no…

Machine Learning · Computer Science 2025-02-11 Cedric Kulbach , Lucas Cazzonelli , Hoang-Anh Ngo , Minh-Huong Le-Nguyen , Albert Bifet

Machine learning (ML) and AI toolboxes such as scikit-learn or Weka are workhorses of contemporary data scientific practice -- their central role being enabled by usable yet powerful designs that allow to easily specify, train and validate…

Software Engineering · Computer Science 2021-01-14 Franz J. Király , Markus Löning , Anthony Blaom , Ahmed Guecioueur , Raphael Sonabend

Data engineering is one of the fastest-growing fields within machine learning (ML). As ML becomes more common, the appetite for data grows more ravenous. But ML requires more data than individual teams of data engineers can readily produce,…

Machine Learning · Computer Science 2021-02-24 Vijay Janapa Reddi , Greg Diamos , Pete Warden , Peter Mattson , David Kanter

The data available in the network traffic fromany Government building contains a significant amount ofinformation. An analysis of the traffic can yield insightsand situational understanding about what is happening inthe building. However,…

Cryptography and Security · Computer Science 2019-10-15 D. Verma , S. Calo

[Context] Machine learning (ML)-enabled systems are present in our society, driving significant digital transformations. The dynamic nature of ML development, characterized by experimental cycles and rapid changes in data, poses challenges…

Software Engineering · Computer Science 2025-06-27 Lucas Romao , Hugo Villamizar , Romeu Oliveira , Silvio Alonso , Marcos Kalinowski

Modern machine learning systems use models trained on ever-growing corpora. Typically, metadata such as ownership, access control, or licensing information is ignored during training. Instead, to mitigate privacy risks, we rely on generic…

In this paper, we present our vision of differentiable ML pipelines called DiffML to automate the construction of ML pipelines in an end-to-end fashion. The idea is that DiffML allows to jointly train not just the ML model itself but also…

Databases · Computer Science 2022-07-06 Benjamin Hilprecht , Christian Hammacher , Eduardo Reis , Mohamed Abdelaal , Carsten Binnig

Efficient management of traffic flow in urban environments presents a significant challenge, exacerbated by dynamic changes and the sheer volume of data generated by modern transportation networks. Traditional centralized traffic management…

Machine Learning · Computer Science 2025-01-29 Bob Johnson , Michael Geller

The effective utilization at scale of complex machine learning (ML) techniques for HEP use cases poses several technological challenges, most importantly on the actual implementation of dedicated end-to-end data pipelines. A solution to…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-06-17 Matteo Migliorini , Riccardo Castellotti , Luca Canali , Marco Zanetti

Machine learning (ML) has become a go-to solution for improving how we use, experience, and interact with technology (and the world around us). Unfortunately, studies have repeatedly shown that machine learning technologies may not provide…

Machine Learning · Computer Science 2025-05-15 Michelle Nashla Turcios , Alicia E. Boyd , Angela D. R. Smith , Brittany Johnson

The recent development of large language models (LLMs) with multi-billion parameters, coupled with the creation of user-friendly application programming interfaces (APIs), has paved the way for automatically generating and executing code in…

Artificial Intelligence · Computer Science 2023-12-14 Alejandro Duque , Abdullah Syed , Kastan V. Day , Matthew J. Berry , Daniel S. Katz , Volodymyr V. Kindratenko

This systematic review examines how machine learning (ML) and deep learning (DL) have transformed forecasting, decision-making, and financial modelling, promoting innovation and efficiency in financial systems. Following PRISMA 2020…

General Mathematics · Mathematics 2026-01-26 Soufiane El Amine El Alami , Abderazzak Mouiha , Abdelatif Hafid , Ahmed El Hilali Alaoui