English
Related papers

Related papers: MLOps Challenges in Multi-Organization Setup: Expe…

200 papers

People increasingly use multiple Multimodal Large Language Models (MLLMs) concurrently, selecting each based on its perceived strengths. This cross-platform practice creates coordination challenges: adapting prompts to different interfaces,…

Human-Computer Interaction · Computer Science 2026-03-30 Seunghwa Pyo , Donggun Lee , Jungwoo Rhee , Soobin Park , Youn-kyung Lim

Applying DevOps practices to machine learning system is termed as MLOps and machine learning systems evolve on new data unlike traditional systems on requirements. The objective of MLOps is to establish a connection between different…

Software Engineering · Computer Science 2024-02-21 Pir Sami Ullah Shah , Naveed Ahmad , Mirza Omer Beg

Although Machine Learning model building has become increasingly accessible due to a plethora of tools, libraries and algorithms being available freely, easy operationalization of these models is still a problem. It requires considerable…

Software Engineering · Computer Science 2024-03-05 D Panchal , P Verma , I Baran , D Musgrove , D Lu

The final goal of all industrial machine learning (ML) projects is to develop ML products and rapidly bring them into production. However, it is highly challenging to automate and operationalize ML products and thus many ML endeavors fail…

Machine Learning · Computer Science 2022-05-17 Dominik Kreuzberger , Niklas Kühl , Sebastian Hirschl

Context: Machine Learning Operations (MLOps) has emerged as a set of practices that combines development, testing, and operations to deploy and maintain machine learning applications. Objective: In this paper, we assess the benefits and…

Software Engineering · Computer Science 2024-03-21 Gabriel Araujo , Marcos Kalinowski , Markus Endler , Fabio Calefato

Seamless integration of artificial intelligence (AI) and machine learning (ML) techniques with wireless systems is a crucial step for 6G AInization. However, such integration faces challenges in terms of model functionality and lifecycle…

Networking and Internet Architecture · Computer Science 2024-10-25 Peizheng Li , Ioannis Mavromatis , Tim Farnham , Adnan Aijaz , Aftab Khan

Using artificial intelligence to manage IT operations, also known as AIOps, is a trend that has attracted a lot of interest and anticipation in recent years. The challenge in IT operations is to run steady-state operations without…

Computers and Society · Computer Science 2024-01-18 Subhadip Kumar

Machine Learning (ML) Operations (MLOps) frameworks have been conceived to support developers and AI engineers in managing the lifecycle of their ML models. While such frameworks provide a wide range of features, developers may leverage…

Software Engineering · Computer Science 2026-01-27 Fiorella Zampetti , Federico Stocchetti , Federica Razzano , Damian Andrew Tamburri , Massimiliano Di Penta

Recently, Machine Learning (ML) has become a widely accepted method for significant progress that is rapidly evolving. Since it employs computational methods to teach machines and produce acceptable answers. The significance of the Machine…

Machine Learning · Computer Science 2023-08-23 Samar Wazir , Gautam Siddharth Kashyap , Parag Saxena

Recent developments in Large Language Models (LLMs) have significantly expanded their applications across various domains. However, the effectiveness of LLMs is often constrained when operating individually in complex environments. This…

Artificial Intelligence · Computer Science 2024-05-08 Silvan Ferreira , Ivanovitch Silva , Allan Martins

Nowadays, machine learning (ML) teams have multiple concurrent ML workflows for different applications. Each workflow typically involves many experiments, iterations, and collaborative activities and commonly takes months and sometimes…

Software Engineering · Computer Science 2025-09-19 Saiful Khan , Joyraj Chakraborty , Philip Beaucamp , Niraj Bhujel , Min Chen

Organizations rely on machine learning engineers (MLEs) to operationalize ML, i.e., deploy and maintain ML pipelines in production. The process of operationalizing ML, or MLOps, consists of a continual loop of (i) data collection and…

Software Engineering · Computer Science 2022-09-20 Shreya Shankar , Rolando Garcia , Joseph M. Hellerstein , Aditya G. Parameswaran

Engineers are deploying ML models as parts of real-world systems with the upsurge of AI technologies. Real-world environments challenge the deployment of such systems because these environments produce large amounts of heterogeneous data,…

Software Engineering · Computer Science 2025-07-18 Christian Cabrera , Andrei Paleyes , Pierre Thodoroff , Neil D. Lawrence

Model deployment in machine learning has emerged as an intriguing field of research in recent years. It is comparable to the procedure defined for conventional software development. Continuous Integration and Continuous Delivery (CI/CD)…

Software Engineering · Computer Science 2022-02-09 Satvik Garg , Pradyumn Pundir , Geetanjali Rathee , P. K. Gupta , Somya Garg , Saransh Ahlawat

Safety assurance is a paramount factor in the large-scale deployment of various autonomous systems (e.g., self-driving vehicles). However, the execution of safety engineering practices and processes have been challenged by an increasing…

Software Engineering · Computer Science 2020-08-12 Umair Siddique

Artificial Intelligence (AI) has recently attracted a lot of attention, transitioning from research labs to a wide range of successful deployments in many fields, which is particularly true for Deep Learning (DL) techniques. Ultimately, DL…

Artificial Intelligence · Computer Science 2022-03-01 Lixuan Yang , Dario Rossi

Artificial intelligence (AI) and machine learning (ML) are increasingly broadly adopted in industry, However, based on well over a dozen case studies, we have learned that deploying industry-strength, production quality ML models in systems…

Machine Learning · Computer Science 2020-06-04 Jan Bosch , Ivica Crnkovic , Helena Holmström Olsson

Artificial Intelligence for IT Operations (AIOps) is an emerging interdisciplinary field arising in the intersection between the research areas of machine learning, big data, streaming analytics, and the management of IT operations. AIOps,…

Machine Learning Operations (MLOps) has become increasingly critical as more organisations move ML models into production. However, the growing landscape of MLOps solutions has introduced complexity for practitioners trying to select…

Software Engineering · Computer Science 2026-04-21 Zakkarija Micallef , Keerthiga Rajenthiram , Ilias Gerostathopoulos

Applying Machine Learning (ML) to business applications for automation usually faces difficulties when integrating diverse ML dependencies and services, mainly because of the lack of a common ML framework. In most cases, the ML models are…

Artificial Intelligence · Computer Science 2018-10-17 Shuai Zhao , Manoop Talasila , Guy Jacobson , Cristian Borcea , Syed Anwar Aftab , John F Murray