English
Related papers

Related papers: Constructing Large-Scale Real-World Benchmark Data…

200 papers

The integration of Artificial Intelligence (AI) into IT Operations Management (ITOM), commonly referred to as AIOps, offers substantial potential for automating workflows, enhancing efficiency, and supporting informed decision-making.…

Software Engineering · Computer Science 2025-01-24 Arthur Vitui , Tse-Hsun Chen

AI for IT Operations (AIOps) is transforming how organizations manage complex software systems by automating anomaly detection, incident diagnosis, and remediation. Modern AIOps solutions increasingly rely on autonomous LLM-based agents to…

Cryptography and Security · Computer Science 2025-08-28 Dario Pasquini , Evgenios M. Kornaropoulos , Giuseppe Ateniese , Omer Akgul , Athanasios Theocharis , Petros Efstathopoulos

The rapid growth in the use of Large Language Models (LLMs) and AI Agents as part of software development and deployment is revolutionizing the information technology landscape. While code generation receives significant attention, a…

Artificial Intelligence (AI) has recently attracted a lot of attention, transitioning from research labs to a wide range of successful deployments in many fields, which is particularly true for Deep Learning (DL) techniques. Ultimately, DL…

Artificial Intelligence · Computer Science 2022-03-01 Lixuan Yang , Dario Rossi

Artificial Intelligence for IT Operations (AIOps) describes the process of maintaining and operating large IT systems using diverse AI-enabled methods and tools for, e.g., anomaly detection and root cause analysis, to support the…

Artificial Intelligence · Computer Science 2022-07-08 Jasmin Bogatinovski , Gjorgji Madjarov , Sasho Nedelkoski , Jorge Cardoso , Odej Kao

Machine learning is now used in many applications thanks to its ability to predict, generate, or discover patterns from large quantities of data. However, the process of collecting and transforming data for practical use is intricate. Even…

Artificial Intelligence for IT Operations (AIOps) has been adopted in organizations in various tasks, including interpreting models to identify indicators of service failures. To avoid misleading practitioners, AIOps model interpretations…

Machine Learning · Computer Science 2022-02-07 Yingzhe Lyu , Gopi Krishnan Rajbahadur , Dayi Lin , Boyuan Chen , Zhen Ming , Jiang

In the evolving IT landscape, stability and reliability of systems are essential, yet their growing complexity challenges DevOps teams in implementation and maintenance. Log analysis, a core element of AIOps, provides critical insights into…

Machine Learning · Computer Science 2025-09-11 Thorsten Wittkopp

Publicly accessible benchmarks that allow for assessing and comparing model performances are important drivers of progress in artificial intelligence (AI). While recent advances in AI capabilities hold the potential to transform medical…

Artificial Intelligence · Computer Science 2022-12-26 Kathrin Blagec , Jakob Kraiger , Wolfgang Frühwirt , Matthias Samwald

The emerging age of connected, digital world means that there are tons of data, distributed to various organizations and their databases. Since this data can be confidential in nature, it cannot always be openly shared in seek of artificial…

Software Engineering · Computer Science 2021-03-17 Tuomas Granlund , Aleksi Kopponen , Vlad Stirbu , Lalli Myllyaho , Tommi Mikkonen

We outline a comprehensive framework for artificial intelligence (AI) Application Operations (AIAppOps), based on real-world experiences from diverse organizations. Data-driven projects pose additional challenges to organizations due to…

Computers and Society · Computer Science 2026-01-13 Daniel Jönsson , Mattias Tiger , Stefan Ekberg , Daniel Jakobsson , Mattias Jonhede , Fredrik Viksten

Big Data analytics supported by AI algorithms can support skills localization and retrieval in the context of a labor market intelligence problem. We formulate and solve this problem through specific DataOps models, blending data sources…

Artificial Intelligence · Computer Science 2021-04-06 Damian Andrew Tamburri , Willem-Jan Van den Heuvel , Martin Garriga

AIOps algorithms play a crucial role in the maintenance of microservice systems. Many previous benchmarks' performance leaderboard provides valuable guidance for selecting appropriate algorithms. However, existing AIOps benchmarks mainly…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-07-23 Yongqian Sun , Jiaju Wang , Zhengdan Li , Xiaohui Nie , Minghua Ma , Shenglin Zhang , Yuhe Ji , Lu Zhang , Wen Long , Hengmao Chen , Yongnan Luo , Dan Pei

Industrial anomaly detection (IAD) has garnered significant attention and experienced rapid development. However, the recent development of IAD approach has encountered certain difficulties due to dataset limitations. On the one hand, most…

Computer Vision and Pattern Recognition · Computer Science 2024-03-20 Chengjie Wang , Wenbing Zhu , Bin-Bin Gao , Zhenye Gan , Jianning Zhang , Zhihao Gu , Shuguang Qian , Mingang Chen , Lizhuang Ma

DRAM failure prediction is a vital task in AIOps, which is crucial to maintain the reliability and sustainable service of large-scale data centers. However, limited work has been done on DRAM failure prediction mainly due to the lack of…

Machine Learning · Computer Science 2021-05-05 Zhiyue Wu , Hongzuo Xu , Guansong Pang , Fengyuan Yu , Yijie Wang , Songlei Jian , Yongjun Wang

As new machine learning methods demand larger training datasets, researchers and developers face significant challenges in dataset management. Although ethics reviews, documentation, and checklists have been established, it remains…

Machine Learning · Computer Science 2024-11-04 Yiwei Wu , Leah Ajmani , Shayne Longpre , Hanlin Li

The proliferation of IoT systems, has seen them targeted by malicious third parties. To address this, realistic protection and investigation countermeasures need to be developed. Such countermeasures include network intrusion detection and…

Cryptography and Security · Computer Science 2018-11-05 Nickolaos Koroniotis , Nour Moustafa , Elena Sitnikova , Benjamin Turnbull

Deployment, operation and maintenance of large IT systems becomes increasingly complex and puts human experts under extreme stress when problems occur. Therefore, utilization of machine learning (ML) and artificial intelligence (AI) is…

Machine Learning · Computer Science 2021-07-30 Dominik Scheinert , Alexander Acker

As artificial intelligence (AI) systems become increasingly deployed across the world, they are also increasingly implicated in AI incidents - harm events to individuals and society. As a result, industry, civil society, and governments…

Computers and Society · Computer Science 2024-09-26 Kevin Paeth , Daniel Atherton , Nikiforos Pittaras , Heather Frase , Sean McGregor

Information Technology (IT) Operations (Ops), particularly Artificial Intelligence for IT Operations (AIOps), is the guarantee for maintaining the orderly and stable operation of existing information systems. According to Gartner's…