English
Related papers

Related papers: AIOpsLab: A Holistic Framework to Evaluate AI Agen…

200 papers

This paper presents ThinkTank, a comprehensive and scalable framework designed to transform specialized AI agent systems into versatile collaborative intelligence platforms capable of supporting complex problem-solving across diverse…

Multiagent Systems · Computer Science 2025-06-04 Praneet Sai Madhu Surabhi , Dheeraj Reddy Mudireddy , Jian Tao

Autonomous agents utilizing Large Language Models (LLMs) have demonstrated remarkable capabilities in isolated medical tasks like diagnosis and image analysis, but struggle with integrated clinical workflows that connect diagnostic…

Artificial Intelligence · Computer Science 2025-10-14 Hongjie Zheng , Zesheng Shi , Ping Yi

Large language model (LLM) agents offer a promising data-driven approach to automating Site Reliability Engineering (SRE), yet their enterprise deployment is constrained by three challenges: restricted access to proprietary data, unsafe…

Machine Learning Operations (MLOps) is becoming a highly crucial part of businesses looking to capitalize on the benefits of AI and ML models. This research presents a detailed review of MLOps, its benefits, difficulties, evolutions, and…

Software Engineering · Computer Science 2023-06-01 A. I. Ullah Tabassam

Multimodal artificial intelligence (AI) systems have the potential to enhance clinical decision-making by interpreting various types of medical data. However, the effectiveness of these models across all medical fields is uncertain. Each…

Existing automated research systems operate as stateless, linear pipelines -- generating outputs without maintaining any persistent understanding of the research landscape they navigate. They process papers sequentially, propose ideas…

Artificial Intelligence · Computer Science 2026-03-27 Yunbo Long

Large Language Models (LLMs) have gained prominence in domains including cloud security and forensics. Yet cloud forensic investigations still rely on manual analysis, making them time-consuming and error-prone. LLMs can mimic human…

Cryptography and Security · Computer Science 2025-10-02 Dalal Alharthi , Ivan Roberto Kawaminami Garcia

We present a rigorous, human-in-the-loop evaluation framework for assessing the performance of AI agents on the task of Air Traffic Control, grounded in a regulator-certified simulator-based curriculum used for training and testing…

Human-Computer Interaction · Computer Science 2026-01-13 Ben Carvell , Marc Thomas , Andrew Pace , Christopher Dorney , George De Ath , Richard Everson , Nick Pepper , Adam Keane , Samuel Tomlinson , Richard Cannon

Health informatics research is characterized by diverse data modalities, rapid knowledge expansion, and the need to integrate insights across biomedical science, data analytics, and clinical practice. These characteristics make it…

Artificial Intelligence · Computer Science 2025-09-24 Yuxiao Cheng , Jinli Suo

Recent advances in agentic AI have enabled increasingly autonomous workflows, but existing systems still face substantial challenges in achieving reliable deployment in real-world scientific research. In this work, we present a safe,…

Artificial Intelligence · Computer Science 2026-04-16 Qibin Liu , Julia Gonski

Modern AI agents, driven by advances in large foundation models, promise to enhance our productivity and transform our lives by augmenting our knowledge and capabilities. To achieve this vision, AI agents must effectively plan, perform…

Agentic AI systems, which leverage multiple autonomous agents and large language models (LLMs), are increasingly used to address complex, multi-step tasks. The safety, security, and functionality of these systems are critical, especially in…

Artificial Intelligence · Computer Science 2026-04-16 Edoardo Allegrini , Ananth Shreekumar , Z. Berkay Celik

Current approaches to AI agent orchestration typically involve building multi-agent frameworks that manage context passing, memory, error handling, and step coordination through code. These frameworks work well for complex, concurrent…

Artificial Intelligence · Computer Science 2026-03-19 Jake Van Clief , David McDermott

Recent advances in large language models have sparked growing interest in AI agents capable of solving complex, real-world tasks. However, most existing agent systems rely on manually crafted configurations that remain static after…

Artificial Intelligence · Computer Science 2025-09-03 Jinyuan Fang , Yanwen Peng , Xi Zhang , Yingxu Wang , Xinhao Yi , Guibin Zhang , Yi Xu , Bin Wu , Siwei Liu , Zihao Li , Zhaochun Ren , Nikos Aletras , Xi Wang , Han Zhou , Zaiqiao Meng

Artificial Intelligence for IT Operations (AIOps) describes the process of maintaining and operating large IT systems using diverse AI-enabled methods and tools for, e.g., anomaly detection and root cause analysis, to support the…

Artificial Intelligence · Computer Science 2022-07-08 Jasmin Bogatinovski , Gjorgji Madjarov , Sasho Nedelkoski , Jorge Cardoso , Odej Kao

Large Language Model (LLM)-based multi-agent systems show promise for automating real-world tasks but struggle to transfer across domains due to their domain-specific nature. Current approaches face two critical shortcomings: they require…

The increasing complexity of user demands necessitates automation frameworks that can reliably translate open-ended instructions into robust, multi-step workflows. Current monolithic agent architectures often struggle with the challenges of…

Computation and Language · Computer Science 2026-03-23 Eslam Reda , Maged Yasser , Sara El-Metwally

Using artificial intelligence to manage IT operations, also known as AIOps, is a trend that has attracted a lot of interest and anticipation in recent years. The challenge in IT operations is to run steady-state operations without…

Computers and Society · Computer Science 2024-01-18 Subhadip Kumar

Users of cloud platforms often must expend significant manual efforts in the deployment and orchestration of their services on cloud platforms due primarily to having to deal with the high variabilities in the configuration options for…

Software Engineering · Computer Science 2019-04-10 Anirban Bhattacharjee , Yogesh Barve , Aniruddha Gokhale , Takayuki Kuroda

DevOps is a necessity in many industries, including the development of Autonomous Vehicles. In those settings, there are iterative activities that reduce the speed of SafetyOps cycles. One of these activities is "Hazard Analysis & Risk…

Software Engineering · Computer Science 2024-03-15 Ali Nouri , Beatriz Cabrero-Daniel , Fredrik Törner , Hȧkan Sivencrona , Christian Berger