English
Related papers

Related papers: AIOpsLab: A Holistic Framework to Evaluate AI Agen…

200 papers

Large Language Models (LLMs) have transformed artificial intelligence from primarily generative systems into increasingly capable reasoning agents. Recent advances in theorem proving, autoformalization, symbolic reasoning, and…

Logic in Computer Science · Computer Science 2026-05-27 Adnan Rashid

The proliferation of cloud-native architectures, characterized by microservices and dynamic orchestration, has rendered modern IT infrastructures exceedingly complex and volatile. This complexity generates overwhelming volumes of…

Multiagent Systems · Computer Science 2026-04-29 Zishan Bai , Hanxuan Chen , Jing Luo , Ziyi Ni , Enze Ge , Jiacheng Shi , Yichao Zhang , Jiayi Gu , Zhimo Han , Riyang Bao , Junfeng Hao

The rapid advancement of large language models (LLMs) has paved the way for the development of highly capable autonomous agents. However, existing multi-agent frameworks often struggle with integrating diverse capable third-party agents due…

Computation and Language · Computer Science 2024-07-11 Weize Chen , Ziming You , Ran Li , Yitong Guan , Chen Qian , Chenyang Zhao , Cheng Yang , Ruobing Xie , Zhiyuan Liu , Maosong Sun

Modern software infrastructure increasingly relies on LLM agents for development and maintenance, such as Claude Code and Gemini-cli. However, these AI agents differ fundamentally from traditional deterministic software, posing a…

Operating Systems · Computer Science 2025-10-21 Yusheng Zheng , Yanpeng Hu , Tong Yu , Andi Quinn

Automated machine learning (AutoML) accelerates AI development by automating tasks in the development pipeline, such as optimal model search and hyperparameter tuning. Existing AutoML systems often require technical expertise to set up…

Machine Learning · Computer Science 2025-06-09 Patara Trirat , Wonyong Jeong , Sung Ju Hwang

Autonomous agents powered by large language models (LLMs) perform complex tasks through long-horizon reasoning and tool interaction, where a fundamental trade-off arises between execution efficiency and reasoning robustness. Models at…

Computation and Language · Computer Science 2026-03-30 Wenbo Gao , Renxi Liu , Xian Wang , Fang Guo , Shuai Yang , Xi Chen , Hui-Ling Zhen , Hanting Chen , Weizhe Lin , Xiaosong Li , Yaoyuan Wang

Large language models (LLMs) have evolved AI assistants into autonomous reasoning engines that maintain context, invoke tools, and pursue long-horizon tasks. This has spurred Agent Operating Systems (Agent OS) as kernel-like layers for…

Human-Computer Interaction · Computer Science 2026-05-18 Heyuan Huang , Yeyi Guan , Jihong Wang , Mingzhi Wang , Jiamu Zhou , Xiangmou Qu , Jiaxin Yin , Xin Liao , Xingyu Lou , Jun Wang

Automating cloud configuration and deployment remains a critical challenge due to evolving infrastructures, heterogeneous hardware, and fluctuating workloads. Existing solutions lack adaptability and require extensive manual tuning, leading…

LLM-based intelligent agents face significant deployment challenges, particularly related to resource management. Allowing unrestricted access to LLM or tool resources can lead to inefficient or even potentially harmful resource allocation…

Operating Systems · Computer Science 2025-08-13 Kai Mei , Xi Zhu , Wujiang Xu , Wenyue Hua , Mingyu Jin , Zelong Li , Shuyuan Xu , Ruosong Ye , Yingqiang Ge , Yongfeng Zhang

Large language models (LLMs) have enabled remarkable advances in automated task-solving with multi-agent systems. However, most existing LLM-based multi-agent approaches rely on predefined agents to handle simple tasks, limiting the…

Artificial Intelligence · Computer Science 2024-05-01 Guangyao Chen , Siwei Dong , Yu Shu , Ge Zhang , Jaward Sesay , Börje F. Karlsson , Jie Fu , Yemin Shi

With the growing adoption of Large Language Models (LLMs) in automating complex, multi-agent workflows, organizations face mounting risks from errors, emergent behaviors, and systemic failures that current evaluation methods fail to…

Artificial Intelligence · Computer Science 2025-09-19 NVJK Kartik , Garvit Sapra , Rishav Hada , Nikhil Pareek

DevOps has emerged as one of the most rapidly evolving software development paradigms. With the growing concerns surrounding security in software systems, the DevSecOps paradigm has gained prominence, urging practitioners to incorporate…

Software Engineering · Computer Science 2024-09-16 Michael Fu , Jirat Pasuksmit , Chakkrit Tantithamthavorn

Developing autonomous agents for web-based tasks is a core challenge in AI. While Large Language Model (LLM) agents can interpret complex user requests, they often operate as black boxes, making it difficult to diagnose why they fail or how…

Artificial Intelligence · Computer Science 2026-03-16 Orit Shahnovsky , Rotem Dror

Companies dealing with Artificial Intelligence (AI) models in Autonomous Systems (AS) face several problems, such as users' lack of trust in adverse or unknown conditions, gaps between software engineering and AI model development, and…

Software Engineering · Computer Science 2021-04-26 Silverio Martínez-Fernández , Xavier Franch , Andreas Jedlitschka , Marc Oriol , Adam Trendowicz

Multi-objective optimization problems (MOPs) are ubiquitous in real-world applications, presenting a complex challenge of balancing multiple conflicting objectives. Traditional evolutionary algorithms (EAs), though effective, often rely on…

Neural and Evolutionary Computing · Computer Science 2024-07-29 Yuxiao Huang , Shenghao Wu , Wenjie Zhang , Jibin Wu , Liang Feng , Kay Chen Tan

AIOps (Artificial Intelligence for IT Operations) solutions leverage the tremendous amount of data produced during the operation of large-scale systems and machine learning models to assist software practitioners in their system operations.…

Software Engineering · Computer Science 2025-05-07 Yingzhe Lyu , Hao Li , Heng Li , Ahmed E. Hassan

As Large Language Models (LLMs) become ubiquitous across various scientific domains, their lack of ability to perform complex tasks like running simulations or to make complex decisions limits their utility. LLM-based agents bridge this gap…

Computation and Language · Computer Science 2026-01-21 Anurag Acharya , Timothy Vega , Rizwan A. Ashraf , Anshu Sharma , Derek Parker , Robert Rallo

Security Operations Centers (SOCs) face growing challenges in managing cybersecurity threats due to an overwhelming volume of alerts, a shortage of skilled analysts, and poorly integrated tools. Human-AI collaboration offers a promising…

Cryptography and Security · Computer Science 2025-05-13 Massimiliano Albanese , Xinming Ou , Kevin Lybarger , Daniel Lende , Dmitry Goldgof

The rapid advancement of Large Language Models (LLMs) is catalyzing a shift towards autonomous AI Agents capable of executing complex, multi-step tasks. However, these agents remain brittle when faced with real-world exceptions, making…

This article presents a structured framework for Human-AI collaboration in Security Operations Centers (SOCs), integrating AI autonomy, trust calibration, and Human-in-the-loop decision making. Existing frameworks in SOCs often focus…

Artificial Intelligence · Computer Science 2025-06-03 Ahmad Mohsin , Helge Janicke , Ahmed Ibrahim , Iqbal H. Sarker , Seyit Camtepe