English
Related papers

Related papers: AIOpsLab: A Holistic Framework to Evaluate AI Agen…

200 papers

Autonomic computing investigates how systems can achieve (user) specified control outcomes on their own, without the intervention of a human operator. Autonomic computing fundamentals have been substantially influenced by those of control…

AI agents using Large Language Models (LLMs) as foundations have shown promise in solving complex real-world tasks. In this paper, we propose an LLM-based agentic workflow for automating Standard Operating Procedures (SOP). For customer…

Human-Computer Interaction · Computer Science 2025-03-21 Mandar Kulkarni

We explore the potential for productive team-based collaboration between humans and Artificial Intelligence (AI) by presenting and conducting initial tests with a general framework that enables multiple human and AI agents to work together…

Human-Computer Interaction · Computer Science 2024-12-04 Benjamin Klieger , Charis Charitsis , Miroslav Suzara , Sierra Wang , Nick Haber , John C. Mitchell

The success of today's AI applications requires not only model training (Model-centric) but also data engineering (Data-centric). In data-centric AI, active learning (AL) plays a vital role, but current AL tools 1) require users to manually…

Machine Learning · Computer Science 2022-11-08 Yizheng Huang , Huaizheng Zhang , Yuanming Li , Chiew Tong Lau , Yang You

Log analysis is crucial for ensuring the orderly and stable operation of information systems, particularly in the field of Artificial Intelligence for IT Operations (AIOps). Large Language Models (LLMs) have demonstrated significant…

Computation and Language · Computer Science 2024-07-03 Tianyu Cui , Shiyu Ma , Ziang Chen , Tong Xiao , Shimin Tao , Yilun Liu , Shenglin Zhang , Duoming Lin , Changchang Liu , Yuzhe Cai , Weibin Meng , Yongqian Sun , Dan Pei

Large language models (LLMs) have enabled a new class of agentic AI systems that reason, plan, and act by invoking external tools. However, most existing agentic architectures remain centralized and monolithic, limiting scalability,…

Computer Science and Game Theory · Computer Science 2026-02-04 Ya-Ting Yang , Quanyan Zhu

AI agents have been developed for complex real-world tasks from coding to customer service. But AI agent evaluations suffer from many challenges that undermine our understanding of how well agents really work. We introduce the Holistic…

Agentic AI represents a significant shift in how intelligence is applied within organizations, moving beyond AI-assisted tools toward autonomous systems capable of reasoning, decision-making, and coordinated action across workflows. As…

Traditional Identity and Access Management (IAM) systems, primarily designed for human users or static machine identities via protocols such as OAuth, OpenID Connect (OIDC), and SAML, prove fundamentally inadequate for the dynamic,…

Cryptography and Security · Computer Science 2025-05-30 Ken Huang , Vineeth Sai Narajala , John Yeoh , Jason Ross , Ramesh Raskar , Youssef Harkati , Jerry Huang , Idan Habler , Chris Hughes

In the realm of AI, large language models (LLMs) like GPT-4, central to the operation of AI agents, predominantly operate in the cloud, incurring high operational costs. With local-based small language models (SLMs) becoming more accurate,…

Machine Learning · Computer Science 2025-04-02 Shiyi Liu , Haiying Shen , Shuai Che , Mahdi Ghandi , Mingqin Li

The combination of LLM agents with external tools enables models to solve complex tasks beyond their knowledge base. Human-designed tools are inflexible and restricted to solutions within the scope of pre-existing tools created by experts.…

Artificial Intelligence · Computer Science 2025-11-18 Mohd Ariful Haque , Justin Williams , Sunzida Siddique , Md. Hujaifa Islam , Hasmot Ali , Kishor Datta Gupta , Roy George

This work introduces xOffense, an AI-driven, multi-agent penetration testing framework that shifts the process from labor-intensive, expert-driven manual efforts to fully automated, machine-executable workflows capable of scaling seamlessly…

Cryptography and Security · Computer Science 2026-04-28 Phung Duc Luong , Le Tran Gia Bao , Nguyen Vu Khai Tam , Dong Huu Nguyen Khoa , Nguyen Huu Quyen , Van-Hau Pham , Phan The Duy

Recent improvements in large language models (LLMs) have led many researchers to focus on building fully autonomous AI agents. This position paper questions whether this approach is the right path forward, as these autonomous systems still…

The operation and maintenance (O&M) of database systems is critical to ensuring system availability and performance, typically requiring expert experience (e.g., identifying metric-to-anomaly relations) for effective diagnosis and recovery.…

Databases · Computer Science 2025-08-05 Wei Zhou , Peng Sun , Xuanhe Zhou , Qianglei Zang , Ji Xu , Tieying Zhang , Guoliang Li , Fan Wu

With AI agents increasingly deployed as long-running systems, it becomes essential to autonomously construct and continuously evolve customized software to enable interaction within dynamic environments. Yet, existing benchmarks evaluate…

This paper details two novel frameworks for developing autonomous, agentic AI in scientific workflows. Both systems leverage a hybrid Local Body, Remote Brain architecture via Google Colab, utilizing Python-based local orchestrators to…

Artificial Intelligence · Computer Science 2026-05-27 Judy Fox , Geoffrey Fox

Autoscaling is a critical mechanism in cloud computing, enabling the autonomous adjustment of computing resources in response to dynamic workloads. This is particularly valuable for co-located, long-running applications with diverse…

Optimization and Control · Mathematics 2025-02-06 Ding Zou , Wei Lu , Zhibo Zhu , Xingyu Lu , Jun Zhou , Xiaojin Wang , Kangyu Liu , Haiqing Wang , Kefan Wang , Renen Sun

Human involvement is critical in training and deploying AI systems in high-stakes defence and security contexts. However, real-time interaction is impractical in HPC environments due to compute intensity and resource constraints. We present…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-05-06 Sergio Mendoza , Cedric Bhihe , Natalia Zamora , David Modesto , Jose Martin Bugallo Batalla , Jesus Gomez Canovas , Rafel Palomo Avellaneda , Miguel Perez Espinosa

With the rapid advancements in Large Language Models (LLMs), an increasing number of studies have leveraged LLMs as the cognitive core of agents to address complex task decision-making challenges. Specially, recent research has demonstrated…

Multiagent Systems · Computer Science 2025-03-13 Di Zhao , Longhui Ma , Siwei Wang , Miao Wang , Zhao Lv

With the rapid advancement of artificial intelligence, the proliferation of autonomous agents has introduced new challenges in interoperability, scalability, and coordination. The Internet of Agents (IoA) aims to interconnect heterogeneous…

Multiagent Systems · Computer Science 2025-05-21 Jun Liu , Ke Yu , Keliang Chen , Ke Li , Yuxinyue Qian , Xiaolian Guo , Haozhe Song , Yinming Li
‹ Prev 1 4 5 6 7 8 10 Next ›