English
Related papers

Related papers: Reproducible, Explainable, and Effective Evaluatio…

200 papers

The integration of Agentic AI into scientific discovery marks a new frontier in research automation. These AI systems, capable of reasoning, planning, and autonomous decision-making, are transforming how scientists perform literature…

Computation and Language · Computer Science 2025-03-13 Mourad Gridach , Jay Nanavati , Khaldoun Zine El Abidine , Lenon Mendes , Christina Mack

Agentic data science (ADS) systems are rapidly improving their capability to autonomously analyze, fit, and interpret data, potentially moving towards a future where agents conduct the vast majority of data-science work. However, current…

Artificial Intelligence · Computer Science 2026-05-06 Chandan Singh , Yan Shuo Tan , Weijia Xu , Zelalem Gero , Weiwei Yang , Michel Galley , Jianfeng Gao

The introduction of large language models ignited great retooling and rethinking of the software development models. The ensuing response of software engineering research yielded a massive body of tools and approaches. In this paper, we…

Software Engineering · Computer Science 2026-02-05 Marian Kica , Lukas Radosky , David Slivka , Karin Kubinova , Daniel Dovhun , Tomas Uhercik , Erik Bircak , Ivan Polasek

Poorly formulated research problems can compromise the practical relevance of Software Engineering studies by not reflecting the complexities of industrial practice. This vision paper explores the use of artificial intelligence agents to…

Software Engineering · Computer Science 2025-12-16 Anrafel Fernandes Pereira , Maria Teresa Baldassarre , Daniel Mendez , Marcos Kalinowski

AI agents have recently shown significant promise in software engineering. Much public attention has been transfixed on the topic of code generation from Large Language Models (LLMs) via a prompt. However, software engineering is much more…

Software Engineering · Computer Science 2025-09-23 Abhik Roychoudhury

The rise of agentic AI systems, where agents collaborate to perform diverse tasks, poses new challenges with observing, analyzing and optimizing their behavior. Traditional evaluation and benchmarking approaches struggle to handle the…

Artificial Intelligence · Computer Science 2025-03-11 Dany Moshkovich , Hadar Mulian , Sergey Zeltyn , Natti Eder , Inna Skarbovsky , Roy Abitbol

Agentic AI represents a new paradigm for automating complex systems by using Large AI Models (LAMs) to provide human-level cognitive abilities with multimodal perception, planning, memory, and reasoning capabilities. This will lead to a new…

Artificial Intelligence · Computer Science 2025-11-05 Jorge Pellejero , Luis A. Hernández Gómez , Luis Mendo Tomás , Zoraida Frias Barroso

This survey paper examines the recent advancements in AI agent implementations, with a focus on their ability to achieve complex goals that require enhanced reasoning, planning, and tool execution capabilities. The primary objectives of…

Artificial Intelligence · Computer Science 2024-04-18 Tula Masterman , Sandi Besen , Mason Sawtell , Alex Chao

When used in high-stakes settings, AI systems are expected to produce decisions that are transparent, interpretable and auditable, a requirement increasingly expected by regulations. Decision trees such as CART provide clear and verifiable…

Machine Learning · Computer Science 2026-04-07 Vincent Grari , Tim Arni , Thibault Laugel , Sylvain Lamprier , James Zou , Marcin Detyniecki

Cybersecurity has become one of the earliest adopters of agentic AI, as security operations centers increasingly rely on multi-step reasoning, tool-driven analysis, and rapid decision-making under pressure. While individual large language…

Cryptography and Security · Computer Science 2025-12-09 Vaishali Vinay

Agentic AI denotes an architectural transition from stateless, prompt-driven generative models toward goal-directed systems capable of autonomous perception, planning, action, and adaptation through iterative control loops. This paper…

Software Engineering · Computer Science 2026-02-12 Mamdouh Alenezi

System Instructions (SIs), or system prompts, are pivotal for guiding Large Language Models (LLMs) but manual crafting is resource-intensive and often suboptimal. Existing automated methods frequently generate non-human-readable "soft…

Artificial Intelligence · Computer Science 2025-07-08 Jeshwanth Challagundla

The increasing adoption of agentic workflows across diverse domains brings a critical need to scalably and systematically evaluate the complex traces these systems generate. Current evaluation methods depend on manual, domain-specific human…

Artificial Intelligence · Computer Science 2025-06-25 Darshan Deshpande , Varun Gangal , Hersh Mehta , Jitin Krishnan , Anand Kannappan , Rebecca Qian

Significant digitalization of financial services in a short period of time has led to an urgent demand to have autonomous, transparent and real-time credit risk decision making systems. The traditional machine learning models are effective…

Artificial Intelligence · Computer Science 2026-01-06 Chandra Sekhar Kubam

Agentic memory systems enable large language model (LLM) agents to maintain state across long interactions, supporting long-horizon reasoning and personalization beyond fixed context windows. Despite rapid architectural development, the…

Computation and Language · Computer Science 2026-05-21 Dongming Jiang , Yi Li , Songtao Wei , Jinxin Yang , Ayushi Kishore , Alysa Zhao , Dingyi Kang , Xu Hu , Feng Chen , Qiannan Li , Bingzhe Li

Agentic AI is poised to usher in a seismic paradigm shift in Software Engineering (SE). As technologists rush head-along to make agentic AI a reality, SE researchers are driven to establish agentic SE as a research area. While early visions…

Software Engineering · Computer Science 2026-02-18 Rashina Hoda

The rapid integration of Large Language Models (LLMs) into high-stakes domains necessitates reliable safety and compliance evaluation. However, existing static benchmarks are ill-equipped to address the dynamic nature of AI risks and…

Artificial Intelligence · Computer Science 2026-05-15 Yixu Wang , Xin Wang , Yang Yao , Xinyuan Li , Xibang Yang , Yan Teng , Xingjun Ma , Yingchun Wang

AI agent development relies heavily on natural language prompting to define agents' tasks, knowledge, and goals. These prompts are interpreted by Large Language Models (LLMs), which govern agent behavior. Consequently, agentic performance…

Artificial Intelligence · Computer Science 2026-04-14 Roi Ben-Gigi , Yuval David , Fabiana Fournier , Lior Limonad , Dany Moshkovich , Hadar Mulian , Segev Shlomov

Recent AI systems combine large language models with tools, external knowledge via retrieval-augmented generation (RAG), and even autonomous multi-agent decision loops. This agentic AI paradigm greatly expands capabilities - but also vastly…

Cryptography and Security · Computer Science 2026-03-25 Ali Dehghantanha , Sajad Homayoun

In this preprint, we present A collaborative human-AI approach to building an inspectable semantic layer for Agentic AI. AI agents first propose candidate knowledge structures from diverse data sources; domain experts then validate,…

Artificial Intelligence · Computer Science 2025-12-05 Liam McGee , James Harvey , Lucy Cull , Andreas Vermeulen , Bart-Floris Visscher , Malvika Sharan