English
Related papers

Related papers: Do AI Coding Agents Log Like Humans? An Empirical …

200 papers

In this short paper we focus on human in the loop for rule-based software used for law enforcement. For example, one can think of software that computes fines like tachograph software, software that prepares evidence like DNA sequencing…

Computers and Society · Computer Science 2023-09-20 Joost J. Joosten

Behavioral analysis of tutoring dialogues is essential for understanding student learning, yet manual coding remains a bottleneck. We present a methodology where LLM coding agents autonomously improve the prompts used by LLM classifiers to…

Human-Computer Interaction · Computer Science 2026-03-31 Eason Chen , Isabel Wang , Nina Yuan , Sophia Judicke , Kayla Beigh , Xinyi Tang

Despite rapid technological progress, effective human-machine cooperation remains a significant challenge. Humans tend to cooperate less with machines than with fellow humans, a phenomenon known as the machine penalty. Here, we show that…

Human-Computer Interaction · Computer Science 2025-05-29 Zhen Wang , Ruiqi Song , Chen Shen , Shiya Yin , Zhao Song , Balaraju Battu , Lei Shi , Danyang Jia , Talal Rahwan , Shuyue Hu

We investigate whether giving LLM agents the collaborative tools and autonomy that humans naturally use for problem solving can improve their performance. We equip Claude Code agents with MCP-based social media and journaling tools and…

Artificial Intelligence · Computer Science 2025-09-18 Harper Reed , Michael Sugimura , Angelo Zangari

AI coding assistants are now widely used in software development. Software developers increasingly integrate AI-generated code into their codebases to improve productivity. Prior studies have shown that AI-generated code may contain code…

Software Engineering · Computer Science 2026-04-28 Yue Liu , Ratnadira Widyasari , Yanjie Zhao , Ivana Clairine Irsan , Junkai Chen , David Lo

As Software Engineering enters its new era (SE 3.0), AI coding agents increasingly automate software development workflows. However, it remains unclear how exactly these agents recognize and address software energy concerns-an issue growing…

Software Engineering · Computer Science 2026-01-01 Tanjum Motin Mitul , Md. Masud Mazumder , Md Nahidul Islam Opu , Shaiful Chowdhury

Existing AI agents typically execute multi-step tasks autonomously and only allow user confirmation at the end. During execution, users have little control, making the confirm-at-end approach brittle: a single error can cascade and force a…

Human-Computer Interaction · Computer Science 2026-05-08 Jieyu Zhou , Aryan Roy , Sneh Gupta , Daniel Weitekamp , Christopher J. MacLellan

Today's AI agents are built on large language models (LLMs) equipped with tools to access and modify external environments, such as corporate file systems, API-accessible platforms and websites. AI agents offer the promise of automating…

Computers and Society · Computer Science 2026-03-26 Merlin Stein

AI is increasingly deployed in multi-agent systems; however, most research considers only the behavior of individual models. We experimentally show that multi-agent "AI organizations" are simultaneously more effective at achieving business…

Writing code has been one of the most transformative ways for human societies to translate abstract ideas into tangible technologies. Modern AI is changing this process by enabling experts and non-experts alike to generate code without…

Human-Computer Interaction · Computer Science 2026-03-09 Haoyu Hu , Raja Marjieh , Katherine M Collins , Chenyi Li , Thomas L. Griffiths , Ilia Sucholutsky , Nori Jacoby

Logging plays a crucial role in software engineering because it is key to perform various tasks including debugging, performance analysis, and detection of anomalies. Despite the importance of log data, the practice of logging still suffers…

Software Engineering · Computer Science 2022-08-16 Keyur Patel , Joao Faccin , Abdelwahab Hamou-Lhadj , Ingrid Nunes

As generative AI systems rapidly improve, a key question emerges: how do users adapt to these changes, and when does such adaptation matter for realizing performance gains? Drawing on theories of dynamic capabilities and IT complements, we…

Human-Computer Interaction · Computer Science 2026-01-08 Eaman Jahani , Benjamin S. Manning , Joe Zhang , Hong-Yi TuYe , Mohammed Alsobay , Christos Nicolaides , Siddharth Suri , David Holtz

This review presents a comprehensive analysis of two emerging paradigms in AI-assisted software development: vibe coding and agentic coding. While both leverage large language models (LLMs), they differ fundamentally in autonomy,…

Software Engineering · Computer Science 2025-05-27 Ranjan Sapkota , Konstantinos I. Roumeliotis , Manoj Karkee

AI tools and agents are reshaping how researchers work, from proving theorems to training neural networks. Yet for many, it remains unclear how these tools fit into everyday research practice. This paper is a practical guide to AI-assisted…

Machine Learning · Computer Science 2026-03-18 Max Zimmer , Nico Pelleriti , Christophe Roux , Sebastian Pokutta

Logs are semi-structured text generated by logging statements in software source code. In recent decades, software logs have become imperative in the reliability assurance mechanism of many software systems because they are often the only…

Software Engineering · Computer Science 2021-06-02 Shilin He , Pinjia He , Zhuangbin Chen , Tianyi Yang , Yuxin Su , Michael R. Lyu

A new generation of AI models generates step-by-step reasoning text before producing an answer. This text appears to offer a human-readable window into their computation process, and is increasingly relied upon for transparency and…

Human-Computer Interaction · Computer Science 2025-08-29 Mosh Levy , Zohar Elyoseph , Yoav Goldberg

The scarcity of real-world attack data significantly hinders progress in cybersecurity research and education. Although honeypots like Cowrie effectively collect live threat intelligence, they generate overwhelming volumes of unstructured…

Cryptography and Security · Computer Science 2025-09-09 Enis Karaarslan , Esin Güler , Efe Emir Yüce , Cagatay Coban

AI agent development relies heavily on natural language prompting to define agents' tasks, knowledge, and goals. These prompts are interpreted by Large Language Models (LLMs), which govern agent behavior. Consequently, agentic performance…

Artificial Intelligence · Computer Science 2026-04-14 Roi Ben-Gigi , Yuval David , Fabiana Fournier , Lior Limonad , Dany Moshkovich , Hadar Mulian , Segev Shlomov

Bug fixing is a complex and time-consuming task in software development. Bug localization research tends to focus on the accuracy of automated tools that suggest source code files for developers to look at. However, little is known about…

Software Engineering · Computer Science 2026-05-07 Pablo Diaz Pedreira , Tamara Lopez , Michel Wermelinger

Background: The increasing adoption of AI assistants in programming has led to numerous studies exploring their benefits. While developers consistently report significant productivity gains from these tools, empirical measurements often…

Human-Computer Interaction · Computer Science 2025-01-07 Ebtesam Al Haque , Chris Brown , Thomas D. LaToza , Brittany Johnson