English
Related papers

Related papers: BUILD-AND-FIND: An Effort-Aware Protocol for Evalu…

200 papers

Ad hoc dataset search requires matching underspecified natural-language queries against sparse, heterogeneous metadata records, a task where typical lexical or dense retrieval alone falls short. We reposition dataset search as a…

Information Retrieval · Computer Science 2026-04-21 Riccardo Terrenzi , Phongsakon Mark Konrad , Tim Lukas Adam , Serkan Ayvaz

Collaborative tasks are ubiquitous activities where a form of communication is required in order to reach a joint goal. Collaborative building is one of such tasks. We wish to develop an intelligent builder agent in a simulated building…

Computation and Language · Computer Science 2022-04-22 Zhengxiang Shi , Yue Feng , Aldo Lipani

Requirements traceability in safety-critical software development remains largely dependent on external documentation maintained separately from the systems it describes. This separation introduces structural fragility: traces degrade…

Software Engineering · Computer Science 2026-03-17 Thorsten Schlathölter

We study cost-efficient collaboration between strong and weak language models for repository-level code generation, where the weak model handles simpler tasks at lower cost, and the most challenging tasks are delegated to the strong model.…

Artificial Intelligence · Computer Science 2025-05-27 Shubham Gandhi , Atharva Naik , Yiqing Xie , Carolyn Rose

Discovering a solution in a combinatorial space is prevalent in many real-world problems but it is also challenging due to diverse complex constraints and the vast number of possible combinations. To address such a problem, we introduce a…

Machine Learning · Computer Science 2021-11-01 Hyunsoo Chung , Jungtaek Kim , Boris Knyazev , Jinhwi Lee , Graham W. Taylor , Jaesik Park , Minsu Cho

AI coding agents increasingly act directly within software environments, yet existing analyses of their failures rely on benchmark trajectories that miss how developers actually experience misalignment. We present an observational study of…

Software Engineering · Computer Science 2026-05-29 Ningzhi Tang , Chaoran Chen , Gelei Xu , Yiyu Shi , Yu Huang , Collin McMillan , Tao Dong , Toby Jia-Jun Li

Code assistants are increasingly utilized in test-driven software development, yet the theoretical mechanisms behind their environment-interaction strategies remain underexplored. We provide a probabilistic framework for two dominant…

Software Engineering · Computer Science 2026-05-08 Nicolas Menet , Michael Hersche , Andreas Krause , Abbas Rahimi

In bridge inspection, engineers should diagnose the observed bridge defects by identifying the factors underlying those defects. Traditionally, engineers search and organize structural condition-related information based on visual…

Human-Computer Interaction · Computer Science 2022-06-01 Pengkun Liu , Ruoxin Xiong , Pingbo Tang

Multi-agent systems built on large language models (LLMs) require many coordination choices that are difficult to fix a priori: which skill protocol to invoke, which agent role should perform a subtask, which model to bind to each role, how…

Multiagent Systems · Computer Science 2026-05-28 Nicole Koenigstein

Legacy systems concentrate business rules, architectural decisions, and operational exceptions that often remain implicit in code, data, configuration, and maintenance practices. At the same time, language-model-based coding agents depend…

Software Engineering · Computer Science 2026-05-19 Sanderson Oliveira de Macedo , Ronaldo Martins da Costa

Autonomous agents powered by large language models (LLMs) promise to accelerate scientific discovery end-to-end, but rigorously evaluating their capacity for verifiable discovery remains a central challenge. Existing benchmarks face a…

Artificial Intelligence · Computer Science 2026-02-04 Zhen Wang , Fan Bai , Zhongyan Luo , Jinyan Su , Kaiser Sun , Xinle Yu , Jieyuan Liu , Kun Zhou , Claire Cardie , Mark Dredze , Eric P. Xing , Zhiting Hu

Computer-aided design (CAD) is the backbone of modern industrial design, yet learned CAD generators still fall short of real engineering pipelines: they neither iterate like engineers nor evaluate what engineering requires. Prior work has…

Graphics · Computer Science 2026-05-28 Guijin Son , Jehyun Park , Seyeon Park , Sunghee Ahn , Youngjae Yu

AI systems are becoming active participants in organizational and knowledge work. They increasingly interact with humans, coordinate workflows, and operate in multi-agent arrangements. Understanding their effects therefore requires more…

Artificial Intelligence · Computer Science 2026-05-19 Yingjie Zhang , Chun Feng , Weizhang Zhu , Tianshu Sun

Building trust in reinforcement learning (RL) agents requires understanding why they make certain decisions, especially in high-stakes applications like robotics, healthcare, and finance. Existing explainability methods often focus on…

Artificial Intelligence · Computer Science 2025-06-18 Rishav Rishav , Somjit Nath , Vincent Michalski , Samira Ebrahimi Kahou

While "Intent-oriented programming" (or "Vibe Coding") redefines software engineering, existing code agents remain tethered to static code snapshots. Consequently, they struggle to model the critical information embedded in the temporal…

Machine Learning · Computer Science 2026-03-17 Yi-Xuan Deng , Xiaoqin Liu , Yi Zhang , Guo-Wei Yang , Shuojin Yang

Coding agents are increasingly used as iterative development partners, but most benchmarks still evaluate one specification followed by one final assessment. This leaves out a basic question: can an agent keep its own codebase working as…

Artificial Intelligence · Computer Science 2026-05-26 Haiyang Shen , Xuanzhong Chen , Wendong Xu , Yun Ma , Liang Chen , Kuan Li

Large Language Models (LLMs) have made significant strides in code generation and problem solving. Current approaches employ external tool-based iterative debuggers that use compiler or other tool-based runtime feedback to refine coarse…

Computation and Language · Computer Science 2026-04-28 Md. Ashraful Islam , Mohammed Eunus Ali , Md Rizwan Parvez

Autonomous, goal-driven agents powered by LLMs have recently emerged as promising tools for solving challenging problems without the need for task-specific finetuned models that can be expensive to procure. Currently, the design and…

Software Repositories contain knowledge on how software engineering teams work, communicate, and collaborate. It can be used to develop a data-informed view of a team's development process, which in turn can be employed for process…

Software Engineering · Computer Science 2020-07-17 Christoph Matthies , Franziska Dobrigkeit , Guenter Hesse

AI coding agents are increasingly integrated into real-world software development workflows, yet their robustness under diverse and adversarial scenarios remains poorly understood. We present ABTest, a behavior-driven fuzzing framework that…

Software Engineering · Computer Science 2026-04-23 Wuyang Dai , Moses Openja , Hung Viet Pham , Gias Uddin , Jinqiu Yang , Song Wang