English

Untangling Knots: Leveraging LLM for Error Resolution in Computational Notebooks

Software Engineering 2024-05-06 v1 Machine Learning

Abstract

Computational notebooks became indispensable tools for research-related development, offering unprecedented interactivity and flexibility in the development process. However, these benefits come at the cost of reproducibility and an increased potential for bugs. There are many tools for bug fixing; however, they are generally targeted at the classical linear code. With the rise of code-fluent Large Language Models, a new stream of smart bug-fixing tools has emerged. However, the applicability of those tools is still problematic for non-linear computational notebooks. In this paper, we propose a potential solution for resolving errors in computational notebooks via an iterative LLM-based agent. We discuss the questions raised by this approach and share a novel dataset of computational notebooks containing bugs to facilitate the research of the proposed approach.

Keywords

Cite

@article{arxiv.2405.01559,
  title  = {Untangling Knots: Leveraging LLM for Error Resolution in Computational Notebooks},
  author = {Konstantin Grotov and Sergey Titov and Yaroslav Zharov and Timofey Bryksin},
  journal= {arXiv preprint arXiv:2405.01559},
  year   = {2024}
}

Comments

accepted at 1st ACM CHI Workshop on Human-Notebook Interactions

R2 v1 2026-06-28T16:14:36.642Z