English
Related papers

Related papers: Training and Evaluating a Jupyter Notebook Data Sc…

200 papers

Interactive notebooks, such as Jupyter, have revolutionized the field of data science by providing an integrated environment for data, code, and documentation. However, their adoption by robotics researchers and model developers has been…

Computational Engineering, Finance, and Science · Computer Science 2024-05-15 Rolando Garcia

Jupyter notebooks has emerged as a standard tool for data science programming. Programs in Jupyter notebooks are different from typical programs as they are constructed by a collection of code snippets interleaved with text and…

Software Engineering · Computer Science 2021-03-02 Malin Källén , Tobias Wrigstad

In software engineering, numerous studies have focused on the analysis of fine-grained logs, leading to significant innovations in areas such as refactoring, security, and code completion. However, no similar studies have been conducted for…

We introduce DS-1000, a code generation benchmark with a thousand data science problems spanning seven Python libraries, such as NumPy and Pandas. Compared to prior works, DS-1000 incorporates three core features. First, our problems…

Software Engineering · Computer Science 2022-11-22 Yuhang Lai , Chengxi Li , Yiming Wang , Tianyi Zhang , Ruiqi Zhong , Luke Zettlemoyer , Scott Wen-tau Yih , Daniel Fried , Sida Wang , Tao Yu

Simultaneously modeling source code and natural language has many exciting applications in automated software development and understanding. Pursuant to achieving such technology, we introduce PyMT5, the Python method text-to-text transfer…

Machine Learning · Computer Science 2020-10-08 Colin B. Clement , Dawn Drain , Jonathan Timcheck , Alexey Svyatkovskiy , Neel Sundaresan

Data science education is increasingly involving human subjects and societal issues such as privacy, ethics, and fairness. Data scientists need to be equipped with skills to tackle the complexities of the societal context surrounding their…

Computers and Society · Computer Science 2022-05-02 Deniz Marti , Michael D. Smith

Jupyter notebooks are widely used for machine learning (ML) prototyping. Yet, few debugging tools are designed for ML code in notebooks, partly, due to the lack of benchmarks. We introduce JunoBench, the first benchmark dataset of…

Software Engineering · Computer Science 2026-05-01 Yiran Wang , José Antonio Hernández López , Ulf Nilsson , Dániel Varró

Computational notebooks, such as Jupyter notebooks, are interactive computing environments that are ubiquitous among data scientists to perform data wrangling and analytic tasks. To measure the performance of AI pair programmers that…

This paper presents the history of the online simulation program Java-DSP (J-DSP) and the most recent function development and deployment. J-DSP was created to support online laboratories in DSP classes and was first deployed in our ASU DSP…

Signal Processing · Electrical Eng. & Systems 2026-02-17 Andreas Spanias

Jupyter notebooks have become central in data science, integrating code, text and output in a flexible environment. With the rise of machine learning (ML), notebooks are increasingly used for prototyping and data analysis. However, due to…

Software Engineering · Computer Science 2025-08-12 Yiran Wang , Willem Meijer , José Antonio Hernández López , Ulf Nilsson , Dániel Varró

We introduce a new challenge to test the STEM skills of neural models. The problems in the real world often require solutions, combining knowledge from STEM (science, technology, engineering, and math). Unlike existing datasets, our dataset…

Computation and Language · Computer Science 2024-05-24 Jianhao Shen , Ye Yuan , Srbuhi Mirzoyan , Ming Zhang , Chenguang Wang

Notebooks provide an interactive environment for programmers to develop code, analyse data and inject interleaved visualizations in a single environment. Despite their flexibility, a major pitfall that data scientists encounter is…

Databases · Computer Science 2021-10-27 Pavle Subotić , Lazar Milikić , Milan Stojić

Computational notebooks are intended to prioritize the needs of scientists, but little is known about how scientists interact with notebooks, what requirements drive scientists' software development processes, or what tactics scientists use…

Software Engineering · Computer Science 2025-03-18 Ruanqianqian Huang , Savitha Ravi , Michael He , Boyu Tian , Sorin Lerner , Michael Coblenz

Computational notebooks have become the tool of choice for many data scientists and practitioners for performing analyses and disseminating results. Despite their increasing popularity, the research community cannot yet count on a large,…

Databases · Computer Science 2021-06-01 Luigi Quaranta , Fabio Calefato , Filippo Lanubile

Computational notebooks -- such as Jupyter or Colab -- combine text and data analysis code. They have become ubiquitous in the world of data science and exploratory data analysis. Since these notebooks present a different programming…

Software Engineering · Computer Science 2022-07-20 Derek Robinson , Neil A. Ernst , Enrique Larios Vargas , Margaret-Anne D. Storey

More than ninety percent of published Jupyter notebooks do not state dependencies on external packages. This makes them non-executable and thus hinders reproducibility of scientific results. We present SnifferDog, an approach that 1)…

Software Engineering · Computer Science 2021-03-05 Jiawei Wang , Li Li , Andreas Zeller

Python has become the prime language for application development in the Data Science and Machine Learning domains. However, data scientists are not necessarily experienced programmers. While Python lets them quickly implement their…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-08-24 Oscar Castro , Pierrick Bruneau , Jean-Sébastien Sottet , Dario Torregrossa

We report a user-friendly software environment for battery data science. It is designed to streamline data management, data cleaning, and data analysis to help bridge the gap between the domain expertise of most battery scientists and the…

Systems and Control · Electrical Eng. & Systems 2022-02-04 Robert Masse , Dan Ulery , Hardik Kamdar

Grading student assignments in STEM courses is a laborious and repetitive task for tutors, often requiring a week to assess an entire class. For students, this delay of feedback prevents iterating on incorrect solutions, hampers learning,…

Artificial Intelligence · Computer Science 2025-02-26 Nils Wandel , David Stotko , Alexander Schier , Reinhard Klein

A large amount of data is produced every second from modern information systems such as mobile devices, the world wide web, Internet of Things, social media, etc. Analysis and mining of this massive data requires a lot of advanced tools and…

Machine Learning · Computer Science 2020-01-13 Rising Odegua , Festus Ikpotokin