English
Related papers

Related papers: A System for Quantifying Data Science Workflows wi…

200 papers

Software developers use metrics to evaluate code quality and productivity, but these practices are still rare in programming education. This project bridges the gap by collecting real-time learning analytics from individual student and…

We introduce TechTrack, a new dataset for tracking entities in technical procedures. The dataset, prepared by annotating open domain articles from WikiHow, consists of 1351 procedures, e.g., "How to connect a printer", identifies more than…

Computation and Language · Computer Science 2021-04-16 Saransh Goyal , Pratyush Pandey , Garima Gaur , Subhalingam D , Srikanta Bedathur , Maya Ramanath

Biological science produces large amounts of data in a variety of formats, which necessitates the use of computational tools to process, integrate, analyse, and glean insights from the data. Researchers who use computational biology tools…

Human-Computer Interaction · Computer Science 2024-05-10 Yo Yehudi , Lukas Hughes-Noehrer , Carole Goble , Caroline Jay

For the purpose of efficient and cost-effective large-scale data labeling, crowdsourcing is increasingly being utilized. To guarantee the quality of data labeling, multiple annotations need to be collected for each data sample, and truth…

Human-Computer Interaction · Computer Science 2024-03-15 Fei Wang , Haoyu Liu , Haoyang Bi , Xiangzhuang Shen , Renyu Zhu , Runze Wu , Minmin Lin , Tangjie Lv , Changjie Fan , Qi Liu , Zhenya Huang , Enhong Chen

AI systems depend on the invisible and undervalued labor of data workers, who are often treated as interchangeable units rather than collaborators with meaningful expertise. Critical scholars and practitioners have proposed alternative…

Jupyter Notebook is a popular tool among data analysts and scientists for working with data. It provides a way to combine code, documentation, and visualizations in a single, interactive environment, facilitating code reuse. While code…

Software Engineering · Computer Science 2023-02-24 Mingke Yang , Yuming Zhou , Bixin Li , Yutian Tang

Data science is an emerging interdisciplinary field that combines elements of mathematics, statistics, computer science, and knowledge in a particular application domain for the purpose of extracting meaningful information from the…

Other Statistics · Statistics 2015-03-20 Ben Baumer

Scientific workflows are a cornerstone of modern scientific computing. They are used to describe complex computational applications that require efficient and robust management of large volumes of data, which are typically stored/processed…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-06-01 Tainã Coleman , Henri Casanova , Loïc Pottier , Manav Kaushik , Ewa Deelman , Rafael Ferreira da Silva

Data science pipelines to train and evaluate models with machine learning may contain bugs just like any other code. Leakage between training and test data can lead to overestimating the model's accuracy during offline evaluations, possibly…

Software Engineering · Computer Science 2022-09-08 Chenyang Yang , Rachel A Brower-Sinning , Grace A. Lewis , Christian Kästner

Data is a precious resource in today's society, and is generated at an unprecedented and constantly growing pace. The need to store, analyze, and make data promptly available to a multitude of users introduces formidable challenges in…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-06-08 Alessandro Margara , Gianpaolo Cugola , Nicolò Felicioni , Stefano Cilloni

Data Science is a complex and evolving field, but most agree that it can be defined as a combination of expertise drawn from three broad areascomputer science and technology, math and statistics, and domain knowledge -- with the purpose of…

Databases · Computer Science 2023-11-15 Rafael C. Alvarado

Data science workers increasingly collaborate on large-scale projects before communicating insights to a broader audience in the form of visualization. While prior work has modeled how data science teams, oftentimes with distinct roles and…

Human-Computer Interaction · Computer Science 2022-10-10 Rock Yuren Pang , Ruotong Wang , Joely Nelson , Leilani Battle

Intensive care units (ICUs) are complex and data-rich environments. Data routinely collected in the ICUs provides tremendous opportunities for machine learning, but their use comes with significant challenges. Complex problems may require…

Human-Computer Interaction · Computer Science 2024-06-05 Marceli Wac , Raul Santos-Rodriguez , Chris McWilliams , Christopher Bourdeaux

We present an ontology for representing workflows over components with Read-Write Linked Data interfaces and give an operational semantics to the ontology via a rule language. Workflow languages have been successfully applied for modelling…

Artificial Intelligence · Computer Science 2022-03-02 Tobias Käfer , Andreas Harth

One of the foundations of science is that researchers must publish the methodology used to achieve their results so that others can attempt to reproduce them. This has the added benefit of allowing methods to be adopted and adapted for…

Databases · Computer Science 2014-06-05 Paolo Missier , Simon Woodman , Hugo Hiden , Paul Watson

Data Scientists often use notebooks to develop Data Science (DS) pipelines, particularly since they allow to selectively execute parts of the pipeline. However, notebooks for DS have many well-known flaws. We focus on the following ones in…

Software Engineering · Computer Science 2023-04-10 Lars Reimann , Günter Kniesel-Wünsche

Task graphs provide a simple way to describe scientific workflows (sets of tasks with dependencies) that can be executed on both HPC clusters and in the cloud. An important aspect of executing such graphs is the used scheduling algorithm.…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-04-18 Jakub Beránek , Stanislav Böhm , Vojtěch Cima

Results from and progress on the development of a Data Intensive and Network Aware (DIANA) Scheduling engine, primarily for data intensive sciences such as physics analysis, are described. Scientific analysis tasks can involve thousands of…

Distributed, Parallel, and Cluster Computing · Computer Science 2007-05-23 Ashiq Anjum , Richard McClatchey , Arshad Ali , Ian Willers

Over the last two decades, the field of computational science has seen a dramatic shift towards incorporating high-throughput computation and big-data analysis as fundamental pillars of the scientific discovery process. This has…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-11-18 Martin Uhrin , Sebastiaan P. Huber , Jusong Yu , Nicola Marzari , Giovanni Pizzi

The principal goal of data science is to derive meaningful information from data. To do this, data scientists develop a space of analytic possibilities and from it reach their information goals by using their knowledge of the domain, the…