中文
相关论文

相关论文: Supporting Better Insights of Data Science Pipelin…

200 篇论文

Data volumes and rates of research infrastructures will continue to increase in the upcoming years and impact how we interact with their final data products. Little of the processed data can be directly investigated and most of it will be…

Data science requires time-consuming iterative manual activities. In particular, activities such as data selection, preprocessing, transformation, and mining, highly depend on iterative trial-and-error processes that could be sped-up…

Data provenance has numerous applications in the context of data preparation pipelines. It can be used for debugging faulty pipelines, interpreting results, verifying fairness, and identifying data quality issues, which may affect the…

数据库 · 计算机科学 2025-11-06 Khalid Belhajjame , Haroun Mezrioui , Yuyan Zhao

To benefit from the abundance of data and the insights it brings data processing pipelines are being used in many areas of research and development in both industry and academia. One approach to automating data processing pipelines is the…

密码学与安全 · 计算机科学 2023-10-18 Ludwig Stage , Dimka Karastoyanova

Data provenance, or data lineage, describes the life cycle of data. In scientific workflows on HPC systems, scientists often seek diverse provenance (e.g., origins of data products, usage patterns of datasets). Unfortunately, existing…

分布式、并行与集群计算 · 计算机科学 2023-08-03 Runzhou Han , Mai Zheng , Suren Byna , Houjun Tang , Bin Dong , Dong Dai , Yong Chen , Dongkyun Kim , Joseph Hassoun , David Thorsley , Matthew Wolf

Increasingly larger number of software systems today are including data science components for descriptive, predictive, and prescriptive analytics. The collection of data science stages from acquisition, to cleaning/curation, to modeling,…

软件工程 · 计算机科学 2022-02-15 Sumon Biswas , Mohammad Wardat , Hridesh Rajan

As data-driven methods are becoming pervasive in a wide variety of disciplines, there is an urgent need to develop scalable and sustainable tools to simplify the process of data science, to make it easier to keep track of the analyses being…

数据库 · 计算机科学 2016-10-18 Hui Miao , Amit Chavan , Amol Deshpande

Data mining is about obtaining new knowledge from existing datasets. However, the data in the existing datasets can be scattered, noisy, and even incomplete. Although lots of effort is spent on developing or fine-tuning data mining models…

机器学习 · 计算机科学 2019-06-21 Canchen Li

Context: Trustworthiness of software has become a first-class concern of users (e.g., to understand software-made decisions). Also, there is increasing demand to demonstrate regulatory compliance of software and end users want to understand…

软件工程 · 计算机科学 2023-02-14 Matthias Galster , Jens Dietrich

Conducting experiments and documenting results is daily business of scientists. Good and traceable documentation enables other scientists to confirm procedures and results for increased credibility. Documentation and scientific conduct are…

分布式、并行与集群计算 · 计算机科学 2011-12-15 Miriam Ney , Guy K. Kloss , Andreas Schreiber

Machine learning (ML) is an increasingly important scientific tool supporting decision making and knowledge generation in numerous fields. With this, it also becomes more and more important that the results of ML experiments are…

机器学习 · 计算机科学 2020-06-23 Sheeba Samuel , Frank Löffler , Birgitta König-Ries

Machine Learning (ML) has already fundamentally changed several businesses. More recently, it has also been profoundly impacting the computational science and engineering domains, like geoscience, climate science, and health science. In…

Data is a valuable asset, and sharing it as a product across organizations is key to building comprehensive and useful insights in fields such as science and industry. Before sharing, data often requires transformation to comply with…

社会与信息网络 · 计算机科学 2025-03-18 Sepideh Masoudi

Data-driven science is an emerging paradigm where scientific discoveries depend on the execution of computational AI models against rich, discipline-specific datasets. With modern machine learning frameworks, anyone can develop and execute…

机器学习 · 计算机科学 2022-08-09 Seth Ockerman , John Wu , Christopher Stewart

Data provenance collects comprehensive information about the events and operations in a computer system at both application and system levels. It provides a detailed and accurate history of transactions that help delineate the data flow…

密码学与安全 · 计算机科学 2021-07-06 Md Morshed Alam , Weichao Wang

Scientific datasets and analysis pipelines are increasingly being shared publicly in the interest of open science. However, mechanisms are lacking to reliably identify which pipelines and datasets can appropriately be used together. Given…

信息检索 · 计算机科学 2021-08-23 Mandana Mazaheri , Gregory Kiar , Tristan Glatard

Machine Learning (ML) is increasingly used to automate impactful decisions, which leads to concerns regarding their correctness, reliability, and fairness. We envision highly-automated software platforms to assist data scientists with…

数据库 · 计算机科学 2024-09-04 Stefan Grafberger

Machine Learning (ML) has become essential in several industries. In Computational Science and Engineering (CSE), the complexity of the ML lifecycle comes from the large variety of data, scientists' expertise, tools, and workflows. If data…

Currently, a variety of pipeline tools are available for use in data engineering. Data scientists can use these tools to resolve data wrangling issues associated with data and accomplish some data engineering tasks from data ingestion…

机器学习 · 计算机科学 2024-06-21 Anthony Mbata , Yaji Sripada , Mingjun Zhong
‹ 上一页 1 2 3 10 下一页 ›