English
Related papers

Related papers: Position Paper on Dataset Engineering to Accelerat…

200 papers

Reusing existing datasets is of considerable significance to researchers and developers. Dataset search engines help a user find relevant datasets for reuse. They can present a snippet for each retrieved dataset to explain its relevance to…

Information Retrieval · Computer Science 2019-07-03 Xiaxia Wang , Jinchi Chen , Shuxin Li , Gong Cheng , Jeff Z. Pan , Evgeny Kharlamov , Yuzhong Qu

Datasets play a key role in imparting advanced capabilities to artificial intelligence (AI) foundation models that can be adapted to various downstream tasks. These downstream applications can introduce both beneficial and harmful…

Computers and Society · Computer Science 2025-07-02 Srija Chakraborty

Ensuring the reproducibility of scientific work is crucial as it allows the consistent verification of scientific claims and facilitates the advancement of knowledge by providing a reliable foundation for future research. However,…

Software Engineering · Computer Science 2025-04-14 Lázaro Costa , Susana Barbosa , Jácome Cunha

There has been an increasing recognition of the value of data and of data-based decision making. As a consequence, the development of data science as a field of study has intensified in recent years. However, there is no systematic and…

Other Computer Science · Computer Science 2024-01-05 M. Tamer Özsu

In this paper, we delve into the critical aspect of dataset quality assessment in machine learning classification tasks. Leveraging a variety of nine distinct datasets, each crafted for classification tasks with varying complexity levels,…

Machine Learning · Computer Science 2023-06-28 Szymon Mazurek , Maciej Wielgosz

Data engineering is one of the fastest-growing fields within machine learning (ML). As ML becomes more common, the appetite for data grows more ravenous. But ML requires more data than individual teams of data engineers can readily produce,…

Machine Learning · Computer Science 2021-02-24 Vijay Janapa Reddi , Greg Diamos , Pete Warden , Peter Mattson , David Kanter

Machine learning datasets are powerful but unwieldy. Despite the fact that large datasets commonly contain problematic material--whether from a technical, legal, or ethical perspective--datasets are valuable resources when handled carefully…

Computers and Society · Computer Science 2025-01-28 Sarah Ciston , Mike Ananny , Kate Crawford

Rising concern for the societal implications of artificial intelligence systems has inspired demands for greater transparency and accountability. However the datasets which empower machine learning are often used, shared and re-used with…

Keeping up with the research literature plays an important role in the workflow of scientists - allowing them to understand a field, formulate the problems they focus on, and develop the solutions that they contribute, which in turn shape…

Information Retrieval · Computer Science 2023-01-11 Sheshera Mysore , Mahmood Jasim , Haoru Song , Sarah Akbar , Andre Kenneth Chase Randall , Narges Mahyar

A main challenge of data-driven sciences is how to make maximal use of the progressively expanding databases of experimental datasets in order to keep research cumulative. We introduce the idea of a modeling-based dataset retrieval engine…

Quantitative Methods · Quantitative Biology 2015-06-19 Ali Faisal , Jaakko Peltonen , Elisabeth Georgii , Johan Rung , Samuel Kaski

Exploiting the recent advancements in artificial intelligence, showcased by ChatGPT and DALL-E, in real-world applications necessitates vast, domain-specific, and publicly accessible datasets. Unfortunately, the scarcity of such datasets…

Machine Learning · Computer Science 2023-05-17 Cyril Picard , Jürg Schiffmann , Faez Ahmed

Spreadsheet engineering adapts the lessons of software engineering to spreadsheets, providing eight principles as a framework for organizing spreadsheet programming recommendations. Spreadsheets raise issues inadequately addressed by…

Software Engineering · Computer Science 2024-12-31 Thomas A. Grossman

Data science is not a science. It is a research paradigm. Its power, scope, and scale will surpass science, our most powerful research paradigm, to enable knowledge discovery and change our world. We have yet to understand and define it,…

Machine Learning · Computer Science 2023-07-25 Michael L Brodie

In this paper we have focused a variety of techniques, approaches and different areas of the research which are helpful and marked as the important field of data mining Technologies. As we are aware that many Multinational companies and…

Databases · Computer Science 2012-11-27 Neelamadhab Padhy , Dr. Pragnyaban Mishra , Rasmita Panigrahi

In this work, we identify elements of effective machine learning datasets in astronomy and present suggestions for their design and creation. Machine learning has become an increasingly important tool for analyzing and understanding the…

Instrumentation and Methods for Astrophysics · Physics 2022-11-30 Bernie Boscoe , Tuan Do , Evan Jones , Yunqi Li , Kevin Alfaro , Christy Ma

Data engineering pipelines are essential - albeit costly - components of predictive analytics frameworks requiring significant engineering time and domain expertise for carrying out tasks such as data ingestion, preprocessing, feature…

Machine Learning · Computer Science 2025-05-22 Iman Kazemian , Paritosh Ramanan , Murat Yildirim

Spatial data science has emerged in recent years as an interdisciplinary field. This position paper discusses the importance of building and sharing high-quality datasets for spatial data science.

Computers and Society · Computer Science 2020-07-17 Yingjie Hu

In the quest to align deep learning with the sciences to address calls for rigor, safety, and interpretability in machine learning systems, this contribution identifies key missing pieces: the stages of hypothesis formulation and testing,…

Machine Learning · Computer Science 2019-04-25 Jessica Zosa Forde , Michela Paganini

A dataset is crucial for model learning and evaluation. Choosing the right dataset to use or making a new dataset requires the knowledge of those that are available. In this work, we provide that knowledge, by reviewing twenty datasets that…

Robotics · Computer Science 2016-07-05 Yongqiang Huang , Yu Sun

Progress in science is deeply bound to the effective use of high-performance computing infrastructures and to the efficient extraction of knowledge from vast amounts of data. Such data comes from different sources that follow a cycle…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-06-15 Rosa M Badia , Jorge Ejarque , Francesc Lordan , Daniele Lezzi , Javier Conejero , Javier Álvarez Cid-Fuentes , Yolanda Becerra , Anna Queralt