English
Related papers

Related papers: Structuring data analysis projects in the Open Sci…

200 papers

While the open-source software development model has led to successful large-scale collaborations in building software systems, data science projects are frequently developed by individuals or small teams. We describe challenges to scaling…

Machine Learning · Computer Science 2021-10-26 Micah J. Smith , Jürgen Cito , Kelvin Lu , Kalyan Veeramachaneni

Software systems evolve over their lifetime. Changing conditions, such as requirements or customer requests make it inevitable for developers to perform adjustments to the underlying code base. Especially in the context of open source…

Software Engineering · Computer Science 2019-07-15 Christian Zirkelbach , Alexander Krause , Wilhelm Hasselbring

The string-matching field has grown at a such complicated stage that various issues come into play when studying it: data structure and algorithmic design, database principles, compression techniques, architectural features, cache and…

Data Structures and Algorithms · Computer Science 2008-01-16 Paolo Ferragina

Distributed software development is more difficult than co-located software development. One of the main reasons is that communication is more difficult in distributed settings. Defined processes and artifacts help, but cannot cover all…

Software Engineering · Computer Science 2021-04-12 Kai Stapel , Eric Knauss , Kurt Schneider , Nico Zazworka

Unorganized heaps of analysis code are a growing liability as data analysis pipelines are getting longer and more complicated. This is worrying, as neuroscience papers are getting retracted due to programmer error. In this paper, some…

Software Engineering · Computer Science 2019-08-12 Marijn van Vliet

The need for discovering knowledge from XML documents according to both structure and content features has become challenging, due to the increase in application contexts for which handling both structure and content information in XML data…

Databases · Computer Science 2015-04-17 Olfa Arfaoui , Minyar Sassi Hidri

Online forms are widely used to collect data from human and have a multi-billion market. Many software products provide online services for creating semi-structured forms where questions and descriptions are organized by pre-defined…

Computation and Language · Computer Science 2022-11-11 Yijia Shao , Mengyu Zhou , Yifan Zhong , Tao Wu , Hongwei Han , Shi Han , Gideon Huang , Dongmei Zhang

Structuring related work is a daunting task encompassing literature review, classification, comparison (primarily in the form of concepts), and gap analysis. Building taxonomies is a compelling way to structure concepts in the literature…

Digital Libraries · Computer Science 2019-06-27 Mohsen Ahmadvand , Amjad Ibrahim , Felix Huber

Unstructured text has long been difficult to automatically analyze at scale. Large language models (LLMs) now offer a way forward by enabling {\em semantic data processing}, where familiar data processing operators (e.g., map, reduce,…

Human-Computer Interaction · Computer Science 2025-04-22 Shreya Shankar , Bhavya Chopra , Mawil Hasan , Stephen Lee , Björn Hartmann , Joseph M. Hellerstein , Aditya G. Parameswaran , Eugene Wu

As the complexity and volume of datasets have increased along with the capabilities of modular, open-source, easy-to-implement, visualization tools, scientists' need for, and appreciation of, data visualization has risen too. Until…

Instrumentation and Methods for Astrophysics · Physics 2018-05-30 Alyssa A. Goodman , Michelle A. Borkin , Thomas P. Robitaille

The reproducibility of scientific research has become a point of critical concern. We argue that openness and transparency are critical for reproducibility, and we outline an ecosystem for open and transparent science that has emerged…

Computers and Society · Computer Science 2018-09-27 Russell A. Poldrack , Krzysztof J. Gorgolewski , Gael Varoquaux

The development of modern information technologies permits to collect and to analyze huge amounts of statistical data in different spheres of life. The main problem is not to only to collect but to process all relevant information. The…

Information Retrieval · Computer Science 2010-07-08 O. Mryglod , Yu. Holovatch

Order is one of the main instruments to measure the relationship between objects in (empirical) data. However, compared to methods that use numerical properties of objects, the amount of ordinal methods developed is rather small. One reason…

Artificial Intelligence · Computer Science 2023-12-29 Gerd Stumme , Dominik Dürrschnabel , Tom Hanika

With the shifting focus of organizations and governments towards digitization of academic and technical documents, there has been an increasing need to use this reserve of scholarly documents for developing applications that can facilitate…

Digital Libraries · Computer Science 2016-06-07 Samiya Khan , Kashish A. Shakil , Mansaf Alam

To retrieve and compare scientific data of simulations and experiments in materials science, data needs to be easily accessible and machine readable to qualify and quantify various materials science phenomena. The recent progress in open…

Materials Science · Physics 2025-03-25 Balduin Katzer , Steffen Klinder , Katrin Schulz

The development and approval of new treatments generates large volumes of results, such as summaries of efficacy and safety. However, it is commonly overlooked that analyzing clinical study data also produces data in the form of results.…

Computers and Society · Computer Science 2022-04-22 Joana M Barros , Lukas A Widmer , Mark Baillie , Simon Wandel

Software development is a collaborative task and, hence, involves different persons. Research has shown the relevance of social aspects in the development team for a successful and satisfying project closure. Especially the mood of a team…

Software Engineering · Computer Science 2021-05-07 Martin Obaidi , Jil Klünder

As high-dimensional and high-frequency data are being collected on a large scale, the development of new statistical models is being pushed forward. Functional data analysis provides the required statistical methods to deal with large-scale…

Statistics Theory · Mathematics 2020-07-08 Israel Martínez-Hernández , Marc G. Genton

Traditional data science education often omits training on research workflows: the process that moves a scientific investigation from raw data to coherent research question to insightful contribution. In this paper, we elaborate basic…

Computers and Society · Computer Science 2021-06-09 Sara Stoudt , Valeri N. Vasquez , Ciera C. Martinez

Document parsing (DP) transforms unstructured or semi-structured documents into structured, machine-readable representations, enabling downstream applications such as knowledge base construction and retrieval-augmented generation (RAG).…