English
Related papers

Related papers: Role of Apache Software Foundation in Big Data Pro…

200 papers

Free and Open Source Software (FOSS) communities' sustainability, meaning to remain operational without signs of weakening or interruptions to its development, is fundamental for the resilience and continuity of society's digital…

Software Engineering · Computer Science 2025-04-15 Adam Alami , Steffan Klockmann , Lasse Rehder Sørensen , Raúl Pardo , Johan Linåker

We investigate the performance of Apache Spark, a cluster computing framework, for analyzing data from future LSST-like galaxy surveys. Apache Spark attempts to address big data problems have hitherto proved successful in the industry, but…

Instrumentation and Methods for Astrophysics · Physics 2018-10-17 Julien Peloton , Christian Arnault , Stéphane Plaszczynski

[Context and motivation] Ecosystems developed as Open Source Software (OSS) are considered to be highly innovative and reactive to new market trends due to their openness and wide-ranging contributor base. Participation in OSS often implies…

Software Engineering · Computer Science 2022-08-05 Johan Linåker , Patrick Rempel , Björn Regnell , Patrick Mäder

The ever-increasing volumes of scientific data present new challenges for distributed computing and Grid technologies. The emerging Big Data revolution drives exploration in scientific fields including nanotechnology, astrophysics,…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-08-14 A. V. Vaniachine

Recent advances in data collection and computational statistics coupled with increases in computer processing power, along with the plunging costs of storage are making technologies to effectively analyze large sets of heterogeneous data…

Cryptography and Security · Computer Science 2015-02-04 Hervais Simo Fhom

Development organizations and International Non-Governmental Organizations have been emphasizing the high potential of Free and Open Source Software for the Less Developed Countries. Cost reduction, less vendor dependency and increased…

General Literature · Computer Science 2008-08-28 Victor van Reijswoud , Arjan de Jager

The past year has seen movement on several fronts for improving software citation, including the Center for Open Science's Transparency and Openness Promotion (TOP) Guidelines, the Software Publishing Special Interest Group that was started…

The proliferation of Open Source Software (OSS) adoption and collaboration has surged within industry, resulting in its ubiquitous presence in commercial offerings and shared digital infrastructure. However, in the public sector, both…

Software Engineering · Computer Science 2023-08-10 Johan Linåker , Gregorio Robles , Deborah Bryant , Sachiko Muto

Broad efforts are underway to capture metadata about research software and retain it across services; notable in this regard is the CodeMeta project. What metadata are important to have about (research) software? What metadata are useful…

Instrumentation and Methods for Astrophysics · Physics 2017-12-08 Alice Allen , Peter Teuben , G. Bruce Berriman , Kimberly DuPrie , Keith Shortridge , Rein Warmels

Smart city projects address many of the current problems afflicting high populated areas and cities and, as such, are a target for government, institutions and private organizations that plan to explore its foreseen advantages. In technical…

Networking and Internet Architecture · Computer Science 2018-10-30 Joberto S. B. Martins

To keep the competitive advantage and adapt to changes in the market and technology, companies need to innovate in an organised, purposeful and systematic manner. However, due to their size and complexity, large companies tend to focus on…

Software Engineering · Computer Science 2018-02-19 Henry Edison , Xiaofeng Wang , Ronald Jabangwe , Pekka Abrahamsson

Open Source Software (OSS) Foundations and projects are investing in creating Diversity and Inclusion (D&I) initiatives. However, little is known about contributors' perceptions about the usefulness and success of such initiatives. We aim…

Software Engineering · Computer Science 2024-01-24 Mariam Guizani , Bianca Trinkenreich , Aileen Abril Castro-Guzman , Igor Steinmacher , Marco Gerosa , Anita Sarma

Open data is an emerging paradigm to share large and diverse datasets -- primarily from governmental agencies, but also from other organizations -- with the goal to enable the exploitation of the data for societal, academic, and commercial…

Software Engineering · Computer Science 2012-02-09 Holger M. Kienle

Open Source Software (OSS) often relies on large repositories, like SourceForge, for initial incubation. The OSS repositories offer a large variety of meta-data providing interesting information about projects and their success. In this…

Software Engineering · Computer Science 2009-05-01 George Tsatsaronis , Maria Halkidi , Emmanouel A. Giakoumakis

Programming systems incorporating aspects of functional programming, e.g., higher-order functions, are becoming increasingly popular for large-scale distributed programming. New frameworks such as Apache Spark leverage functional techniques…

Programming Languages · Computer Science 2016-02-12 Philipp Haller , Heather Miller

Most of the popular Big Data analytics tools evolved to adapt their working environment to extract valuable information from a vast amount of unstructured data. The ability of data mining techniques to filter this helpful information from…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-09-23 Taha Tekdogan , Ali Cakmak

In many academic disciplines, software is created during the research process or for a research purpose. The crucial role of software for research is increasingly acknowledged. The application of software engineering to research software…

Software Engineering · Computer Science 2025-12-02 Stephan Druskat , Lars Grunske

Data sizes that cannot be processed by conventional data storage and analysis systems are named as Big Data.It also refers to nex technologies developed to store, process and analyze large amounts of data. Automatic information retrieval…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-02-15 Selen Gurbuz , Galip Aydin

Agile software development is nowadays a widely adopted practise in both open-source and industrial software projects. Agile teams typically heavily rely on issue management tools to document new issues and keep track of outstanding ones,…

Software Engineering · Computer Science 2022-02-03 Vali Tawosi , Afnan Al-Subaihin , Rebecca Moussa , Federica Sarro

To meet the standards of the Open Science movement, the FAIR Principles emphasize the importance of making scientific data Findable, Accessible, Interoperable, and Reusable. Yet, creating a repository that adheres to these principles…