English
Related papers

Related papers: Role of Apache Software Foundation in Big Data Pro…

200 papers

With the advent of extremely high dimensional datasets, dimensionality reduction techniques are becoming mandatory. Among many techniques, feature selection has been growing in interest as an important tool to identify relevant features on…

Agile development relies on self-organizing teams having a high degree of autonomy. For single-team development, more autonomy is generally considered better. In large-scale agile development, where several teams collaborate on the same…

Software Engineering · Computer Science 2025-03-05 Casper Lassenius , Torgeir Dingsøyr

Big Data concern large-volume, growing data sets that are complex and have multiple autonomous sources. Earlier technologies were not able to handle storage and processing of huge data thus Big Data concept comes into existence. This is a…

Machine Learning · Computer Science 2015-03-26 Praful Koturwar , Sheetal Girase , Debajyoti Mukhopadhyay

In the digital age, the amount of data produced is growing exponentially. Governments and institutions can no longer rely on old methods for storing data and passing on the knowledge to future generations. Digital data preservation is a…

Digital Libraries · Computer Science 2017-07-21 Carlos André Rosa , Olga Craveiro , Patricio Domingues

Digitization and data-driven manufacturing process is needed for today's industry. The term Industry 4.0 stands for today industrial digitization which is defined as a new level of organization and control over the entire value chain of the…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-07-30 Ozgun Akin , Halil Faruk Deniz , Dogukan Nefis , Alp Kiziltan , Altan Cakir

Apache Hive is an open-source relational database system for analytic big-data workloads. In this paper we describe the key innovations on the journey from batch tool to fully fledged enterprise data warehousing system. We present a hybrid…

Our analysis of recent AI4H publications reveals that, despite a trend toward utilizing open datasets and sharing modeling code, 74% of AI4H papers still rely on private datasets or do not share their code. This is especially concerning in…

Computers and Society · Computer Science 2026-03-05 John Wu , Zhenbang Wu , Jimeng Sun

Big data are data on a massive scale in terms of volume, intensity, and complexity that exceed the capacity of standard software tools. They present opportunities as well as challenges to statisticians. The role of computational…

Computation · Statistics 2018-06-13 Chun Wang , Ming-Hui Chen , Elizabeth Schifano , Jing Wu , Jun Yan

Positive experience of agile development methods in smaller projects has created interest in the applicability of such methods in larger scale projects. However, there is a lack of conceptual clarity regarding what large-scale agile…

Software Engineering · Computer Science 2018-01-29 Torgeir Dingsøyr , Tor Erlend Fægri , Juha Itkonen

End users positive response is essential for the success of any software. This is true for both commercial and Open Source Software (OSS). OSS is popular not only because of its availability, which is usually free but due to the user…

Software Engineering · Computer Science 2020-05-21 Arif Razza , Luiz Fernando Capretz , Shuib Basri

In the last few years, the field of data science has been growing rapidly as various businesses have adopted statistical and machine learning techniques to empower their decision making and applications. Scaling data analysis, possibly…

Databases · Computer Science 2021-02-11 Phanwadee Sinthong , Michael J. Carey

Over the last years, Linked Data has grown continuously. Today, we count more than 10,000 datasets being available online following Linked Data standards. These standards allow data to be machine readable and inter-operable. Nevertheless,…

Databases · Computer Science 2020-01-31 Gezim Sejdiu , Anisa Rula , Jens Lehmann , Hajira Jabeen

Open Source Software (OSS) has been recognized by the software development community as an effective way to deliver software. Unlike traditional software development, OSS development is driven by collaboration among developers spread…

Software Engineering · Computer Science 2020-08-13 Bianca Minetto Napoleão , Fabio Petrillo , Sylvain Hallé

The Open Source Software movement has been growing exponentially for a number of years with no signs of slowing. Driving this growth is the widespread availability of libraries and frameworks that provide many functionalities. Developers…

Software Engineering · Computer Science 2022-06-22 Stan Zajdel , Diego Elias Costa , Hafedh Mili

In large-scale projects operated in regulated environments, standard development processes are employed to meet strict compliance demands. Since such processes are usually complex, providing process users with access to their required…

Software Engineering · Computer Science 2025-02-18 Oliver Greulich , Christoph Knieke , Bassel Rafie , Andreas Rausch , Marco Kuhrmann

Analyzing the increasingly large volumes of data that are available today, possibly including the application of custom machine learning models, requires the utilization of distributed frameworks. This can result in serious productivity…

Databases · Computer Science 2019-08-20 Phanwadee Sinthong , Michael J. Carey

Although OSS development is very popular, ultimately more than 80 percent of OSS projects fail. Identifying the factors associated with OSS success can help in devising interventions when a project takes a downturn. OSS success has been…

Software Engineering · Computer Science 2021-06-01 Likang Yin , Zhunagzhi Chen , Qi Xuan , Vladimir Filkov

Today, data is being actively generated by a variety of devices, services, and applications. Such data is important not only for the information that it contains, but also for its relationships to other data and to interested users. Most…

Databases · Computer Science 2020-09-11 Xikui Wang , Michael J. Carey , Vassilis J. Tsotras

Scientific software is essential to scientific innovation and in many ways it is distinct from other types of software. Abandoned (or unmaintained), buggy, and hard to use software, a perception often associated with scientific software can…

Software Engineering · Computer Science 2025-06-23 Addi Malviya Thakur , Reed Milewicz , Mahmoud Jahanshahi , Lavínia Paganini , Bogdan Vasilescu , Audris Mockus

The parallel and distributed processing are becoming de facto industry standard, and a large part of the current research is targeted on how to make computing scalable and distributed, dynamically, without allocating the resources on…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-04-10 Rajendra Purohit , K R Chowdhary , S D Purohit