English
Related papers

Related papers: Magda - Manager for grid-based data

200 papers

All the recent redshift surveys show highly irregular patterns of galaxies on scales of hundreds of megaparsecs such as chains, walls and cells. One of the most powerful catalog of galaxies is represented by the LEDA database that contains…

Astrophysics · Physics 2007-05-23 H. Di Nella , M. Montuori , G. Paturel , L. Pietronero , F. Sylos Labini

In this paper, we present the ADMIRE architecture; a new framework for developing novel and innovative data mining techniques to deal with very large and distributed heterogeneous datasets in both commercial and academic applications. The…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-03-30 Nhien-An Le-Khac , M-Tahar Kechadi , Joe Carthy

In this paper, we propose Multi-Modal Databases (MMDBs), which is a new class of database systems that can seamlessly query text and tables using SQL. To enable seamless querying of textual data using SQL in an MMDB, we propose to extend…

Databases · Computer Science 2023-05-01 Matthias Urban , Carsten Binnig

This paper addresses the problem of efficiently storing and accessing massive data blocks in a large-scale distributed environment, while providing efficient fine-grain access to data subsets. This issue is crucial in the context of…

Distributed, Parallel, and Cluster Computing · Computer Science 2008-10-14 Bogdan Nicolae , Gabriel Antoniu , Luc Bougé

This paper proposes Kudu, a distributed execution engine with a well-defined abstraction that can be integrated with existing single-machine graph pattern mining (GPM) systems to provide efficiency and scalability at the same time. The key…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-11-14 Jingji Chen , Xuehai Qian

Modern organizations manage their data with a wide variety of specialized cloud database engines (e.g., Aurora, BigQuery, etc.). However, designing and managing such infrastructures is hard. Developers must consider many possible designs…

Databases · Computer Science 2024-07-31 Geoffrey X. Yu , Ziniu Wu , Ferdi Kossmann , Tianyu Li , Markos Markakis , Amadou Ngom , Samuel Madden , Tim Kraska

Gene regulatory network reconstruction is a fundamental problem in computational biology. We recently developed an algorithm, called PANDA (Passing Attributes Between Networks for Data Assimilation), that integrates multiple sources of…

Quantitative Methods · Quantitative Biology 2017-04-18 Kimberly Glass , John Quackenbush , Jeremy Kepner

This paper introduces the recent work of Nebula Graph, an open-source, distributed, scalable, and native graph database. We present a system design trade-off and a comprehensive overview of Nebula Graph internals, including graph data…

Databases · Computer Science 2022-06-16 Min Wu , Xinglu Yi , Hui Yu , Yu Liu , Yujue Wang

This document describes our current effort to gridify Jade, a java-based environment for the autonomic management of clustered J2EE application servers, developed in the INRIA SARDES research team. Towards this objective, we use the java…

Distributed, Parallel, and Cluster Computing · Computer Science 2009-09-29 Cristian Ruz , Françoise Baude , Virginie Legrand Contes

As an alternative to downloading content from a cellular access network, mobile devices could be used to store data files and distribute them through device-to-device (D2D) communication. We consider a D2D-based storage community that is…

Networking and Internet Architecture · Computer Science 2013-09-25 J. Pääkkönen , C. Hollanti , O. Tirkkonen

A new family of Intensional RDBs (IRDBs), introduced in [1], extends the traditional RDBs with the Big Data and flexible and 'Open schema' features, able to preserve the user-defined relational database schemas and all preexisting user's…

Databases · Computer Science 2014-04-11 Zoran Majkic

Distributed ledgers are a new type of database technology that allows open access to data stored across distributed, decentralised, publicly maintained infrastructures. Current implementations of the such ledgers expect competition between…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-04-21 Phani Chitti

Understanding how machine learning models respond to distributional shifts is a key research challenge. Mazes serve as an excellent testbed due to varied generation algorithms offering a nuanced platform to simulate both subtle and…

Grid computing is a distributed computing paradigm which aims to aggregate several heterogeneous and distributed resources, belonging to different and independent organizations, in a dynamic, transparent and coordinated way. Since its…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-12-27 Cosimo Anglano , Massimo Canonico , Marco Guazzone

A fleet of connected vehicles easily produces many gigabytes of data per hour, making centralized (off-board) data processing impractical. In addition, there is the issue of distributing tasks to on-board units in vehicles and processing…

Programming Languages · Computer Science 2021-02-02 Gregor Ulm , Simon Smith , Adrian Nilsson , Emil Gustavsson , Mats Jirstrand

Fault-tolerant distributed applications require mechanisms to recover data lost via a process failure. On modern cluster systems it is typically impractical to request replacement resources after such a failure. Therefore, applications have…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-01-26 Lukas Hübner , Demian Hespe , Peter Sanders , Alexandros Stamatakis

MADlib is a free, open source library of in-database analytic methods. It provides an evolving suite of SQL-based algorithms for machine learning, data mining and statistics that run at scale within a database engine, with no need for data…

In today's Web and social network environments, query workloads include ad hoc and OLAP queries, as well as iterative algorithms that analyze data relationships (e.g., link analysis, clustering, learning). Modern DBMSs support ad hoc and…

Databases · Computer Science 2012-08-02 Svilen R. Mihaylov , Zachary G. Ives , Sudipto Guha

Current distributed key value stores achieve scalability by trading off consistency. As persistent memory technologies evolve tremendously, it is not necessary to sacrifice consistency for performance. This paper proposes DTranx, a…

Databases · Computer Science 2017-11-28 Ning Gao , Zhang Liu , Dirk Grunwald

A critical aspect of power systems research is the availability of suitable data, access to which is limited by privacy concerns and the sensitive nature of energy infrastructure. This lack of data, in turn, hinders the development of…

Machine Learning · Computer Science 2021-10-27 Minas Chatzos , Mathieu Tanneau , Pascal Van Hentenryck