English
Related papers

Related papers: Introducing Distributed Dynamic Data-intensive (D3…

200 papers

Orientation of modern software systems towards data-intensive processing raises new difficulties in software engineering on how to build and maintain such systems. Some of the important challenges concern the design of software…

Software Engineering · Computer Science 2023-12-07 Aleksandar Dimov , Simeon Emanuilov , Boyan Bontchev , Yavor Dankov , Tasos Papapostolu

Recently, increasingly large amounts of data are generated from a variety of sources. Existing data processing technologies are not suitable to cope with the huge amounts of generated data. Yet, many research works focus on Big Data, a…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-06-07 Wissem Inoubli , Sabeur Aridhi , Haithem Mezni , Mondher Maddouri , Engelbert Mephu Nguifo

Intending to support new emerging applications with latency requirements below what can be offered by the cloud data centers, the edge and fog computing paradigms have reared. In such systems, the real-time instant data is processed closer…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-11-14 Yahya Hassanzadeh-Nazarabadi , Sanaz Taheri-Boshrooyeh , Öznur Özkasap

Major domains such as logistics, healthcare, and smart cities increasingly rely on sensor technologies and distributed infrastructures to monitor complex processes in real time. These developments are transforming the data landscape from…

The advent of experimental science facilities-instruments and observatories, such as the Large Hadron Collider, the Laser Interferometer Gravitational Wave Observatory, and the upcoming Large Synoptic Survey Telescope-has brought about…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-02-12 E. A. Huerta , Roland Haas , Shantenu Jha , Mark Neubauer , Daniel S. Katz

Data-driven science is heralded as a new paradigm in materials science. In this field, data is the new resource, and knowledge is extracted from materials data sets that are too big or complex for traditional human reasoning - typically…

Computational Physics · Physics 2019-10-28 Lauri Himanen , Amber Geurts , Adam S. Foster , Patrick Rinke

Nowadays, many scientific areas share the same broad requirements of being able to deal with massive and distributed datasets while, when possible, being integrated with services and applications. In order to solve the growing gap between…

Instrumentation and Methods for Astrophysics · Physics 2011-12-06 M. Brescia , S. Cavuoti , R. D'Abrusco , O. Laurino , G. Longo

The last decades have seen a surge of interests in distributed computing thanks to advances in clustered computing and big data technology. Existing distributed algorithms typically assume {\it all the data are already in one place}, and…

Machine Learning · Computer Science 2019-05-07 Donghui Yan , Yingjie Wang , Jin Wang , Guodong Wu , Honggang Wang

This is a thought piece on data-intensive science requirements for databases and science centers. It argues that peta-scale datasets will be housed by science centers that provide substantial storage and processing for scientists who access…

Databases · Computer Science 2007-05-23 Jim Gray , David T. Liu , Maria Nieto-Santisteban , Alexander S. Szalay , David DeWitt , Gerd Heber

The apparent dichotomy between information-processing and dynamical approaches to complexity science forces researchers to choose between two diverging sets of tools and explanations, creating conflict and often hindering scientific…

Neurons and Cognition · Quantitative Biology 2022-01-26 Pedro A. M. Mediano , Fernando E. Rosas , Juan Carlos Farah , Murray Shanahan , Daniel Bor , Adam B. Barrett

We review some aspects of the current state of data-intensive astronomy, its methods, and some outstanding data analysis challenges. Astronomy is at the forefront of "big data" science, with exponentially growing data volumes and data…

Instrumentation and Methods for Astrophysics · Physics 2014-11-04 G. Longo , M. Brescia , S. G. Djorgovski , S. Cavuoti , C. Donalek

Deep learning has recently become very popular on account of its incredible success in many complex data-driven applications, such as image classification and speech recognition. The database community has worked on data-driven applications…

Databases · Computer Science 2020-01-22 Wei Wang , Meihui Zhang , Gang Chen , H. V. Jagadish , Beng Chin Ooi , Kian-Lee Tan

Given that observational and numerical climate data are being produced at ever more prodigious rates, increasingly sophisticated and automated analysis techniques have become essential. Deep learning is quickly becoming a standard approach…

Fluid Dynamics · Physics 2017-09-12 A. Rupe , J. P. Crutchfield , K. Kashinath , Prabhat

Many problems in industry --- and in the social, natural, information, and medical sciences --- involve discrete data and benefit from approaches from subjects such as network science, information theory, optimization, probability, and…

Social and Information Networks · Computer Science 2018-08-08 Mason A. Porter , Sam D. Howison

The power grid is going through significant changes with the introduction of renewable energy sources and incorporation of smart grid technologies. These rapid advancements necessitate new models and analyses to keep up with the various…

We present a framework for a large-scale distributed eScience Artificial Intelligence search. Our approach is generic and can be used for many different problems. Unlike many other approaches, we do not require dedicated machines,…

Distributed, Parallel, and Cluster Computing · Computer Science 2012-09-18 Lars Kotthoff , Tom Kelsey , Martin McCaffery

Nanoscale design of surfaces and interfaces is essential for modern technologies like organic LEDs, batteries, fuel cells, superlubricating surfaces, and heterogeneous catalysis. However, these systems often exhibit complex surface…

Materials Science · Physics 2025-07-08 Lukas Hörmann , Wojciech G. Stark , Reinhard J. Maurer

Society's capacity for algorithmic problem-solving has never been greater. Artificial Intelligence is now applied across more domains than ever, a consequence of powerful abstractions, abundant data, and accessible software. As capabilities…

Machine Learning · Statistics 2024-08-20 Kris Sankaran

It is undeniable that most developers today are building distributed applications. However, most of these applications are developed by composing existing systems together through unspecified APIs exposed to the application developer.…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-02-09 Christopher S. Meiklejohn , Peter Van Roy