English
Related papers

Related papers: Cloud based Real-Time and Low Latency Scientific E…

200 papers

Adapting the cloud for high-performance computing (HPC) is a challenging task, as software for HPC applications hinges on fast network connections and is sensitive to hardware failures. Using cloud infrastructure to recreate conventional…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-09-04 Philipp A. Witte , Mathias Louboutin , Henryk Modzelewski , Charles Jones , James Selvage , Felix J. Herrmann

Cloud computing is an established technology allowing users to share resources on a large scale, never before seen in IT history. A cloud system connects multiple individual servers in order to process related tasks in several environments…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-09-30 Leszek Sliwko

To conduct real-time analytics computations, big data stream processing engines are required to process unbounded data streams at millions of events per second. However, current streaming engines exhibit low throughput and high tuple…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-08-11 Shinhyung Yang , Jiun Jeong , Bernhard Scholz , Bernd Burgstaller

The size of astronomical observational data is increasing yearly. For example, while Atacama Large Millimeter/submillimeter Array is expected to generate 200 TB raw data every year, Large Synoptic Survey Telescope is estimated to produce 15…

Instrumentation and Methods for Astrophysics · Physics 2016-11-21 Satoshi Eguchi

Large-scale astronomical image data processing and prediction are essential for astronomers, providing crucial insights into celestial objects, the universe's history, and its evolution. While modern deep learning models offer high…

Computer Vision and Pattern Recognition · Computer Science 2025-10-10 Mills Staylor , Amirreza Dolatpour Fathkouhi , Md Khairul Islam , Kaleigh O'Hara , Ryan Ghiles Goudjil , Geoffrey Fox , Judy Fox

Scientific workflow is a powerful tool to streamline and organize computational steps of scientific application. This paper presents Emerald, a system that adds sophisticated cloud offloading capabilities to scientific workflows. Emerald…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-10-05 Hao Qian

Cloud computing is a powerful new technology that is widely used in the business world. Recently, we have been investigating the benefits it offers to scientific computing. We have used three workflow applications to compare the performance…

Instrumentation and Methods for Astrophysics · Physics 2015-03-17 G. Bruce Berriman , Ewa Deelman , Gideon Juve , Moira Regelson , Peter Plavchan

Fully re-orientable small spacecraft are now supported by commercial technologies, allowing them to point their instruments in any direction and capture images, with short notice. When combined with improved onboard processing, and…

Robotics · Computer Science 2025-06-24 Sreeja Roy-Singh , Alan P. Li , Vinay Ravindra , Roderick Lammers , Marc Sanchez Net

Social media analysis of disaster events is a critical task in crisis informatics research. It involves analyzing social media data generated during natural disasters, crisis events, or other mass convergence events. Due to the large data…

Software Engineering · Computer Science 2020-07-09 Gerard Casas Saez

Evaluating the performance of software for automated vehicles is predominantly driven by data collected from the real world. While professional test drivers are supported with technical means to semi-automatically annotate driving maneuvers…

Information Retrieval · Computer Science 2023-04-21 Christian Berger , Lukas Birkemeyer

The era of data-intensive astronomy is being ushered in with the increasing size and complexity of observational data across wavelength and time domains, the development of algorithms to extract information from this complexity, and the…

Instrumentation and Methods for Astrophysics · Physics 2020-05-20 Mubdi Rahman , Dustin Lang , Renée Hložek , Jo Bovy , Laurence Perreault-Levasseur

In recent past, big data opportunities have gained much momentum to enhance knowledge management in organizations. However, big data due to its various properties like high volume, variety, and velocity can no longer be effectively stored…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-02-16 Mohammad Shorfuzzaman

Seismology has entered the petabyte era, driven by decades of continuous recordings of broadband networks, the increase in nodal seismic experiments, and the recent emergence of Distributed Acoustic Sensing (DAS). This review explains how…

Cities play a pivotal role in human development and sustainability, yet studying them presents significant challenges due to the vast scale and complexity of spatial-temporal data. One such challenge is the need to uncover universal urban…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-12-04 Zhenhui Li , Hongwei Zhang , Kan Wu

Incident management is essential to maintain the reliability and availability of cloud computing services. Cloud vendors typically disclose incident reports to the public, summarizing the failures and recovery process to help minimize their…

Performance · Computer Science 2026-03-18 Xiaoyu Chu , Shashikant Ilager , Yizhen Zang , Sacheendra Talluri , Alexandru Iosup

Event-based data are commonly encountered in edge computing environments where efficiency and low latency are critical. To interface with such data and leverage their rich temporal features, we propose a causal spatiotemporal convolutional…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Yan Ru Pei , Sasskia Brüers , Sébastien Crouzet , Douglas McLelland , Olivier Coenen

Exploration of time domain is now a vibrant area of research in astronomy, driven by the advent of digital synoptic sky surveys. While panoramic surveys can detect variable or transient events, typically some follow-up observations are…

Scientific endeavors such as large astronomical surveys generate databases on the terabyte scale. These, usually multidimensional databases must be visualized and mined in order to find interesting objects or to extract meaningful and…

Much like on-premises systems, the natural choice for running database analytics workloads in the cloud is to provision a cluster of nodes to run a database instance. However, analytics workloads are often bursty or low volume, leaving…

Databases · Computer Science 2019-11-27 Matthew Perron , Raul Castro Fernandez , David DeWitt , Samuel Madden

The site conditions that make astronomical observatories in space and on the ground so desirable -- cold and dark -- demand a physical remoteness that leads to limited data transmission capabilities. Such transmission limitations directly…

Artificial Intelligence · Computer Science 2025-06-11 Tuan Truong , Rithwik Sudharsan , Yibo Yang , Peter Xiangyuan Ma , Ruihan Yang , Stephan Mandt , Joshua S. Bloom