English
Related papers

Related papers: A Communication Efficient and Scalable Distributed…

200 papers

Earth Observation (EO) mining aims at supporting efficient access and exploration of petabyte-scale space- and airborne remote sensing archives that are currently expanding at rates of terabytes per day. A significant challenge is…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-01-22 Luigi Mascolo , Marco Quartulli , Pietro Guccione , Giovanni Nico , Igor G. Olaizola

The astronomical community is grappling with the increasing volume and complexity of data produced by modern telescopes, due to difficulties in reducing, accessing, analyzing, and combining archives of data. To address this challenge, we…

Like every other field of intellectual endeavor, astronomy is being revolutionised by the advances in information technology. There is an ongoing exponential growth in the volume, quality, and complexity of astronomical data sets, mainly…

Astrophysics · Physics 2009-11-07 S. G. Djorgovski , A. Mahabal , R. Brunner , R. Williams , R. Granat , D. Curkendall , J. Jacob , P. Stolorz

Astronomy has a long history of acquiring, systematizing, and interpreting large quantities of data. Starting from the earliest sky atlases through the first major photographic sky surveys of the 20th century, this tradition is continuing…

Astrophysics · Physics 2007-05-23 Robert J. Brunner , S. George Djorgovski , Thomas A. Prince , Alex S. Szalay

For the successful development of the astrophysics and, accordingly, for obtaining more complete knowledge of the Universe, it is extremely important to combine and comprehensively analyze information of various types (e.g., about charged…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-11-16 Alexander Kryukov , Andrey Demichev

Astronomical researchers often think of analysis and visualization as separate tasks. In the case of high-dimensional data sets, though, interactive exploratory data visualization can give far more insight than an approach where data…

Instrumentation and Methods for Astrophysics · Physics 2015-06-05 Alyssa A. Goodman

A Virtual Observatory (VO) will enable transparent and efficient access, search, retrieval, and visualization of data across multiple data repositories, which are generally heterogeneous and distributed. Aspects of data mining that apply to…

Astrophysics · Physics 2009-10-31 Kirk D. Borne

Access to astronomical data through archives and VO is essential but does not solve all problems. Availability of appropriate software for analyzing the data is often equally important for the efficiency with which a researcher can publish…

Instrumentation and Methods for Astrophysics · Physics 2010-04-27 P. Grosbol , D. Tody

We present a scalable, cloud-based science platform solution designed to enable next-to-the-data analyses of terabyte-scale astronomical tabular datasets. The presented platform is built on Amazon Web Services (over Kubernetes and S3…

Instrumentation and Methods for Astrophysics · Physics 2022-08-03 Steven Stetzler , Mario Jurić , Kyle Boone , Andrew Connolly , Colin T. Slater , Petar Zečević

This study proposes an efficient data collection strategy exploiting a team of Unmanned Aerial Vehicles (UAVs) to monitor and collect the data of a large distributed sensor network usually used for environmental monitoring, meteorology,…

Robotics · Computer Science 2021-01-12 S. MahmoudZadeh , A. Yazdani , A. Elmi , A. Abbasi , P. Ghanooni

We present a distributed system for storage, processing, three-dimensional visualisation and basic analysis of data from Earth-observing satellites. The database and the server have been designed for high performance and scalability,…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-11-17 Marek Szuba , Parinaz Ameri , Udo Grabowski , Jörg Meyer , Achim Streit

Astronomy is undergoing through a methodological revolution triggered by an unprecedented wealth of complex and accurate data. The new panchromatic, synoptic sky surveys require advanced tools for discovering patterns and trends hidden…

With many large science equipment constructing and putting into use, astronomy has stepped into the big data era. The new method and infrastructure of big data processing has become a new requirement of many astronomers. Cloud computing,…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-01-24 Changhua Li , Chenzhou Cui , Boliang He , Dongwei Fan , Linying Mi , Shanshan Li , Sisi Yang , Yunfei Xu , Jun Han , Junyi Chen , Hailong Zhang , Ce Yu , Jian Xiao , Chuanjun Wang , Zihuang Cao , Yufeng Fan , Liang Liu , Xiao Chen , Wenming Song , Kangyu Du

We review some aspects of the current state of data-intensive astronomy, its methods, and some outstanding data analysis challenges. Astronomy is at the forefront of "big data" science, with exponentially growing data volumes and data…

Instrumentation and Methods for Astrophysics · Physics 2014-11-04 G. Longo , M. Brescia , S. G. Djorgovski , S. Cavuoti , C. Donalek

Cloud computing provides scientists a platform that can deploy computation and data intensive applications without infrastructure investment. With excessive cloud resources and a decision support system, large generated data sets can be…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-01-27 Dong Yuan , Lizhen Cui , Xiao Liu , Erjiang Fu , Yun Yang

The rapid advance of mega-constellation facilitates the booming of direct-to-satellite massive access, where multi-user detection is critical to alleviate the induced inter-user interference. While centralized implementation of on-board…

Information Theory · Computer Science 2024-03-07 Sirui Miao , Neng Ye , Peisen Wang , Qiaolin Ouyang

Distributed, online data mining systems have emerged as a result of applications requiring analysis of large amounts of correlated and high-dimensional data produced by multiple distributed data sources. We propose a distributed online data…

Machine Learning · Computer Science 2013-07-03 Cem Tekin , Mihaela van der Schaar

Heterogeneous cellular networks (HCN) with embedded small cells are considered, where multiple mobile users wish to download network content of different popularity. By caching data into the small-cell base stations (SBS), we will design…

Signal Processing · Electrical Eng. & Systems 2020-03-30 Jun Li , Youjia Chen , Zihuai Lin , Wen Chen , Branka Vucetic , Lajos Hanzo

The exponential growth of astronomical data collected by both ground based and space borne instruments has fostered the growth of Astroinformatics: a new discipline laying at the intersection between astronomy, applied computer science, and…

Instrumentation and Methods for Astrophysics · Physics 2015-05-30 Massimo Brescia , Stefano Cavuoti , S. G. Djorgovski , Ciro Donalek , Giuseppe Longo , Maurizio Paolillo

Due to the pervasive diffusion of personal mobile and IoT devices, many "smart environments" (e.g., smart cities and smart factories) will be, generators of huge amounts of data. Currently, analysis of this data is typically achieved…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-09-24 Lorenzo Valerio , Marco Conti , Andrea Passarella