English
Related papers

Related papers: Spatial Indexing of Large Multidimensional Databas…

200 papers

Machine learning tasks over image databases often generate masks that annotate image content (e.g., saliency maps, segmentation maps, depth maps) and enable a variety of applications (e.g., determine if a model is learning spurious…

Databases · Computer Science 2024-01-09 Dong He , Jieyu Zhang , Maureen Daum , Alexander Ratner , Magdalena Balazinska

We present the MULTIMODAL UNIVERSE, a large-scale multimodal dataset of scientific astronomical data, compiled specifically to facilitate machine learning research. Overall, the MULTIMODAL UNIVERSE contains hundreds of millions of…

Astronomical datasets are growing in size and diversity, posing severe technical problems. At the same time scientific goals increasingly require the analysis of very large amounts of data, and data from multiple archives. The Virtual…

Instrumentation and Methods for Astrophysics · Physics 2009-05-14 A. Lawrence

Data intensive applications often involve the analysis of large datasets that require large amounts of compute and storage resources. While dedicated compute and/or storage farms offer good task/data throughput, they suffer low resource…

Distributed, Parallel, and Cluster Computing · Computer Science 2008-08-27 Ioan Raicu , Yong Zhao , Ian Foster , Alex Szalay

Modern astronomical surveys such as the Sloan Digital Sky Survey (SDSS) provide extensive astronomical databases enabling researchers to access vast amount of diverse data. However, retrieving data from archives requires knowledge of query…

Instrumentation and Methods for Astrophysics · Physics 2025-10-31 Prathamesh Tamhane

System level simulations of large 5G networks are essential to evaluate and design algorithms related to network issues such as scheduling, mobility management, interference management, and cell planning. In this paper, we look back to the…

Information Theory · Computer Science 2020-05-25 Roohollah Amiri , Eren Balevi , Jeffrey G. Andrews , Hani Mehrpouyan

The Sloan Digital Sky Survey (SDSS) science database describes over 140 million objects and is over 1.5 TB in size. The SDSS Catalog Archive Server (CAS) provides several levels of query interface to the SDSS data via the SkyServer website.…

Distributed, Parallel, and Cluster Computing · Computer Science 2007-05-23 William OMullane , Nolan Li , Maria Nieto-Santisteban , Alex Szalay , Ani Thakar , Jim Gray

The proliferation of location-based services has led to massive spatial data generation. Spatial join is a crucial database operation that identifies pairs of objects from two spatial datasets based on spatial relationships. Due to the…

Databases · Computer Science 2025-04-03 Yongyi Liu , Ahmed Mahmood , Amr Magdy , Minyao Zhu

Due to the surge of spatio-temporal data volume, the popularity of location-based services and applications, and the importance of extracted knowledge from spatio-temporal data to solve a wide range of real-world problems, a plethora of…

Machine Learning · Computer Science 2021-03-19 Md Mahbub Alam , Luis Torgo , Albert Bifet

Indexing is an effective way to support efficient query processing in large databases. Recently the concept of learned index, which replaces or complements traditional index structures with machine learning models, has been actively…

Databases · Computer Science 2022-08-01 Yao Tian , Tingyun Yan , Xi Zhao , Kai Huang , Xiaofang Zhou

Massive stars condition the evolution of the interstellar medium by the amount of energy released during their lives and especially by their deaths as supernova explosions. The vast amounts of spectroscopic data for massive stars provided…

Solar and Stellar Astrophysics · Physics 2024-01-11 Klaus Rubke , Amparo Marco , Ignacio Negueruela , Artemio Herrero , Sergio Simon-Diaz , Hugo Tabernero , Lee Patrick

We review some of the recent developments and challenges posed by the data analysis in modern digital sky surveys, which are representative of the information-rich astronomy in the context of Virtual Observatory. Illustrative examples…

Astrophysics · Physics 2016-11-18 S. G. Djorgovski , C. Donalek , A. Mahabal , R. Williams , A. Drake , M. Graham , E. Glikman

Nowadays there is no field research which is not flooded with data. Among the sciences, Astrophysics has always been driven by the analysis of massive amounts of data. The development of new and more sophisticated observation facilities,…

Instrumentation and Methods for Astrophysics · Physics 2017-06-14 Mauro Garofalo , Alessio Botta , Giorgio Ventre

With the continued digitization of societal processes, we are seeing an explosion in available data. This is referred to as big data. In a research setting, three aspects of the data are often viewed as the main sources of challenges when…

Databases · Computer Science 2022-05-24 Lu Chen , Yunjun Gao , Xuan Song , Zheng Li , Yifan Zhu , Xiaoye Miao , Christian S. Jensen

We present the use of self-supervised learning to explore and exploit large unlabeled datasets. Focusing on 42 million galaxy images from the latest data release of the Dark Energy Spectroscopic Instrument (DESI) Legacy Imaging Surveys, we…

Instrumentation and Methods for Astrophysics · Physics 2021-12-02 George Stein , Peter Harrington , Jacqueline Blaum , Tomislav Medan , Zarija Lukic

In recent decades, large-scale sky surveys such as Sloan Digital Sky Survey (SDSS) have resulted in generation of tremendous amount of data. The classification of this enormous amount of data by astronomers is time consuming. To simplify…

Instrumentation and Methods for Astrophysics · Physics 2022-11-02 Sarvesh Gharat , Yogesh Dandawate

Analyzing high-dimensional data and finding hidden patterns is a difficult problem and has attracted numerous research efforts. Automated methods can be useful to some extent but bringing the data analyst into the loop via interactive…

Human-Computer Interaction · Computer Science 2017-12-04 Bing Wang , Klaus Mueller

Today, huge amounts of data are being collected with spatial and temporal components from sources such as meteorological, satellite imagery etc. Efficient visualisation as well as discovery of useful knowledge from these datasets is…

Databases · Computer Science 2017-03-31 Nhien-An Le-Khac , Martin Bue , Michael Whelan , Tahar Kechadi

In the framework of the European VO-Tech project, we are implementing new machine learning methods specifically tailored to match the needs of astronomical data mining. In this paper, we shortly present the methods and discuss an…

Astrophysics · Physics 2007-05-23 R. d'Abrusco , G. Longo , M. Paolillo , E. de Filippis , M. Brescia , A. Staiano , R. Tagliaferri

Spatiotemporal data mining aims to discover interesting, useful but non-trivial patterns in big spatial and spatiotemporal data. They are used in various application domains such as public safety, ecology, epidemiology, earth science, etc.…

Databases · Computer Science 2022-06-28 Arun Sharma , Zhe Jiang , Shashi Shekhar