中文
相关论文

相关论文: Large-Scale Query and XMatch, Entering the Paralle…

200 篇论文

There is a growing need for massive computational resources for the analysis of new astronomical datasets. To tackle this problem, we present here our first steps towards marrying two new and emerging technologies; the Virtual Observatory…

In the current data-driven science era, it is needed that data analysis techniques has to quickly evolve to face with data whose dimensions has increased up to the Petabyte scale. In particular, being modern astrophysics based on…

天体物理仪器与方法 · 物理学 2017-06-14 Giuseppe Riccio , Massimo Brescia , Stefano Cavuoti , Amata Mercurio , Anna Maria Di Giorgio , Sergio Molinari

We are living in the big data age: An ever increasing amount of data is being produced through data acquisition and computer simulations. While large scale analysis and simulations have received significant attention for cloud and…

图形学 · 计算机科学 2019-02-26 Stefan Eilemann

Astronomy is entering a new era as multiple, large area, digital sky surveys are in production. The resulting datasets are truly remarkable in their own right; however, a revolutionary step arises in the aggregation of complimentary…

天体物理学 · 物理学 2007-05-23 A. S. Szalay , R. J. Brunner

Modern scientific data mainly consist of huge datasets gathered by a very large number of techniques and stored in very diversified and often incompatible data repositories. More in general, in the e-science environment, it is considered as…

天体物理仪器与方法 · 物理学 2010-10-20 M. Brescia , G. Longo , F. Pasian

Virtual observatories will give astronomers easy access to an unprecedented amount of data. Extracting scientific knowledge from these data will increasingly demand both efficient algorithms as well as the power of parallel computers.…

天体物理学 · 物理学 2007-09-14 Jeffrey P. Gardner , Andrew Connolly , Cameron McBride

Advances in deep learning have greatly widened the scope of automatic computer vision algorithms and enable users to ask questions directly about the content in images and video. This paper explores the necessary steps towards a future…

数据库 · 计算机科学 2018-12-20 Sanjay Krishnan , Adam Dziedzic , Aaron J. Elmore

There has been an unprecedented and continuing growth in the volume, quality, and complexity of astronomical data sets over the past few years, mainly through large digital sky surveys. Virtual Observatory (VO) concept represents a…

天体物理学 · 物理学 2007-05-23 S. G. Djorgovski , R. Brunner , A. Mahabal , R. Williams , R. Granat , P. Stolorz

Following a series of high-profile drug safety disasters in recent years, many countries are redoubling their efforts to ensure the safety of licensed medical products. Large-scale observational databases such as claims databases or…

统计计算 · 统计学 2012-08-07 Marc A. Suchard , Shawn E. Simpson , Ivan Zorych , Patrick Ryan , David Madigan

The analysis and an efficient scientific exploration of the Digital Palomar Observatory Sky Survey (DPOSS) represents a major technical challenge. The input data set consists of 3 Terabytes of pixel information, and contains a few billion…

天体物理学 · 物理学 2015-06-24 S. G. Djorgovski , R. R. de Carvalho , S. C. Odewahn , R. R. Gal , J. Roden , P. Stolorz , A. Gray

Data processing systems offer an ever increasing degree of parallelism on the levels of cores, CPUs, and processing nodes. Query optimization must exploit high degrees of parallelism in order not to gradually become the bottleneck of query…

数据库 · 计算机科学 2015-11-06 Immanuel Trummer , Christoph Koch

Astronomy is entering a new era as multiple, large area, digital sky surveys are in production. The resulting datasets are truly remarkable in their own right; however, a revolutionary step arises in the aggregation of complimentary…

天体物理学 · 物理学 2007-05-23 R. J Brunner , T. Prince , J. Good , T. Handley , C. Lonsdale , S. G. Djorgovski

Recent advancements in remote sensing technology have resulted in petabytes of data in raster format. This data is often processed in combination with high resolution vector data that represents, for example, city boundaries. One of the…

数据库 · 计算机科学 2020-10-15 Samriddhi Singla , Ahmed Eldawy

Though large language models (LLMs) have demonstrated exceptional performance across numerous problems, their application to predictive tasks in relational databases remains largely unexplored. In this work, we address the notion that LLMs…

机器学习 · 计算机科学 2024-11-19 Marek Wydmuch , Łukasz Borchmann , Filip Graliński

Like every other field of intellectual endeavor, astronomy is being revolutionised by the advances in information technology. There is an ongoing exponential growth in the volume, quality, and complexity of astronomical data sets, mainly…

天体物理学 · 物理学 2009-11-07 S. G. Djorgovski , A. Mahabal , R. Brunner , R. Williams , R. Granat , D. Curkendall , J. Jacob , P. Stolorz

Modern astronomical surveys have multiple competing scientific goals. Optimizing the observation schedule for these goals presents significant computational and theoretical challenges, and state-of-the-art methods rely on expensive human…

天体物理仪器与方法 · 物理学 2023-12-15 Maggie Voetberg , Brian Nord

Spatial data fusion is a bottleneck when it meets the scale of 10 billion records. Cross-matching celestial catalogs is just one example of this. To challenge this, we present a framework that enables efficient cross-matching using Learned…

天体物理仪器与方法 · 物理学 2025-04-16 Phu-Minh Lam , Dongwei Fan , Hongbo Wei , Jun Wang , Yu Zhou , Qi Ma , Baolong Zhang , Xiazhao Zhang , Yongheng Wang

With the application of advanced astronomical technologies, equipments and methods all over the world, astronomy covers from radio, infrared, visible light, ultraviolet, X-ray and gamma ray band, and enters into the era of full wavelength…

天体物理仪器与方法 · 物理学 2016-11-09 Bo Han , Yanxia Zhang , Shoubo Zhong , Yongheng Zhao

Spatiotemporal data are being produced in continuously growing volumes by a variety of data sources and a variety of application fields rely on rapid analysis of such data. Existing systems such as PostGIS or MobilityDB usually build on…

数据库 · 计算机科学 2026-05-21 Diana Baumann , Tim C. Rese , David Bermbach

The use of large-scale machine learning methods is becoming ubiquitous in many applications ranging from business intelligence to self-driving cars. These methods require a complex computation pipeline consisting of various types of…

数据库 · 计算机科学 2021-11-10 Yongyang Yu , Mingjie Tang , Walid G. Aref