Related papers: Big Data Challenges of FAST
New radio interferometers such as MeerKAT, SKA, ngVLA, and DSA-2000 drive advancements in software for two key reasons. First, handling the vast data from these instruments requires subdivision and multi-node processing. Second, their…
Astronomy has been at the forefront of the development of the techniques and methodologies of data intensive science for over a decade with large sky surveys and distributed efforts such as the Virtual Observatory. However, it faces a new…
The ongoing exponential growth of computational power, and the growth of the commercial High Performance Computing (HPC) industry, has led to a point where ten commercial systems currently exceed the performance of the highest-used HPC…
We have carried out extensive radio and optical follow-up of 176 sources from the 15 GHz 9th Cambridge survey. Optical identifications have been found for 155 of the radio sources; optical images are given with radio maps overlaid. The…
Fast Radio Bursts (FRBs) are intense radio flashes from the sky that are characterized by millisecond durations and Jansky-level flux densities. We carried out a statistical analysis on FRBs discovered. Their mean dispersion measure, after…
The digital revolution is transforming astronomy from a data-starved to a data-submerged science. Instruments such as the Atacama Large Millimeter Array (ALMA), the Large Synoptic Survey Telescope (LSST), and the Square Kilometer Array…
We are surrounded by huge amounts of large-scale high dimensional data. It is desirable to reduce the dimensionality of data for many learning tasks due to the curse of dimensionality. Feature selection has shown its effectiveness in many…
The All Sky Automated Survey (ASAS) is monitoring all sky to about 14 mag with a cadence of about 1 day; it has discovered about 10^5 variable stars, most of them new. The instrument used for the survey had aperture of 7 cm. A search for…
Super-resolution (SR) advances astronomical imaging by enabling cost-effective high-resolution capture, crucial for detecting faraway celestial objects and precise structural analysis. However, existing datasets for astronomical SR (ASR)…
The eruption of big data with the increasing collection and processing of vast volumes and variety of data have led to breakthrough discoveries and innovation in science, engineering, medicine, commerce, criminal justice, and national…
The Large sky Area Multi-Object Fiber Spectroscopic Telescope (LAMOST) is the largest optical telescope in China. In last four years, the LAMOST telescope has published four editions data (pilot data release, data release 1, data release 2…
We identify 3,113 highly variable objects in 7,200 square degrees of the Palomar-QUEST Survey, which each varied by more than 0.4 magnitudes simultaneously in two broadband optical filters on timescales from hours to roughly 3.5 years. The…
We present a method by using the phase characteristics of radio observation data for pulsar search and candidate identification. The phase characteristics are relations between the pulsar signal and the phase correction in the…
The continuous increase of data generated provides enormous possibilities of both public and private companies. The management of this mass of data or big data will play a crucial role in the society of the future, as it finds applications…
The detection of fast radio bursts (FRBs) in radio astronomy is a complex task due to the challenges posed by radio frequency interference (RFI) and signal dispersion in the interstellar medium. Traditional search algorithms are often…
The Square Kilometre Array (SKA) will be both the largest radio telescope ever constructed and the largest Big Data project in the known Universe. The first phase of the project will generate on the order of 5 zettabytes of data per year. A…
Fast Radio Bursts (FRBs) are energetic phenomena that have significant implications for understanding fundamental physics and the universe. Recent observations of FRB 121102, FRB 20220912A, and FRB 20201124A by the Five-hundred-meter…
We present periodicity and single-pulse searches at 1250 MHz for 22 radio-quiet gamma-ray pulsars, conducted using the Five-hundred-meter Aperture Spherical Radio Telescope (FAST). For PSR J1813$-$1246, we successfully detected pulsed…
Gaia mission will offer an exceptional opportunity to perform variability studies. The data homogeneity, its optimised photometric systems, composed of 11 medium and 4-5 broad bands, the high photometric precision in G band of one milli-mag…
Astronomy has a long history of acquiring, systematizing, and interpreting large quantities of data. Starting from the earliest sky atlases through the first major photographic sky surveys of the 20th century, this tradition is continuing…